Do the light stay on the ebike on when the battery gets empty?

Yes, the lights will continue to stay on even if the battery has only a small charge left. This "lights only" mode lasts at least an hour and allows you to ride safely to the nearest power outlet.