Yeah, you’re still thinking about this in terms of precise timing and location and that’s not the point. The point is
the ~4 minute difference between the Earth’s physical rotation with the universe as reference and the Earth’s apparent rotation with the sun as reference.
I’ll try to find you a video to make it more understandable.