The universe isn't infinite. At the moment of the Big Bang, the universe was infinitesmally small, then space began exploding outward in all directions and it's still expanding now.
Think of space as the ocean and matter as boats floating on the ocean. Now imagine that the ocean is expanding in every direction. That's the universe.
Originally Posted by cpjust
