Revelation 21:22-23 states:
And I saw no temple therein: for the Lord God Almighty and the Lamb are the temple of it. And the city had no need of the sun, neither of the moon, to shine in it: for the glory of God did lighten it, and the Lamb is the light thereof,which implies that we would have to take the earth's inner core with us. Now, maybe not exactly. According to Revelation 21:16 the New Jerusalem is a cube with a side length of 12,000 στάδια , where 1 στάδιο is 184.9 meters, so 2,218.8 kilometers. And the diameter of the earth's inner core is estimated based on shock wave measurements to be 2,442 kilometers, its volume thus 7,624,925,436 (km)3, and the volume of the New Jerusalem is 10,923,315,348 (km)3, and it is entirely possible that the discrepancy is due to the assumption in the estimate of the inner core's diameter that it must be spherical.
So, in fairness, Revelation 21 does suggest that we leave earth in the earth's inner core.