A friend, Dr. John Guzlowski, sent me an article from www.guardian.co.uk titled "Charles Yu's top 10 time travel books." According to the article, Yu is the author of How to Live Safely in a Science Fictional Universe.
The following are Yu's favorite "reading about 'the fundamental weirdness of moving around in time'":
1. Slaughterhouse-Five, or The Children's Crusade: A Duty-Dance with Death by Kurt Vonnegut, Jr.
2. "The Garden of Forking Paths" by Jorge Luis Borges
3. Einstein's Dreams by Alan Lightman
4. The Fermata by Nicholson Baker
5. The Fabric of Reality by David Deutsch
6. A Wrinkle in Time by Madeleine L'Engle
7. "—All You Zombies—" by Robert Heinlein
8. Six Walks in the Fictional Woods by Umberto Eco
9. "An example of a new type of cosmological solution of Einstein's field equations of gravitation" by Kurt Gödel (Rev. Mod. Phys. 21: 447–450.)
10. The Restaurant at the End of the Universe by Douglas Adams
If you want to see the list with book/short story descriptions, click here to go to the article.
Personally speaking, The Restaurant at the End of the Universe by Douglas Adams is a good book, and I'll have to remind myself to read Robert Heinlein's zombie short story (and finish Revolt in 2100 while I'm at it). The others are worth checking out.