Making room for a slower temple-and-cafe day after several packed days

We've packed our first three Japan sightseeing days with early starts, museums and evening neighborhoods. Looking at the schedule now, I can already tell day four needs breathing room. I'm imagining one temple or garden, a long café stop and enough wandering time to follow interesting side streets. Which places lend themselves to that kind of unhurried day, where the point is being there rather than collecting sights?