Hidden Driveways formed in the late 1990's in the wake of the break-up of Syrup USA. Sam Mallery had been playing bass and singing with Syrup USA since he and Seana Carmody of Swirlies formed the group in 1993. When Syrup USA called it quits in 1998, Hidden Driveways had already been formed as a side project and they started playing shows immediately. They played a number of shows in Boston, including opening up for Black Heart Procession at The Middle East.
In 2000 the band moved to New York City. Shortly after arriving they started playing shows around New York. In a home studio set up in Sam and Kristin's apartment they slowly produced the recordings that are featured on the new full length album Electrique Fence Tambourines.