Andy & Me was started in the summer of 2002 by guitarist and lead vocalist Aaron Guzik and guitarist/vocalist Andy Schulz (Baby vs. Giant, Forget Flying). A year later, the band recorded its first full length, backed by bassist Ethan Margolis (Forget Flying) and drummer Geoff Guillard. Where the Sun Don't Shine was released later that autumn. Around this time, the band frequently performed with Guzik, Schulz, Guillard, and Guillard's older brother, Jeremy, on bass.
Andy & Me experienced a slow period from Autumn 2004 to Spring 2005 as Schulz moved to Pittsburgh to attend Pitt and form Baby vs. Giant. However, upon Schulz's graduation and BvG's dissolution, Schulz and Guzik relocated to Boston, where Guillard attends Berklee College of Music. There, the three recruited bassist Brian Padavic to round out their current touring roster.