Red Hill City formed in the latter months of 2004 when Tyler King (vocals and guitar), Josh Myers (drums) and Ben McCain (keyboard) decided to step away from their earlier punk rock roots and venture into a more alternative/modern rock sound. With the addition of Joseph Regan on guitar and Gant O'Brien on bass in early 2005 they found that a broad range of musical influences and experimental sounds would catapult their new concepts to another level.
In the fall of 2010 the band decided to change musical directions and changed their name to House of Hounds. They still perform around Jackson, MS as well as Hattiesburg.