Rabbit Junk started in 2004 after the dissolvation of JP's first band, The Shizit. After adding additional vocalist Jeniffer "Sum Grrl" Bernett to the band, the two man project released their self-titled debut album called Rabbit Junk in 2004. One year later, the band signed to Glitch Mode Recordings and released the follow up to their debut album called REframe, which gained the band a stronger and more broad fan base.[2] They showcased heavier sound and influences from different styles, such as Black metal and Industrial metal/Digital hardcore band The Mad Capsule Markets. A video for the song "In your head no one can hear you scream" was produced by the Kandycore Design Company. The project would later become a Live band, as JP added live guitarists and percussion to live shows. After REframe was released, Rabbit Junk contributed the song "Industrial IS Dead" to the Glitch Mode compilation CD Hordes of the Elite. Later, a cover of Atari Teenage Riot's "Start The Riot" appeared on the D-Trash Records Atari Teenage Riot tribute album called "The Virus Has Been Spread".