Another newly completed song, "You Just Haven't Earned It Yet, Baby", was originally intended to be the A-side of this single. It made it to the white label test pressing stage and approximately 900 stock copies of the single were manufactured. This aborted single mix can be heard on The World Won't Listen, while a remixed version is included in Louder Than Bombs.
During a 1987 interview with Shaun Duggan, Morrissey said of the song: "[It does] not literally mean picking up a loaf of bread or a watch and sticking it in your coat pocket. It's more or less spiritual shoplifting, cultural shoplifting, taking things and using them to your own advantage." Musically the song has a resemblance to the T. Rex song "Children of the Revolution".