How to delete purchased music off my iPhone 5?

I have a few albums that I purchased and no longer listen to, I can't get them off my phone! My iCloud does not say they are in there when I log in and I have deleted these songs from my iTunes. They will not go away! I tried selecting not to show all music in the music settings on the phone and it still plays the music, it just doesn't show a download button next to the song. ITs incredibly annoying, how can I get rid of this?!

The easy way to get it off your iphone is through itunes, just conned the iphone to itunes un-ckeck the albums you no longer want and just sync and the music will be removed from your phone.

This does not work as I already deleted the music off my computer. Something else is keeping the music on my phone.