How to delete music off your iPhone with IOS7?

I installed IOS7 and it downloaded all of my old music onto my phone and every time I try to go and delete it iCloud won't let me actually delete it. I've tried hooking my phone up to my computer, erasing all of my music, then redownloading it, but it just keeps putting the older stuff on there. I've also turned off iCloud, thinking that would make it stop, but it didn't do anything.

Same thing happened to me when I downloaded it. Go to settings > music > and then hit the green button that says "show all music" so it turns grey. Hope it works! Worked for me!