How to keep deleted songs OFF my iPhone 4?

So whenever I plug my phone into my computer it automatically syncs which I'm fine with. But I can't seem to figure out how to delete songs off my phone from iTunes directly. Or when I delete them off my phone, they're synced back on when I don't want them anymore since I don't listen to them as much on my phone.

I've tried clicking on my phone's name, going to 'Music' and selecting the artists, albums, and genres that I want but when I sync the changes, all the albums to that certain artist is synced to my phone and I don't want them.

For example, I have 14 Maroon 5 albums and out of all those, I only want their Overexposed album on my phone but iTunes decides to put all the albums on my phone. Same goes with Taylor Swift. I only want the singles We're Never Getting Back Together, Begin Again, and I Knew You Were Trouble but all her albums are synced to my phone!

How do I only get the songs, albums, and artists I listen to 24/7 on to my phone? I don't want to restore my phone if I have to. I know I can back it all up but for me, it takes forever to do so.

You don't have to restore. Just uncheck the boxes next to the songs you don't want on your phone or if that doesn't work then make a playlist with everything you want on your iPhone and sync the playlist to your phone.