How to permanently delete an app from iPhone (4s)?

What I do is I go into iTunes, then into apps on the left sidebar. Select the app that i want to delete>press delete on the keyboard>click 'move to recycling bin'.

But most the time I go to sync my iPhone after I've deleted an app, it asks me if I want to transfer new stuff that I'd bought through app store on my phone. Thinking it really is something i just bought, i click 'Transfer' and the same app that i just deleted gets transferred back into iTunes.

How can do i do it right?

Delete it from iTunes, than also delete the app from your phone.