Why is husband receiving all my conversations.iphone4?

So we just got 2 iPhones thru Verizon and when I'm talking to someone else hes getting all my messages on his phone and also receiving the other persons to… Ohh and we also get each others apps that we download. How to stop it? Help

Added (1). Okay I thought so thank you what setting do I use to change this?

You guys are using the same Apple ID connection. So it sends the messages and apps to both of the phones. Both of you guys need to create to separate ID's for this to quit. Or turn off the setting that allows this in the settings. That should fix everything!

Destroy the phones IMMEDIATELY, the missions been compromised.

If you haven't got one, create a new Apple ID for yourself.
To bind iMessage to a different Apple ID…
On your iPhone Tap Settings,
scroll down the list on the left and tap "Messages"
tap "Send and Receive" then the Apple ID and choose "Sign Out"
Enter you new Apple ID and password and sign in, check the email address (make sure the email address/s are not the same as any your husband is using on his iPhone- check this on his device settings too)
tap "next" to commit the changes and you're done.
Do the same procedure for "iTunes & App stores", Facetime, iCloud etc if you want these to also be associated with your own Apple ID as well (be aware that any apps, music etc you purchased/downloaded using the previous Apple ID in "iTunes & App stores" will no longer be available on your device once you change the Apple ID.)
That should fix things