How to delete apps on my iPhone 4s?

I'm sorry for the dumb question but I've never had such kind of phone before. So the usual way with holding the app doesn't work, the X doesn't appear. Also, when I tried to turn the delete mode on, I couldn't fine Restrictions menu in Settings/General. Some help please?
Also, how do I install new ones and how do I create a folder?

Are you sure you did not find the restrictions in setting>general?
check again or can you tell me what app did you wanted to delete because some apps like newstand or passbook can't be deleted

The x doesn't appear on the stock apps. Assuming that was the app you were trying to delete, you can't.

To install new ones you download from the App Store

To create a folder you drag 1 icon on top another.