Should I invite him to my party?

Well i'm having my birthday party soon and Ii'm inviting alot of my friends to this party but now here's the problem. I have this friiend who really hasn't acted like a friend he always says i don't have any friends or i'm not social or stuff like that. Well he doesn't even realize it hurts me and he brushes it off as were joking. Well now he expects me to invite him to my party he's been asking me the same thing all week., but I don't know really how to say no you haven't been acting like a friend lately. Well before that I told my friends to not tell him but then I forgot some of my friends I feel like are the most blabbermouths in this school and told him. And now some friends from the person I don't want to invite want to go and I don't like either because they both always ask me for my iphone. Well my question is how can I just tell them no without hurting their feelings i'm a kid so can I just tell them this "The amount of people is 20 and I already have 20 people" Can you guys like help me find a way to tell them that i'm not inviting them and in a way that can't hurt their feelings?

Go with the limit of people excuse

You say he hurts your feeling all the time so just tell him straight up no.

Tell him 20 are coming and you can only have 20. Or tell him to f-off hes not invited