How to stop people's iPhones, iPads, etc from connecting to Xbox One?

My brother can connect his iPhone when my Xbox one is on. I find that rather annoying. How can I prevent this or turn it off. On my Xbox I already put that no smart glass devices can be connected

Block his phones MAC Address on your router or change the Wi-Fi password while you're playing. Both will need to be undone when you're finished though.