If you don't want to turn it off completely you can go into Settings>Chat and switch "Auto-add suggested contacts" to "Only allow people that I've explicitly approved to chat with me and see when I'm online". That /should/ not auto-add suggested contacts.