Meh...who cares if someone else joins? Really it just makes it faster(granted, if you close your fireteam then even in matchmaking no one should be able to join).