That's how it is on ps4, it's just that unless your in a clan with someone people usually ask if they can join first instead of just joining on the ps4...except for the dickhead last night, we where able to kick him though. Doesn't sound like your group had the chance