You don't have to side with them until a certain point. Spoiler free: When you reach this certain point, you will be prompted by an on screen message indicating moving forward will make an enemy of (insert faction). This is when you know you cant move forward unless to you side with them. You can however keep doing side quests.