I often have Phogoth down to 75% health by the time my fire team catches up so by all means leave, it will scale down the enemy difficulty for me to run it even faster haha.