Goku nearly always needs someone to finish his fights for him. 50 Million guardians could easily take him. Also, Goku is basically superman and superman gets wrecked by Batman (a [b]MAN[/b], who just wears armour, has some cool tech and is really awesome!). So Goku would get defeated by the combined force of every guardian.