That's the tradeoff. Full set....give up the exotic weapon or armor perk for whatever the set perk would be. Essentially the entire set of gear works like one big exotic. Depending on the perks, it could actually make the game interesting.