Simple fix: swapping special weapons from Icebreaker or Invective (or a sidearm) resets your special for the gun you switched to to zero. Probably should have been that way since the start anyway. The exotic perks were never intended to provde unlimited ammo for other special weapons via weapon swapping.