I dropped the Umbral Conflict quest after thinking the 45 shatter kills in Crucible was either bugged or otherwise not worth (after 15 games I still had 0/45 - playing as a Shadebinder) completing, and found you cannot grab another from the Exo Stranger after dropping it. So it seems I'm now permanently down one Fragment (not sure how many there are but that's not a great realization).