I don't think the fan base is really the same. Destiny is after all a FPS that appeals to players who wanted something more from the genre. ESO is more of a traditional fantasy RPG. If any games are likely to draw people away, my guess would be Battlefront or more likely The Division.