Not how gravity works. Smaller objects do not fall faster. The moon having less mass would mean it affects Earth less. Overall there is less attraction from the combined gravity of both objects.