Asymmetry allows divergent use of pollinators, but often represents a one-way evolutionary street