It depends on the person. People are "loyal" to genuine people, genuine celebrities. Britney Spears is genuine,
so her fanbase will always be there. Ke$ha and Rihanna are genuine, so their fanbase will most likely stay.
People who are disingenuous and change themselves for whatever reason, will have a fickle fanbase.