I don't really see why someone hasn't just stabbed Ramsay in the back or in his sleep.
How could anyone trust him let alone let him lead them?
I could understand it before because his father was around to kill anyone that offed Ramsay, but now that daddy's gone who would actually protect him like that?