It's almost worse that he said ninja. It implies that he knew he shouldn't have said it and was trying to get around it. He'd be better of if he said it, played dumb and apologized.
I doubt he'll get any backlash, certain monstrous rappers can make whole songs dissing black women and be praised as the best.