Unleashing the Black Caucus Could Draw Backlash