‘They had a huge opportunity’: People of color on Trump’s team reckon with a backlash