Kentucky Republican Sen. Rand Paul said no one in Congress “has a stronger belief in minority rights” than he does and insists he will continue outreach efforts to black and Hispanic voters despite reports about a former aide’s past connections to neo-Confederate groups.

In an interview with Yahoo News in Iowa, where Paul spoke to a gathering of Christian pastors and church leaders last week, the possible presidential contender acknowledged that stories about the aide could set back his efforts, but he defended his commitment to bringing more black and Hispanic voters into the Republican Party.

“I’m not easily dissuaded, so it’s not something that makes me shrink away, it makes me come out even stronger to say that I don’t think there’s anyone in Congress who has a stronger belief in minority rights than I do,” Paul told Yahoo News. “Because my conception of justice is that there have been many times in our history when we have done things unfairly to Japanese Americans, to black Americans. I still think that the justice system does not treat African Americans fairly in regard to non-violent drug crime, with regard to felonies being on your record.”