“I have been with this president through thick and thin. I have supported him in campaigning. I have supported him in voting,” Rice told the Associated Press on Thursday. “It hurts my heart.”

South Carolina’s GOP state chair, Drew McKissick, said in a statement following Rice’s vote that “to say I’m severely disappointed in Congressman Tom Rice would be an understatement.” The Seventh District, which Rice has represented since 2013, voted heavily for the president.

“If it does, it does,” said Rice when asked if the vote might cost him his seat, adding, “You tell my constituents I love ’em, and it’s the honor of my life to do this job. I’ve tried to do my best to do the right thing and represent their interests, but if they decide that it’s time for me to come home, that’s OK, too.”