But with Trump serving as one of the most polarizing leaders in the country’s history, a new poll has indicated the voters who originally picked Trump due to their dislike of Clinton could swing the other way during this fall’s midterm elections.

Fifty-one percent of so-called “Never Hillary” independent voters disapprove of Trump, with 47 percent approving, according to an Axios/Survey Monkey poll released Friday. The online poll drew its results from 52,211 respondents and had a margin-of-error of 1.5 percentage points.

The disapproval for Trump among the group, even if narrow, could be a worrying sign for the president and his party looking ahead to the 2018 midterms. Much, though, will depend on how many of those who disapprove of Trump show up to cast a vote for a Democrat in November.