Joe Biden has told aides and outside advisers that Attorney General Merrick Garland did not do enough to rein in a special counsel report stating that the president had diminished mental faculties, according to two people close to the president, as White House frustration with the head of the Justice Department grows.

The report from special counsel Robert Hur ultimately cleared Biden of any charges stemming from his handling of classified documents that were found at Biden’s think tank and his home. But Hur’s explanation for not bringing charges — that Biden would have persuaded the jury that he was a forgetful old man — upended the presidential campaign and infuriated the White House.

Biden and his closest advisers believe Hur went well beyond his purview and was gratuitous and misleading in his descriptions, according to those two people, who were granted anonymity to speak freely. And they put part of the blame on Garland, who they say should have demanded edits to Hur’s report, including around the descriptions of Biden’s faltering memory.