White House officials pressured Secretary of Defense Chuck Hagel to increase the pace of detainee transfers from the U.S. prison in Guantanamo Bay, the outgoing secretary acknowledged to CNN’s Barbara Starr in an interview Friday.

Those comments come just one day after reports surfaced that a Guantanamo detainee released as part of the deal that freed American POW Sgt. Bowe Bergdahl may have sought to return to militant activity.

“Not everyone at the White House has agreed with me,” said Hagel of his methodology for deciding on detainee releases.