Mulvaney faced White House ouster threat before impeachment crisis took over