It was clear from the start that neoconservatives would exit the GOP to support Hillary