Seeing the chances of legislation dim with Cantor’s defeat, immigration advocates cast doubt on Wednesday on President Barack Obama’s strategy to hold back on executive action until he has given the Republican-controlled House of Representatives a last chance to act.

Obama said last month he would be delaying much-anticipated changes to the nation’s deportation policy in hopes the House would act on passing comprehensive immigration before this August’s legislative recess, which is seen as the last practical window for passing a bill under this Congress.

“If there were doubts before, this is sort of the lid to put on it. We now need the president to act,” said Eddie Carmona, campaign manager for PICO National Network’s Campaign for Citizenship.