Vice President Biden has already said he would not attend the speech due to a scheduling conflict, and a growing number of Democrats are joining him in opting out.

Vermont Sen. Bernie Sanders, an independent who caucuses with the Democrats, said Monday he would skip the event, and that it was “wrong” that Obama was not consulted ahead of time. Rep. Luis Gutiérrez (D-Ill.) dismissed the speech as a “stunt” to the Chicago Sun-Times.

A few notable lawmakers said Monday they did plan to attend the address, including Senate Minority Leader Harry Reid (D-Nev.) and Sens. Charles Schumer (D-N.Y.) and Barbara Boxer (D-Calif.), who said she was “deeply troubled that politics has been injected” into the U.S.-Israel relationship.

Obama did not directly address a question Monday on whether he thought lawmakers should skip the event, but acknowledged he and Netanyahu “have a very real difference around Iran sanctions.”