The Department of Housing and Urban Development on Wednesday proposed a new rule that would weaken Obama-era protections for homeless transgender people, allowing federally funded shelters to deny people admission on religious grounds or force transgender women to share bathrooms and sleeping quarters with men.

The proposed rule comes one day after HUD Secretary Ben Carson assured members of Congress the agency had no plans to eliminate the 2012 Equal Access Rule, which barred federal housing discrimination on the basis of sexual orientation or gender identity.

When questioned by Rep. Jennifer Wexton (D-VA) on HUD’s treatment of transgender people, Carson said his responsibility is to “make sure everybody is treated fairly. ”