Pelosi sees defections from an unusual quarter — the left