Senate Republicans are overwhelmingly admonishing their House colleagues for allowing McCarthy's speakership to be vacated, calling it a "sad day."

Sen. John Cornyn of Texas said ousting McCarthy was a "disgraceful" move by a small group of House conservatives.

"These insurgents have no plan," Cornyn said. "And now they've created even more chaos and it's not good for the House, it's not good for Republicans," he said.

A visibly miffed Sen. Roger Wicker of Mississippi agreed: "It stinks, and it's bad for the country."

Republicans are the minority party in the Senate. With a much more favorable map on the horizon in 2024, some now worry the dysfunction in the House will be a distraction for voters.

-ABC News' Allison Pecorin

The White House confirmed late Tuesday afternoon that President Joe Biden saw the developments in the House, but the administration is declining to weigh in on congressional politics.

Instead, aides said Biden is focused on governing and they pointed to the announcement earlier Tuesday on drugmakers agreeing to take part in Medicare negotiations.

-ABC News' Justin Gomez

McCarthy exited the chamber declining to comment after the House voted to remove him.

Several members in GOP leadership are currently meeting inside McCarthy's office. Republicans are slated to gather behind closed doors on Tuesday evening for a conference meeting.

McCarthy shook his head slightly when the presiding officer slammed the gavel after the roll call vote.

Gaetz spoke to reporters outside the Capitol just moments after his motion to vacate succeeded.

"The stages of grief are in progress," he said.

The Florida Republican floated names for who could become the next speaker. On his list were House Majority Leader Steve Scalise, House Majority Whip Tom Emmer and Oklahoma Rep. Kevin Hern.

Gaetz said he will "absolutely not" put himself forward for speakership.

In one of Rep. Patrick McHenry’s first moves as speaker pro tempore, he ordered former Democratic House Speaker Nancy Pelosi to immediately vacate her hideaway office in the Capitol by Wednesday, sources tell ABC News.

Most lawmakers have offices in the buildings surrounding the Capitol -- not in the Capitol itself.

Hideaway offices are private unmarked spaces in the Capitol, typically reserved for members of House leadership. But as a former speaker, Pelosi was allowed to keep one.

Pelosi was informed of this news as she was in San Francisco attending a memorial service for the late Sen. Dianne Feinstein.

In a statement to ABC News, Pelosi criticized the move, “With all of the important decisions that the new Republican Leadership must address, which we are all eagerly awaiting, one of the first actions taken by the new Speaker Pro Tempore was to order me to immediately vacate my office in the Capitol. Sadly, because I am in California to mourn the loss of and pay tribute to my dear friend Dianne Feinstein, I am unable to retrieve my belongings at this time.”

Pelosi continued, “This eviction is a sharp departure from tradition. As Speaker, I gave former Speaker Hastert a significantly larger suite of offices for as long as he wished.”

Politico was the first to report the news.