In a new statement following the vote to remove McCarthy, House Democratic leader Hakeem Jeffries said, "It is our hope that traditional Republicans will walk away from MAGA extremism and join us in partnership for the good of the country."

Jeffries led his minority in voting against McCarthy along with the eight Republicans who ensured the speaker lost his role.

Separately, out of the White House, Biden press secretary Karine Jean-Pierre said the president is is hoping the House will "quickly elect a Speaker" and that he "looks forward to working together with them."

Rep. Patrick McHenry, a Republican from North Carolina, was quickly named as speaker pro tempore of the House on Tuesday after McCarthy was voted out.

What does that title mean? It's quite simply somebody designated to preside over the House when the speaker is unable to do so.

After September 11, the House adopted a new rule making it possible to have a speaker pro tempore even if the speaker of the House is unable to name one -- or the speakership suddenly becomes vacant.

The rule was adopted as a measure to ensure "continuity of government" -- so that Congress would not be paralyzed after a terrorist attack. A speaker pro tempore has the power to lead, to pass emergency measures and even a declaration of war.

The position is supposed to be temporary, but there is no explicit limit on how temporary or when a new election must be held to elect a permanent speaker.

But, for now anyway, Republicans are operating on the premise that the House can convene and function even without an elected speaker.

One thing driving the temporary nature of this situation: The speaker of the House is in the line of presidential succession; the speaker pro tempore is not.

-ABC News Chief Washington Correspondent Jonathan Karl

Senate Republicans are overwhelmingly admonishing their House colleagues for allowing McCarthy's speakership to be vacated, calling it a "sad day."

Sen. John Cornyn of Texas said ousting McCarthy was a "disgraceful" move by a small group of House conservatives.

"These insurgents have no plan," Cornyn said. "And now they've created even more chaos and it's not good for the House, it's not good for Republicans," he said.

A visibly miffed Sen. Roger Wicker of Mississippi agreed: "It stinks, and it's bad for the country."

Republicans are the minority party in the Senate. With a much more favorable map on the horizon in 2024, some now worry the dysfunction in the House will be a distraction for voters.

-ABC News' Allison Pecorin

The White House confirmed late Tuesday afternoon that President Joe Biden saw the developments in the House, but the administration is declining to weigh in on congressional politics.

Instead, aides said Biden is focused on governing and they pointed to the announcement earlier Tuesday on drugmakers agreeing to take part in Medicare negotiations.

-ABC News' Justin Gomez

Now-former Speaker McCarthy addressed reporters from Capitol Hill on Tuesday night where he looked back at his years in Republican leadership, touted his record -- and struck an optimistic if ambiguous note about his future.

"I believe I can continue to fight," McCarthy said, while noting that he will not run again for speaker after he lost a historic vote on the motion to vacate earlier in the day.

"My goals have not changed. My ability to fight is just in a different form," he said, later adding, "I'll never give up on the American people. That doesn't mean I have to be speaker."

McCarthy also swiped at the conservative rebels who ousted him from his role -- stressing that they were just 4% of the GOP conference -- and claimed that Gaetz was acting out of a personal sense of grievance in pushing him out, which Gaetz denies.

Despite the defeat he suffered from within his own party, McCarthy sounded largely sanguine about his political career.

He contended that the Democratic minority deciding to vote against him had made a "political decision" that undercut the ability of the House to govern.

"My fear is the institution fell today," he said.

Still, in largely valedictory remarks, he pointed back to work to cut government spending, expand his party's base and increase their majority in Congress, including by electing more women and minorities.

"I feel fortunate to have served the American people," he insisted. "I leave the speakership with a sense of pride, accomplishment and, yes, optimism."

-ABC News' Adam Carlson