Republicans have also ordered Rep. Steny Hoyer, D-Md., to vacate his Capitol hideaway office, a source familiar with the communication confirmed to ABC News. Hoyer served for two decades in House Democratic leadership but stepped away after the 2022 midterm elections, stating it was time for a new generation to take over.

Along with the move to push former House Speaker Nancy Pelosi out of her office, it’s the latest sign of how much hostility exists between Republicans and Democrats following the removal of McCarthy as House speaker.

In one of Rep. Patrick McHenry’s first moves as speaker pro tempore, he ordered former Democratic House Speaker Nancy Pelosi to immediately vacate her hideaway office in the Capitol by Wednesday, sources tell ABC News.

Most lawmakers have offices in the buildings surrounding the Capitol -- not in the Capitol itself.

Hideaway offices are private unmarked spaces in the Capitol, typically reserved for members of House leadership. But as a former speaker, Pelosi was allowed to keep one.

Pelosi was informed of this news as she was in San Francisco attending a memorial service for the late Sen. Dianne Feinstein.

In a statement to ABC News, Pelosi criticized the move, “With all of the important decisions that the new Republican Leadership must address, which we are all eagerly awaiting, one of the first actions taken by the new Speaker Pro Tempore was to order me to immediately vacate my office in the Capitol. Sadly, because I am in California to mourn the loss of and pay tribute to my dear friend Dianne Feinstein, I am unable to retrieve my belongings at this time.”

Pelosi continued, “This eviction is a sharp departure from tradition. As Speaker, I gave former Speaker Hastert a significantly larger suite of offices for as long as he wished.”

Politico was the first to report the news.

Now-former Speaker McCarthy addressed reporters from Capitol Hill on Tuesday night where he looked back at his years in Republican leadership, touted his record -- and struck an optimistic if ambiguous note about his future.

"I believe I can continue to fight," McCarthy said, while noting that he will not run again for speaker after he lost a historic vote on the motion to vacate earlier in the day.

"My goals have not changed. My ability to fight is just in a different form," he said, later adding, "I'll never give up on the American people. That doesn't mean I have to be speaker."

McCarthy also swiped at the conservative rebels who ousted him from his role -- stressing that they were just 4% of the GOP conference -- and claimed that Gaetz was acting out of a personal sense of grievance in pushing him out, which Gaetz denies.

Despite the defeat he suffered from within his own party, McCarthy sounded largely sanguine about his political career.

He contended that the Democratic minority deciding to vote against him had made a "political decision" that undercut the ability of the House to govern.

"My fear is the institution fell today," he said.

Still, in largely valedictory remarks, he pointed back to work to cut government spending, expand his party's base and increase their majority in Congress, including by electing more women and minorities.

"I feel fortunate to have served the American people," he insisted. "I leave the speakership with a sense of pride, accomplishment and, yes, optimism."

-ABC News' Adam Carlson

The House has canceled votes for the remainder of the week, according to Majority Whip Tom Emmer.

GOP sources say that Speaker Pro Tempore Patrick McHenry told party members during a Tuesday night conference meeting that the House is expected to recess until Oct. 10 -- and the plan is to hold a speaker candidate forum that day and then a vote for a permanent speaker on Oct. 11.

House Majority Leader Steve Scalise appears to be emerging from the closed-door conference meeting as the front-runner to replace McCarthy.

Both House Republican Conference Chair Elise Stefanik and Emmer indicated they're not running for speaker.

It's unclear if Scalise has enough support to succeed, but he spoke to reporters as he walked back to his office.

"We have a lot of work to get done, but I haven't made any formal announcement," Scalise, R-La., said.

"Clearly within our conference, we have a very tight majority," he acknowledged. "Getting things that done is going to be difficult in the tight majority. It's still will be so no matter who's going to be the next speaker, the challenges still remain, but I think the opportunity is there to continue moving forward."

Asked whether he is physically up to the job as speaker as he continues treatment for blood cancer, Scalise said, "I feel great."

From the moment McCarthy was elected speaker, it was clear that his ability to keep that job could depend on Democrats.

To get elected on that 15th ballot in January, McCarthy had to agree to a series of rules that made him a profoundly weak speaker -- including the provision allowing a single member of the House to call for a vote to oust him (the now-famous "motion to vacate"). But while it takes just one member to call for such a vote, it requires a majority to actually remove the speaker.

McCarthy could survive a rebellion from a handful of renegade Republicans -- but he could not survive such a rebellion if Democrats go along with it.

Gaetz has said he expected Democrats to save McCarthy. Many others did too.

As recently as Tuesday morning, House Minority Leader Hakeem Jeffries suggested a way out of this for McCarthy. In an interview on MSNBC, he said House rules should be changed so that a single member could not force a vote on removing the speaker. Jeffries could deliver the votes to save McCarthy's job and the votes to change the rules to make it impossible for Gaetz to pull off a stunt like this again.

But Democrats would have a price for doing that. What would McCarthy offer in return? An end to the impeachment inquiry in President Joe Biden and his family? A guarantee that McCarthy honors the deal he struck on spending with the White House? Power sharing?

McCarthy has developed a cordial relationship with Jeffries, but he signaled no willingness to give Democrats anything in exchange for keeping the job.

In fact, McCarthy's actions have made it virtually impossible for Jeffries to throw him a lifeline. The speaker unilaterally launched the impeachment inquiry and just Saturday infuriated Jeffries by attempting to jam Democrats on a bill to keep the government funded for 45 days.

Back in January -- and again last month on impeachment -- McCarthy showed he was willing to do almost anything to appease his right-wing critics to get and keep his job. That worked for a while -- but it has made it virtually impossible to get Democrats to save him now.

-ABC News Chief Washington Correspondent Jonathan Karl