House Majority Leader Steve Scalise also stood up to support McCarthy during the debate on the motion to vacate, saying now isn't the time to stop the progress House Republicans have made.

"When we go back to January, as many people have, we knew that it was going to be a narrow majority," Scalise said. "We also knew it wasn't going to be easy. How many of us came here because we thought this job was going to be easy?"

Scalise continued, "One thing we did know is that if we were going to finally start confronting the problems that had been ignored for years and years and years, we had to change the way this place worked. And one thing Speaker McCarthy embraced from Day 1 is to start making those kind of changes to this institution -- opening up the process, allowing members to be more engaged, having amendments come to the floor, single-subject bills, doing appropriations bills."

"Speaker McCarthy has been leading at the top of the level to make sure we have the tools to do our jobs," he added.

Gaetz said earlier this week he'd support Scalise for speaker and believed other Republicans would, too, telling reporters he thinks "very highly" of the No. 2 House Republican.

During the debate, after initially introducing speeches from a few other Republicans who are backing his motion, including Andy Biggs and Bob Good, Gaetz has since used his time to personally respond to each of the pro-McCarthy speeches being made by other lawmakers.

Those responses have sometimes been as brief as simply disputing the common refrain from McCarthy's backers: that moving to oust him is a short-sighted and punitive act that won't help the conference accomplish its goals.

Not so, Gaetz has continually said as he repeats his argument: McCarthy must go.

-ABC News' Adam Carlson

Right before debate began on the motion to vacate, Gaetz was seen trying to use the microphones on the Republican side of the chamber.

But he was blocked by McCarthy allies and aides, who shooed him to the Democratic side of the chamber.

McCarthy is sitting in the second row on the Republican side of the chamber as debate continues.

With debate continuing between those backing McCarthy and the minority in the GOP who have joined Gaetz, Rep. Jim Jordan, R-Ohio, said McCarthy deserves to keep his job -- calling him "rock solid" on several promises Republicans made when they retook majority control of the chamber.

Jordan pointed to several bills that were passed by the House, including border security legislation and rescinding funding for the IRS. Jordan also touted House oversight activities and defended McCarthy's actions to keep the government open and operational for 45 more days.

"I think the speaker has kept his word," he said. "I know my colleagues and friends are saying different. I think he has kept his word ... I think we should keep him as speaker."

From the moment McCarthy was elected speaker, it was clear that his ability to keep that job could depend on Democrats.

To get elected on that 15th ballot in January, McCarthy had to agree to a series of rules that made him a profoundly weak speaker -- including the provision allowing a single member of the House to call for a vote to oust him (the now-famous "motion to vacate"). But while it takes just one member to call for such a vote, it requires a majority to actually remove the speaker.

McCarthy could survive a rebellion from a handful of renegade Republicans -- but he could not survive such a rebellion if Democrats go along with it.

Gaetz has said he expected Democrats to save McCarthy. Many others did too.

As recently as Tuesday morning, House Minority Leader Hakeem Jeffries suggested a way out of this for McCarthy. In an interview on MSNBC, he said House rules should be changed so that a single member could not force a vote on removing the speaker. Jeffries could deliver the votes to save McCarthy's job and the votes to change the rules to make it impossible for Gaetz to pull off a stunt like this again.

But Democrats would have a price for doing that. What would McCarthy offer in return? An end to the impeachment inquiry in President Joe Biden and his family? A guarantee that McCarthy honors the deal he struck on spending with the White House? Power sharing?

McCarthy has developed a cordial relationship with Jeffries, but he signaled no willingness to give Democrats anything in exchange for keeping the job.

In fact, McCarthy's actions have made it virtually impossible for Jeffries to throw him a lifeline. The speaker unilaterally launched the impeachment inquiry and just Saturday infuriated Jeffries by attempting to jam Democrats on a bill to keep the government funded for 45 days.

Back in January -- and again last month on impeachment -- McCarthy showed he was willing to do almost anything to appease his right-wing critics to get and keep his job. That worked for a while -- but it has made it virtually impossible to get Democrats to save him now.

-ABC News Chief Washington Correspondent Jonathan Karl