Right before debate began on the motion to vacate, Gaetz was seen trying to use the microphones on the Republican side of the chamber.

But he was blocked by McCarthy allies and aides, who shooed him to the Democratic side of the chamber.

McCarthy is sitting in the second row on the Republican side of the chamber as debate continues.

With debate continuing between those backing McCarthy and the minority in the GOP who have joined Gaetz, Rep. Jim Jordan, R-Ohio, said McCarthy deserves to keep his job -- calling him "rock solid" on several promises Republicans made when they retook majority control of the chamber.

Jordan pointed to several bills that were passed by the House, including border security legislation and rescinding funding for the IRS. Jordan also touted House oversight activities and defended McCarthy's actions to keep the government open and operational for 45 more days.

"I think the speaker has kept his word," he said. "I know my colleagues and friends are saying different. I think he has kept his word ... I think we should keep him as speaker."

Gaetz took aim at Cole's comments as he also slammed McCarthy and criticized Capitol Hill's approach to spending.

"Chaos is Speaker McCarthy," Gaetz said, rebuffing how Cole argued that the motion to vacate would create needless disruption in the chamber.

"Chaos is somebody that we cannot trust with their word. The one thing that the White House, House Democrats and many of us on the conservative side of the Republican caucus would argue is that the thing we have in common: Kevin McCarthy said something to all of us at one point that he didn't really mean and never intended to live up to."

Gaetz went on to lambast the size of national debt and deficit as well as the lack of single-subject spending bills -- something McCarthy has said he is also focused on enacting.

After Rep. Bob Good, R-Va., delivered a speech castigating McCarthy and explaining why he was joining Gaetz in the motion to vacate, Republican Rep. Tom Cole of Oklahoma spoke out in support of McCarthy and warned of "chaos" should the conference's breakaway faction succeed in removing him.

"They're willing to plunge this body into chaos, and this country into uncertainty, for reasons only they understand," Cole said. To the Democrats who are expected to vote against McCarthy as well, Cole said, "Think long and hard before you plunge us into chaos."

Cole also celebrated how McCarthy had navigated the differences in the closely divided House -- and Washington more broadly -- to notch spending cuts in the debt limit fight earlier this year, pushing back on criticism from Gaetz and others that McCarthy hadn't done enough to curb the federal budget.

Cole also suggested McCarthy had proven himself capable of making sure the House would continue to accomplish Republican priorities.

"I'm very proud of this speaker. I'm very proud to stand behind him. Tomorrow morning, whether I win or lose, I'm going to be pretty proud of the people I fought with and I'm going to be pretty proud of the person I fought for," Cole said.

-ABC News' Adam Carlson

Rep. Patrick McHenry, the new speaker pro tempore, is currently occupying the speaker of the House's office in the Capitol. Notably, the sign still reads "Speaker Of The House Kevin McCarthy."

-ABC's Arthur Jones