President Joe Biden weighed in for the first time on the ouster of McCarthy, calling on Congress to change the "poisonous atmosphere in Washington" and come together.

"More than anything we need to change the poisonous atmosphere in Washington. You know, we have strong disagreements, but we need to stop seeing each other as enemies. We need to talk to one another, listen to one another, work with one another. And we can do that," Biden urged while delivering remarks on student loans at the White House.

Biden said the GOP will need to "reorganize" and that it might "take some time" to select a new leader.

-ABC's Justin Gomez and Molly Nagle

House Majority Leader Steve Scalise has officially entered the race to replace McCarthy.

The Louisiana Republican, in a lengthy letter to his colleagues on Wednesday, made a pitch for unity as he touted his work as the No. 2 House Republican.

"You know my leadership style I've displayed as your Majority Leader and Whip," he wrote. "I have a proven track record of bringing together the diverse array of viewpoints within our Conference to build consensus where others thought it impossible."

"Our strength as a Conference comes from our unity, and we have seen when we unite as a Conference, we can deliver wins for the American people," he wrote. "Now we need to take those unified positions and work to extract conservative wins from the Democrat Senate and White House by leveraging upcoming deadlines. While we need to be realistic about what can be achieved, if we stay united, we can preserve leverage for the House to secure tangible wins in our impending policy fights."

Rep. Jim Jordan has sent a letter to colleagues announcing his speakership bid.

"We are at a critical crossroad in our nation's history," he wrote. "Now is the time for our Republican conference to come together to keep our promises to Americans."

Senate Republican leader Mitch McConnell said he is keenly aware of the thankless work it takes to be a Congressional leader as he praised McCarthy in a floor speech.

“I’ve said before, in reference to my own position, that being the leader of your party in the Senate is much like being the groundskeeper at a cemetery. Everybody’s under you, but no one’s listening," McConnell said, adding: “Of course, I doubt that Kevin McCarthy has ever seen himself as above anyone else."

McConnell praised McCarthy's willingness to dive "head first" into worthwhile fights, calling him a trusted and honest partner in leading the GOP caucus.

“He didn’t hesitate to get his hands dirty. When circumstances were tough, he drew on his faith, his family and his belief in American exceptionalism," McConnell said.

“And I’m not sure anyone could have predicted just how much these qualities would come in handy over the past nine months," he said.

-ABC's Mariam Khan

The House has canceled votes for the remainder of the week, according to Majority Whip Tom Emmer.

GOP sources say that Speaker Pro Tempore Patrick McHenry told party members during a Tuesday night conference meeting that the House is expected to recess until Oct. 10 -- and the plan is to hold a speaker candidate forum that day and then a vote for a permanent speaker on Oct. 11.

House Majority Leader Steve Scalise appears to be emerging from the closed-door conference meeting as the front-runner to replace McCarthy.

Both House Republican Conference Chair Elise Stefanik and Emmer indicated they're not running for speaker.

It's unclear if Scalise has enough support to succeed, but he spoke to reporters as he walked back to his office.

"We have a lot of work to get done, but I haven't made any formal announcement," Scalise, R-La., said.

"Clearly within our conference, we have a very tight majority," he acknowledged. "Getting things that done is going to be difficult in the tight majority. It's still will be so no matter who's going to be the next speaker, the challenges still remain, but I think the opportunity is there to continue moving forward."

Asked whether he is physically up to the job as speaker as he continues treatment for blood cancer, Scalise said, "I feel great."