A White House official said the expanded bilateral meeting broke at 5:05 p.m. local time (11:05 a.m. ET), after a little more than an hour.

The two men spent two hours and 38 minutes meeting together in total, according to the White House -- shorter than the four to five hours the Biden administration said it expected it to last.

Biden's ride, the Beast, is staged outside the Villa.

The second meeting was going to be broken into two parts -- with a break splitting up the two parts -- but the official said that it was all just one long part.

It appears the leaders are done meeting for the day.

White House officials have significantly downplayed the prospect of a prisoner swap for two U.S. Marine veterans, Trevor Reed and Paul Whelan, being held in Russia, ahead of the meetings.

"That's certainly something the Russians have been pushing for," said ABC News Chief White House Correspondent Cecilia Vega. "They have basically said this could encourage the Kremlin to target more Americans unfairly like they believe these two Americans there were targeted."

Russian officials have indicated they would like to trade Reed and Whelan for two Russians held in the U.S.: Viktor Bout -- one of the world's most notorious arms dealers and dubbed "the Merchant of Death" — and also Konstantin Yaroshenko, a pilot currently serving a lengthy jail sentence for a drug smuggling conviction.

Whelan's family overnight released an audio message from him recorded from the prison camp in central Russia where he is held. In it, he appealed to Biden to help free him.

A White House official confirmed the expanded bilateral meeting started about an hour ago, at 4 p.m. local time (10 a.m. ET).

ABC News Correspondent Karen Travers said the summit is about setting the U.S.-Russia relationship on a new path forward to a more stable, predictable relationship.

"In terms of the stakes, it's been striking to hear officials on both sides say over the last few days heading into this summit that there are very low expectations for some major breakthrough between President Biden and President Putin," Travers said. "This is all about starting a conversation."

She also noted how different this meeting looks from President Donald Trump's encounter Putin in Helsinki in 2018, and the two took questions standing side-by-side at a joint news conference.

ABC News Chief Global Affairs Correspondent Martha Raddatz highlighted the "incredible" body language seen in Biden and Putin's face-to-face meeting and said the images captured there already make the summit a success for Putin.

"I think President Putin, you saw those pictures of president Putin with President Biden. That's essentially what he wants right there," Raddatz said. "The relaxed President Putin sitting back in his chair, Joe Biden looking relaxed as well. All of this is so rehearsed."

"They know the world is looking at those pictures, especially Vladimir Putin. He wants to be on the world stage," she added.

Even with Putin denying Russian involvement in recent U.S. cyberattacks, his refusal to discuss imprisoned opposition leader Alexey Navalny with Biden going into the meeting, and the two leaders still likely to air their grievances in dueling press conferences later, Raddatz said, since relations are so low, any progress will be a win.

"I think because they have lowered the bar so far, but it's still a bar, that any progress will be seen as a win according to Joe Biden and probably according to Vladimir Putin, too," she said.

When Putin meets Biden on Wednesday in Switzerland, experts in Moscow say for all their differences, the two leaders want something similar from their first summit: to cool things down.

The U.S. and Russia's relations are the worst they have been since the Cold War and since 2016 in particular seem locked in almost permanent crises.

Biden has said he wants a more stable and predictable relationship with Russia, one that would allow it to focus on other foreign policy priorities that are more important to it, like taking a harder line with China. The Kremlin for its part has faced a continuous and intensifying barrage of sanctions-- the latest in April-- and with its crackdown on opposition at home and aggressive actions abroad is increasingly becoming a pariah with western countries.

Since coming to office, Russia has appeared to want to get Biden's attention. The president offered Putin the summit after Russia massed thousands of troops on Ukraine's border in April.

But now, having got Biden to the table, analysts said Putin has a clear proposal to deliver in Geneva: stay out of Russian domestic politics and Russia might act less troublesome abroad.

"The Kremlin wants to transition to a respectful adversarial relationship from a disrespectful one we have today," said Vladimir Frolov, a former diplomat at Russia's embassy in Washington and now a commentator on foreign affairs.

"That is, it wants to be treated the same way the Soviet Politburo was treated by the US in 1970-80s," Frolov told ABC News. "Meaning no name-calling" — such as Biden calling Putin a "killer" — "no personal sanctions on the leadership, no democracy lectures, regular personal summit meetings; respectful tone of discussions, no tangible support for Russian opposition."

It will not be an invitation for détente but instead to return to the later years of the Cold War when Putin was a KGB agent and the Soviet Union and the U.S. saw each other as enemies but tried to maintain a predictable relationship. And, crucially, where Russia was treated as an equal.

"For this, the Kremlin is prepared to promise to behave more responsibly," Frolov said.

"This seems to be in line with what the White House sees as a desirable deliverable," he continued. "So unless one of the leaders stormed out of the meeting shouting expletives, the summit would be a major success."

-ABC News' Patrick Reevell