Supreme Court Chief Justice John Roberts and Justice Sonia Sotomayor are administering the oaths of office at the presidential inaugural ceremonies on Capitol Hill.

The vice president-elect -- making history as the first woman, first Black woman and first South Asian American vice president -- will be sworn in by Sotomayor, the first Latina Supreme Court Justice.

All three Trump appointees to the high court -- Justices Brett Kavanaugh, Neil Gorsuch and Amy Coney Barrett are also in attendance with Barrett appearing in public in her black judicial robe for the first time.

The court says Stephen Breyer, Samuel Alito and Clarence Thomas opted not to attend because of public health risks from the coronavirus pandemic.

It's the first time since 2001 that the entire court is not in attendance at an inauguration.

-ABC News' Devin Dwyer

Vice President Mike Pence has left a handwritten note for Vice President-elect Kamala Harris, an aide to Pence confirmed, meaning both Trump and Pence left behind notes for their successors.

Trump did not make direct contact with Biden beyond the note left in the Oval Office earlier Wednesday morning.

Pence spoke with Harris on a call last Thursday, sources familiar with the call told ABC News, 68 days after Biden and Harris were projected the winners.

The outgoing vice president is on Capitol Hill for the inaugural ceremonies and did not attend Trump's earlier sendoffs at the White House or Joint Base Andrews.

-ABC News Katherine Faulders and Jordyn Phelps

Eugene Goodman, the Capitol Police officer who led rioters away from the Senate chamber during the Capitol assault two weeks ago, is escorting Kamala Harris at the inaugural ceremonies.

Goodman has been named an honorary deputy House Sergeant at Arms for the day, ABC News has learned.

Three members of Congress introduced a bill last week to honor Goodman with the Congressional Gold Medal "for his bravery and quick thinking."

Ahead of Biden being sworn in as the 46th president of the United States, guests are arriving at a fortified U.S. Capitol -- where just two weeks to the day pro-Trump supporters stormed the West Front steps.

But two weeks later, even Republican Sens. Ted Cruz and Josh Hawley -- who objected to Biden's Electoral College victory that same day -- have arrived on Capitol Hill for Biden's inauguration.

Senate Majority Leader Mitch McConnell -- who attended Mass with Biden earlier and has condemned Trump, who he said "provoked" the mob -- has also arrived with wife Elaine Chao, Trump's former transportation secretary who became the first Cabinet member to resign because of the Capitol riot.

Former Republican House Speaker Paul Ryan, also present, told reporters he was there to "honor this process," adding that Biden was "legitimately elected."

Former President Barack Obama and Michelle Obama have arrived, as well, with Michelle Obama posting on Instagram shortly before that she is feeling "hopeful for what's to come."

Former New York Yankee Alex Rodriguez was also spotted on the carpet ahead of Jennifer Lopez, Lady Gaga and Garth Brooks' performances.