The California Democrat, who won a new two-year term in Tuesday's election, said she has yet to consider what she will do now.
"I'll have a conversation with my caucus, I'll have a conversation with my family, and pray over it, and decide how to go forward," she said in an exclusive ABC News interview with "World News" anchor Diane Sawyer. "But today isn't that day."
Watch Diane Sawyer's exclusive interview with House Speaker Nancy Pelosi on "World News" tonight at 6:30 p.m. ET
Pelosi became the first female House speaker in 2007. But after Republicans retook the house on Election Day Tuesday, she will be handing over her speaker's gavel, likely the current House minority leader, John Boehner, R-Ohio.
"Being the first woman speaker and breaking the marble ceiling is pretty important," she told ABC News. "Now it's time to move on."
Pelosi said she had "no regrets" after losing her position as the most powerful woman in American politics and said the country's unemployment problem was to blame for the Democrats' loss.
"We believe we did the right thing, and we worked very hard in our campaigns to convey that to the American people," she said. "Nine and a half percent unemployment is a very eclipsing event. If people don't have a job, they're not too interested in how you intend for them to have a job. They want to see results."
Asked to assess her tenure, Pelosi quickly answered, "Job well done."
She said it's now Boehner's job to produce results and described him as a friend.
"He knows that I wish him well personally," Pelosi said. "And for the American people, I wish him well in his work as well."
Allies and critics say Pelosi's legacy will be as much about the position she held as the sweeping agenda that she pursue.
From the Capitol, she led her party's efforts to overhaul the health care system, increase the minimum wage, reform the regulation of Wall Street and stimulate the economy. At times Pelosi pushed through intense Republican opposition.
More than any other Democrat other than President Obama, Pelosi became the face of GOP attack ads. Michael Steele, the Republican National Committee chairman, campaigned around the country in a bus plastered with the slogan, "Fire Pelosi."
At an election night rally in downtown Washington, Steele said: "We're about to do the one thing the American people want done and that is to fire Pelosi."
Pelosi said she didn't take it personally.
"They have used me as a personification of health care and the rest," she told Sawyer. "I take that as a compliment."
When pressed by Sawyer whether she ever in private felt "bruised" by the attacks, Pelosi said, "Well let me tell you, when I get time for that, I'll call you and I'll let you know how it feels. Because first of all I haven't had a moment alone to even think about myself. And second of all, it's a luxury at this time and that I can't afford."