"I don't spend a lot of time really worrying about short-term history. I guess I don't worry about long-term history, either, since I'm not going to be around to read it," he added. "But look, in this job you just do what you can. The thing that's important for me is to get home and look in that mirror and say, 'I did not compromise my principles.' And I didn't. I made tough calls."
The public wasn't with him in the end. The most recent ABC News/Washington Post poll showed a 68 percent disapproval rating, dragged down by economic duress and a still-unpopular war.
It wasn't always this way for this president.
A polarized country rallied behind him after the 9/11 terrorist attacks, and his approval ratings reached a high of 92 percent.
"He had this huge burst of unity, used it well and nurtured it through Afghanistan," said Bruce Buchanan, a government professor at the University of Texas who has followed Bush's career since his days as governor of Texas.
That unity began to crumble -- like so much surrounding his presidency -- over the Iraq war.
President Bush's push to oust Saddam Hussein from power soon became more than a foreign-policy initiative; the president and his allies used it as a wedge issue against Democrats in the run-up to the 2002 elections.
"After 9/11, he had a country that said, 'We're ready to follow,' " Rahm Emanuel, President-elect Barack Obama's incoming chief of staff, told ABC News before he was tapped for the new post. "There was so much we could have done. But he said, 'Go shopping,' and then he divided the nation."
The hyper-political push for war cost him the support of Democrats. There would be no more big bipartisan successes for him to celebrate, such as his signature education law, No Child Left Behind.
Republicans stayed with him, however, and while they controlled Congress. That was often enough. It kept him politically potent through the 2002 and 2004 campaigns.
But new spending programs and other breaks with conservative dogma hurt the president's standing inside the GOP, and he never really worked the Washington game to develop relationships with members of Congress.
In his second term, Democrats scuttled Social Security reform even before the president could file a bill. Opposition to Bush became their organizing principle -- the formula they rode to success in 2006 after the botched federal response to Hurricane Katrina and a continuing war left Bush politically crippled.
Then came 2007, and with it a new chance to work with Democrats on an issue that had long been close to his heart -- immigration.
But in that case, Bush's fellow Republicans abandoned him, unwilling to follow a politically damaged president down a road they did not favor.
It was as if the Bush-Rove vision came full circle: They fostered a polarized political environment, and then saw their grand policy goals shattered by that very climate, where bipartisan cooperation was impossible.
"They created a political situation where nothing could get done," Buchanan said. "President Bush has demonstrated the fine line between leadership and stubbornness."
Bush's legacy will perhaps always be tied to the Iraq War, and on that measure it's too early to make judgment.
Bush himself has often said that he'll leave his legacy to the judgment of historians. But as he retires to Texas, it is a complex mix of success and failure that define the two terms of George W. Bush.
"He achieved more in the way of policy changes with less in terms of mandate and public support than any president in memory. If you're grading him in terms of batting average, you'd grade him rather high," Mann said.