(Bill Clark/Roll Call/Getty Images)

Sen. Rand Paul, R-Ky., told ABC News he believes the Supreme Court ruling on the Defense of Marriage Act was appropriate, and that the issue should be left to the states. He praised Justice Anthony Kennedy for avoiding "a cultural war."

"As a country we can agree to disagree," Paul said today, stopping for a moment to talk as he walked through the Capitol. "As a Republican Party, that's kind of where we are as well. The party is going to have to agree to disagree on some of these issues."

The comments from Paul, a likely GOP presidential candidate in 2016, highlight how the party's field could divide over gay marriage. Many Republicans have been unusually muted in their reactions to the Supreme Court rulings today.

Paul said he agreed with Kennedy, whom he called "someone who doesn't just want to be in front of opinion but wants government to keep up with opinion." He said Kennedy "tried to strike a balance."