His office said the painting "disparaged police officers” and was “viewed offensively by many people.” His chief of staff said the move to take the painting off the wall was done to "signal strong support for the law enforcement community.”
"This is the US Capitol, not a modern art museum," Hunter's chief of staff added. "The Capitol is not a place to have any type of art that refers to police officers as swine.”
The artist's depiction of police officers as animals has been interpreted as pigs by critics. But the painting's supporters stress that it is a symbolic representation of injustice and inequality.
On Tuesday morning, Clay brought the painting back and hung it up with the support of some of his colleagues.
“I am very pleased that today, we have restored the winning painting to its assigned location. But this is really not about a student art competition anymore…it’s about defending the Constitution," he wrote in a statement.
But other House Republicans removed the painting two more times as of Tuesday evening, returning it to Clay in his office.
In an interview with ABC News Tuesday evening, Clay said Republicans' actions are making him "dizzy."
But he plans to keep returning the photo to its place on the wall, next to artwork from other congressional districts.
"It's a semblance of the breakdown of civility and decorum of this institution," Clay said, adding that he's spoken to some of the Republicans.
"They have their opinion, and I have mine," he said. "They have a right to hang the portrait, that's the winner."
The Architect of the Capitol's office, which maintains and operates the Capitol complex, did not respond to a request for comment.