Haley said the escape wouldn't have happened if the prison had been properly staffed, but added that failures in the security system also contributed.
The prison, which houses 1,300 convicts, is staffed by just 188 guards, though there should be at least 250, Haley said. Because of the shortage, the guards are forced to rely too strongly on electronic surveillance and an alarm system.
He suggested that the convicts should not have been able to get through the electric fence using a wooden broom handle.
According to The Associated Press, corrections officers at the facility say it is so severely understaffed that the six passed a guard tower — with no guard in it.
Also, an alarm that was supposed to sound if anyone manipulated the electrical fence did not trigger.
"Obviously, it didn't function as it was supposed to," Haley was quoted as saying.
The Associated Press is also reporting that two of the six may have robbed an RV park store in Floyd County, Ga., and pistol-whipped the park's manager on Wednesday afternoon.
John Wallace, the manager of the park, was "beaten pretty bad" with a .45-caliber pistol "and was probably left for dead," Floyd County Police Chief Jim Free told The Associated Press.
After receiving treatment for the beating at Redmond Regional Medical Center,Wallace identified Scott and Gamble from a photo lineup, the FBI said.
ABCNEWS affiliate WKRN in Nashville contributed to this report.