Bedford town attorney Joel Sachs said a stop work order was issued on the tent just after 5 p.m. Tuesday because it is illegal to build a temporary residence without a permit. He called the tent an "illegal structure."
"If no activity has been undertaken, so far as either removing the tent or other equipment, or removing any individuals who may be residing in the tent, then we would then proceed to take one of two types of enforcement actions," Sachs told The Associated Press.
He said the town might "seek an injunction to have the tent taken down, and individuals residing in the tent removed from the property."
Gadhafi's tent has accompanied him on trips to Paris, Rome and Moscow. He apparently distrusts elevators and needs space for his all-female security team.
Diane Sawyer, anchor of "Good Morning America," said today that she has been in Gadhafi's tent in Libya.
"It's perfumed, you should know," Sawyer said.
State and federal politicians who learned that Gadhafi had rented property in the area were outraged that the Libyan, who has been linked to acts of state-sponsored terror, might sleep among their constituents.
"He's not going to have many fans in Bedford or Westchester County, certainly not me. Don't want to see him in my county or my district. There's not going to be any welcome mat for him in Bedford," Republican State Sen. Vincent L. Leibell said.
U.S. Rep. Hall said he would contact the State Department and other federal authorities to protest Gadhafi's presence in his district.
"This sponsor of terror is not welcome here," Hall said. "Several residents of this area were horrifically murdered on Pan Am Flight 103. Gadhafi's presence in our community is a slap in the face to the memories of these victims and their families, adding to the recent outrage of the hero's welcome Gadhafi staged for the convicted murderer released by Scotland."
Gadhafi's plans have been greeted with similar sentiments elsewhere.
In August, Englewood residents protested the possibility of Gadhafi pitching a tent on property there owned by the Libyan Embassy.
Many of the Englewood residents were particularly incensed by the release of Abdelbaset al-Megrahi, a Libyan imprisoned in Scotland for the 1988 bombing of Pan AM Flight 103 over Lockerbie, Scotland, who was warmly welcomed home by Gadhafi last month.
"Frankly speaking, I'm glad he won't be sleeping in my city limits," said Michael Wildes, mayor of Englewood and an immigration lawyer. "I can't understand why he won't be served an arrest warrant for the 38 citizens of New Jersey that died in the Lockerbie disaster.
"It is my prayer that the State Department will issue a restrictive visa so he won't, under the cover of night, sneak into my town," Wildes said.
Gadhafi isn't the only world leader who has had trouble finding a place to stay for this week's world summit.
President Mahmoud Ahmadinejad of Iran, had a difficult time finding a spot to hang up a favorite khaki-colored sports coat.
When he arrived in New York in 2007 to address the General Assembly and students at Columbia University, Iran's Ahmadinejad was met with protests.
In 2007, he was considered a pariah who denied the Holocaust, called for the destruction of Israel and pursued an internationally condemned nuclear weapons program.