Sources close to Kelley also say a complaint about Kelley's former attorney was filed with the Florida Consumer Assistance Program, charging that he may have violated attorney-client privilege by holding a news conference and speaking about Kelley.
In addition, a letter from Kelley's lawyer was dispatched to the Department of Justice, asking if there will be an investigation of how his clients' names leaked to the media.
Victor told ABC News he has not yet received the letter that was released to selected reporters this evening, but after being told of its contents Victor said it appears to be a frivolous complaint.
"I don't know what they're upset about. I've said nothing derogatory about Ms. Kelley and have only told the facts as I know them, in fact much of what I've said was complimentary," Victor said.
As to charges of inappropriate behavior, Victor said he was mystified. He told ABC News he had only met Kelley in the presence of his female chief of staff and received gracious follow emails from Kelley afterwards.
Victor said he did indeed contact Kelley after the Petraeus scandal broke, but mainly to find out what was going on.
Requests for comment from the Kelleys' Florida attorney were not immediately returned.