In an English translation of its website, Qatar's Ministry of Foreign Affairs called the decision "not justified" and based on "unfounded allegations."
The diplomats returned later that year, but the rift between the Arab nations and Qatar never mended.
"I think what we’re witnessing is a growing list of some irritants in the region that have been there for some time, and obviously they have now bubbled up to a level that some countries have decided they needed to take action in an effort to have those interests addressed," Tillerson said. "We'd certainly encourage those parties to sit down together and address these differences."
But Monday's move could prove challenging for the United States, which relies on many of these nations, including Qatar, in the global coalition against ISIS.
Qatar specifically is home to one of the largest U.S. military bases in the Middle East, Al Udeid Air Base, with about 9,000 U.S. and coalition service members deployed there and more than 100 aircraft. An aircraft takes off or lands at the base approximately every ten minutes, according to the Air Force.
The base is the forward headquarters for U.S. Air Forces Central Command and contains the 379th Air Expeditionary Wing and U.S. Combined Air Operations Center (CAOC). CAOC is the command and control for all U.S. and coalition air power in nearly two dozen countries, including Iraq, Syria, and Afghanistan.
Despite Monday's decision creating a large rift between some Arab coalition-members, Tillerson said he did not expect the decision to have any significant impact on the fight against terrorism.
In a statement, the U.S. Air Force told ABC News that U.S. military aircraft continue to conduct missions from Al Udeid Air Base "in support of ongoing operations across the region."
"The United States and the Coalition are grateful to the Qataris for their longstanding support of our presence and their enduring commitment to regional security. We have no plans to change our posture in Qatar," Major Adrian Rankine-Galloway, Pentagon spokesman, said in a statement. "We encourage all our partners in the region to reduce tensions and work towards common solutions that enable regional security."
ABC News' Luis Martinez contributed to this report.