The All-Star guard, who missed the past eight games with a biceps injury, will not be under any minutes restriction, Brown said.
Irving practiced with his Cavaliers teammates for the first time in two weeks Tuesday and took some contact during his first workout since straining a left biceps tendon March 16 against the Los Angeles Lakers.
Irving's return comes as the Cavs enter their biggest games this season.
While he was out, the team went 4-4 and climbed into playoff contention in the Eastern Conference. Cleveland trails Atlanta by three games for the No. 8 spot. After playing the Magic, the Cavs face the Hawks on Friday in Atlanta.
Information from The Associated Press was used in this report.