The news came just one day after the late-night TV show host canceled the Friday taping of "The Tonight Show."
A spokesperson for the comedian told ABC News in a statement, "Jimmy Fallon's mother, Gloria, died peacefully on Saturday. Jimmy was at his mother's bedside, along with her loved ones, when she passed away at NYU Langone Medical Center in NYC."
"Our prayers go out to Jimmy and his family as they go through this tough time," the statement concluded.
In light of his mother's death, "The Tonight Show" has been canceled this week, an NBC spokesperson told ABC News in a statement.
"On behalf of everyone at NBC, we extend our deepest condolences to Jimmy and all his family at this time of enormous loss," a statement read. "Our hearts go out to Jimmy and everyone else whose lives were so touched by Gloria Fallon's love, kindness and support."
Jimmy Fallon, 43, has often talked about his childhood and family.
In May he shared a funny observation about his mother, saying, "My mom and I were talking on the phone for the third time that day, and she actually said, 'We don't talk enough.'"
Fallon opened up about his mother in an interview with New York magazine.
"My mom was, like, a total square. She wasn't allowed to leave her stoop in Brooklyn," he said. "She was a nun for about a month, but then she was like, 'You know what? I didn't get the calling!' Ha!"