In fact, the pair are still in touch and have a mutual respect for each other, says Ben.
"We don't have the kind of relationship where she relies on me for advice," he told the Hollywood Reporter.
"But we do have the kind of relationship where there'll be an email saying, 'Oh, your movie looks great.'"
The couple announced their plans to marry in 2002 after a whirlwind courtship, but their romance broke down two years later, partly under the strain of the intense media interest in them.
But he's still interested in her career, and congratulated her when she was announced as a judge on American Idol.
"I remember when she got American Idol. I said: 'This was really smart. Good luck'," he says.
"I touch base. I respect her. I like her. She's put up with some stuff that was unfair in her life, and I'm really pleased to see her successful."
Jennifer went on to marry Marc Anthony and have twins Max and Emme with the Latino singer in 2008, though the couple are now separated.
She's since found love again with backing dancer Casper Smart.
Ben, meanwhile, is happily married to Jennifer Garner, with whom he has two daughters, six-year-old Violet and three-year-old Seraphina, and son Samuel, seven months.
The 40-year-old has nothing but praise for his gorgeous wife.
"She truly is kind," he said. "She means no one any harm. She doesn’t have ill will for any person. She’s not competitive with other people. She’s not spiteful."