The music mogul has given a strong indication he's determined to get the show's golden girl Cheryl Cole back on board to fill one of the gaps left by departing judges Gary Barlow, Sharon Osbourne and Louis Walsh, saying: "We have to find a way."
CLICK ON PHOTO TO ENLARGE
This exciting news for the show comes hot on the heels of the fact that this year's winner Sam Bailey has scored the Christmas Number One with Sky Scraper - which has become one of the fastest-selling singles of the year.
Simon said of the Cheryl: "She was a really, really good judge. I mean, she took what she did seriously.
"She used to phone me almost every night – one, two, three o’clock in the morning, talking about songs and what she should be doing.
“That’s the kind of judge you want to be working with on these shows, because they really care.
"I hope we’re going to get the chance to work together. We have to find a way because we had a lot of fun."
Cheryl added more fuel to the fire of return rumours when she posted a 'Throwback Thursday' photo to Twitter of herself posing with fellow former judge Dannii Minogue during their X Factor glory days.
The Geordie beauty is yet to comment on the reports she will return to the TV star search in 2014.