The couple, who married in 2010, are apparently lined up to join Simon Cowell on the hit ITV show when it returns later this year.
Field, an actress, is no stranger to UK audiences as a guest panellist on Loose Women while Williams is world-renowned for his music.
A source told The Mirror: “She thinks doing the show with Robbie will be a lot of fun – particularly as she wants to beat her husband at his own game.
“She can’t wait to get started,” they added.
Standard Online have contacted representatives for Williams and Field for comment. The X Factor have also been contacted.
Williams, who will perform at the World Cup 2018 opening ceremony on Thursday , is allegedly the replacement for Louis Walsh, who has confirmed he will not be back for the new series.
In a statement last week, Walsh said: "I've had a fantastic 13 years on The X Factor but the show needs a change and I'm ready to leave.
"I'm looking forward to another series of Ireland's Got Talent, going back to my day job as a manager, writing my memoirs and seeing the world."
Sharon Osbourne, who returned as a judge a few years ago, will only appear in the live shows while it remains to be seen if Nicole Scherzinger will feature in series 15.
The X Factor returns to ITV later this year.