The EastEnders legend was on the normal version of the reality TV show last year, when it was in Gwrych Castle in Wales instead of Australia because of the coronavirus.
He finished sixth in the show - which was won by Emmerdale actor Danny Miller - and revealed he would leap at the chance to be a camper again.
Read more: All the winners of I'm A Celebrity so far
Speaking on ITV's Lorraine, he said: "If my agent phones me up and says, 'Oh they've been on the phone and they want you for the All Stars' it would take me a nanosecond to say yes."
"I loved it, it was brilliant," said the Ian Beale actor.
"There is no phone, there is no email, there is no distraction."
Woodyatt, 54, joked that the only downside was when presenters Ant and Dec turned up for the gruelling trials, but that "the rest of the day is great".
If the actor does return to the reality show, it won't be in Wales.
It has been confirmed that the series is returning to its original home Down Under this year after two series at Gwrych Castle.
Ant and Dec had previously said they hoped the programme would return home.
"We would all like to go back - it’s proper home, so fingers crossed," Ant said on Lorraine.
Dec said he felt that Australia was its “spiritual home”.
And he joked that the cheeky duo could "torment" the campers a bit more there too.
The pair also said that when the show is in Australia they get to play golf in their time off but that it was a bit “too drizzly” when they were in north Wales.
Watch: Adam Woodyatt on being Ian Beale and motorhome living