The third-in-line joked that William was "jealous" of him as he would love to get away from his "screaming child" Prince George. Harry made the comments as he was preparing in Antarctica to make the expedition.
CLICK ON PHOTOS TO ENLARGE
On a more serious note he also told how his dad Prince Charles was worried about the dangers he would face as he journeys to the South Pole – which he hopes to reach by 16 December .
In an interview with Sky News, Harry – who trekked to the North Pole with Walking for the Wounded in 2011 said: "My father was a little concerned, but I obviously tried to keep him calm and explain the North Pole was the dangerous one because we're walking on a frozen ocean whereas this time there are crevasses.
"But hopefully the guides will take us around that. Apart from frostbite you should be able to look after yourself as long as you just head south."
The Prince also spoke about breaking his toe, joking: "I obviously broke my toe trying to get out of the trip - that was a massive fail - friends of mine said 'you really need to go that step further and break your leg' - I chose not to. But my toe is probably 95% now so I'm fine."
"Whatever setbacks I've had it's irrelevant amongst these guys, and it always was going to be, there was no question of pulling out. I've got four limbs and I'm completely fine - well almost fine up here," he added, pointing to his head.
The Walking With The Wounded South Pole Allied Challenge 2013, of which Harry is a proud patron, will see participants of largely wounded ex-servicemen and women race over a 200-mile course to the South Pole.
The teams are hoping to trek between nine and 12 miles a day, enduring temperatures as low as -45C and 50mph winds while pulling their 70kg sleds. They aim to reach the South Pole by 16 December.
Harry said: "Every single person who takes part in this challenge is extraordinary. The fact these guys have made it to this point is extraordinary and I count myself incredibly lucky to be part of it."