But Andrew is seemingly showing little sign of budging, particularly after he took out a 75-year lease on the property in 2003 following the death of the late Queen Mother.
Daily Express royal expert Richard Palmer explained the house doesn’t fall into what is known as the Occupied Royal Palaces Estate, like some 200 other royal properties, but is instead a Crown Estate property.
He told the Daily Express Royal Round Up: “The King is saying ‘I can’t support you in the way I used to support you like your mother used to be able to support you, and I’m worried are you going to e able to stay there and do the maintenance work that is needed on the property.’
“I think Andrew is saying ‘I’m not moving and I will find a way’ but nobody is quite clear how exactly he’s going to do that.
Get the latest royal news straight to your phone by joining our Whatsapp community!
“I think the King is putting pressure on his brother to move to something smaller and something that is more financially manageable.
“But apart from the financial support he gives him, he doesn’t have a lot of leverage over that.
“He can’t evict his brother from Royal Lodge because as I have said, that is a Crown Estate property.
“The monarchy is technically the owner of the Crown Estate, but in name only and it is basically an independent property company that makes money from the UK Government.”
Mr Palmer believes The Firm will be wondering how Andrew will be able to afford the vast renovations at Royal Lodge himself should he still refuse to move from there.
The royal expert was asked: “How would he be able to afford all of these renovations if he is no longer a senior working royal and is quite tight-lipped about what he is doing these days given the headlines from the last few years? Where is this money coming from?”
The royal expert replied: “That’s a question the family is asking – if he can afford it? I think he has private investments. Did he inherit money from his parents?”
“Probably not too much because I suspect it was passed from monarch to monarch but the King may have found a way of funneling some money toward him.”
They said: “They originally wanted Andrew out of Royal Lodge so that the property could be renovated and prepared for new lodgers.
“But he is adamant that, as he has so many years left to run on his lease and he spent millions from his own fortune doing up the place he is not going to leave his home.
“He feels very strongly, perhaps with some justification, that they are moving the goalposts suddenly and it is hugely unfair.”
