According to the British publication, the two have been left in "victim mode" after haters slammed them for their jet set ways and other issues.
Now will they "go Hollywood" and live in former actress Meghan's place of birth?
The insider said Meghan, 38, rumored to be a diva, and Harry, 34, have apparently snubbed his father Prince Charles’ plans for them to reside in an estate in Herefordshire.
Charles hoped his son would create a country estate for his family near the Welsh borders.
But Harry reportedly isn't interested in that—and instead, could be heading to America with his former Suits star wife and their baby Archie, now three months old.
"In the 1980s, it was decided baby Harry would one day have a family and want to build an estate. Charles has discussed Herefordshire, thinking he’d love it," the source told The Mail on Sunday.
"Perhaps back then they were expecting Harry would marry a…nursery school teacher who would love nothing more than running an estate. Fast forward to 2019, and that dream seems deeply old-fashioned, not to mention unrealistic."
Meghan has been rumored to be difficult as multiple royal staffers have quit after working for her.
There was an outcry over Meghan's lavish baby shower in New York City.
About a week after Prince Harry faced criticism for being one of the world’s elite using a private jet to reach a climate change summit at Google Camp in Sicily, he and his wife flew by private plane to Spain for a family vacation with their boy.
The Duke and Duchess of Sussex have been labeled “hypocrites” for their luxury travel by environmentalists, members of Parliament and Princess Diana’s former royal protection officer Ken Wharfe, as Vanity Fair has reported.
Los Angeles, where numerous celebrities live, could be a respite for the couple.
Meghan and Harry reportedly visited her mother Doria Ragland at her L.A. home before Archie's birth.
Doria has been dubbed "the power behind the throne," as she's been a rock for them, helping to choose a suitable nanny.
The source told The Mail that Meghan and Harry "do not feel they need to change their actions, but rather, change the people around them and possibly even the country they call home. They have no wish, for the moment, to take on a stuffy shooting estate."