The move could upset Prince Archie and Princess Lilibet who are close with the animals.