The Doctor feels he has every right to be miffed. After everything he did, this is how he’s repaid?
It’s not as if he’d been expecting to be knighted or anything, but he saved Queen Victoria’s life, among others, and sent the werewolf away from earth, to wherever it wanted to go.
Now as a reward he’s being banished from earth? How ungrateful is that? It hardly seems fair.
Then to add insult to injury, Her Majesty sets up the Torchwood Institute and makes him public enemy number one in their charter. What did he ever do to deserve that?