He didn’t blame them, at least not entirely. He didn’t blame the Master for coming to Earth, he didn’t blame him for letting himself die on the Valiant, he didn’t blame him for resurrecting himself and he didn’t blame him for letting the Time Lords track him to Earth. He didn’t blame the Time Lords for bringing Gallifrey back and breaking the time lock.
He blamed them for forcing him to make a choice, though. He blamed them for forcing him to kill them twice. He blamed himself the most, for choosing to do the right thing both times. He’d never forgive himself for that, because the right thing isn’t always the best thing.