He owned it, he bought it.
Also, I think we can all agree that we want it to work that way, because the current Lord of Harrenhal is Petyr Baelish, and man I can’t WAIT for him to get his.
Hence the prophecy of the giant and the maiden with purple serpents.
Anyone who thinks that prophecy referred only to a child’s toy is a cad and a bounder!