Why is Raymun Darry repeatedly referred to as Ser when he is a Lord?

There isn’t an official explanation, but the best explanation I’ve seen is that the Darrys were reduced from lords to landed knights as punishment for their support of the Targaryens during Robert’s Rebellion.