I think there are only a few hundred people in my world that have eaten devil fruits, out of the billions of people that exist. So it is still a rare thing... it's just that those people tend to be of some importance in my world. As such I suspect they'd be more likely to show up here than let's say... a bagel maker.