Modern depictions of leprechauns are largely based on derogatory 19th century caricatures and stereotypes of the Irish
https://en.wikipedia.org/wiki/Leprechaun
And Rory is from the North of Ireland and Leprechauns hail from the South so its derogatory and geographically inaccurate