Absolutely.
My brother once though I was in an abusive relationship because I used to play wrestle with my boyfriend and we were very physical. We used to hit each other and play around like that all the time. It was completely harmless and I loved it. There was nothing abusive about it and he was the nicest sweetest guy in the world. But my brother was convinced this was the wrong relationship for me. (i suspect it might have had something to do with the fact that he was black)
Your family only see less than 5% of your relationship. Its impossible to judge someone else's relationship just from the small amount you see of them around you. It's stupid to try to judge.
You know your own relationship, you shouldn't let other people tell you how to feel about someone.
That being said, if my brother started dating a crack ***** who had 3 kids by 3 different guys, I'd have something to say about it...
so maybe i'm a hypocrite?