Putting on the accent helps you to pronounce the words properly. I doubt you actually sound French or Spanish or whatever to the natives
They're probably told the same thing, alot of times you can tell if a person has learned English in America because some of the words have an American twang.