Are you doing as follows:
Go to Control Panel/Options, then click on the tab Edit Profile. Scroll down and you'll see your avatar with a tickbox underneath that says Delete Avatar. Click on that, then Edit Profile at the bottom.
Then once it's deleted, go back to that page, but this time go to the Upload avatar from your computer bit, click browse and go from there.
