Lighten up! When somebody makes an “off the cuff” remark don’t take it to heart. Many times a snide remark really isn’t directed at you but is instead a reflection on how the person who said it feels about themselves. Sometimes it could also be said out of jealousy.
The best thing to do is just brush it off and go on about your business. Let it pass. Don’t give others power over you to make you feel bad.