I don't think it necessarily have to do with your skin color unless there was a situation that occurred to make you feel this way. If you are in a management position or the youngest in your department that might play a factor. Pay attention to the cues people give when they are around you.