I have the terrible feeling people assume I'm middle-class

You know when you get a feeling? Well I keep getting that strange sense that when people meet and greet me, the automatically assume I'm middle-class! I wonder what it is that makes them think that?