I don't think you should ever let anyone tell you what you can and can't do.
To be without some of the things you want is an indispensable part of happiness.