I don't support profound changes, because I believe that it is good to be in touch with your personal style, especially when you reach a certain age, and to know exactly what suits you.
Keep some pieces of clothing in your wardrobe that you usually wear in your off duty time, and some more demanding pieces, like a blazer, a high waisted skirt, a dress, nice socks or stockings, a bag, and appropriate footwear.
I love some girl time, just drinking coffee with my friends and chatting away, but I admit that I also need quiet times when I stay at home in my slippers, baking cookies, with the telephone screen black. That's life too.