let yourself go
which means to allow yourself to become less attractive or healthy.
Example: It's easy to let yourself go when you have small kids.
This meaning is quite negative. However, this expression has a positive connotation too, meaning to relax completely and enjoy yourself.
Example: It's a party, let yourself go!