Happiness comes from within. It is not something anyone can just give you. You have to choose it. Claim it. Own it.
As long as you are not hurting anyone and as long as it is not at the expense of other people’s feelings, then there is no reason for you to be guilty. You deserve to be happy. Don’t dwell on things that hurt you. Life is short. Make the best out of it.