It is always devastating when you realized that your spouse is having an affair. There will be grief, frustration, anger and at times can make you feel you have loss your self-esteem. Your whole life seems like it has been ripped apart. You will be asking yourself what you have done wrong.