My father ignored me

I'm Alexander 38 only child of Heather (deceased) and Alexander (deceased). Back when I was 13 my mother died suddenly (heart)and my father sent me to boarding school and basically forgot about me. My only contact with him was thru his secretary Mary, it was her who attended all the school events and consulted with the school on his behalf. She was 35 at the time I first met her and I was 16. If not for her I would've been at the school all the time. She was a war widow and had 1 child of her own Hayley than 12, so on my holidays from school I stayed with Mary and Hayley. After I started university I stayed with Mary and Hayley and had something close to a family life. I was quite reserved is my way of saying I didn't mix well with others. It was Mary who caught me masturbating and gave me my first sexual experience, I didn't see Mary as a employee more as family. At 25 my father died in an accident and everything passed to me, in the 12 years since my mother's death I had seen my father just 5 or 6 times and for no more than a few minutes each time. Mary rented her home and on me inheriting from my father I had her and Hayley move in with me. I took over the business and had Mary as my PA and we were regularly fucking as well. She was the only woman I had fucked up to that point, Mary said I should find a wife and I asked her to marry me on the spot. She refused me and said I should find someone closer to my own age. Hayley is like me quiet and reserved and we got on very well and she knew I was fucking her mother and it didn't bother her. With Mary saying no to marrying me, I said I would marry Hayley then. Mary smiled at me and said you can only ask. Hayley was attending the same university as I had just finished. On her getting home that day I asked her, it was a bit of a surprise at first for her. But she thought about and then said okay, with made me happy and surprised Mary. Mary asked Hayley why she accepted and Hayley said she wanted to marry and have a family and I was the only male she felt comfortable around. Adding that it wouldn't concern her if I continued having sexual relations with Mary also. Which I was happy about, I was a little shock Hayley had agreed to marry me. But the more I thought about it, the more I thought it was the best for me and them. We married in a simple wedding within weeks of the proposal. After the wedding I made Mary my Executive Assistant, everyone at the company knew we lived together. But because I had married Hayley done thought I was having a sexual relationship with Mary. Hayley quickly got pregnant after our marriage and in the years since had 4 more children. She is very happy being a mother, but she finished university and come on business trips with me, Mary and the 5 children on school holidays. I'm not wanting to neglect them like my father did to me. Mary is still sleeping with me and Hayley and is normal for us.