I had trouble using Photoshop but found Affinity Photo understandable and pleasant to use.
People who have gone to the trouble of learning Photoshop usually will not give it up. I would be interested to learn if Affinity Photo 2 can claim a place in your workflow in spite of your past with Photoshop. 
I deleted Photoshop from my iPad to force me to try AP2 so we shall see.
Though no fault of Affinity. I just never made it through the Adobe cancellation process. Adobe offered me a deal I could not refuse. While I am confident that AP2 could be a reasonable replacement for Photoshop, the thought of losing Premiere and having to learn Final Cut or DaVinci Resolve at this time just weighted the scales too far. So…
Perfectly understandable. Adobe is never a wrong choice. Some days, I miss Adobe Bridge and Camera Raw. I just never warmed up to Photoshop. 
The similarity between trying to leave CC, and trying to cancel streaming services with multiple family members watching shows, just hit me.