The OP has to decide for himself if his goals are too feel happy or feel healthy and if the primal/paleo lifestyle can lead him to either of those end points.
It sounds like the OP has already been struggling much for 2 and half years with the way he himself perceives his exterior appearance (how much he should look/weigh). This, more than not, falls into the happiness category.
Did the OP begin his paleo journey with the right intent? Did you want to change/improve the way you felt about how you looked or when you looked at yourself.....or did you want to change/improve your health?
I do not consider 3 days of "clean" eating followed by periods of binge eating the proper adherence to the primal/paleo life style WOE. If this pattern continued on for 2+ years, there is no way you're going to feel happy or very healthy.
Maybe it is a good idea to end your story, but if you ever choose to pick up on the journey again, give yourself an honest 30 days of maybe 5-6 out 7 "clean" eating days and strict primal/paleo adherence and 1 or 2 out of 7 days a more lenient, relaxed WOE....maybe you might see what you wanted to see in the end.