I have two reasons that I pull the ball. One is my push away gets out in front of my body which throws the swing off plane. It will feel just fine but the swing is a couple degrees off plane and I will pull it. Also I do have a tendency to drop my shoulder when really trying to get some hand on the ball. This steers the ball dead left. Those are the things I do so you could probably look there.
Always be sincere, even when you don't mean it