I think you're trying to control the ball more than you have to in your swing. The ball should be moving with gravity, not with your muscles. Once you push it away, let it drop and fall up and down into your release point instead of you trying to over control the speed. Another thing I notice is that you let go of the ball a little too late. You can reduce loft by letting go earlier, like in the downswing, not back on the upswing like in the video.