One thing I notice when I allow my shoulders to rotate like this was that I was not making contact with the ground in front of the ball. The low spot is NOT opposite the left shoulder but is at address position.
This is what made me believe that I was doing the drill wrong.
If I only allow my arms to move (with the "right arm feeling like a piston") then I get more of a divot feel in front of the ball.