When he does try to blow yoy off quickly hit the X button to grab the side of the column then pull yourself up when he stops. Keep moving to the left, using the rock columns as shelter when he starts blowing again. You'll be attacked some by harpies during this- use grabbing attacks to keep yourself behind cover.