Impact of matrix deformations on drying of granular materials