If I understood everything right, I have the same problem with padding in masonry blocks. When the block is medium or large image fills the whole block. In a small blocks I have padding as was set in “element spacing” (only for left and right sides).
I’m using mantle theme.
Wiktor, your site looks great!