Before filling with water, make sure gaskets are facing the right direction as shown below.

Occurs to less than 1% of WaterBricks, but small leaks will occur if gasket is not facing the right direction.