In addition to Steve's recommendation, in this case I would remove the fill from the red square to make the pattern background colorless and transparent, apply the swatch to the desired shape, then, in the Appearance Panel, add a red fill behind the pattern fill.
Peter
Hi, Steve.