I know that I don't have the expertise to give any educated information but what directly came to my mind is:

Could the fact that we observe and measure the symetric behavior is influenced already because the matter around is matter and not anti-matter.

Would we observe something similar in direction of matter when all around is anti-matter?

Would the symetric only occour when none of the opposite would be around?