One simple and clever way to test for significant results is to run an A/A/B test. When your two A buckets converge, you've probably done enough testing.