TY - JOUR
T1 - Property testing in high-dimensional ising models
AU - Neykov, Matey
AU - Liu, Han
N1 - Funding Information:
Received April 2018. 1Supported by NSF BIGDATA 1840866, NSF RI 1408910, NSF CAREER 1841569, NSF TRIPODS 1740735, along with an Alfred P. Sloan Fellowship. MSC2010 subject classifications. 62F03, 62H15. Key words and phrases. Ising models, minimax testing, Dobrushin’s comparison theorem, antiferromagnetic Curie–Weiss detection, two-point function bounds, correlation tests.
Publisher Copyright:
© 2019 Institute of Mathematical Statistics. All rights reserved.
PY - 2019
Y1 - 2019
N2 - This paper explores the information-theoretic limitations of graph property testing in zero-field Ising models. Instead of learning the entire graph structure, sometimes testing a basic graph property such as connectivity, cycle presence or maximum clique size is a more relevant and attainable objective. Since property testing is more fundamental than graph recovery, any necessary conditions for property testing imply corresponding conditions for graph recovery, while custom property tests can be statistically and/or computationally more efficient than graph recovery based algorithms. Understanding the statistical complexity of property testing requires the distinction of ferromagnetic (i.e., positive interactions only) and general Ising models. Using combinatorial constructs such as graph packing and strong monotonicity, we characterize how target properties affect the corresponding minimax upper and lower bounds within the realm of ferromagnets. On the other hand, by studying the detection of an antiferromagnetic (i.e., negative interactions only) Curie-Weiss model buried in Rademacher noise, we show that property testing is strictly more challenging over general Ising models. In terms of methodological development, we propose two types of correlation based tests: computationally efficient screening for ferromagnets, and score type tests for general models, including a fast cycle presence test. Our correlation screening tests match the information-theoretic bounds for property testing in ferromagnets in certain regimes.
AB - This paper explores the information-theoretic limitations of graph property testing in zero-field Ising models. Instead of learning the entire graph structure, sometimes testing a basic graph property such as connectivity, cycle presence or maximum clique size is a more relevant and attainable objective. Since property testing is more fundamental than graph recovery, any necessary conditions for property testing imply corresponding conditions for graph recovery, while custom property tests can be statistically and/or computationally more efficient than graph recovery based algorithms. Understanding the statistical complexity of property testing requires the distinction of ferromagnetic (i.e., positive interactions only) and general Ising models. Using combinatorial constructs such as graph packing and strong monotonicity, we characterize how target properties affect the corresponding minimax upper and lower bounds within the realm of ferromagnets. On the other hand, by studying the detection of an antiferromagnetic (i.e., negative interactions only) Curie-Weiss model buried in Rademacher noise, we show that property testing is strictly more challenging over general Ising models. In terms of methodological development, we propose two types of correlation based tests: computationally efficient screening for ferromagnets, and score type tests for general models, including a fast cycle presence test. Our correlation screening tests match the information-theoretic bounds for property testing in ferromagnets in certain regimes.
KW - Antiferromagnetic Curie-Weiss detection
KW - Correlation tests
KW - Dobrushin's comparison theorem
KW - Ising models
KW - Minimax testing
KW - Two-point function bounds
UR - http://www.scopus.com/inward/record.url?scp=85072248620&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85072248620&partnerID=8YFLogxK
U2 - 10.1214/18-AOS1754
DO - 10.1214/18-AOS1754
M3 - Article
AN - SCOPUS:85072248620
SN - 0090-5364
VL - 47
SP - 2472
EP - 2503
JO - Annals of Statistics
JF - Annals of Statistics
IS - 5
ER -