Background: Early prediction of cerebral palsy (CP) using the General Movement Assessment (GMA) during the fidgety movements (FM) period has been recommended as standard of care in high-risk infants. The aim of this study was to determine the accuracy of GMA, alone or in combination with neonatal imaging, in predicting cerebral palsy (CP). Methods: Infants with increased risk of perinatal brain injury were prospectively enrolled from 2009–2014 in this multi-center, observational study. FM were classified by two certified GMA observers blinded to the clinical history. Abnormal GMA was defined as absent or sporadic FM. CP-status was determined by clinicians unaware of GMA results. Results: Of 450 infants enrolled, 405 had scorable video and follow-up data until at least 18–24 months. CP was confirmed in 42 (10.4%) children at mean age 3 years 1 month. Sensitivity, specificity, positive and negative predictive values, and accuracy of absent/sporadic FM for CP were 76.2, 82.4, 33.3, 96.8, and 81.7%, respectively. Only three (8.1%) of 37 infants with sporadic FM developed CP. The highest accuracy (95.3%) was achieved by a combination of absent FM and abnormal neonatal imaging. Conclusion: In infants with a broad range of neonatal risk factors, accuracy of early CP prediction was lower for GMA than previously reported but increased when combined with neonatal imaging. Sporadic FM did not predict CP in this study.