Sonography of solid breast lesions: Observer variability of lesion description and assessment

OBJECTIVE. The purpose of this study was to measure the level of inter- and intraobserver agreement and to evaluate the causes of variability in radiologists' descriptions and assessments of sonograms of solid breast masses. MATERIALS AND METHODS. Sixty sonograms of solid masses were evaluated independently by five radiologists. Observers used the lexicon of a recently published benchmark report on sonographic appearances of breast masses to determine mass shape, margin, echogenicity, echotexture, presence of echogenic pseudocapsule, and acoustic transmission. Final diagnostic assessments were determined by applying the rule-based model of the same benchmark report to the radiologists' descriptions. In addition, one observer interpreted each case twice to evaluate intraobserver variability. Inter- and intraobserver variability were measured using Cohen's kappa statistic. We also investigated causes of variability in radiologists' descriptions. RESULTS. Interobserver agreement ranged from lowest for determining the presence of an echogenic pseudocapsule (κ = .09) to highest for determining mass shape (κ = .8). Intraobserver agreement was lowest for mass echotexture (κ = .24) and greatest for mass shape (κ = .79). Variability in descriptions of lesions contributed to interobserver (κ = .51) and some intraobserver (κ = .66) inconsistency in assessing the likelihood of malignancy. CONCLUSION. Lack of uniformity among observers' use of descriptive terms for solid breast masses resulted in inconsistent diagnoses. The need for improved definitions and additional illustrative examples could be addressed by developing a standardized lexicon similar to that of the Breast Imaging Reporting and Data System.