|Ahead of print
|Effect of alvarado score on the negative predictive value of nondiagnostic ultrasound for acute appendicitis
Duangkamon Prapruttam1, Sopon Klawandee2, Phatthawit Tangkittithaworn1, Sirote Wongwaisayawan1
1 Department of Diagnostic and Therapeutic Radiology, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
2 Department of Diagnostic and Therapeutic Radiology, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok; Department of Radiology, King Prajadhipok Memorial Hospital, Chanthaburi, Thailand
Click here for correspondence address and email
|Date of Submission||24-Jun-2021|
|Date of Decision||22-Jul-2021|
|Date of Acceptance||03-Aug-2021|
|Date of Web Publication||27-Dec-2021|
Background: The purposes of this study were to calculate the negative predictive value (NPV) of nondiagnostic ultrasound (US) in patients with suspected appendicitis and to identify the clinical factors that were associated with the nondiagnostic US. Methods: We conducted a retrospective review of 412 patients who had graded-compression appendiceal US performed during January 2017 and December 2017. The NPV of the nondiagnostic US in combination with clinical parameters was calculated. Multivariate regression analysis was used to determine the independent predictors for the nondiagnostic US. Results: The US exam was nondiagnostic in 64.8% of the patients, giving an NPV of 70.8%. The NPV of nondiagnostic US increased to 96.2% in patients who had an Alvarado score of <5. The patients who did not have migratory pain, did not have leukocytosis, and had a pain score of <7 were more likely to have a nondiagnostic US study (P < 0.001). Conclusion: Alvarado score had an inverse effect on the NPV of nondiagnostic appendiceal US. Patients who had nondiagnostic US and Alvarado score of <5 were very unlikely to have appendicitis. Active clinical observation or re-evaluation rather than immediate computed tomography may be a safe alternative approach in these low-risk patients. However, the Alvarado score itself was not a predictive factor of nondiagnostic US. The absence of migratory pain, absence of leukocytosis, and low pain score were the independent predictors of nondiagnostic appendiceal US.
Keywords: Alvarado score, appendicitis, negative predictive value, nondiagnostic ultrasound, ultrasound
|How to cite this URL:|
Prapruttam D, Klawandee S, Tangkittithaworn P, Wongwaisayawan S. Effect of alvarado score on the negative predictive value of nondiagnostic ultrasound for acute appendicitis. J Med Ultrasound [Epub ahead of print] [cited 2022 Jul 5]. Available from: http://www.jmuonline.org/preprintarticle.asp?id=333889
| Introduction|| |
Early diagnosis and prompt treatment of acute appendicitis are important to reduce morbidity and mortality from perforation and abscess formation. Although computed tomography (CT) is considered to be a modality of choice due to its excellent diagnostic performance,, there is growing concern about ionizing radiation exposure as well as contrast-induced nephropathy in patients who have a CT scan., Moreover, CT scan may not be generally available in a resource-limiting situation. Therefore, graded-compression ultrasound (US) has been suggested as the first imaging test and followed by selective CT if the US is nondiagnostic or equivocal.,
In clinical practice, 65%–71% of all US examinations fail to demonstrate the appendix or cannot demonstrate the whole length of appendix.,,, This condition is commonly regarded as a nondiagnostic US examination. In these patients, the decision to perform a CT scan may be very challenging. A combination of US findings and the clinical predictive score would be helpful for the patient triage to CT scan, which can help to make effective use of both imaging modalities.
The purposes of this study were
- To calculate the negative predictive value (NPV) of nondiagnostic US alone and when it is combined with the clinical parameters, particularly the Alvarado score
- To identify the clinical factors that were associated with nondiagnostic US in patients with suspected appendicitis.
| Materials and Methods|| |
This retrospective study was conducted in accordance with the Declaration of Helsinki and was approved by the Institutional Committee on Human Rights Related to Research Involving Human Subjects (ID 06-61-73). The informed consent was waived. The records of 502 patients who had graded-compression appendiceal US from January 2017 to December 2017 were retrieved from our radiology database. Ninety patients were excluded because of inaccessible follow-up medical records (n = 45) and incomplete medical records (n = 45).
The medical and pathology records were reviewed for patient age, gender, weight, body mass index, duration of symptoms, Alvarado score, surgical diagnosis, pathological diagnosis, and patient disposition. The Alvarado score is a diagnostic score that is based on the symptoms (migratory pain, anorexia, nausea, and/or vomiting), signs (tenderness, rebound tenderness, and elevated body temperature), and laboratory findings (leukocytosis and left shift). One point was given to the presence of each indicator, except two points for tenderness and leukocytosis, making a total score of 10. A higher score means a higher probability of appendicitis.
The imaging studies were reviewed for US visualization of appendix, relevant US findings, US diagnosis, other imaging modalities performed, and their impression. The definitive diagnosis of appendicitis was based on the surgical pathology in patients who had surgery and on abdominal CT or clinical follow-up at 3 months after emergency department (ED) admission for those who did not have surgery.
All US examinations were performed with one of the two US systems: Aplio 500 system (Toshiba Medical Systems, Tokyo, Japan) with curved transducer (C6-2 MHz) and linear-array transducer (L14-3 MHz or L11-3 MHz) and Xario 200 scanner (Toshiba Medical Systems, Tokyo, Japan) with curved transducer (C6-1 MHz) and linear-array transducer (L14-5 MHz or L11-4 MHz). The standard US protocol includes a general scan of the right-sided abdomen and the pelvis using a curved transducer. Later, graded-compression US was performed using a linear-array transducer. This technique involved the examiners gently compressing the linear transducer using both hands, simulating deep palpation of the abdomen. The adjunctive maneuvers (posterior manual compression and left posterior oblique positioning) were also performed if the appendix was not visualized on supine scan., Between 8 am and 4 pm, a radiology trainee performed the US study under the direct supervision of the attending staff, whereas an on-call senior radiology trainee performed the US study during after-hours. The after-hours study was later reviewed and finalized by the attending staff on the following day. The visualization of the appendix was determined by the US operator at the time of the study. The appendiceal US report was categorized into
- Diagnostic study (positive or negative for appendicitis)
- Nondiagnostic study.
The diagnostic criteria for acute appendicitis include enlarged (outer-to-outer wall diameter >6 mm) and noncompressible appendix, hyperechoic change of periappendiceal fat, appendicolith, periappendiceal fluid, and appendiceal wall hyperemia [Figure 1].
|Figure 1: Acute appendicitis in a 20-year-old man. A graded compression sonogram showing an 8-mm noncompressible appendix (white arrows) with hyperechoic change of the surrounding fat|
Click here to view
Categorical data were expressed as count and percentage. Continuous data were summarized as mean and standard deviation or median and range. The sensitivity, specificity, NPV, and positive predictive value (PPV) with a 95% confidence interval (CI) were calculated. The assessment of differences was performed by using the Chi-square test or Fisher's exact test for categorical data and by student t-test or Mann–Whitney U test for continuous data. The variables noted to have differences in the Chi-square test or Mann–Whitney U test were used as dependent variables in univariate logistic regression analysis. Variables with a P ≤ 0.05 were considered to be statistically significant, and then, stepwise multivariate logistic regression analysis was used to determine independent factors. All statistical analyses were performed using STATA version 13 statistical software (Stata Corp., College Station, TX, USA).
| Results|| |
Among 412 patients enrolled, 282 (68.4%) were female. The age ranged from 3 to 91 years (mean age of 43 years). One hundred and ten (26.7%) US examinations were performed by staff radiologists and the rest 302 (73.3%) US examinations were performed by radiology trainees. The demographic characteristics are summarized in [Table 1].
Surgical pathology was able to confirm acute appendicitis in 215 (52%) patients. The rest of 197 (48%) patients did not have appendicitis on either follow-up imaging or clinical records. One hundred and forty-five patients (35.2%) had positive US for appendicitis. Among these, 137 patients (94.5%) had appendicitis (true-positive) and eight patients (5.5%) did not have appendicitis (false-positive). Two out of eight patients had ruptured diverticulitis (n = 1) and nonspecific right lower quadrant (RLQ) inflammation (n = 1). The other six patients had lymphoid hyperplasia. The US results were deemed nondiagnostic in 267 (64.8%) patients, of which 78 patients (29.2%) had appendicitis confirmed on pathology.
The US had an overall sensitivity of 63.7% (95% CI; 56.9%–70.2%), specificity of 95.9% (95% CI; 92.2%–98.2%), PPV of 94.5% (95% CI; 89.4%–97.6%), and NPV of 70.8% (95% CI; 64.9%–76.2%) for the diagnosis of acute appendicitis. The US studies performed by staff radiologists had higher sensitivity than the examinations performed by radiology trainees (76.2% vs. 58.6%; P < 0.05), but both of them had comparable specificity (95.7% vs. 96%), PPV (96% vs. 93.7%), and NPV (75% vs. 69.6%). Several clinical and laboratory parameters were analyzed to assess the effect on NPV of nondiagnostic US, as shown in [Table 2]. When integrated with Alvarado score, the overall NPV of nondiagnostic US was 96.2% (95% CI: 86.8%–99.5%) in patients with Alvarado score of <5 and decreased to 74.1% (95% CI: 64.8%–82.0%) in patients with Alvarado score of 5–6, 58.4% (95% CI: 47.5%–68.8%) in patients with Alvarado score of 7–8, and 38.9% (95% CI: 17.3%–64.3%) in patients with Alvarado score of 9–10.
|Table 2: Negative predictive value of nondiagnostic ultrasound in different clinical scenarios|
Click here to view
Female gender, absence of migratory pain, absence of anorexia, absence of leukocytosis, Alvarado score of <7, and pain score of <7 were significantly associated with nondiagnostic US on univariate analysis. These variables were entered into a multivariate regression model. The absence of migratory pain, absence of leukocytosis, and pain score were the independent predictors of nondiagnostic US on multivariate analysis, as shown in [Table 3].
|Table 3: Univariate and multivariate analyses of predictors for nondiagnostic ultrasound|
Click here to view
| Discussion|| |
The overall NPV of nondiagnostic US in our study was 70.8% which was lower than 84.5% reported by Cohen et al. Their study was performed in the pediatric population which usually has smaller body habitus and a lesser amount of adipose tissue. These two factors may increase the visualization of the appendix, therefore giving the higher NPV.
We found that the low clinical likelihood for acute appendicitis had an inverse effect on the NPV of nondiagnostic US. The NPV of nondiagnostic US increased to 89.3% in patients without leukocytosis and increased to 96.2% in patients with an Alvarado score of <5. Based on the proposed clinical decision rule to rule out appendicitis in patients with nondiagnostic US, the patients with nondiagnostic US can be discharged from the ED and followed up in the following day if they had fewer than two of the following factors: male gender, migration of pain to the RLQ abdomen, vomiting, and white blood cell (WBC) count higher than 12 × 109/L. The NPV of this rule was 84% in patients with inconclusive US. The absence of these factors would give the possible maximal Alvarado score of 6, which yielded an NPV of 74.1% in our study.
We suggest that the integration of US results and clinical data has a significant impact on US performance and patient disposition. An Alvarado score of 5 was described as a useful clinical prediction rule to “rule out” appendicitis in all patient groups. The appendix tends to have a normal size and the signs of inflammation are not evident in the patients who had low Alvarado score and nondiagnostic US. An immediate CT scan may be avoided in these patients with an Alvarado score of <5 to reduce unnecessary radiation and iodinated contrast exposure.,,
Shah et al. studied 318 patients with nonvisualized appendix who had short-interval CT following the US. Appendicitis was diagnosed in 16% of their study population and only 0.6% had other important CT findings which required urgent surgery. They suggested serial physical examination, active clinical observation, and correlation with laboratory findings to further triage the patients. In our study, a second-line CT scan was performed in 25 patients who had nondiagnostic US and Alvarado score of <5. Only two of them had confirmed acute nonperforated appendicitis on both CT scan and pathology results. Neither of them had leukocytosis.
The incidence of appendicitis in our study was 52.2% which was slightly higher than previously reported data of 43%. The sensitivity, specificity, PPV, and NPV in our study were also comparable to previous data in 2010, which suggests a consistent diagnostic performance at our institution.
The relative chance of nondiagnostic US in patients who did not have migratory pain, who did not have leukocytosis, and who had pain score of <7 were 2.53, 3.48, and 2.14 times higher than those of their counterparts, respectively. Seventy-six percent of patients who had nondiagnostic US did not have migratory pain, 39% did not have leukocytosis, and 53.9% had pain score of <7. The migratory pain to the RLQ abdomen is regarded as a classic sign of appendicitis with a sensitivity of 43%, specificity of 84%, and NPV of 80%. This sign can be absent due to anatomical variation of the appendix or due to extreme patient age with atypical presentations. WBC count can also serve as a useful inflammatory biomarker for appendix inflammation. Previous literature found that patients who had normal appendix had lower WBC count than those with inflamed or complicated appendix., The migratory pain had a negative likelihood ratio of 0.52, while an elevated WBC count (i.e., leukocytosis) had a negative likelihood ratio between 0.26 and 0.51 in the diagnosis of appendicitis., We postulated that the patients without migratory pain and leukocytosis were unlikely to have inflamed appendix, therefore reducing the chance of having diagnostic US results. The incidence of nondiagnostic US in our study was 64.8% which was at the lower end among the reported incidence of 65%–71%.,,,, The trend toward a lower nondiagnostic rate in our study might be related to the better US machine and the use of adjunctive US techniques. Nevertheless, the overall sensitivity of the US in our investigation is relatively low (64%). This lower sensitivity may be related to the US examiners' experience level. In 73% of our cases, the US examinations were performed by senior radiology trainees who had 2–3 years of US experience (approximately 200–300 abdominal scans). It was unclear if the US operators had performed adjunctive maneuvers correctly, or they had used other indirect supportive signs of appendicitis. Moreover, the higher sensitivity of previous studies may be related to publication bias (underreport studies with poor US sensitivity).
Several limitations should be noted. This study was conducted in a single academic center which could limit the generalization of the result. There was a lack of pathological proof in patients who did not have surgery. We considered these patients true negative after the follow-up records were reviewed up to 3 months after the initial ED admission. Some patients with overt clinical signs of appendicitis may proceed directly to the surgery without imaging workup. There was a relatively low number of patients with low Alvarado score which could limit the potential impact of our study. We did not assess the outcome of nondiagnostic US such as perforation rate, length of hospital stay, or total time from ED arrival to the final diagnosis.
| Conclusion|| |
The patients who had nondiagnostic US and Alvarado score of <5 were unlikely to have acute appendicitis. Active clinical observation or re-evaluation rather than immediate CT may be a safe alternative approach in a resource-limiting situation. Patients who did not have migratory pain, did not have leukocytosis, and had pain score of <7 were more likely to have nondiagnostic US. Validation of this data with a larger prospective study will aid the clinicians in the selection of imaging options in appendicitis.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Cohen B, Bowling J, Midulla P, Shlasko E, Lester N, Rosenberg H, et al
. The non-diagnostic ultrasound in appendicitis: Is a non-visualized appendix the same as a negative study? J Pediatr Surg 2015;50:923-7.
Doria AS, Moineddin R, Kellenberger CJ, Epelman M, Beyene J, Schuh S, et al
. US or CT for diagnosis of appendicitis in children and adults? A meta-analysis. Radiology 2006;241:83-94.
Garcia EM, Camacho MA, Karolyi DR, Kim DH, Cash BD, Chang KJ, et al
. ACR appropriateness criteria(®) right lower quadrant pain-suspected appendicitis. J Am Coll Radiol 2018;15:S373-87.
Gleeson TG, Bulugahapitiya S. Contrast-induced nephropathy. AJR Am J Roentgenol 2004;183:1673-89.
Journy N, Ancelet S, Rehel JL, Mezzarobba M, Aubert B, Laurier D, et al
. Predicted cancer risks induced by computed tomography examinations during childhood, by a quantitative risk assessment approach. Radiat Environ Biophys 2014;53:39-54.
Wan MJ, Krahn M, Ungar WJ, Caku E, Sung L, Medina LS, et al
. Acute appendicitis in young children: Cost-effectiveness of US versus CT in diagnosis--a Markov decision analytic model. Radiology 2009;250:378-86.
Nasiri S, Mohebbi F, Sodagari N, Hedayat A. Diagnostic values of ultrasound and the modified alvarado scoring system in acute appendicitis. Int J Emerg Med 2012;5:26.
Ramarajan N, Krishnamoorthi R, Barth R, Ghanouni P, Mueller C, Dannenburg B, et al
. An interdisciplinary initiative to reduce radiation exposure: Evaluation of appendicitis in a pediatric emergency department with clinical assessment supported by a staged ultrasound and computed tomography pathway. Acad Emerg Med 2009;16:1258-65.
Stewart JK, Olcott EW, Jeffrey RB. Sonography for appendicitis: Nonvisualization of the appendix is an indication for active clinical observation rather than direct referral for computed tomography. J Clin Ultrasound 2012;40:455-61.
D'Souza N, D'Souza C, Grant D, Royston E, Farouk M. The value of ultrasonography in the diagnosis of appendicitis. Int J Surg 2015;13:165-9.
Alter SM, Walsh B, Lenehan PJ, Shih RD. Ultrasound for diagnosis of appendicitis in a community hospital emergency department has a high rate of nondiagnostic studies. J Emerg Med 2017;52:833-8.
Alvarado A. A practical score for the early diagnosis of acute appendicitis. Ann Emerg Med 1986;15:557-64.
Puylaert JB. Acute appendicitis: US evaluation using graded compression. Radiology 1986;158:355-60.
Lee JH, Jeong YK, Hwang JC, Ham SY, Yang SO. Graded compression sonography with adjuvant use of a posterior manual compression technique in the sonographic diagnosis of acute appendicitis. AJR Am J Roentgenol 2002;178:863-8.
Lee JH, Jeong YK, Park KB, Park JK, Jeong AK, Hwang JC. Operator-dependent techniques for graded compression sonography to detect the appendix and diagnose acute appendicitis. AJR Am J Roentgenol 2005;184:91-7.
Quigley AJ, Stafrace S. Ultrasound assessment of acute appendicitis in paediatric patients: Methodology and pictorial overview of findings seen. Insights Imaging 2013;4:741-51.
Leeuwenburgh MM, Stockmann HB, Bouma WH, Houdijk AP, Verhagen MF, Vrouenraets B, et al
. A simple clinical decision rule to rule out appendicitis in patients with nondiagnostic ultrasound results. Acad Emerg Med 2014;21:488-96.
Ohle R, O'Reilly F, O'Brien KK, Fahey T, Dimitrov BD. The Alvarado score for predicting acute appendicitis: A systematic review. BMC Med 2011;9:139.
Keller C, Wang NE, Imler DL, Vasanawala SS, Bruzoni M, Quinn JV. Predictors of nondiagnostic ultrasound for appendicitis. J Emerg Med 2017;52:318-23.
Blitman NM, Anwar M, Brady KB, Taragin BH, Freeman K. Value of focused appendicitis ultrasound and alvarado score in predicting appendicitis in children: Can we reduce the use of CT? AJR Am J Roentgenol 2015;204:W707-12.
Shah BR, Stewart J, Jeffrey RB, Olcott EW. Value of short-interval computed tomography when sonography fails to visualize the appendix and shows otherwise normal findings. J Ultrasound Med 2014;33:1589-95.
Koseekriniramol V, Kaewlai R. Abdominal wall thickness is not useful to predict appendix visualization on sonography in adult patients with suspected appendicitis. J Clin Ultrasound 2015;43:269-76.
Mostbeck G, Adam EJ, Nielsen MB, Claudon M, Clevert D, Nicolau C, et al
. How to diagnose acute appendicitis: Ultrasound first. Insights Imaging 2016;7:255-63.
Al-Gaithy ZK. Clinical value of total white blood cells and neutrophil counts in patients with suspected appendicitis: Retrospective study. World J Emerg Surg 2012;7:32.
Gronroos JM, Gronroos P. Leucocyte count and C-reactive protein in the diagnosis of acute appendicitis. Br J Surg 1999;86:501-4.
Yu CW, Juan LI, Wu MH, Shen CJ, Wu JY, Lee CC. Systematic review and meta-analysis of the diagnostic accuracy of procalcitonin, C-reactive protein and white blood cell count for suspected acute appendicitis. Br J Surg 2013;100:322-9.
Andersson RE. Meta-analysis of the clinical and laboratory diagnosis of appendicitis. Br J Surg 2004;91:28-37.
Kouamé N, N'goan-Domoua AM, N'dri KJ, Konan AN, Yao-Bathaix MF, N'gbesso RD, et al
. The diagnostic value of indirect ultrasound signs during acute adult appendicitis. Diagn Interv Imaging 2012;93:e24-8.
Department of Diagnostic and Therapeutic Radiology, Faculty of Medicine Ramathibodi Hospital, Mahidol University, 270 Rama VI Road, Ratchathewi, Bangkok 10400
Source of Support: None, Conflict of Interest: None
[Table 1], [Table 2], [Table 3]
| Article Access Statistics|
| Viewed||460 |
| PDF Downloaded||18 |