Is combining serum interleukin-6 and C-reactive protein a reliable diagnostic tool in periprosthetic joint infections?

Abstract

Background

Because there is no single gold standard method for the diagnosis of periprosthetic joint infection (PJI), the combination of valuable methods to evaluate infection appears to achieve a better diagnostic result. The objective of the present study was to evaluate the diagnostic value of serum interleukin (IL)-6 and C-reactive protein (CRP) for the diagnosis of PJI.

Methods

PubMed, Embase, and the Web of Science databases were searched for articles describing PJI diagnosis using serum IL-6 and CRP published between January 1990 and December 2019.

Results

Eight studies were included in the meta-analysis. The pooled sensitivity was 0.84 (95% confidence interval [CI], 0.80−0.88) for the combined method (serum IL-6 and CRP) in series and parallel approaches, 0.87 (95% CI, 0.82−0.90) for IL-6, and 0.84 (95% CI, 0.79−0.88) for CRP. The pooled specificity was 0.85 (95% CI, 0.82−0.88) for the combined method, 0.83 (95% CI, 0.79−0.87) for IL-6, and 0.83 (95% CI, 0.79−0.87) for CRP. The combined method had the highest value for the area under the curve (0.9453), followed by IL-6 (0.9237) and CRP (0.9074). Subgroup analyses showed that the sensitivity of the combined method in parallel tests was higher than that in IL-6 or CRP (94% vs. 89% and 84%, respectively). Serial testing of the combined method showed increased specificity compared to a single indicator (96% vs. 83% and 80%).

Conclusion

The combination of serum IL-6 and CRP was a reliable tool for the diagnosis of periprosthetic hip and knee infection, demonstrating a better diagnostic accuracy than single marker analysis.

Background

Although a variety of serum, synovial fluid, periprosthetic tissue, and sonication fluid tests are currently performed for the diagnosis of periprosthetic joint infection (PJI), there is no single indicator that can detect infection with 100% accuracy [1]. Combined tests appear to further improve the diagnostic value, although which combined test is more suitable for diagnosis remained unclear [2, 3].

Previous studies have indicated that serum interleukin-6 (IL-6) appears to be a promising tool for the diagnosis of PJI [4, 5]. A meta-analysis of 11 studies reported that the pooled sensitivity and specificity of serum IL-6 were 0.72 (95% confidence interval [CI], 0.63−0.80) and 0.89 (95% CI, 0.77−0.95), respectively [6]. The combined diagnostic method of serum IL-6 and C-reactive protein (CRP) has been used during recent years, and the International Consensus Meeting (ICM) on PJI also place emphasis on its use [7]. IL-6 and CRP have been demonstrated to provide an excellent combined screening test to identify PJI [4, 8]. However, due to the series or parallel tests used in various studies [9, 10], it remains unknown whether these assays are of diagnostic value compared to single parameter analysis for the diagnosis of PJI. Therefore, the objective of the present meta-analysis was to compare the diagnostic performance of IL-6 and CRP with single use parameter detection for the diagnosis of PJI.

Materials and methods

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement was used to guide our methods for the present research [11].

Search strategy

A search of the PubMed, Embase, and Web of Science databases was performed for studies that assessed the diagnostic value of the combination of IL-6 and CRP for the diagnosis of PJI between January 1990 and December 2019. The following terms refer to the previous publication and search the following medical subject headings (MeSH) or keywords [12]: “arthroplasty or joint prosthesis or joint replacement or periprosthetic joint or prosthetic joint”, “infection or infectious or infected”, “interleukin-6 or IL-6”, and “C-reactive protein or CRP”. The reference lists of the included studies and relevant literature on the combination method of CRP and IL-6 were also manually searched to identify potential studies until no additional articles could be found. In addition, we reviewed the included studies from three relevant meta-analyses [6, 13, 14].

The included studies were selected according to the following criteria: (1) combined method of IL-6 and CRP for the diagnosis of PJI, which were performed in parallel or via serial testing. In parallel testing, a positive result for either IL-6 or CRP was considered positive. In series testing, a positive result in both IL-6 and CRP was defined as positive [15]; (2) the diagnosis standard of PJI was identified by ICM, Infectious Diseases Society of America (IDSA), Musculoskeletal Infection Society (MSIS), European Bone and Joint Infection Society (EBJIS) criteria, or the definition including clinical signs of infection, presence of sinus tract, purulence around the prosthesis, histopathological examination, or the result of synovial fluid, periprosthetic tissue samples, or positive sonication fluid [1, 16,17,18,19]; and (3) the number of true positive (TP), true negative (TN), false positive (FP), and false negative (FN) values reported or could be calculated by their corresponding sensitivity and specificity in each article [20].

Data extraction and study quality assessment

Data extraction was completed independently by two reviewers and subsequently rechecked by a third investigator. Data contained the first author, year of publication, country, enrollment period, study design, number of patients, total cases, infected cases, type of prosthetic joint and bacterium, cut-off, diagnostic criteria, potentially influencing elements, antibiotic use, and the sensitivity and specificity of serum IL-6 and CRP.

All identified studies were evaluated according to the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) guidelines by two authors [21]. Any disagreement in the evaluation of the studies was adjudicated by a third author.

Statistical analysis

For the analysis of the diagnostic value of serum IL-6 and CRP, all statistical analyses were executed using the Meta-Disc software (version 1.4, Unit of Clinical Biostatistics team, Madrid, Spain) [22]. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratio (DOR) were assessed. The I² statistic was calculated to evaluate the heterogeneity of the included articles, with a range of values from 0 to 100%. If heterogeneity existed between studies, the random effects model was used. Subsequently, subgroup analysis was used to estimate factor affecting the diagnostic accuracy of the combined method for PJI detection.

Results

Search results

A total of 111 articles were identified following the database search, excluding those excluded due to multiple indexing in different databases. After further review of the title, abstracts, and full articles, eight publications met the inclusion criteria and were included in the analysis (Fig. 1) [4, 8,9,10, 23,24,25,26].

Fig. 1

Flow diagram of the selection process for eligible studies

The eight included studies were conducted in seven countries between 2007 and 2019, with 692 total joint arthroplasties (645 patients) identified. Seven articles were written in English and one in Chinese. All studies used an appropriate prospective cohort study design. All studies were related to periprosthetic knee and/or hip infections (Table 1). Seven studies reported bacterial culture results, with staphylococcal infections the most common identified (Table 2). The QUADAS-2 tool was evaluated in all publications and showed that the included studies were of good quality (Fig. 2).

Table 1 Characteristics of the included studies for meta-analysis

Table 2 Bacterial species detected in the included studies

Fig. 2

Methodological quality assessment of the included studies

Diagnostic accuracy of the combined method

The pooled sensitivity, specificity, PLR, NLR, and DOR estimates for the detection of PJI using combined serum IL-6 and CRP were 0.84 (95% CI, 0.80−0.88), 0.85 (95% CI, 0.82−0.88), 5.98 (95% CI, 3.24−11.01), 0.17 (95% CI, 0.07−0.39), and 58.35 (95% CI, 18.04−188.79), respectively. The overall pooled sensitivity, specificity, PLR, NLR, and DOR of the IL-6 assay for PJI were 0.87 (95% CI, 0.82−0.90), 0.83 (95% CI, 0.79−0.87), 4.95 (95% CI, 3.19−7.68), 0.16 (95% CI, 0.07−0.38), and 36.27 (95% CI, 12.67−103.88), respectively, while those of serum CRP were 0.84 (95% CI, 0.79−0.88), 0.83 (95% CI, 0.79−0.87), 4.97 (95% CI, 3.03−8.17), 0.21 (95% CI, 0.12−0.36), and 27.24 (95% CI, 10.61−69.91), respectively (Fig. 3, 4, 5, 6, 7). The summary receiver operating characteristic (SROC) plot showed the sensitivity and specificity as well as the 95% confidence intervals and prediction regions, with an area under the curve (AUC) of 0.9453 for the combination of IL-6 and CRP as well as 0.9237 for IL-6 and 0.9074 for CRP (Fig. 8). Significant heterogeneity was found in the combined and single diagnostic tests. Therefore, a random-effects model was used.

Fig. 3

Forest plots of sensitivity for the combined method (A), IL-6 (B), and CRP (C)

Fig. 4

Forest plots of specificity for the combined method (A), IL-6 (B), and CRP (C)

Fig. 5

Forest plots of the positive likelihood ratio for the combined method (A), IL-6 (B), and CRP (C)

Fig. 6

Forest plots of the negative likelihood ratio for the combined method (A), IL-6 (B), and CRP (C)

Fig. 7

Forest plots of the diagnostic odds ratio for the combined method (A), IL-6 (B), and CRP (C)

Fig. 8

Summary of SROC for the combined method (A), IL-6 (B), and CRP (C)

Subgroup analysis

The subgroup results of serum IL-6, CRP, and the combined method are presented in Table 3. Parallel testing of the combined method showed higher sensitivity than IL-6 and CRP (94% vs. 89% and 84%, respectively), while the least specificity 74% vs. 79% and 85%, respectively. In series testing, the combined method demonstrated a lower level of sensitivity than IL-6 and CRP (66% vs. 86% and 77%, respectively), whereas the highest specificity was observed in the combined method with 96%. In the parallel and series tests, the AUC of the combined method was higher than that of single indicators.

Table 3 Subgroup analysis of parallel and series tests for PJI diagnosis

Discussion

The present study demonstrates that the combined method of serum IL-6 and CRP can be used for the diagnosis of periprosthetic hip and knee infection. The AUC of the combined method was higher than that of either IL-6 or CRP alone (0.9453 vs. 0.9237 and 0.9074, respectively).

Since there is no gold standard for the diagnosis of PJI, the question of how to accurately judge PJI or aseptic loosening has always been of concern to surgeons, microbiologists, and infectious disease specialists [27]. Traditionally, the combined or single use of the erythrocyte sedimentation rate (ESR) and CRP was most commonly performed in the diagnosis of PJI, which is also one of the criteria of the MSIS definition [17]. One meta-analysis of 12 studies of serum ESR and CRP for the diagnosis of periprosthetic hip infection showed that the sensitivity and specificity were 0.860 (95% CI, 0.825−0.890) and 0.723 (95% CI, 0.704−0.742) as well as 0.869 (95% CI, 0.83−0.899) and 0.786 (95% CI, 0.769−0.803), respectively [28]. However, the diagnostic value of ESR and CRP was not ideal, with a blood test marker for the diagnosis of PJI still required. Serum IL-6 appears to be a superior postoperative inflammatory indicator compared with ESR and CRP. In a patient without complications from hip or knee arthroplasty surgery, the IL-6 level reached its peak value more rapidly than CRP or ESR levels, also rapidly returning to normal [29, 30]. For the diagnosis of PJI, Di Cesare and colleagues found that serum IL-6 had a higher diagnostic accuracy compared with CRP and ESR in diagnosing infection following hip and knee replacement (97% and 83%, 69%, respectively) [5]. A prospective study by Abou et al. [4] also found similar results, namely, that serum IL-6 had better diagnostic accuracy than CRP and ESR (92.5% vs. 87.5% and 82.5%, respectively). Serum IL-6 shows great potential for the diagnosis of periprosthetic hip and knee infection, and IL-6 levels strongly correlated with ESR and CRP using the combined method [25]. The combined test of both parameters has been used recently in the diagnosis of PJI, and some reports have supported that the combination of IL-6 and CRP can improve its diagnostic accuracy [9, 23,24,25]. The parallel combined screening test could reduce false negative results, increasing the sensitivity and lowering the specificity. Conversely, using series testing could reduce false positives and achieve higher specificity and lower sensitivity [15]. In the present study, eight publications described the use of the combination of IL-6 and CRP in parallel or series tests. Of these, two presented both parallel and series tests and demonstrated a comparison between the combined method of CRP and ESR. Majors et al. [25] showed the sensitivity of IL-6 (> 9.14 pg/ml) and CRP (> 17 mg/l) in a parallel test and specificity in a serial test to be 93.8 and 85%, respectively, whereas the combined CRP and ESR (> 27 mm/h) showed lower sensitivity and specificity (80 and 81%, respectively). Li and colleague [26] reported that the sensitivity of IL-6 (> 6.90 pg/ml) and CRP (> 8.54 mg/l) in the parallel test was higher than that of CRP (> 8.54 mg/l) combined with ESR (> 22.5 mm/h; 100% vs. 86.4%), with a lower specificity to that of CRP and ESR in the serial test (93.1% vs. 96%). In the subgroup of the present study, results were divided into parallel and serial testing. The pooled sensitivity of the parallel test (94%) and the pooled specificity of the serial test (96%) in the combined method was higher than in CRP or IL-6 alone.

All studies included of our meta-analysis were associated with infection after hip or knee arthroplasty. However, the surgical site is likely the potential factor that could affect the diagnostic accuracy. Several reports found that the use of IL-6 or CRP were not suitable for diagnosing infection after shoulder arthroplasty, with the sensitivity of both tests less than 50%. The reason for the low diagnostic value is potentially due to the low virulence of the detected bacterium, such as Cutibacterium acnes (C. acnes), which commonly occurs in periprosthetic shoulder infections [31, 32]. Majors and colleagues [25] found that the sensitivity and specificity of IL-6 for C. acnes in PJI cases was 50 and 59.3%, respectively. Both the sensitivity and specificity were 66.7% for CRP. In coagulase-negative staphylococci infections, the sensitivity and specificity of IL-6 were 100 and 59.3%, respectively, whereas the sensitivity and specificity for CRP was 50 and 66.7%, respectively. The combined method of IL-6 and CRP may improve the diagnostic accuracy of low virulence bacteria. Buttaro et al. demonstrated that the specificity of IL-6 and CRP in serial tests were higher than that of IL-6 or CRP alone (100% vs. 94% and 91%, respectively), with approximately 73% of low virulence organisms presented in the study [22]. Ettinger and co-workers [9] reported a specificity of 98.2% and a sensitivity of 75% for low-grade joint infection. When IL-6 was greater than 5.12 pg/ml and CRP greater than 0.3 mg/dl in serial testing, the specificity of IL-6 or CRP was lower than that of the combined method (87.7% and 64% vs. 98.2%). The author concluded the CRP and IL-6 appears to be the most helpful combination for distinguishing between aseptic loosening and low-grade infection.

In the present study, the different cut-off levels for IL-6 and CRP demonstrated a range from 3 to 18 mg/l for CRP and 4.7 to 12 pg/ml for IL-6. There is no consensus on the use of a single cut-off value, which differ amongst the various studies. For the MSIS definition, the most commonly performed cut-off for CRP was 10 mg/l and 30 mm/h for ESR [17]. However, current thresholds for the diagnosis of PJI should be reconsidered. Bingham et al. [33] reported a sensitivity of CRP with a cut-off of 10 mg/l, which was lower than the 5 mg/l cut-off (85.1% vs. 95.1%). Compared with the threshold of 5 mg/l for CRP and 10 mm/h for ESR, the use of CRP and ESR screening cut-offs of 10 mg/l and 30 mm/h, respectively, would not detect nine PJI cases. The cut-off levels of serum IL-6 for the diagnosis of PJI are still debatable. Previous meta-analysis performed by Xie et al. reported that a serum IL-6 cut-off ≥ 10 pg/ml with greater sensitivity and specificity compared to the cut-off < 10 pg/ml (77% and 98% vs. 70% and 80%, respectively), if used a sensitivity and specificity that is greater or equal to 90% as the optimal cut-off from all our included studies. Only two studies meet the criteria in both the serum IL-6 and CRP groups [4, 8, 24], with an IL-6 cut-off of 6.6 or 10.4 pg/ml, and CRP cut-off of 3.2 or 8.83 mg/l potentially achieving a sensitivity and specificity of 90%. When considering studies with a sensitivity and specificity greater or equal to 90% for both IL-6 and CRP, the optimal cut-off is only presented by the study of Yildirim and colleagues [8]. The sensitivity and specificity of IL-6 with a cut-off of 6.6 pg/ml was 95 and 96%, respectively. For CRP, the sensitivity and specificity with a cut-off of 8.83 mg/l was 95 and 90%, respectively. The combined IL-6 and CRP showed a sensitivity of 99% and a specificity of 98%. The high sensitivity and specificity presented in both the individual or combined methods may also be related to the study excluding patients with inflammatory comorbidities, with none of the patients affected by antibiotic treatment. Whether the cut-offs of 6.6 pg/ml for IL-6 and 8.83 mg/l for CRP represent the most optimal cut-offs remains to be explored.

The present meta-analysis has some limitations. First, two of the included studies only had 11 cases of infection [4, 23], and the small sample size potentially affected overall results. Second, although the diagnostic standard was always used to identify cases of infection, the use of different diagnostic standards to estimate the value of diagnostic tools resulted in different sensitivity and specificity values [34]. Third, based on the current publication, two studies showed that the combined method may improve diagnostic results compared to single use in low virulence infections [9, 23]. Due to the relative lack of literature, further research is required to confirm this finding.

Conclusions

The present meta-analysis supported that the combined serological testing of IL-6 and CRP has a higher diagnostic value than individual testing for diagnosing of periprosthetic hip and knee infection. Further studies are required to confirm the current results.