Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Rates of discontinuation and non-publication of upper and lower extremity fracture clinical trials

Journal of Orthopaedic Surgery and Research volume 18, Article number: 256 (2023) Cite this article

Abstract

Purpose

To our knowledge, no study has quantified the rate of discontinuation and nonpublication of randomized controlled trials (RCTs) regarding upper and lower extremity fractures.

Methods

We searched ClinicalTrials.gov on September 9th, 2020, for phase 3 and 4 RCTs pertaining to upper and lower extremity fractures. Trial completion status was determined using records available on ClinicalTrials.gov. Publication status was determined using records on ClinicalTrials.gov and by searching PubMed (MEDLINE), Embase, and Google Scholar. We queried corresponding authors on trial status if a peer-reviewed publication was not identified.

Results

Our final analysis included 142 RCTs, of which 57 (40.1%) were discontinued and 71 (50%) were unpublished. Thirty-six (of 57, 63.2%) discontinued trials failed to provide a reason for discontinuation, the most commonly identified reason for discontinuation was due to inadequate recruitment (13/21, 61.9%). Completed trials were more likely to reach publication (59/85; 69.4%; X2 = 32.92; P ≤ 0.001) than discontinued trials. Trials with more than 80 participants were less likely not to reach publication (AOR: 0.12; 95% CI 0.15–0.66).

Conclusion

Our analysis of 142 upper and lower extremity fracture RCTs demonstrated one-half failed to reach publication and two-fifths were discontinued prior to trial completion. These findings indicate the need for increased guidance in developing, completing, and publishing RCTs in upper and lower extremity fractures. Discontinuation and nonpublication of orthopaedic RCTs hinder the public’s access to collected data and negate the valued contribution from study participants. Discontinuation and non-publication of clinical trials may subject participants to potentially harmful interventions, limit the advancement of clinical research, and contribute to research waste.

Level of Evidence: III.

Introduction

In the USA, the annual incidence of age-related fractures is expected to surpass 3 million fractures per year by 2025 [1]. More specifically, the incidence of upper and lower extremity fractures is estimated to occur at a rate of 67 and 70 per 100,000 people per year, respectively [2, 3]. By the year 2040 the projected cost for fracture care is expected to exceed $90 billion [4]. Given the high prevalence and significant medical expenses required to manage upper and lower extremity fractures, it is essential that health policy and clinical decision-making is guided by robust and reliable evidence.

Atop the evidence-based hierarchy are randomized controlled trials (RCTs), which are often regarded as Level-I evidence by some orthopaedic surgery journals [5]. Results from these studies are used to establish clinical recommendations, thereby directly influencing patient care. For example, the American Academy of Orthopedic Surgeons (AAOS) cites the results of an RCT as supporting evidence for a strong-grade (Level A) recommendation for the use of a multimodal pain regime to minimize narcotic associated delirium in patients following bipolar hemiarthroplasty for hip fractures [6, 7]. Considering the implications these studies have on clinical practice, it is critical that all results––regardless of nature or statistical significance––are readily accessible for both patients and clinicians, alike. However, previous research suggests that upwards of 85% of biomedical research is wasted––accounting for more than US $170 billion spent on potentially wasted research [8]. The exact etiology behind this burden of wasted research is likely multifactorial; however, two contributing factors are studies that fail to reach publication or studies that are erroneously discontinued.

Failing to publish research outcomes is not uncommon with current estimates suggesting up to one-half of RCTs never reach publication [9]. Failing to publish these outcomes may hinder scientific advancement. Publication bias––defined as the increased likelihood of a study with statistically significant results reaching publication––is a well-documented source of bias within medical research [10, 11]. Some contend that nonpublication of research findings jeopardizes the reliability and trust in scientific research [12, 13]. Others claim that nonpublication may result in weaker evidence and hinder any true association between a particular intervention and positive outcomes [13]. Similar to nonpublication, trial discontinuation is another mechanism by which resources are wasted.

Trial discontinuation may result from necessary circumstances, including patient safety, poor trial efficacy, or the feasibility of completion. However, many documented reasons for trial discontinuation may be preventable [14, 15]. According to the Declaration of Helsinki, trial discontinuation for personal or financial purposes is unethical, contributes to research waste, and may threaten the safety of research participants [16, 17]. From a global perspective, trial discontinuation for any reason may jeopardize patient–physician relationships in terms of missing out on accessing valuable research that may benefit treatment” [15]. As a similar study has already been conducted in otolaryngology [18], it has shown the importance of such an analysis in uncovering biases, improving the transparency and reliability of the evidence base, and ultimately advancing the field. Conducting this study in the field of upper and lower extremity fractures will allow us to contextualize our findings among existing literature and identify unique challenges faced in this field. Moreover, this study will call attention to areas for improvement in the clinical trial process, including increased transparency and ethical considerations, and provide recommendations for future trials in this field. By conducting this study, we can work towards a clinical trial system that is fair, reliable, and transparent, ultimately improving patient outcomes. Therefore, to investigate the reasons for trial discontinuation and nonpublication within orthopaedic surgery, our primary objectives are to: (1) determine the rate of trial discontinuation and nonpublication of trial results among upper and lower extremity fracture RCTs; and (2) identify factors associated with trial discontinuation and nonpublication.

Materials and methods

Objective and outcome measures

This investigation employed a cross-sectional study design. We assessed the rate of discontinuation and nonpublication of phase 3 or 4 clinical trials involving human subject participants who had an upper or lower extremity fracture. Data were collected using ClinicalTrials.gov and published trial reports. Human participant data were not used during this investigation; thus, institutional review board oversight was not required per 45 CFR 46.102(d) and (f) of the US Department of Health and Human Services' Code of Federal Regulations [19].

Identifying eligible orthopaedic clinical trials

We performed a systematic search of registered clinical trials using ClinicalTrials.gov––an online clinical trial repository managed by the United States National Library of Medicine. The decision to use this registry was based on the fact that U.S. clinical trialists are required to: (1) prospectively register their trial on this platform prior to study commencement; and (2) provide regular updates throughout the course of the trial. Each trial is assigned a unique national clinical trial (NCT) number. Data available on each registry includes recruitment status, intervention type, participants, funding, and other relevant data related to the trial. We used the advanced search function on ClinicalTrials.gov using the search terms provided in Additional file 1. ClinicalTrials.gov captures a wide range of potentially relevant articles through use of an automated term mapping system by searching additional, related terms. This search was performed on September 9, 2020.

Study inclusion and exclusion criteria

We searched for trials that were completed or discontinued by only including trials with the following designations: completed, suspended, terminated, withdrawn, or unknown status. All trials with the completed status were categorized to the “completed” group, and trials with the status terminated, withdrawn, unknown, or suspended were categorized to the “discontinued” group. Trials with the status of active, not recruiting, or enrolling by invitation were excluded. One of us (JMA) screened search results by registered title, condition, study design, and date of completion. Studies were excluded if they were not relevant to upper or lower extremity fractures, were not a Phase 3 or 4 trial, or if the trial was completed after September 9, 2017. We included only Phase 3 and 4 trials because they assess long-term outcomes in diverse human subject participants, with the intent of publication. Studies with multiple phases listed on the ClinicalTrials.gov database were treated as the most advanced phase listed (for example, Phase 2/3 trials were considered phase 3). Additionally, phase 3 or 4 trials are of the highest levels of evidence which likely affects clinical decision making [20,21,22]. Early phase trials (0–2) are designed for effective dosing, sample size calculations, and intervention safety and are not commonly intended for translation to clinical care [23, 24]. Furthermore, phase 0 and 1 trials are not required to be registered with the CliniclaTrials.gov database [25]. Therefore phase 0, 1, and 2 trials were excluded from our sample and in congruence with previously published methodology [11, 26,27,28]. The exclusion date of September 9, 2017 was chosen to allow trialists 36 months from the date of study completion for publication, as done in previous studies [18, 29]. The study completion date is when the last participant in a clinical study was examined or received an intervention/treatment to collect final data for the primary outcome measures, secondary outcome measures, and adverse events [30]. To include the largest possible number of RCTs, no limitation was used for patient age or demographics.

Locating publications of completed trials

To determine the publication status of each included RCT, two investigators (SS, BH) searched for publication information or direct link to the publication on ClinicalTrials.gov. A clinical trial that linked a publication that did not directly report on the results of the trials was not considered a published trial. We only considered a trial as “published” if the trial results were available in the form of a complete manuscript in a peer-reviewed journal. If no publication information was found on ClinicalTrials.gov, two of us (SS, BH) searched MEDLINE via PubMed, Embase, and Google Scholar by trial title, authors, and/or NCT numbers using the same approach. This search algorithm was developed and pilot-tested a priori from a sample of trials in a different field. Our definition of published and our search strategy to locate publications were both adapted from previous studies [18, 31].

Contacting central contacts

Per ClinicalTrials.gov any questions or inquiries about a specific study should be addressed to the research staff member listed in the trials “Contacts and Study Location” section of the study record. [30, 32] When clinical trials are in the recruiting phase the listed contact is referred to on ClinicalTrial.gov as the “Central Contact” under the contacts and study location tab [30]. We attempted to reach a trial’s central contact for one of the following reasons: (1) if a trial was determined to have not been completed yet failed to provide a reason on ClinicalTrials.gov; and (2) if we were unable to identify a publication using the aforementioned search strategy. To locate the central contacts' email address, we searched ClinicalTrials.gov, institutional websites, Google, and PubMed publications for the central contact. After emails were located, we used a standardized email with several prespecified responses addressing the reason(s) for either discontinuation or nonpublication. Responses to our standardized email were based on a systematic review by Song et al. [33]. We repeated this email strategy once per week for 3 consecutive weeks. If no response was received in 8 weeks, or if the email was returned as inactive, we considered the author as unreachable. This method of email contact has been successfully used in previous studies [18, 29]. Trials were considered to be unpublished if both the search and email strategies failed to reveal evidence of publication.

Statistical analysis

Descriptive statistics—frequency, percentages, and median (interquartile range, IQR)—for extracted variables were reported. To evaluate the effects of trial characteristic variables on discontinuation and publication status, adjusted odds ratios (AOR) were calculated via multivariable logistic regression. We preselected variables for adjustment of these logistic regression models a priori. Alpha was set at 0.05 for all analyses, which were conducted using STATA 16.1 (College Station, Texas, USA).

Results

Study characteristics

Our search of ClinicalTrials.gov resulted in 951 potentially eligible RCTs, of which 142 met the final inclusion criteria (Fig. 1). Seventy-nine (of 142; 55.6%) of the RCTs were classified as phase 4 trials, 52 (of 142; 36.6%) trials were phase 3, and 11 (of 142; 7.7%) were combined phase 2 and 3 trials. All of the trials in our sample were interventional studies, the majority of which investigated pharmaceutical interventions (83/142; 58.5%). The majority of RCTs received hospital (73/142; 51.4%) or industry (30/142; 21.1%) support. The median number of participants enrolled was 81 (IQR = 126) (Table 1). We found that only 29 (of 142; 20.4%) trials in our sample had results linked to ClinicalTrials.gov. The dates of trial registration ranged from September 9th, 1997, to October 31st, 2016.

Fig. 1
figure 1

Flow chart for study inclusion and exclusion

Full size image
Table 1 Characteristics of completed versus discontinued trials and published versus unpublished trials (n = 142)
Full size table

Discontinued trials

Of the 142 RCTs, 85 (59.9%) were completed and 57 (40.1%) were discontinued. Of the 57 discontinued trials, 24 (42.1%) were terminated, 24 (42.1%) had an “unknown” status, 8 (14.0%) were withdrawn, and 1 (1.8%) was suspended. The registration years for discontinued trials ranged from 1997 to 2016 with no specific year having a markedly higher percentage of discontinued trials. Prior to email 36 RCTs (of 57; 63.2%) did not provide reasons for trial discontinuation on ClinicalTrials.gov. We contacted all 36 primary investigators yet received no reply (Fig. 2). The most common reasons identified for discontinuation on ClinicalTrials.gov included inadequate sample size or recruitment problems (13/21; 61.9%), poor study quality or design (3/21; 14.3%), intervention no longer in production (2/21; 9.5%) withdrawn funding or support from trial sponsor (1/21; 4.8%), adverse events or concerns for patient safety (1/21; 4.8%), and primary investigator left (1/21; 4.8%). Trials with more than 80 participants were less likely to be discontinued (AOR: 0.42; 95% CI 0.2–0.88) compared to trials with fewer than 80 participants (Table 2).

Fig. 2
figure 2

Flow chart for identifying reasons for trial discontinuation

Full size image
Table 2 Logistic regression of trial discontinuation and nonpublication
Full size table

Publication status

A total of 71 RCTs (of 142; 50.0%) were published in a peer-reviewed journal and 71 RCTs (of 142; 50.0%) were unpublished. Twelve of the 57 discontinued trials (21.1%) reached publication, whereas 59 of the 85 completed trials (69.4%) reached publication. The registration years for unpublished trials ranged from 2000 to 2016 with no specific year having a markedly higher percentage of unpublished trials. Of the 26 completed, yet unpublished, trials, we identified all 26 central contact’s email addresses. However, our effort to determine the status of these unpublished trials was unsuccessful as none of the central contacts replied to our email queries (Fig. 3). Completed trials were more likely to reach publication (59/85; 69.4%; X2 = 31.92; P ≤ 0.001) compared to discontinued trials (12/57; 20.1%). Trials with more than 80 participants were found to be less at risk of not reaching publication (AOR: 0.12; 95% CI 0.15–0.66) compared to trials with fewer than 80 participants (Table 2).

Fig. 3
figure 3

Flow chart for identifying reasons for nonpublication in completed trials

Full size image

Discussion

Of the 142 upper and lower extremity fracture RCTs included in our analysis, approximately one-half failed to reach publication and two-fifths were discontinued prior to trial completion. Of the discontinued RCTs, over 90% did not provide access to trial results. Similarly, the majority of discontinued trials did not provide a reason for discontinuation on ClinicalTrials.gov. When provided, loss of funding and inadequate recruitment represented the most common reasons for trial discontinuation. Lastly, discontinued trials were less likely to reach publication compared to completed trials. Here, we expand on our findings, compare our findings within the broader context of the existing literature on trial discontinuation and nonpublication, and provide recommendations to address these barriers to help increase the transparency and accessibility of trial data in orthopaedic surgery.

Our results––that 40.1% of trials were discontinued––suggest the rates of discontinuation among upper and lower extremity fracture RCTs is high. Among discontinued trials, over one-third failed to provide a reason for discontinuation on ClinicalTrials.gov. The rate of trial discontinuation––and the rate by which trialists provide a justification for discontinuation––is variable across medical specialties. For example, Johnson et al. [18] reported 29.2% of head and neck cancer clinical trials were discontinued, with 50% of trials failing to provide a reason for discontinuation on ClinicalTrials.gov. In contrast, a 2018 analysis of trials related to osteoarthritis found reasons for discontinuation for 97% of discontinued RCTs [29]. While discontinuation may be problematic in some circumstances, it can be necessary in others [34]. For example, trials may be appropriately discontinued when new evidence supports trial futility, when the benefit of the treatment is superior, and when the risks outweigh the benefits [35]. Randomized controlled trials are also discontinued for preventable reasons [34]. One trial in our sample listed an “adverse event” as the primary reason for discontinuation, however, other trials listed potentially preventable reasons such as inadequate study design, poor recruitment, and lack of funding support [26, 36,37,38,39]. Addressing these reasons for discontinuation may help to reduce medical research waste and improve the likelihood of trials reaching publication [40].

We found that completed trials were more likely to reach publication compared to discontinued trials––a finding that is consistent with previous investigations [18, 29]. Publication of trials through a peer-review process has traditionally served as the primary means for disseminating results to the scientific community [9]. However, one-half of the included trials from our sample remain unpublished, thereby hindering the public’s access to these trials’ results. This lack of readily accessible data is compounded by the fact that only one-fifth of included trials provided access to trial results on ClinicalTrials.gov. Failure to provide access to unpublished trial results on a public repository precludes investigators and clinicians from synthesizing these results when attempting to answer clinical questions. In fact, previous researchers have noted that published trials often report larger effect estimates favoring the investigational product compared to unpublished trials [41,42,43]. Others have reported the exclusion of unpublished trial results from systematic reviews and meta-analyses may lead to an increased likelihood of reporting favorable results, as well as larger overall, yet less precise, effect estimates [41,42,43]. Taken together, these findings highlight the importance that results from clinical trials have on the research community, regardless of the nature of the findings themselves. Therefore, we contend that clinical trialists, at a minimum, should strongly consider updating the trial’s registry with the most up-to-date and accurate results both during the course of and upon completion or discontinuation of the trial. Doing so will help increase the transparency and validity of ongoing and future research within the field of orthopaedic surgery.

Efforts to mitigate trial discontinuation and nonpublication may serve to increase the accessibility of trial results, regardless of the significance of trial outcomes. Because a large portion of trials within our sample were discontinued for reasons related to trial recruitment and participant retention, we contend that clinical trialists should first direct their attention to developing safeguards against trial discontinuation for seemingly preventable reasons. More specifically, we suggest trialists provide evidence of tested and robust methodology––including how adequate target sample sizes will be obtained, acceptable recruitment periods, and participating site locations. In a 2021 study published in BMJ Open, Axen and colleagues highlight common challenges researchers face during the recruitment of study participants––including the relevance of the research question towards potential study subjects, sufficient communication between parties regarding the nature of the study and reassurance of anonymity, time constraints, and trust in the research team [44]. To help address these common challenges, Axen et al. [44] provide a stepwise checklist to help ensure adequate recruitment in pragmatic intervention studies. Implementation of a similar checklist as part of an a priori protocol might help identify gaps in recruitment efforts prior to initiation of the trial, thereby allowing corrections to be made with ample time such that the integrity of the study is not jeopardized. In the event a trial is discontinued, trialists should be required to publish trial results on ClinicalTrials.gov in an appropriate amount of time after trial completion or discontinuation. Currently, the U.S. Food and Drug Administration are making efforts to increase the rate of data sharing on the ClinicalTrials.gov platform by notifying trial sponsors when they are overdue on posting their trial results [45]. Similar efforts from other influential stakeholders in the research community may be a step in the right direction towards decreasing the large proportion of unavailable evidence from orthopaedic clinical trials. Lastly, we encourage orthopaedic journals to follow the lead of journals across other medical specialties by dedicating a section of their journals for null or negative trial results [46, 47]. For example, the American Heart Association journals have developed an online “Null Hypothesis Section” which seeks to promote access to negative, inconclusive, or confirmatory research [48]. A similar initiative in orthopaedic journals would be a major step towards promoting transparency of ongoing research within the field.

Although we attempted to retrieve a maximum of registered trials regarding upper and lower extremity fractures, it is possible some were omitted from our search. Moreover, our sample only included phase 3 and 4 trials and therefore may not be generalizable to other clinical trial phases. It should also be noted that the low response rate to our email queries for unpublished trials could be due to factors such as a change of institution (and therefore the trials central contact email address) without an appropriate update to records on ClinicalTrials.gov [18, 26, 29]. Lastly, our study focused on upper and lower extremity fractures and may not be generalizable to the breadth of orthopaedic literature.

Conclusion

Rates of discontinuation and nonpublication among upper and lower extremity fracture RCT are high. Discontinuation and nonpublication of clinical trials may subject participants to potentially harmful interventions, limit the advancement of clinical research, and contribute to research waste. On the other hand, some clinical trials are discontinued or not published when the evidence is deemed to be futile, the benefit of the treatment is superior, or when the risk outweighs the benefit. Efforts to mitigate these inconsistent research practices are warranted to improve clinical trials within the field of orthopaedic surgery.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A. Incidence and economic burden of osteoporosis-related fractures in the United States, 2005–2025. J Bone Miner Res. 2007;22:465–75.

    Article  PubMed  Google Scholar 

  2. Karl JW, Olson PR, Rosenwasser MP. The epidemiology of upper extremity fractures in the United States, 2009. J Orthop Trauma. 2015;29:e242–4.

    Article  PubMed  Google Scholar 

  3. Lambers K, Ootes D, Ring D. Incidence of patients with lower extremity injuries presenting to US emergency departments by anatomic region, disease category, and age. Clin Orthop Relat Res. 2012;470:284–90.

    Article  PubMed  Google Scholar 

  4. Lewiecki EM, Ortendahl JD, Vanderpuye-Orgle J, Grauer A, Arellano J, Lemay J, Harmon AL, Broder MS, Singer AJ. Healthcare policy changes in osteoporosis can improve outcomes and reduce costs in the United States. JBMR Plus. 2019;3: e10192.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wright JG, Swiontkowski MF, Heckman JD. Introducing levels of evidence to the journal. J Bone Joint Surg Am. 2003;85:1–3.

    Article  PubMed  Google Scholar 

  6. Kang H, Ha Y-C, Kim J-Y, Woo Y-C, Lee J-S, Jang E-C. Effectiveness of multimodal pain management after bipolar hemiarthroplasty for hip fracture: a randomized, controlled study. J Bone Joint Surg Am. 2013;95:291–6.

    Article  PubMed  Google Scholar 

  7. Roberts KC, Brox WT. AAOS clinical practice guideline: management of hip fractures in the elderly. J Am Acad Orthop Surg. 2015;23:138–40.

    Article  PubMed  Google Scholar 

  8. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Obstet Gynecol. 2009;114:1341–5.

    Article  PubMed  Google Scholar 

  9. Chan A-W, Song F, Vickers A, Jefferson T, Dickersin K, Gøtzsche PC, Krumholz HM, Ghersi D, van der Worp HB. Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014;383:257–66.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Kaper NM, Swart KMA, Grolman W, Van Der Heijden GJMG. Quality of reporting and risk of bias in therapeutic otolaryngology publications. J Laryngol Otol. 2018;132:22–8.

    Article  CAS  PubMed  Google Scholar 

  11. Scott J, Checketts JX, Cooper CM, Boose M, Wayant C, Vassar M. An evaluation of publication bias in high-impact orthopaedic literature. JB JS Open Access. 2019;4: e0055.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Onishi A, Furukawa TA. Publication bias is underreported in systematic reviews published in high-impact-factor journals: metaepidemiologic study. J Clin Epidemiol. 2014;67:1320–6.

    Article  PubMed  Google Scholar 

  13. Murad MH, Chu H, Lin L, Wang Z. The effect of publication bias magnitude and direction on the certainty in evidence. BMJ Evid Based Med. 2018;23:84–6.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9:672–7.

    Article  PubMed  Google Scholar 

  15. Lievre M. Premature discontinuation of clinical trial for reasons not related to efficacy, safety, or feasibility commentary: early discontinuation violates Helsinki principles. BMJ. 2001;322:603–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. World Medical Association. World Medical Association declaration of Helsinki. Ethical principles for medical research involving human subjects. Bull World Health Organ. 2001;79:373–4.

    PubMed Central  Google Scholar 

  17. Psaty BM, Rennie D. Stopping medical research to save money: a broken pact with researchers and patients. JAMA. 2003;289:2128–31.

    Article  PubMed  Google Scholar 

  18. Johnson AL, Fladie I, Anderson JM, Lewis DM, Mons BR, Vassar M. Rates of discontinuation and nonpublication of head and neck cancer randomized clinical trials. JAMA Otolaryngol Head Neck Surg. 2020;146:176–82.

    Article  PubMed  Google Scholar 

  19. Electronic Code of Federal Regulations-US Department of Health and Human Services’ Code of Federal Regulation 45 CFR 46.102(d).

  20. Close Glossary of Common Site Terms—ClinicalTrials.gov. https://clinicaltrials.gov/ct2/about-studies/glossary. Accessed 18 Mar 2019.

  21. Atkins D, Best D, Briss PA, GRADE Working Group, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328:1490.

    Article  PubMed  Google Scholar 

  22. Huang YQ, Traore K, Ibrahim B, Sewitch MJ, Nguyen LHP. Reporting quality of randomized controlled trials in otolaryngology: review of adherence to the CONSORT statement. J Otolaryngol Head Neck Surg. 2018;47:34.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Decullier E, Chan A-W, Chapuis F. Inadequate dissemination of phase I trials: a retrospective cohort study. PLoS Med. 2009;6: e1000034.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Van Spall HGC, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA. 2007;297:1233–40.

    Article  PubMed  Google Scholar 

  25. FDAAA 801 and the Final Rule. https://clinicaltrials.gov/ct2/manage-recs/fdaaa. Accessed 27 Feb 2023.

  26. Chapman SJ, Shelton B, Mahmood H, Fitzgerald JE, Harrison EM, Bhangu A. Discontinuation and non-publication of surgical randomised controlled trials: observational study. BMJ. 2014;349:g6870–g6870.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Roddick AJ, Chan FTS, Stefaniak JD, Zheng SL. Discontinuation and non-publication of clinical trials in cardiovascular medicine. Int J Cardiol. 2017;244:309–15.

    Article  PubMed  Google Scholar 

  28. Strzebonska K, Wasylewski MT, Zaborowska L, Riedel N, Wieschowski S, Strech D, Waligora M. Results dissemination of registered clinical trials across Polish academic institutions: a cross-sectional analysis. BMJ Open. 2020;10: e034666.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Scott J, Cooper CM, Checketts JX, Cutler J, Boose M, Morris J, Vassar M. An observational analysis of discontinuation and non-publication of osteoarthritis trials. Osteoarthr Cartil. 2018;26:1162–9.

    Article  CAS  Google Scholar 

  30. Common Site Terms. https://clinicaltrials.gov/ct2/about-studies/glossary. Accessed 27 Feb 2023.

  31. Chapman SJ, Shelton B, Mahmood H, Fitzgerald JE, Harrison EM, Bhangu A. Discontinuation and non-publication of surgical randomised controlled trials: observational study. BMJ. 2014;349: g6870.

    Article  PubMed  PubMed Central  Google Scholar 

  32. For Researchers. https://clinicaltrials.gov/ct2/help/for-researcher. Accessed 27 Feb 2023.

  33. Song F, Hooper L, Loke Y. Publication bias: what is it? How do we measure it? How do we avoid it? Open Access J Clin Trials. 2013;2013:71–81.

    Article  Google Scholar 

  34. Briel M, Olu KK, von Elm E, Kasenda B, Alturki R, Agarwal A, Bhatnagar N, Schandelmaier S. A systematic review of discontinued trials suggested that most reasons for recruitment failure were preventable. J Clin Epidemiol. 2016;80:8–15.

    Article  PubMed  Google Scholar 

  35. Deichmann RE, Krousel-Wood M, Breault J. Bioethics in practice: considerations for stopping a clinical trial early. Ochsner J. 2016;16:197–8.

    PubMed  PubMed Central  Google Scholar 

  36. Kasenda B, von Elm E, You J, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311:1045–51.

    Article  CAS  PubMed  Google Scholar 

  37. Carlisle B, Kimmelman J, Ramsay T, MacKinnon N. Unsuccessful trial accrual and human subjects protections: an empirical analysis of recently closed trials. Clin Trials. 2015;12:77–83.

    Article  PubMed  Google Scholar 

  38. Bernardez-Pereira S, Lopes RD, Carrion MJM, et al. Prevalence, characteristics, and predictors of early termination of cardiovascular clinical trials due to low recruitment: insights from the ClinicalTrials.gov registry. Am Heart J. 2014;168:213-9.e1.

    Article  PubMed  Google Scholar 

  39. Khan MS, Shahid I, Asad N, et al. Discontinuation and non-publication of heart failure randomized controlled trials: a call to publish all trial results. ESC Heart Fail. 2021;8:16–25.

    Article  PubMed  Google Scholar 

  40. Rosenthal R, Kasenda B, Dell-Kuster S, et al. Completion and publication rates of randomized controlled trials in surgery: an empirical study. Ann Surg. 2015;262:68–73.

    Article  PubMed  Google Scholar 

  41. Conn VS, Valentine JC, Cooper HM, Rantz MJ. Grey literature in meta-analyses. Nurs Res. 2003;52:256–61.

    Article  PubMed  Google Scholar 

  42. Hopewell S, McDonald S, Clarke MJ, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007;2:MR000010.

    Google Scholar 

  43. McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? Lancet. 2000;356:1228–31.

    Article  CAS  PubMed  Google Scholar 

  44. Axén I, Björk Brämberg E, Galaasen Bakken A, Kwak L. Recruiting in intervention studies: challenges and solutions. BMJ Open. 2021;11: e044702.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Piller C. In a first. FDA cites violation of clinical trials reporting law: Science; 2021. https://doi.org/10.1126/science.abj2323.

    Book  Google Scholar 

  46. Evangelou E, Siontis KC, Pfeiffer T, Ioannidis JPA. Perceived information gain from randomized trials correlates with publication in high-impact factor journals. J Clin Epidemiol. 2012;65:1274–81.

    Article  PubMed  Google Scholar 

  47. Dirnagl U, Lauritzen M. fighting publication bias: introducing the negative results section. J Cereb Blood Flow Metab. 2010;30:1263–4.

    Article  PubMed  Google Scholar 

  48. Nallamothu BK, Schultz J, Petty S. True negatives. Circ Cardiovasc Qual Outcomes. 2020;13: e007448.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Oklahoma State University Center for Health Sciences, 1111 W 17Th St, Tulsa, OK, 74107, USA

    Samuel Shepard, Benjamin Heigle, Micah Hartwell & Matt Vassar

  2. Department of Orthopedic Surgery, Oklahoma State University Medical Center, 744 West 9Th St, Tulsa, OK, USA

    J. Michael Anderson, Jay C. Thompson & Byron Detweiler

  3. Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, 1111 W 17Th St, Tulsa, OK, 74107, USA

    Micah Hartwell & Matt Vassar

Authors
  1. Samuel Shepard
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J. Michael Anderson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Benjamin Heigle
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jay C. Thompson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Byron Detweiler
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Micah Hartwell
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Matt Vassar
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JMA, JT, BD, and MV conceived the study design. SS, JMA, BH, JT, BD, MH, and MV supervised the data collection and literature review. SS, JMA, and MH analyzed the data. SS, JMA, BH, JT, BD, and MH drafted the manuscript and revised it. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Samuel Shepard.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

MH receives research support through the US Department of Justice. MV reports grant funding from the National Institutes of Health, the U.S. Office of Research Integrity, and Oklahoma Center for the Advancement of Science and Technology, all outside the present work. All other authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Clinical Trials.gov search criteria

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shepard, S., Anderson, J.M., Heigle, B. et al. Rates of discontinuation and non-publication of upper and lower extremity fracture clinical trials. J Orthop Surg Res 18, 256 (2023). https://doi.org/10.1186/s13018-023-03698-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13018-023-03698-5

Keywords

Journal of Orthopaedic Surgery and Research

ISSN: 1749-799X