Skip to main content

Advertisement

Translation and validation of a Hebrew version of the Western Ontario Shoulder Instability index

Article metrics

  • 215 Accesses

Abstract

Background

The Western Ontario Shoulder Instability index (WOSI) is a questionnaire designed to measure health-related quality of life in patients with shoulder instability. The aim of the current study was to translate the WOSI into Hebrew and assess its psychometric properties.

Methods

The WOSI was translated into Hebrew according to World Health Organization guidelines. Twenty-five patients completed the WOSI and the Disabilities of Arm, Shoulder, and Hand (DASH) questionnaire 2 weeks and 2 months after surgical shoulder stabilization. Internal consistency (Cronbach’s α), criterion validity (Pearson’s correlation coefficient with DASH), responsiveness, and floor and ceiling effects were assessed.

Results

Cronbach’s α was 0.88–0.95 for total WOSI (range 0.68–0.95 for different sections). Strong correlation with DASH score (r = 0.76–0.84) indicated good criterion validity. Changes between baseline and follow-up for WOSI and DASH scores were moderately correlated (r = 0.68), suggesting moderate responsiveness. Some items demonstrated floor and ceiling effects, especially at baseline, but no floor or ceiling effects were observed for total WOSI or for the WOSI sections.

Conclusions

The results of the current study demonstrate that the Hebrew version of the WOSI is a valid instrument that can be used to assess disability in patients with shoulder instability. Additional studies are warranted to assess its psychometric properties among various subpopulations.

Trial registration

The study was pre-registered at the ClinicalTrials.gov website, registration number NCT02978365.

Introduction

Anterior shoulder dislocations are the primary cause of shoulder instability (SI), a condition that refers to the inability to maintain the humeral head in the glenoid fossa [1]. The incidence of primary shoulder dislocation is 8.2 to 23.9 per 100,000 person-years, and its estimated prevalence is 1.7% [2, 3]. About two thirds of shoulder dislocations will evolve into SI within five years [4]. Recurrent dislocations are also common, affecting 59–96% of youth (< 20 years old) and 40–74% of adults (20–40 years old) after primary dislocation [5]. In patients with SI, the ability to participate in sports-related activities is often inhibited, resulting in decreased quality of life [4]. Due to high recurrence rates and unsatisfactory outcomes after non-operative rehabilitation [6, 7], more than 60% of patients choose surgical treatment [8].

Results of either conservative or surgical treatment should be evaluated objectively and subjectively. Objective evaluation includes measurement of range of motion and rotator cuff strength, provocative physical examination maneuvers, and rate of re-dislocations [9]. Subjective measures include questionnaires, referred to as patient-reported outcome measures (PROMs), that assess patient function and satisfaction [10]. A PROM commonly used to evaluate upper extremity function is the Disabilities of Arm, Shoulder, and Hand questionnaire (DASH) [11]. The DASH can detect and differentiate small and large changes in disability over time after surgery in patients with a variety of upper-extremity musculoskeletal disorders [12,13,14].

The Western Ontario Shoulder Instability index (WOSI) is a questionnaire designed to measure health-related quality of life in patients with SI [15]. This instrument consists of four subscales: (1) physical symptoms and pain; (2) sport, recreation, and work function; (3) lifestyle and social functioning; and (4) emotional well-being. The 21 items are scored using a visual analog scale, measuring 100 mm horizontally, placed under each question. The best possible score indicating the highest possible shoulder-related quality of life is 0, and 100 is the worst possible. It has been thoroughly evaluated for reliability, validity, and sensitivity for change, both pre- and post-operatively [12, 16,17,18]. The WOSI has been translated and culturally adapted into several languages [19,20,21,22,23].

Translation and validation of PROMs allow comparison of national and international study results [24, 25]. In addition, it allows patient evaluation using internationally accepted instruments. Recently, the Israeli Physical Therapy Society has encouraged clinicians and researchers to translate and validate PROMs into Hebrew, for clinical use. Therefore, the aim of this study was to translate and validate a Hebrew version of the WOSI (H-WOSI).

Methods

The translation process was conducted according to the World Health Organization (WHO) requirements for translation and cultural adaptation [26, 27] and included the following: (1) forward translation into Hebrew by a native Hebrew speaker, (2) an experts’ panel to identify and correct unclear expressions, (3) a back translation to English by a native English speaker, (4) pre-testing and interviewing five patients, and (5) accepting the final version. The Hebrew translation was done by a physical therapist that studied and worked in England for several years. The experts’ committee included three physical therapists that are very familiar with musculoskeletal injuries, as well as with research and outcome measures. The experts’ panel debated the precise words and expressions used to describe different types of pain (i.e., pain, aching, throbbing). Other changes were made to make the structure of the questions understandable for Hebrew speakers. The back translation was done by a native English speaker who does not have any medical training. The pre-testing and interview were completed with five patients who were an average of 5 (±2.8) weeks after surgical repair of SI and did not participate in further data analysis. These patients were asked to explain in their own words each item in the questionnaire, to assure comprehension. Several issues were raised by the participants and were discussed by the experts’ panel. After correcting these issues, the final version was obtained and is available as supplementary data.

Validation of the final version was conducted on 25 patients who participated in a larger study that has not been published yet. The study was approved by the IDF Medical Corps Helsinki Committee (approval number 1702-2016) and was registered at the ClinicalTrials.gov website (registration number NCT02978365). Written informed consent was obtained from all eligible patients who were recruited. Participants were male soldiers 18–30 years old who attended the military physical therapy clinic in Tzrifin from March 2017 to March 2018, after undergoing arthroscopic repair of SI.

Participants completed the H-WOSI and a Hebrew version of DASH (H-DASH) at 0–2 and 7–8 weeks post-surgery. The DASH was chosen as it was previously used to validate the WOSI in several languages [10, 15, 19, 21]. The cross-cultural adaptation of the H-DASH was previously performed by Ziv et. al and is available at the official DASH website [28]. It has been used in clinical and research settings [29].

Data analysis

Participants’ characteristics and outcome measures are presented using descriptive statistics. Continuous variables are described as mean, standard deviation (SD), 95% CI, and range. Categorical variables are displayed as number of participants and percentage for each category.

Internal consistency, which reflects the extent to which the questionnaire items are intercorrelated or whether they measure the same construct consistently, was measured by calculating Cronbach’s α for each section of the H-WOSI, separately. Consistency was concluded when Cronbach’s α reached a minimum value of 0.7 [30].

Criterion validity refers to the extent to which scores on a particular instrument relate to a gold standard. This measure was assessed by calculating Pearson’s correlation coefficient between the H-WOSI and the H-DASH at the two measurement intervals (baseline and follow-up). Criterion validity was defined when the correlation coefficient r > 0.7 [30].

Responsiveness is defined as the ability of a questionnaire to detect clinically important changes over time. To assess responsiveness of the H-WOSI, a correlation coefficient was calculated between the baseline and follow-up change in the H-WOSI, as compared to the change in H-DASH. Changes were calculated as percentage of baseline score. Standardized response mean (SRM) was also calculated for both measures.

Floor (worst possible) and ceiling (best possible) effects were defined as the bottommost and topmost scores for each item, respectively. A floor or a ceiling effect was concluded when > 15% of respondents achieved the lowest or highest possible score [30].

IBM Statistical Package for the Social Sciences (SPSS) v.23.0 was used for all analyses.

Results

Twenty-five patients were included in final analysis. Baseline characteristics of participants are described in Table 1. The results of each questionnaire are shown in Table 2.

Table 1 Baseline characteristics of participants
Table 2 Baseline and follow-up outcome measures and comparisons

Excellent internal consistency was found for the H-WOSI, both at baseline and at follow-up. No items were found to significantly increase consistency of the H-WOSI, if removed. Nevertheless, when assessing internal consistency of the separate sections, the lifestyle and emotional sections at baseline did not reach the minimum value of 0.7 (Cronbach’s α = 0.698 and 0.688, respectively). This information is described in Table 3.

Table 3 Internal consistency of the H-WOSI

The H-WOSI and H-DASH scores indicated a strong correlation both at baseline (r = 0.768, p < 0.001) and at follow-up (r = 0.849, p < 0.001).

The changes in H-WOSI and H-DASH from baseline to follow-up were moderately correlated (r = 0.689, p < 0.001), suggesting fair responsiveness. The SRM for both measures was large, with SRM = 1.29 for H-WOSI and SRM = 1.5 for H-DASH.

Only one subject reached the overall ceiling score at baseline, and one at follow-up. When evaluating subscales separately, ceiling effect was found at baseline for the sports, lifestyle, and emotional sections. Furthermore, 18/21 and 2/21 items demonstrated a ceiling and floor effect at baseline, respectively. At follow-up, ceiling effect was found in 6/21 items, and floor effect for 2/21 items (Table 4).

Table 4 Number of subjects (%) who displayed floor or ceiling effect in each subscale

Discussion

Translation and validation of measurement tools are important assets for local research and international collaborative study, as well as treatment optimization. The translation and validation of H-WOSI resulted in a valid instrument to measure shoulder-related quality of life in patients with SI.

Patients who underwent surgical shoulder stabilization participated in the current study. Disability immediately after surgery is temporary and is mainly caused by the surgery itself, rather than the condition that led to it. Two months after surgery, a considerable reduction in disability is expected, but not complete return to athletic activity. The WOSI was designed to assess outcomes in all patients with SI, including pre-operatively and post-operatively. The original version of the WOSI was validated on patients at 2 weeks and 3 months after shoulder stabilization, similarly to the current study [15].

Internal consistency of the H-WOSI was excellent at baseline (Cronbach’s α = 0.885) and at follow-up (Cronbach’s α = 0.952). Similar results were previously reported for several translations of the WOSI [10, 19, 22]. van der Linde et al. [10] reported Cronbach’s α = 0.96 for total WOSI score in 138 patients with SI. Similarly, Salomonsson et al. [22], who examined patients before and 6 months after surgery, reported Cronbach’s α = 0.89–0.95. While high internal consistency was evident in all subsections of the WOSI at follow-up, the lifestyle and emotional subscales at baseline demonstrated lower internal consistency. This finding is partly in agreement with a relatively low internal consistency in the lifestyle section reported by Salomonsson et al [22]. As suggested by van der Linde et al. [10], some sections of the WOSI may lack face validity. Although questions regarding fear of falling or sleeping difficulties are included in the lifestyle section, they represent emotional aspects or physical symptoms. Therefore, it was suggested that the subscales should be used with caution [10].

Criterion validity of the H-WOSI was evaluated by comparing it to the H-DASH score, as done in previous studies that translated and validated this instrument [10, 19, 21, 23]. The current findings demonstrate that the H-WOSI has excellent criterion validity immediately after surgery (r = 0.768) and at short-term follow-up (r = 0.849). These results are consistent with previous reports that showed strong correlations between WOSI and DASH scores. van der Linde et al. [10] evaluated the Dutch version of the WOSI and reported a correlation coefficient of r = 0.81 with DASH scores in 138 patients with SI. Similarly, Cacchio et al. [19] reported a correlation coefficient of r = 0.79 between the Italian version of the WOSI and DASH, in a population of 64 patients with SI. The strong, yet not perfect, relationship between the WOSI and DASH confirms that the WOSI is a valid tool to evaluate shoulder function. However, the finding that the correlation is not absolute emphasizes the differences between the two instruments. This may be attributed to the specific characteristics of the WOSI in evaluating subjects with SI. The DASH only evaluates functional tasks and symptoms, while the WOSI also includes items that assess emotions and lifestyle. Moreover, several items in the DASH are often not relevant to patients with SI, such as writing, opening a jar, or turning a key.

Although reliability was not directly assessed, the strength of the agreement between the H-WOSI and H-DASH on the same patients at two post-operative intervals can provide some indication regarding reliability. Furthermore, the changes in H-WOSI and H-DASH from baseline to follow-up were moderately correlated. This means that subjects who improved according to the H-DASH also improved according to H-WOSI, and that the H-WOSI was sensitive for detecting these changes. Therefore, it is suggested that the translated H-WOSI has acceptable levels of responsiveness.

Both floor and ceiling effects were identified for several items, with a very large ceiling effect at baseline. More than 20% of patients demonstrated a ceiling effect for 15 of 21 items at baseline. This is expected, as certain items refer to actions that the participants were not allowed to perform at that stage of rehabilitation. On the other hand, when floor and ceiling effects were measured per section and not per item, only the sports section at baseline demonstrated a ceiling effect. Therefore, it is suggested that the H-WOSI has acceptable floor and ceiling effects, although caution should be used when assessing patients immediately after surgery.

This study had several limitations. It was conducted on a relatively small sample size of 25 patients, which is substantially smaller than the recommended sample size of 50 for validation studies [27, 30]. Yet, the process of translation and adaption of an instrument may be less demanding, as suggested by the WHO guidelines for translating and adapting instruments [26].

Test-retest reliability was not directly assessed. Therefore, several psychometric measures, such as standard error of the measurement or the minimal detectable change, could not be calculated. Nevertheless, it is unlikely that the Hebrew translation would result in any differences regarding these features.

Despite these limitations, we suggest that the H-WOSI can be adopted for clinical and laboratory use, as the psychometric properties measured in the current study were very similar to those found in previous translation and validation studies of the WOSI.

In summary, based on the results of the current study, the H-WOSI seems to be a valid instrument that can be used to assess disability in Hebrew-speaking patients with SI. The utilization of the H-WOSI in clinical practice and research should be encouraged in order to obtain a better perspective of the patient’s functional status, as well as to measure progress. Furthermore, the specific characteristics of the WOSI compared to traditional instruments make it preferable tool for evaluating subjects with SI. Further studies are warranted to assess psychometric properties of the WOSI among various subpopulations.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

DASH/H-DASH:

Disabilities of Arm, Shoulder, and Hand/Hebrew version

PROM:

Patient-reported outcome measure

SD:

Standard deviation

SI:

Shoulder instability

SPSS:

Statistical Package for the Social Sciences

SRM:

Standardized response mean

WHO:

World Health Organization

WOSI/H-WOSI:

Western Ontario Shoulder Instability index/Hebrew version

References

  1. 1.

    Kuhn JE. A new classification system for shoulder instability. Br J Sports Med. 2010;44:341–6.

  2. 2.

    Owens BD, Agel J, Mountcastle SB, Cameron KL, Nelson BJ. Incidence of glenohumeral instability in collegiate athletics. Am J Sports Med. 2009;37:1750–4.

  3. 3.

    Amako M, Sasao H, Matsuhashi Y, Yato Y, Yoshihara Y, Arino H, et al. Incidence and characteristics of traumatic shoulder instability in Japanese military cadets. Mil Med. 2016;181:577–81.

  4. 4.

    Robinson CM, Howes J, Murdoch H, Will E, Graham C. Functional outcome and risk of recurrent instability after primary traumatic anterior shoulder dislocation in young patients. J Bone Jt Surg. 2006;88:2326–36.

  5. 5.

    Godin J, Sekiya JK. Systematic review of rehabilitation versus operative stabilization for the treatment of first-time anterior shoulder dislocations. Sports Health. 2010;2:156–65.

  6. 6.

    Dickens JF, Rue J-P, Cameron KL, Tokish JM, Peck KY, Allred CD, et al. Successful return to sport after arthroscopic shoulder stabilization versus nonoperative management in contact athletes with anterior shoulder instability: a prospective multicenter study. Am J Sports Med. 2017;45:2540–6.

  7. 7.

    Longo UG, van der Linde JA, Loppini M, Coco V, Poolman RW, Denaro V. Surgical versus nonoperative treatment in patients up to 18 years old with traumatic shoulder instability: a systematic review and quantitative synthesis of the literature. Arthroscopy. 2016;32(5):944–52.

  8. 8.

    Lebus GF, Raynor MB, Nwosu SK, Wagstrom E, Jani SS, Carey JL, et al. Predictors for surgery in shoulder instability: a retrospective cohort study using the FEDS system. Orthop J Sport Med. 2015;3:1–7.

  9. 9.

    Lizzio VA, Meta F, Fidai M, Makhni EC. Clinical evaluation and physical exam findings in patients with anterior shoulder instability. Curr Rev Musculoskelet Med. Springer. 2017;10:434–41.

  10. 10.

    van der Linde JA, Willems WJ, van Kampen DA, van Beers LW, van Deurzen DFP, Terwee CB. Measurement properties of the Western Ontario Shoulder Instability index in the Netherlands patients with shoulder instability. BMC Musculoskelet Disord. 2014;15:211.

  11. 11.

    Hudak PL, Amadio PC, Bombardier C. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG). Am J Ind Med. 1996;29:602–8.

  12. 12.

    Angst F, Schwyzer H-KK, Aeschlimann A, Simmen BR, Goldhahn J. Measures of adult shoulder function: Disabilities of the Arm, Shoulder, and Hand Questionnaire (DASH) and Its Short Version (QuickDASH), Shoulder Pain and Disability Index (SPADI), American Shoulder and Elbow Surgeons (ASES) Society Standardized Shoulder. Arthritis Care Res. 2011;63:174–88.

  13. 13.

    Smith MV, Calfee RP, Baumgarten KM, Brophy RH, Wright RW. Upper extremity-specific measures of disability and outcomes in orthopaedic surgery. J Bone Joint Surg Am. 2012;94:277–85.

  14. 14.

    Oliva F, Piccirilli E, Bossa M, Via AG, Colombo A, Chillemi C, et al. I.S.Mu.L.T - Rotator cuff tears guidelines. Muscles Ligaments Tendons J. 2015;5:227–63.

  15. 15.

    Kirkley A, Griffin S, McLintock H, Ng L. The development and evaluation of a disease-specific quality of life measurement tool for shoulder instability. The Western Ontario Shoulder Instability Index (WOSI). Am J Sports Med. 1998;26:764–72.

  16. 16.

    Khiami F, Sariali E, Rosenheim M, Hardy P. Anterior shoulder instability arthroscopic treatment outcomes measures: the WOSI correlates with the Walch-Duplay score. Orthop Traumatol Surg Res. 2012;98:48–53.

  17. 17.

    Kemp KAR, Sheps DM, Beaupre LA, Styles-Tripp F, Luciak-Corea C, Balyk R. An evaluation of the responsiveness and discriminant validity of shoulder questionnaires among patients receiving surgical correction of shoulder instability. ScientificWorldJournal. 2012;2012:410125. https://doi.org/10.1100/2012/410125.

  18. 18.

    Rouleau DM, Faber K, MacDermid JC. Systematic review of patient-administered shoulder functional scores on instability. J Shoulder Elb Surg. 2010;19:1121–8.

  19. 19.

    Cacchio A, Paoloni M, Griffin SH, Rosa F, Properzi G, Padua L, et al. Cross-cultural adaptation and measurement properties of an Italian version of the Western Ontario Shoulder Instability index (WOSI). J Orthop Sport Phys Ther. 2012;42:559–B6.

  20. 20.

    Yuguero M, Huguet J, Griffin S, Sirvent E, Marcano F, Balaguer M, et al. Transcultural adaptation, validation and assessment of the psychometric properties of the Spanish version of the Western Ontario Shoulder Instability Index questionnaire. Rev Española Cirugía Ortopédica y Traumatol (English Ed.). 2016;60:335–45.

  21. 21.

    Perrin C, Frederic K, Beguin L, Calmels P, Gresta G, Edouard P. Translation and validation of the shoulder algo-functional score WOSI (Western Ontario Shoulder Instability Index): WOSI-Fr. Ann Phys Rehabil Med. 2016;59:e109–10.

  22. 22.

    Salomonsson B, Ahlström S, Dalén N, Lillkrona U. The Western Ontario Shoulder Instability Index (WOSI): validity, reliability, and responsiveness retested with a Swedish translation. Acta Orthop. 2009;80:233–8.

  23. 23.

    Hatta T, Shinozaki N, Omi R, Sano H, Yamamoto N, Ando A, et al. Reliability and validity of the Western Ontario Shoulder Instability Index (WOSI) in the Japanese population. J Orthop Sci. 2011;16:732–6.

  24. 24.

    Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Heal. 2005;8:94–104.

  25. 25.

    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–91.

  26. 26.

    Process of translation and adaptation of instruments, World Health Organization. https://www.who.int/substance_abuse/research_tools/translation/en/. Accessed 6 June 2019

  27. 27.

    Tsang S, Royse CF, Terkawi AS. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi j anaesth. 2017;11(Suppl 1):S80. https://doi.org/10.4103/sja.SJA_203_17.

  28. 28.

    Efrat Z, Ety S, Yael K-C, Hagar P. The Disabilities of the Arm, Shoulder and Hand in Hebrew. Barzilai Med. Center, Ashkelon, Isr. (Institute Work Heal). 2006. http://www.dash.iwh.on.ca/available-translations. Accessed 6 June 2019.

  29. 29.

    Dor A, Vatine J-J, Kalichman L. Proximal myofascial pain in patients with distal complex regional pain syndrome of the upper limb. J Bodyw Mov Ther. 2019. https://doi.org/10.1016/j.jbmt.2019.02.015.

  30. 30.

    Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.

Download references

Acknowledgements

The authors would like to acknowledge Ori Bar-Zeev, Nirit Rotem and Dina Reznik for their assistance in the WOSI translation.

Funding

None of the authors have received or will receive benefits for personal or professional use from a commercial party related directly or indirectly to the subject of this article.

Author information

UG reviewed the literature, conception and design, acquisition, analysis, and interpretation of data, and drafted the manuscript. SS reviewed the literature and contributed to the conception and design, manuscript proofing, and critical revision of the manuscript. All authors read and approved the final manuscript.

Correspondence to Uri Gottlieb.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the IDF Medical Corps Helsinki Committee (approval number 1702-2016) and was registered at the ClinicalTrials.gov website (registration number NCT02978365). Written informed consent was obtained from all eligible patients who were recruited.

Consent for publication

Not applicable.

Competing interests

The authors declare they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gottlieb, U., Springer, S. Translation and validation of a Hebrew version of the Western Ontario Shoulder Instability index. J Orthop Surg Res 14, 245 (2019) doi:10.1186/s13018-019-1289-4

Download citation

Keywords

  • Evaluation
  • Shoulder instability
  • Quality of life
  • Self-administered questionnaire
  • Patient-reported outcome measures