- Research article
- Open Access
Psychological symptoms and the MCID of the DASH score in shoulder surgery
Journal of Orthopaedic Surgery and Research volume 13, Article number: 246 (2018)
Psychological symptoms are frequently present in patients scheduled for shoulder surgery. The perception of functional disability, activity level and pain in the shoulder is negatively influenced by psychological symptoms, which leads to higher scores of the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire. The aim of this study was to determine the influence of psychological symptoms on the minimal clinically important difference (MCID) of the DASH score in patients after shoulder surgery.
In this prospective longitudinal cohort study, 176 patients were included. Group 1 (32 patients) had symptoms of psychological disorders before and after surgery; group 2 had no symptoms of psychological disorders (110 patients). In the remaining patients (34 patients), psychological disorders changed after surgery. Clinical outcome was measured with the change of DASH score and anchor questions for perceived improvement of pain and function after surgery. Symptoms of psychological disorders were identified with the Four-Dimensional Symptom Questionnaire. An anchor-based mean change score technique was used to determine the MCID of the DASH score.
DASH scores before and 12 months after shoulder surgery were significantly higher in patients with symptoms of psychological disorders; change of DASH score was not different between the two groups. The MCID of the DASH score was 13.0 [SD 20.7] in the group with symptoms of psychological disorders and 12.7 [SD 17.6] in the group with no symptoms of psychological disorders. We observed no difference (p = 0.559) in the MCID between the group with and the group without symptoms of psychological disorders.
Symptoms of psychological disorders had a negative effect on the DASH score but no influence on the MCID of the DASH score. The DASH score could be used in future studies to assess the influence of psychological factors on the clinical outcome of treatment.
The influence and relationship of psychological symptoms with clinical outcome after shoulder surgery has been studied but not clearly defined. Psychological symptoms may have a role in the etiology, perceived disability and pain and the outcome of treatment of shoulder complaints. The Disabilities of the Arm, Shoulder and Hand questionnaire (DASH) is one of the most frequently used PROMs for the shoulder. The perception of functional disability, activity level and pain in the shoulder is negatively influenced by psychological symptoms, which leads to higher DASH scores [3,4,5,6]. The minimal clinically important difference (MCID) is defined as the smallest measured change score that patients perceive to be important [7,8,9]. The MCID of the DASH score has been assessed in the general shoulder population [8,9,10,11,12,13,14,15,16].
To our knowledge, it is unknown if psychological symptoms influence the magnitude of the MCID of the DASH score. In order to interpret the DASH change score after treatment of shoulder symptoms in patients with and without psychological symptoms, it seems important to assess if the MCID is different in patients with psychological symptoms compared to patients with no psychological symptoms.
The aim of this study was to determine the influence of psychological symptoms on the MCID of the DASH score in patients treated with shoulder surgery. Our hypothesis was that psychological symptoms have a negative impact on the magnitude of the DASH score before and after shoulder surgery and that the MCID will be different in patients with and without psychological symptoms.
Design and study population
This study was a prospective longitudinal cohort study. We included all consecutive patients that were planned for elective shoulder surgery in a one and a half year period (January 2012 until May 2013). Operating procedures were carried out in a general teaching hospital by a single surgeon and his supervised trainees. Patients were considered eligible for the study if they were scheduled for elective shoulder surgery and were at least 16 years of age. Exclusion criteria were diagnostic shoulder arthroscopy and shoulder arthrodesis and unable to complete questionnaires because of language or cognitive disorders. If patients were re-operated or sustained a shoulder fracture within the follow-up period, they were excluded. Participants were informed about the study using a patient information letter and patients had the opportunity to ask questions about the study. Then, informed consent was received orally and formally recorded. Approval for this study was obtained from the Regional Medical Ethical Committee Isala Hospital, Zwolle, the Netherlands, number 14.11151.
Figure 1 presents a flow diagram with study enrolment and follow-up. In the study period, 205 patients were included. Twenty-three patients (11.6%) were unwilling to fill in the postoperative questionnaire and completed a telephone interview with our research nurse including the anchor questions. Six patients were lost to follow-up; one of these patients died in the study period, which was not related to the shoulder operation. Preoperative DASH score and patients’ perceived improvement of pain and function after shoulder surgery (anchor questions) were not different in the group who completed a telephone interview compared to the group who filled in the postoperative questionnaire.
Prior to elective shoulder surgery, orthopaedic patients were seen 2 to 3 weeks before surgery at an outpatient clinic by an independent physiotherapist from our shoulder unit. Demographic and clinical variables including the DASH and Four-Dimensional Symptom Questionnaire (4DSQ) were obtained. The orthopaedic surgeons and physiotherapists involved in the treatment of the patient were blinded to the results of the psychological questionnaire (4DSQ) to minimize bias. After 1 year, data were obtained using a web-based system. The patients completed an online questionnaire at home containing the DASH, 4DSQ, and the anchor question pain and function. If the patient did not respond to our request to fill in the postoperative questionnaire, a telephone interview by an independent research nurse was conducted with the two anchor questions about pain and function. All data were collected independently by the research unit of our Orthopaedic Department, using standardized case report forms and a study-specific database.
The Disabilities of the Arm, Shoulder and Hand (DASH) score
The DASH is a 30-item self-report questionnaire designed to measure physical function and symptoms in people with musculoskeletal disorders of the upper limb . The DASH questionnaire has been shown to be reliable, valid and responsive in patients with shoulder disability  and has been validated in Dutch for patients with a disorder of the upper limb .
Four-dimensional symptom questionnaire (4DSQ)
The 4DSQ is a psychological questionnaire validated in orthopedic shoulder patients . The 4DSQ is a 50-item self-report questionnaire that identifies four psychological disorders: distress, depression, anxiety and somatisation . The distress scale measures people’s most general, most basic response to stress of any kind, be it work or family demands, psychosocial difficulties or life events. The depression and anxiety scales identify specific symptoms of depressive and anxiety disorders that are severe enough to warrant specific treatment. The somatisation scale measures symptoms associated with somatic stress. Psychological disorders in this study were defined to be present if the patients scored medium or high risk on (one of the items of) the 4DSQ [20, 21]. The 4DSQ was equally able to detect depressive and anxiety disorders as the Hospital Anxiety Depression Scales . A Dutch and an English version of the 4DSQ have been validated .
An anchor is a global rating scale in which patients are asked in a single question to indicate how much their function (functional anchor) or pain (pain anchor) has changed since baseline [7, 23]. The response options are completely recovered (7), much improved (6), slightly improved (5), unchanged (4), slightly worse (3), much worse (2) and worse than ever (1). Specific instructions to the patients were to try to remember how painful and how limited their shoulder function was before the surgery and how has the pain or functioning of their shoulder changed compared to the first time they completed this questionnaire.
The DASH change scores were calculated by subtracting each patient’s 12 months after surgery score from the baseline (before surgery) score and were then used to determine the MCID using an anchor-based mean change score technique [24, 25]. There are different measurement techniques to calculate the MCID of the DASH score . We chose the anchor-based mean change method because this method is most frequently used [8,9,10, 12, 13]. The anchor scores were used to categorize patients into seven subgroups, varying from completely recovered to worse than ever. DASH change scores were calculated in each of the seven subgroups. The MICD was defined as the mean change score in the subcategory of patients who were ‘slightly improved’ according to the anchor scores [7, 24]. The DASH score primarily assesses shoulder function; therefore, we compared these change scores only to the functional anchor. We performed independent samples t tests to compare two groups: group 1 included patients with one or more psychological disorders before and 12 months after surgery and group 2 included patients with no psychological disorders before and 12 months after surgery. We decided not to study patients with a change of psychological disorders after surgery because in these patients, only one of the DASH scores before or after surgery was influenced by the psychological disorders, maybe confounding possible associations.
The total study population consisted of 176 patients; 110 patients did not have any psychological disorders before or after surgery (group 1) and 32 patients had psychological disorders both before and after surgery (group 2). In the remaining patients (34 patients), psychological disorders changed after surgery. These patients were excluded from the analysis. Preoperative psychological disorders disappeared after surgery in 18 patients, and new psychological disorders were observed in 16 patients. Demographic and clinical data of group 1 and group 2 are presented in Table 1.
In group 1, significantly more females were present (p = 0.002), patients were older (p = 0.017), patients more frequently had a history of previous surgery (p = 0.004) and more often had glenohumeral osteoarthritis as the primary diagnosis (p = 0.042). Glenohumeral instability was less frequently encountered and duration of symptoms were not different between the two groups. DASH scores before and 12 months after shoulder surgery were significantly higher in patients with symptoms of psychological disorders (before surgery: patients with psychological disorders DASH score 55.5 [SD 19.8], patients without psychological disorders DASH score 35.3 [SD 21.2] (p < 0.001); 12 months after surgery: patients with psychological disorders DASH score 34.8 [SD 20.5], patients without psychological disorders DASH score 12.1 [SD 12.1] (p < 0.001)). Change of DASH score was not different (p = 0.559) between the two groups. Previous shoulder surgery and the distribution of shoulder diagnoses could not explain the difference in DASH scores between the two groups. Symptoms of psychological disorders were encountered in all various shoulder diagnoses (Table 2).
Minimal clinically important difference
The mean change scores per subgroup based on the functional anchor are presented in Table 3. The numbers of patients in the ‘unchanged’ and ‘worse’ categories were too small to calculate the mean change scores. The mean change score of the slightly improved group was used to determine the MCID of the DASH. The MCID was 13.0 [SD 20.7] in the group with symptoms of psychological disorders and 12.7 [SD 17.6] in the group with no symptoms of psychological disorders. We observed no difference (p = 0.559) in the MCID between the group with and the group without symptoms of psychological disorders.
No difference in the MCID of the group with symptoms of psychological disorders was found compared to the group without symptoms of psychological disorders. Although symptoms of psychological disorders had a significant negative effect on the magnitude of the DASH score, it had no effect on the MCID in our study population. The MCID of the DASH score could therefore be used in all patients after shoulder surgery, irrespective of the presence of psychological symptoms.
Monitoring the effects of treatment is of well-recognized importance and is the foundation of modern evidence-based health care . In our study population and in other studies [3,4,5], DASH scores were significantly worse in patients with psychological symptoms. This effect could not be explained by differences in age, gender, duration of symptoms or diagnosis but seems to reflect the negative influence of psychological symptoms on the DASH score. In order to interpret clinical outcome, the influence of psychological symptoms on the outcome measurement instrument should be taken into account .
Three clinical studies have investigated if preoperative psychological disorders were associated with functional outcomes after shoulder surgery [6, 27, 28]. They all showed that functional outcomes after shoulder surgery were not negatively influenced by preoperative psychological symptoms. Shoulder surgery resulted in a significant change in DASH scores after surgery in most patients, irrespective of the presence of psychological symptoms before surgery [6, 27, 28]. It is however important to know if a certain change in DASH score indicates the same perceived improvement in patients with and patients without psychological symptoms. We observed that the DASH change score which patients perceived to be important was not different in patients with and without psychological symptoms. This means that the MCID of the DASH score could be used in all patients after shoulder surgery, irrespective of the presence of psychological symptoms. Although there is debate in literature about the best measurement technique to calculate the MCID of the DASH score , the anchor-based mean change method is most frequently used [8,9,10, 12, 13]. There is no international consensus on the optimal cut-off point on an anchor; however, we think that the slightly improved group best reflects a minimally important change opposed to the much improved group. Previously published MCID of the DASH score ranges from 10 to 13 [10,11,12,13]. All these studies were performed in heterogeneous study populations, with study samples ranging from 53 to 361 patients.
There are some limitations that have to be mentioned. First, the study sample was relatively small, especially in the group of patients with psychological symptoms before and after surgery. The perceived improvement of pain and function 12 months after shoulder surgery was good to excellent in most patients, leaving a small number of patients with unchanged or worse clinical results. Further studies with larger study samples should include more patients reporting inferior clinical outcomes, for example, including patients treated conservatively or patients after shoulder surgery but with a shorter follow-up period.
Second, the 4DSQ questionnaire is a tool to identify psychological symptoms. However, having significant psychological symptoms is not the same as having a psychological illness. Psychological disorders have to be diagnosed by a psychologist or psychiatrist using DSM-V criteria. We did not account for the use of antidepressive medication and if patients are treated by a psychologist or psychiatrist during the study period.
Third, we used a heterogeneous population for calculation of the MCID. We included a heterogeneous patient population with shoulder complaints, with different diagnoses, operations, levels of pain and functional disability and duration of symptoms. Psychological symptoms were observed in all various shoulder diagnoses before surgery. There is no evidence in the literature that the MCID differs among (sub)populations with different diagnoses and surgical or non-surgical treatment, but it has been suggested that this should be evaluated [26, 29]. We could not perform subgroup calculations in our study population because the subgroups would be too small. The advantage of using a heterogeneous cohort is that it provides a MCID estimation that can be used in all kinds of shoulder disorders. Future studies should investigate if and how the MCID varies among shoulder subgroups. We only studied the MCID and did not measure the smallest detectable change (SDC). In order to calculate the SDC, two measurements of a study population at two time periods close together are needed; we only measured patients before and 12 months after surgery. As the MCID observed in the two groups of our study population (MCID 13) are within the range of previously published MCID of the DASH score (range from 10 to 13) [10,11,12,13,14], we assume that the SDC of our study population might be also in the range of these reports (range from 10 to 16) [10, 12,13,14].
Symptoms of psychological disorders in patients treated with shoulder surgery seem to have a negative effect on the magnitude of the DASH score but did not influence the MCID of the DASH score. This means that the MCID of the DASH score could be used in all patients after shoulder surgery, irrespective of the presence of psychological symptoms. The DASH score could be used in future studies to assess the influence of psychological factors on the clinical outcome of treatment.
Four-Dimensional Symptom Questionnaire
Disabilities of the Arm, Shoulder and Hand questionnaire
Minimal clinically important difference
Koorevaar RCT, Terluin B, Van‘t Riet E, Madden K, Bulstra SK. Validation of the Four-Dimensional Symptom Questionnaire (4DSQ) and prevalence of psychological disorders in orthopedic shoulder patients. J Orthop Res. 2016;34:683–91. https://doi.org/10.1002/jor.23051.
Cho CH, Seo HJ, Bae KC, Lee KJ, Hwang I, Warner JJ. The impact of depression and anxiety on self-assessed pain, disability, and quality of life in patients scheduled for rotator cuff repair. J Shoulder Elb Surg. 2013;22:1160–6. https://doi.org/10.1016/j.jse.2013.02.006.
Roh YH, Noh JH, Oh JH, Baek GH, Gong HS. To what degree do shoulder outcome instruments reflect patients’ psychologic distress? Clin Orthop Relat Res. 2012;470:3470–7. https://doi.org/10.1007/s11999-012-2503-4.
Roh YH, Lee BK, Noh JH, Oh JH, Gong HS, Baek GH. Effect of depressive symptoms on perceived disability in patients with chronic shoulder pain. Arch Orthop Trauma Surg. 2012;132:1251–7. https://doi.org/10.1007/s00402-012-1545-0.
Ring D, Kadzielski J, Fabian L, Zurakowski D, Malhotra LR, Jupiter JB. Self-reported upper extremity health status correlates with depression. J Bone Joint Surg Am. 2006;88:1983–8.
Koorevaar RC, van 't Riet E, Gerritsen MJ, Madden K, Bulstra SK. The influence of preoperative and postoperative psychological symptoms on clinical outcome after shoulder surgery: a prospective longitudinal cohort study. PLoS One. 2016;11:e0166555. https://doi.org/10.1371/journal.pone.0166555.
de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in Medicine. New York: Cambridge University Press; 2011.
Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10:407–15.
Redelmeier DA, Lorig K. Assessing the clinical importance of symptomatic improvements. An illustration in rheumatology. Arch Intern Med. 1993;153:1337–42.
van Kampen DA, Willems WJ, van Beers LW, Castelein RM, Scholtes VA, Terwee CB. Determination and comparison of the smallest detectable change (SDC) and the minimal important change (MIC) of four-shoulder patient-reported outcome measures (PROMs). J Orthop Surg Res. 2013;8:40. https://doi.org/10.1186/1749-799X-8-40.
Gummesson C, Atroshi I, Ekdahl C. The disabilities of the arm, shoulder and hand (DASH) outcome questionnaire: longitudinal construct validity and measuring self-rated health change after surgery. BMC Musculoskelet Disord. 2003;4:11.
Beaton DE, van Eerd D, Smith P, van der Velde G, Cullen K, Kennedy CA, Hogg-Johnson S. Minimal change is sensitive, less specific to recovery: a diagnostic testing approach to interpretability. J Clin Epidemiol. 2011;64:487–96.
Schmitt JS, Di Fabio RP. Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. J Clin Epidemiol. 2004;57:1008–18.
Franchignoni F, Vercelli S, Giordano A, Sartorio F, Bravini E, Ferriero G. Minimal clinically important difference of the disabilities of the arm, shoulder and hand outcome measure (DASH) and its shortened version (QuickDASH). J Orthop Sports Phys Ther. 2014;44:30–9. https://doi.org/10.2519/jospt.2014.4893.
Malay S, SUN Study Group, Chung KC. The minimal clinically important difference after simple decompression for ulnar neuropathy at the elbow. J Hand Surg Am. 2013;38:652–9.
Sorensen AA, Howard D, Tan WH, Ketchersid J, Calfee RP. Minimal clinically important differences of 3 patient-rated outcomes instruments. J Hand Surg Am. 2013;38:641–9. https://doi.org/10.1016/j.jhsa.2012.12.032 Epub 2013 Mar 6.
Hudak PL, Amadio PC, Bombardier C. The Upper Extremity Collaborative Group (UECG). Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand). Am J Ind Med. 1996;29:602–8.
Desai AS, Dramis A, Hearnden AJ. Critical appraisal of subjective outcome measures used in the assessment of shoulder disability. Ann R Coll Surg Engl. 2010;92:9–13. https://doi.org/10.1308/003588410X12518836440522.
Veehof MM, Sleegers EJ, van Veldhoven NH, Schuurman AH, van Meeteren NL. Psychometric qualities of the Dutch language version of the Disabilities of the Arm, Shoulder, and Hand questionnaire (DASH-DLV). J Hand Ther. 2002;15:347–54.
Terluin B, van Marwijk HW, Adèr HJ, et al. The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatry. 2006;6:34.
Terluin B, Brouwers EP, van Marwijk HW, Verhaak P, van der Horst HE. Detecting depressive and anxiety disorders in distressed patients in primary care; comparative diagnostic accuracy of the Four-Dimensional Symptom Questionnaire (4DSQ) and the Hospital Anxiety and Depression Scale (HADS). BMC Fam Pract. 2009;10:58. https://doi.org/10.1186/1471-2296-10-58.
Terluin B, Smits N, Miedema B. The English version of the four-dimensional symptom questionnaire (4DSQ) measures the same as the original Dutch questionnaire: a validation study. Eur J Gen Pract. 2014;20:320–6. https://doi.org/10.3109/13814788.2014.905826.
De Vet HCW, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59(10):1033–9. https://doi.org/10.1016/j.jclinepi.2005.10.015.
Terwee CB, Roorda LD, Dekker J, Bierma-Zeinstra SM, Peat G, Jordan KP, Croft P, de Vet HCW: Mind the MIC: large variation among populations and methods. J Clin Epidemiol. 2010;63:524–34.
Crosby RD, Kolotkin RL, Williams GR. Defining clinically meaningful change in health-related quality of life. J Clin Epidemiol. 2003;56:395–407.
Revicki D, Hays RD, Cella D, et al. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61:102–9. https://doi.org/10.1016/j.jclinepi.2007.03.012.
Potter MQ, Wylie JD, Granger EK, Greis PE, Burks RT, Tashjian RZ. One-year patient-reported outcomes after arthroscopic rotator cuff repair do not correlate with mild to moderate psychological distress. Clin Orthop Relat Res. 2015;473:3501–10.
Cho CH, Song KS, Hwang I, Warner JJ. Does rotator cuff repair improve psychologic status and quality of life in patients with rotator cuff tear? Clin Orthop Relat Res. 2015;473(11):3494–500.
King M. A point of minimal important difference (MID): a critique of terminology and methods. Expert Rev Pharmacoecon Outcomes Res. 2011;11:171–84.
Special thanks to Hannie Elskamp, research nurse of our orthopedic department, and Marcel Ipskamp, Robert Spenkelink and Marleen Jaspers, shoulder physiotherapists, who collected the data.
All authors declare that they have no financial relationships with any organizations that might have an interest in the submitted work in the previous 3 years; there are no other relationships or activities that could appear to have influenced the submitted work. We received no funding for this research project.
Availability of data and materials
The dataset supporting the conclusions of this article is available at our institution.
Ethics approval and consent to participate
Participants were informed about the study using a patient information letter, and patients had the opportunity to ask questions about the study. Then, informed consent was received orally and formally recorded. Approval for this study was obtained from the Regional Medical Ethical Committee Isala Hospital, Zwolle, the Netherlands. Number 14.11151.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Koorevaar, R.C.T., Kleinlugtenbelt, Y.V., Landman, E.B.M. et al. Psychological symptoms and the MCID of the DASH score in shoulder surgery. J Orthop Surg Res 13, 246 (2018) doi:10.1186/s13018-018-0949-0
- Psychological symptoms MCID
- DASH shoulder surgery