Simplified Chinese version of the Forgotten Joint Score (FJS) for patients who underwent joint arthroplasty: cross-cultural adaptation and validation
Journal of Orthopaedic Surgery and Research volume 12, Article number: 6 (2017)
The Forgotten Joint Score (FJS) is a newly developed health-related quality of life (HRQoL) questionnaire designed to evaluate the awareness after total knee arthroplasty (TKA). This study cross-culturally adapted and psychometrically validated a simplified Chinese version of the FJS (SC-FJS).
Cross-cultural adaptation was performed according to the internationally recognized guidelines. One-hundred and fifty participants who underwent primary TKA were recruited in this study. Cronbach’s α and intra-class correlations were used to determine reliability. Construct validity was analyzed by evaluating the correlations between SC-FJS and the Knee Injury and Osteoarthritis Outcome Score (KOOS) and the short form (36) health survey (SF-36).
Each of the 12 items was properly responded and correlated with the total items. SC-FJS had excellent reliability [Cronbach’s α = 0.907, intra-class correlation coefficient (ICC) = 0.970, 95% CI 0.959–0.978). Elimination of any one item in all did not result in a value of Cronbach’s α of <0.80. SC-FJS had a high correlation with symptoms (0.67, p < 0.001) and pain (0.60, p < 0.001) domains of KOOS and social functioning (0.66, p < 0.001) domain of SF-36, and it also moderately correlated with function in daily living (0.53, p < 0.001) and function in sport and recreation (0.40, p < 0.001) domains of KOOS, and physical subscale of SF-36 (0.49–0.53, p < 0.001) but had a low (r = 0.20) or not significant (p > 0.05) correlation with mental subscale of SF-36.
SC-FJS demonstrated excellent acceptability, internal consistency, reliability, and construct validity, which can be recommended for patients who underwent joint arthroplasty in Mainland China.
Total knee arthroplasty (TKA) has proven to be a successful and effective treatment for end-stage arthritis and other knee disorders [1, 2]. As TKA has been performed more than one million a year, the patients’ postoperative subjective perception should draw greater attention.
From the 1980s, a large body of researches have been devoted to the development of health-related quality of life (HRQoL) questionnaires . HRQoL questionnaires are patient-based questionnaires filled by the patients themselves for a better understanding of their disorder severity and more appropriate therapeutic approach .
Although many scoring systems have been applied to patients in different countries and cultural background, this need has become more essential with the growing number of multicenter and multinational studies , which provide more statistic power of randomized controlled trials . When one reliable, valid questionnaire is being used in populations with different cultures, it is necessary to test the psychometric properties of the questionnaire rather than simply translating the content to avoid bias involved in cultural variety [6, 7].
The Forgotten Joint Score (FJS) is a newly developed 12-item score introducing a new aspect of HRQoL, the patient’s ability to forget the artificial joint in everyday life . The original English FJS is distinguished in brief expression, good reliability, and validity [8,9,10] and have been translated into three languages including French, Dutch, and Danish [9,10,11]. However, there is no FJS in the Chinese version for this population so far.
The purpose of this study was to translate and adapt the FJS into a simplified Chinese version (SC-FJS) and evaluate the psychometric properties of the SC-FJS in native Chinese-speaking patients who underwent TKA and the psychometric properties we tested including reliability and validity.
Patients and data collection
Between March 2015 and September 2015, 150 patients who underwent total knee arthroplasty at least 1 year before the evaluation were included in our study and completed two rounds of the questionnaires. Detailed demographic and clinical characteristics of the participants are listed in Table 1. The inclusion criteria were as follows: age >18 years with independent signing authority, literate native Chinese speakers, and patients who underwent TKA due to degenerative osteoarthritis. Participants were excluded for knee infection or traumatic osteoarthritis, revised total knee arthroplasty, history of spine surgery or any surgery in the recent 1 month, and other uncontrolled systematic disorders, such as diabetes mellitus, malignant tumor, or hepatitis. The population also needed to meet the standards proposed in the article by Terwee et al.  that stated that a study should include at least 100 patients for internal consistency analysis and 50 patients for floor or ceiling effects, reliability, and validity analysis. All included participants were required to sign informed consent, and the study was approved by the clinical research Ethics Committee of Changzheng Hospital, Shanghai, China.
Patients should provide demographic data regarding gender, year of age, side of surgery, and time after primary surgery at the first day approving to participate the study and then should finished SC-FJS, Knee Injury and Osteoarthritis Outcome Score (KOOS), and the short form (36) health survey (SF-36). Two weeks later, participants filled in SC-FJS for the second time to assess its test-retest reliability.
Translation and cross-cultural adaptation
The steps of translation and transcultural adaptation followed previous guidelines in five steps, including forward translation, synthesis of the translation, backward translation, summarization of prefinal version, and determination of final version (Table 2) [3, 13]. Eventually, all researchers involved in this study discussed issues from the previous test and developed the final SC-FJS.
The FJS is a disease-specific questionnaire evaluating patients’ awareness of an artificial joint in everyday life . In this 12-item questionnaire, all questions are answered in never, almost never, seldom, sometimes, mostly and “not relevant to me,” corresponding to 4 to 0 points and missing value, respectively. Total points are calculated according to the average score of all answered questions (eliminating missing value) and then multiplied by 25 into centesimal system (0–100 points). Higher scores refer to better outcome, that is, a better “forgotten” index of the joint and a low degree of awareness.
KOOS is a knee function score that mainly evaluates knee-related clinical symptoms and function. Consistent with FJS, the higher scores for KOOS refer to better function for patients . SF-36 is a questionnaire assessing general quality of life . Both of the scales above have been translated into Chinese and proved to possess good reliability and validity [16, 17].
Psychometric assessments and statistical analysis
According to the original author’s proposal, if more than two items in SC-FJS were not answered, the questionnaire should be judged as invalid questionnaire and rejected in the final analysis .
To assess acceptability of SC-FJS, patients were asked for the difficulties encountered. Miss rates for each item were calculated, and if it was more than 5% for a certain item, it suggested that the acceptability and intelligibility were not satisfying . Besides, mean completion time was obtained for all participants.
Statistical analysis for score distribution was performed. Floor and ceiling effects exceeding 15% were considered to be significant .
Reliability was examined in terms of test-retest reliability and internal consistency. The test-retest reliability was tested by comparing outcomes when the same patient without changes in health answered SC-FJS in two separated circumstances. It was evaluated by the intra-class correlation coefficient (ICC), which is derived from a two-way analysis of variance in a random effects model. ICC > 0.8 and >0.9 were considered as good and excellent reliability . Meanwhile, Cronbach’s alpha was used to assess internal consistency of the questionnaire, and >0.7, 0.8, and 0.9 were considered as acceptable, good, and excellent internal consistency, respectively . In addition, Bland-Altman plots were carried out to estimate systematic bias between the two measures .
Validity for SC-FJS was evaluated in dimensions of content validity and construct validity. To assess content validity of SC-FJS, we invited one rehabilitation expert and three orthopedic experts to analyze the correlation between content in each item and state of disease. Good construct validity meant that the questionnaire correlated well with measures of the same construct (convergent validity) while correlating poorly with measures of different constructs (divergent or discriminant validity) . Based on this theory, we assumed that the score of SC-FJS should be in accordance with subdomains of KOOS and physical subdomains (physical function, role-physical, and bodily pain) of SF-36, but not with mental subdomains (role-emotional and mental health) of SF-36. Under this assumption, we calculated the Pearson’s correlation coefficient (r) between SC-FJS and domains of KOOS and SF-36. Then, the construct validity for SC-FJS was evaluated by comparing how data fitted with the calculated correlations, judged as poor (r = 0–0.2), fair (r = 0.2–0.4), moderate (r = 0.4–0.6), very good (r = 0.6–0.8), or excellent (r = 0.8–1.0) .
Statistical Package for the Social Sciences, version 20.0 (SPSS, Chicago, IL) was used to analyze the data. Mean values were reported with standard deviation (SD). ICC values were reported with 95% confidence intervals (CIs). p values of 0.05 or less were considered significant.
Translation and cross-cultural adaptation process
There were no major problems in the forward and back translations of FJS. Some minor differences were found in some items due to the cultural diversity and then adapted cross-culturally, such as item 10, “Are you aware of your artificial knee when doing housework or gardening?”, which was a question about the daily housework. Seldom Chinese urban population owns a house with a garden, and most people living in the countryside are not used to gardening as a daily housework. Instead, the motor function related to daily household that patients who underwent TKA cared most was the ability to buy groceries around. Therefore, the item was adapted to be “Are you aware of your artificial knee when doing housework/buying groceries/farming?”. Furthermore, the background for item 10 was household. Some males might seldom do these in daily life owing to traditional culture, so we marked “assume” ahead of the original items to outline the hypothetical situation in case of omission.
In pilot trial, three out of ten patients mistakenly considered that items in prefinal SC-FJS were asking the frequency they were able to finish a corresponding activity with the knee which underwent TKA. Under the circumstances, we emphasized “aware of your artificial knee” at the beginning of the questionnaire in bold and underlined font and informed all participants of this content orally. Afterwards, no misunderstanding of the questionnaire turned up for the following participants (Additional file 1).
Acceptability and score distribution
In formal study, no participants complained any content was too difficult to understand at the first time of completing SC-FJS. All items had an answer rate of 100%. The choice “not relevant to me,” regarded as missing value, however, was chosen for 2 (1.3%), 4 (2.7%), and 28 (18.7%) times in item 10, 11, and 12, respectively. The mean time to complete SC-FJS was 85 ± 23 s.
Absolute values of all three scores are listed in Table 3. No ceiling effect (2.0%) and floor effect (0%) were observed in the total score of SC-FJS.
The internal consistency of SC-FJS was excellent (Cronbach’s alpha = 0.907). Elimination of one item in all 12 questions did not result in a value of <0.80. All items correlated with the total score of >0.47 (Table 4). The test-retest reliability of SC-FJS was also excellent. Mean score of the retest was 60.1 ± 20.0, which was comparable with the first test (60.7 ± 21.0). ICC for the overall SC-FJS was 0.970 (95%CI, 0.959–0.978), and test-retest reliability of each question was good or excellent (ICC = 0.86–0.95) (Table 4). Bland-Altman plots for the two measures revealed no systematic error (Fig. 1), which suggested good test-retest agreement and reproducibility of SC-FJS .
According to the evaluation of rehabilitation expert and orthopedic experts in SC-FJS, content validity was good for the questionnaire, and information derived from all questions was adequate to assess the function of patients who underwent TKA. Under this circumstance, it was not recommended to add to or remove any questions.
Table 5 lists the data of construct validity of SC-FJS, which were consistent with our consumption. The result revealed that SC-FJS correlated well with symptoms (0.67, p < 0.001) and pain (0.60, p < 0.001) domains of KOOS and social functioning (0.66, p < 0.001) domain of SF-36. The correlation between SC-FJS and function in daily living (0.53, p < 0.001) and function in sport and recreation (0.40, p < 0.001) domains of KOOS and physical subscale of SF-36 (0.49–0.53, p < 0.001) was also moderate. Meanwhile, SC-FJS was weakly (r = 0.20) or not significantly (p > 0.05) correlated to the mental subscale of SF-36. All of these suggested satisfied divergent or discriminant validity for SC-FJS.
HRQoL questionnaires are very important and valuable for clinical research, especially in the quantification of patients’ status of function and data analysis among studies. Nowadays, due to the largest population of patients and government’s greater attention to scientific research in China, a sharp increase in the quantity and quality of clinical research has been witnessed over years, and the second large number of papers is publishing annually . Therefore, valid questionnaires are urgently needed to support this huge amount of clinical research.
There is no disease-specific questionnaire available in China that can be used to evaluate patients with the awareness of artificial joint after total joint arthroplasty, a common problem that imposes a considerable burden on the affected individuals and society. Only some functional questionnaires, such as KSS and WOMAC, for measurement of quality-of-life state of the upper extremity are available in a validated Chinese version [23, 24]. However, these questionnaires were not specifically developed for the subjective awareness of artificial joint and may be affected by the contralateral knee without surgery, other lower limb joints with poor function, and the spine. FJS, the questionnaire to evaluate the subjective perception for the joint after joint arthroplasty, has been translated into three languages and proven to be well reliable and valid [9,10,11]. In consequence, we considered that the cross-cultural adaptation for FJS in Chinese, the language spoken by the largest population around the world, was of great significance, which was the fundamental objective for the study.
In our study, the process of translation and cross-cultural adaptation went exceptionally well. No large modifications were made on the original questionnaire, and we just adjusted some items in terms of the cultural gap between Chinese and western cultures. After the adaptation, no question was hard to understand for participants, and all items were answered 100% in pretest and formal study, which revealed good acceptability of SC-FJS. Most participants in our study were elderly patients, and age and other organ functions highly restricted their athletic ability, which could be an explanation for the fact that 28 (18.7%) patients chose “not relevant to me” in item 12. The corrected item-total correlation (CITC) for item 12 was also much lower than other items (CITC = 0.476), which could be explained as follows. First, the rate of missing value for item 12, mostly chosen by patients with lower motor function, was high, and the score for this item was calculated as the average of the other scores, which very likely enhanced the score for item 12 compared to the true score of awareness when they had strenuous sports. Second, the purpose for some patients bearing TKA was to do their favorite sport, such as square dance, a famous sport with Chinese feature, and the delight mood could lower uncomfortable feelings when doing favorite sport. Last but not the least, favorite sport varied a lot in different individuals, and people with better motor function tended to like more vigorous sport, which made them easier to be aware of artificial joint. Under the circumstances, we suggested adding the choice “I can’t do this” to item 12 scoring 0.
SC-FJS showed perfect internal consistency (Cronbach’s alpha = 0.907) and test-retest reliability (ICC = 0.970), which was consistent with other cross-cultural adaptation studies and original study for FJS [9, 11, 25, 26]. The lowest ICC value presented to item 4 (“Are you aware of your artificial knee when taking a bath/shower?”, ICC = 0.86). One possible reason might be the subjective feeling of pain changing in different situations, even if the disease itself remained firm in 2 weeks. The highest ICC value, however, was presented in item 10 (“Are you aware of your artificial knee when doing housework/buying groceries/farming?”, ICC = 0.95), a question based on objective fact, which indirectly revealed the success of cross-cultural adaptation. Furthermore, the 2-week gap for the two separated evaluation of questionnaire was appropriate, according to studies published previously, that the knee function reaches plateau beyond 1 year after TKA [27, 28], which avoided possible error.
The correlation between SC-FJS and domains of KOOS, as well as SF-36, was in accordance with our hypothesis. The association between SC-FJS and symptoms and pain domains of KOOS was the strongest in our study (r = 0.672 and 0.604, respectively; good). One possible reason might be that these two domains of KOOS and FJS were both designed for evaluation of joint function and symptoms, and symptoms and pain are both important causes for patients getting aware of the artificial joint. Likewise, function in daily living and sport and recreation domains of KOOS and physical subscales of SF-36 were moderately correlated with SC-FJS (r = 0.40–0.53). The correlation, however, was weaker than symptoms and pain domains of KOOS, perhaps because the two domains of KOOS indicated specific situation instead of specific sensation, which were not as direct as symptoms and pain; and SF-36 was a scale for general situation and showed less accuracy than other specific scales . In addition, mental subscales of SF-36 were weakly associated with SC-FJS (r = 0.20 or p > 0.05), which could be well understood as psychological state was affected by many factors other than physical situation.
There are several limitations in our study. First, the sample was limited in size and may not fully represent the Chinese population. Second, although simplified Chinese is the official language in China, China is a country with multiple nationalities, most of which have their own language. Thus, the problem of national cultural differences should be noted. Finally, the authors did not evaluate the responsiveness of SC-FJS, which could be carried out in the follow-up studies.
In summary, FJS was successfully translated and cross-culturally adapted into simplified Chinese. The SC-FJS demonstrated good reliability and validity in the evaluation of mainland Chinese patients with history of TKA. Suggestion for improvement of FJS would be adding the choice “I can’t do this” to item 12 scoring 0. The FJS seems promising, and this work will greatly promote the use of FJS by physicians and researchers in Mainland China in data collection.
Corrected item-total correlation
Forgotten Joint Score
Health-related quality of life
Intra-class correlation coefficient
Knee injury and osteoarthritis outcome score
Simplified Chinese version of the Forgotten Joint Score
The short form (36) health survey
Total knee arthroplasty
Fischer M, von Eisenhart-Rothe R, Simank HG. Comparable short-term results seen with standard and high-flexion knee arthroplasty designs in European patients. J Orthop. 2013;10:119–22.
Hawker G, Wright J, Coyte P, Paul J, Dittus R, Croxford R, Katz B, Bombardier C, Heck D, Freund D. Health-related quality of life after knee replacement. J Bone Joint Surg Am. 1998;80:163–73.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417–32.
Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med. 1993;118:622–9.
Freedman KB, Back S, Bernstein J. Sample size and statistical power of randomised, controlled trials in orthopaedics. J Bone Joint Surg (Br). 2001;83:397–402.
Pynsent PB. Choosing an outcome measure. J Bone Joint Surg (Br). 2001;83:792–4.
Zheng W, Li J, Zhao J, Liu D, Xu W. Development of a valid simplified Chinese version of the Oxford hip score in patients with hip osteoarthritis. Clin Orthop Relat Res. 2014;472:1545–51.
Behrend H, Giesinger K, Giesinger JM, Kuster MS. The “forgotten joint” as the ultimate goal in joint arthroplasty: validation of a new patient-reported outcome measure. J Arthroplasty. 2012;27:430–6. e431.
Thomsen MG, Latifi R, Kallemose T, Barfod KW, Husted H, Troelsen A. Good validity and reliability of the forgotten joint score in evaluating the outcome of total knee arthroplasty. Acta Orthop. 2016;87:280–5.
Thienpont E, Opsomer G, Koninckx A, Houssiau F. Joint awareness in different types of knee arthroplasty evaluated with the Forgotten Joint score. J Arthroplasty. 2014;29:48–51.
Shadid MB, Vinken NS, Marting LN, Wolterbeek N. The Dutch version of the Forgotten Joint Score: test-retesting reliability and validation. Acta Orthop Belg. 2016;82:112–8.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–91.
Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome Score (KOOS)—development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28:88–96.
Brazier JE, Harper R, Jones NM, O'Cathain A, Thomas KJ, Usherwood T, Westlake L. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305:160–4.
Li L, Wang HM, Shen Y. Chinese SF-36 health survey: translation, cultural adaptation, validation, and normalisation. J Epidemiol Community Health. 2003;57:259–63.
Xie F, Li SC, Roos EM, Fong KY, Lo NN, Yeo SJ, Yang KY, Yeo W, Chong HC, Thumboo J. Cross-cultural adaptation and validation of Singapore English and Chinese versions of the Knee injury and Osteoarthritis Outcome Score (KOOS) in Asians with knee osteoarthritis in Singapore. Osteoarthritis Cartilage. 2006;14:1098–103.
Dawson J, Rogers K, Fitzpatrick R, Carr A. The Oxford shoulder score revisited. Arch Orthop Trauma Surg. 2009;129:119–23.
Coste J, Fermanian J, Venot A. Methodological and statistical problems in the construction of composite measurement scales: a survey of six medical and epidemiological journals. Stat Med. 1995;14:331–45.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.
Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.
Wei X, Wang Z, Yang C, Wu B, Liu X, Yi H, Chen Z, Wang F, Bai Y, Li J, et al. Development of a simplified Chinese version of the Hip Disability and Osteoarthritis Outcome Score (HOOS): cross-cultural adaptation and psychometric evaluation. Osteoarthritis Cartilage. 2012;20:1563–7.
Liu D, He X, Zheng W, Zhang Y, Li D, Wang W, Li J, Xu W. Translation and validation of the simplified Chinese new Knee Society Scoring System. BMC Musculoskelet Disord. 2015;16:391.
Symonds T, Hughes B, Liao S, Ang Q, Bellamy N. Validation of the Chinese Western Ontario and McMaster Universities Osteoarthritis Index in patients from Mainland China with osteoarthritis of the knee. Arthritis Care Res (Hoboken). 2015;67:1553–60.
Giesinger JM, Kuster MS, Holzner B, Giesinger K. Development of a computer-adaptive version of the forgotten joint score. J Arthroplasty. 2013;28:418–22.
Thompson SM, Salmon LJ, Webb JM, Pinczewski LA, Roe JP. Construct validity and test re-test reliability of the forgotten joint score. J Arthroplasty. 2015;30:1902–5.
Shoji H, Solomonow M, Yoshino S, D'Ambrosia R, Dabezies E. Factors affecting postoperative flexion in total knee arthroplasty. Orthopedics. 1990;13:643–9.
Kim YH, Choi Y, Kim JS. Range of motion of standard and high-flexion posterior cruciate-retaining total knee prostheses a prospective randomized study. J Bone Joint Surg Am. 2009;91:1874–81.
Patrick DL, Deyo RA. Generic and disease-specific measures in assessing health status and quality of life. Med Care. 1989;27:S217–32.
This project was funded by National Natural Science Foundation of China (grant number: 81171727).
Availability of data and materials
The datasets during and/or analyzed during the current study are available from the corresponding author on reasonable request.
SQC, QRQ, and NL are involved in the study design. SQC, WXH, and YPZ performed the data analysis. SQC and WXH translated the questionnaires. NL, FP, YC, LXL, QWF, and WJZ collected the data. SQC and NL wrote the manuscript. SQC and WXH revised the manuscript. SQC, WXH, QRQ, and YPZ modified the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
All procedures performed in this study involving human participants were approved by the Ethical Committee of Changzheng Hospital, which followed the ethical standards of the institutional and national research committee and the 1964 Helsinki Declaration and its later amendments. Informed consent was obtained from all individual participants included in the study.
About this article
Cite this article
Cao, S., Liu, N., Han, W. et al. Simplified Chinese version of the Forgotten Joint Score (FJS) for patients who underwent joint arthroplasty: cross-cultural adaptation and validation. J Orthop Surg Res 12, 6 (2017). https://doi.org/10.1186/s13018-016-0508-5