The Chiba Medical Society

Links

Chiba Medical J. 100E:49-56, 2024

doi:10.20776/S03035476-100E-4-P49

Original Article

Inter-examiner variability in three-dimensional kinematics of manual ankle anterior drawer test

Abstract

【Purpose】To clarify three-dimensional ankle kinematics during manual anterior drawer test in cadaveric anterior talofibular ligament (ATFL) injury models.

【Methods】A total of eight certified orthopedic surgeons performed anterior drawer tests on intact and ATFL-resected cadaveric ankles in a blind fashion. Three-dimensional ankle kinematics, including the ATFL length change, talar anterior translation, and talar internal rotation, were measured during the test using infrared markers mounted on the tibia and talus. An independent certified orthopaedic surgeon visually evaluated the examiner’s technique. Furthermore, the examiners also assessed ankle instability. The kinematic variables between the intact and ATFL-resected ankles were compared using Wilcoxon signed-rank tests.

【Results】The median (25th, 75th percentiles) ATFL length change during the maneuver was 3.1 (2.4, 6.8) mm in the intact and 6.2 (4.2, 7.3) mm in the ATFL-resected ankles, with no significant difference (P = 0.31). Moreover, three of eight examiners had smaller length changes in the ATFL-resected ankles than in the intact ankles. There were no significant differences in talar anterior translation or internal rotation between the ligament conditions. Five of the eight examiners assessed the intact ankle incorrectly as unstable, and two examiners assessed the ATFL-resected ankle incorrectly as stable.

【Conclusion】Ankle kinematics and examination techniques of manual anterior drawer tests varied greatly among certified orthopaedic surgeons. Moreover, the examiner’s assessments of instability were inconsistent. This study highlighted the difficulty of the anterior drawer test and the need for further research to improve the technique and diagnostic accuracy.

I.Introduction

Ankle sprains are the most common ankle injuries in daily life and sports activities. The anterior talofibular ligament (ATFL) is injured in 80% of sprains due to the inversion mechanism1. One-third of individuals experience residual symptoms one year after injury. Inadequate management may pose a risk of chronic ankle instability and ankle osteoarthritis2. Therefore, assessment of ankle instability is mandatory for satisfactory outcomes.

Manual anterior drawer test (ADT) is the most widely used technique for evaluating ankle instability due to lateral ankle ligament injury3. It is a simple physical examination, and no instrument is required. Therefore, ADT is recommended for assessing acute and chronic ATFL injury in clinical guidelines4,5. However, its implementation is not easy6. The reported diagnostic accuracy varies greatly among studies, with a specificity of 12%–80% and a sensitivity of 67%–100%2. While there are reports that ADT has higher diagnostic accuracy than stress X-rays, there are also reports that ADT alone does not have enough diagnostic accuracy to determine a treatment plan7. This variability suggests that disagreement in the test results could occur among examiners. For clinicians, whether their diagnosis agrees with the diagnosis made by colleagues is of interest8. This is a typical case in daily practice when patients are referred to different physicians with varying experience8. Therefore, identifying the differences among examiners provides essential information contributing to improved diagnostic accuracy.

Previous studies have reported various ADT techniques, which can cause insufficient test reliability 2,3. The variations include ankle and knee positions and placement of the examiner’s hands to hold the lower leg and foot. The direction of the stress to induce talar displacement is also variable, such as simple anterior drawer force, internal rotation, and their combination. Regardless of the techniques, a sufficient talar translation is mandatory for an accurate diagnosis. However, most reports on ADT used mechanical devices to apply controlled stress in a laboratory setting. The ankle position was also strictly fixed. The constrained environment does not recreate kinematic variations in clinical practice, in which the stress and ankle position may vary among examiners. Few studies have compared kinematics during manual ADT across examiners 6,9. However, the number of examiners in their study was relatively small, with the test maneuver being standardized6,9. To clarify the variability in ADT techniques and kinematics in clinical practice, a study with a large number of examiners and without a limitation on the test maneuver is necessary.

This study aimed to measure ankle kinematics during ADT in a cadaveric lateral ankle ligament injury model and three-dimensional motion analysis system.

II.Methods

Examiners

Inclusion criteria of the examiners were 1) board-certified orthopaedic surgeons and 2) those specializing in foot and ankle surgery. There was no specific exclusion criterion. The potential examiners were identified from hospitals in Chiba prefecture and were emailed for availability. A total of 8 male surgeons participated in the experiment. The mean ± standard deviation age was 43 ± 8 years, with a mean experience of 14 ± 8 years in foot and ankle surgery. The Research Ethics Committee of our institute approved this study, and informed consent was obtained from all examiners.

Cadaveric models

Two pairs of fresh-frozen, above-knee amputated limbs were used. They were 76-year-old male and 84-year-old female. The cadavers were thawed at room temperature 48 hours before the experiment. The absence of joint contracture, deformity, or osteoarthritic change was confirmed in both specimens. Intact and ATFL-resected models were created using the right ankle of each pair for kinematic analysis. A 3-cm skin incision was made along the anterior border of the lateral malleolus. After the subcutaneous tissue was dissected, the ATFL was exposed. In the intact model, no ligament resection was performed (sham surgery) and no instability was observed by direct inspection. In the ATFL-resected model, we cut the ligament in the mid-substance and instability was observed, followed by subcutaneous and skin closures. Left ankles were used as references for the examiner’s assessment of ankle instability during ADT. We also performed sham surgeries on the left ankles. The femur of each limb was fixed on an operating table using an external fixator. The lower leg was hung over the edge of the table.

Manual anterior drawer test

The examiners performed the anterior drawer tests on the intact and ATFL-resected ankles, blinded to the stability of the ankles and other examiner’s techniques. They were requested to conduct the test as they did in clinical practice. The evaluation items were 1) ankle kinematics, 2) assessment of ankle instability, and 3) examination technique.

Ankle kinematics

We measured the three-dimensional kinematics of the tibiotalar joint using a commercial motion capture system (VICON, Vicon Motion Systems Ltd, Oxfordshire, United Kingdom). A stainless steel pin of 4 mm diameter, mounted with five 14-mm reflective markers attached, was inserted into the anterior aspect of the tibial distal third and talar neck (Fig. 1A).

Anatomical coordinate systems of the tibia/fibula and talus were defined during surgery before transecting the ankle ligament. For the tibia/fibula, the origin was the center of the ATFL fibular footprint, depicted under a direct vision. Superoinferior, anteroposterior, and mediolateral axes were parallel to the International Society of Biomechanics recommendation in the ankle neutral position; the superoinferior axis was a line connecting the midpoint between the ankle medial and lateral malleolus and the midpoint between the medial and lateral tibial condyles10. The anteroposterior axis was a line perpendicular to a plane containing the medial and lateral malleolus and the superoinferior axis. The mediolateral axis was a line mutually perpendicular to the superoinferior and anteroposterior axes. For the talus, the origin was defined as the center of the ATFL fibular footprint. The coordinate axes were defined so that they were parallel to the tibia/fibular axes in a neutral ankle position. Six infrared cameras (Bonita 10, Vicon Motion Systems Ltd, Oxfordshire, United Kingdom) were placed to detect the motion of the reflective markers with a sampling frequency of 100 Hz (Fig. 1B). The tibiotalar kinematics were expressed as a motion of the talus relative to the tibia/fibula using Euler angles with a dorsi/plantarflexion-internal/external rotation-inversion/eversion sequence. Furthermore, we calculated the distance between the coordinate origins of the tibia/fibula and talus as the ATFL length. Raw kinematic data were smoothed using a Butterworth filter with a cutoff frequency of 6 Hz.

The primary kinematic outcome was the ATFL length change, defined as the difference between the maximum and minimum ATFL length during the test cycle6. The secondary outcomes were the change in talar anterior translation and internal rotation. After several trials to familiarize themselves with the experimental setting, the examiner performed five consecutive tests. We used the mean values of the second, third, and fourth trials for analysis.

Assessment of ankle instability

The examiners assessed the degree of ankle instability, with the contralateral left intact ankle as a reference. Instability was classified into three grades: - (stable), + (unstable), and ++ (very unstable with a sulcus sign) 5. The assessments were further dichotomized into stable (-) and unstable (+ and ++).

Examination technique

The examiners answered a questionnaire on their preferred ADT technique. Question items included 1) hand placement to hold the foot (hold the patient’s foot from the lateral side /hold the foot from the medial side /Hold the foot with the right hand regardless of the laterality of patient’s ankle/the foot with the left hand), 2) stress direction (anterior drawer with no internal or external foot rotation/anterior drawer with unconstrained foot rotation/anterior drawer with intentional rotation), 3) instability assessment (two grades with negative and positive/three grades with negative, positive, and gross). Additionally, a 44-year-old certified orthopaedic surgeon with 12 years of experience in foot and ankle surgery visually evaluated the position of the cadaveric limb during the examination. The evaluations were 4) ankle position (plantarflexed/neutral) and 5) knee position (flexed/extended).

Statistical analysis

We used descriptive statistics to present the ankle kinematics, examination technique, and examiner’s evaluation of ankle instability. Continuous variables were expressed using medians and interquartile values because they had non-normal distribution. Categorical variables were shown using numbers. The ATFL length changes and other kinematic variables between the intact and ATFL-resected ankles were compared using Wilcoxon signed-rank tests. Statistical significance was set at P < 0.05.

Fig. 1

Fig. 1 Experimental setting of ankle kinematics measurement. Placement of infrared markers (A) and cameras (B).

III.Results

The ATFL length changes during ADT ranged between 2.0 mm and 9.3 mm in the intact ankle and between 2.2 mm and 7.4 mm in the ATFL-resected ankle. The median ATFL length change was larger in the ATFL-resected ankle than in the intact ankle; however, the difference did not reach statistical significance (Table 1). When assessing the individual data, three examiners had smaller length changes in the ATFL-resected ankles than in the intact ankles (Fig. 2A). Similar to the ATFL length change, there were no significant differences in the talar anterior translation or internal rotation between the intact and ATFL-resected ankles (Table 1, Fig. 2B, and C).

In the ligament intact ankle, three of eight examiners assessed it as stable, while the other five evaluated it incorrectly as unstable. (Fig. 2A). Furthermore, six examiners assessed the ATFL-resected ankle as unstable, and the other two evaluated it incorrectly as stable. The instability assessments were not associated with the kinematic parameters and examiner’s age and years of experience, although statistical analysis was not performed (Fig. 2A-C). For example, the ATFL length changes for the ATFL-resected ankles by the incorrect examiners were above the median value at 6.5 mm and 6.9 mm (Fig. 2A).

The examination techniques were variable among examiners. The majority of examiners (n = 5) held the patient’s foot with the right hand regardless of the laterality of the ankle examined (Fig. 3A, Table 2). The others grasped the foot from the lateral side (Fig. 3B). One examiner performed ADT with the knee extended (Fig. 3C), while others performed it with the knee flexed. The ankle position was consistent among examiners and plantarflexed (Table 2).

Table 1 Ankle kinematics during anterior drawer test in the intact and ATFL-resected ankles.

Table 1

Fig. 2

Fig. 2 Ankle kinematics during anterior drawer test. ATFL length change (A), talar anterior translation (B), and internal rotation (C). Black and white circles indicate examiners with correct and incorrect instability assessments, respectively. ATFL, anterior talofibular ligament.

Fig. 3

Fig. 3 Various anterior drawer test techniques. An examiner holds the lower leg from the inside and the foot from the outside with the knee flexed (A), and another examiner grasps the lower leg from the outside and the foot from the inside (B). An examiner holds the lower leg with the knee extended (C).

Table 2 Examination technique.

Table 2

IV.Discussion

We found that the ankle kinematics during ADT varied across examiners, with no difference in the ATFL length changes between the intact and ATFL-resected ankles. Furthermore, some examiners misjudged instability. The examination techniques were also variable. Although orthopedic surgeons commonly evaluate ankle instability due to the prevalence of ankle sprains, our findings underscored the challenges in consistently conducting ADT and emphasized the imperative for technical standardization.

This study showed that the ATFL length changes were variable in intact and ATFL-resected ankles based on the examiner’s individual ADT methods. Despite a median length change of 3 mm greater in ATFL-resected ankles than intact ankles, the difference lacked statistical significance. Our results are consistent with previous cadaveric research that found variability in anterior talar displacement during ADT among five clinicians, even though the ankle plantarflexion angle during the examination was standardized9. The authors found a wide overlap in displacement between the intact and ATFL-resected ankles 9. Conversely, a separate study employing a standardized ADT technique after video instruction and one-hour hands-on training showed relatively small inter-examiner variance6. However, the difference in ATFL length change between the intact and ATFL-resected ankles was only about 2 mm6. Our study and existing literature suggest the necessity for standardizing techniques and training to ensure consistent kinematics across examiners.

Some examiners inaccurately assessed the intact ankle as unstable in our study. Our results contradict a recent meta-analysis that reported a high specificity of ADT2. A possible explanation is that we used cadaveric ankles. The talar displacement in cadaveric ankles may be larger than in vivo ankles due to the absence of muscle guarding, leading to false positive instability assessment on the ligament intact ankle 11. As a result, the specificity is lower in cadaveric studies than in vivo studies12. We also found that two examiners misdiagnosed the ATFL-resected ankle as stable, aligning with a meta-analysis reporting a low sensitivity of 54%2. ADT diagnosis requires a proper maneuver execution to induce sufficient talar translation and accurate interpretation of the talar translation. Difficulty in satisfying the two elements in knee and shoulder physical examination has been reported13. No gold standard exists for assessing ankle instability. Stress radiography has a large interpatient variability and low test-retest reliability14. The sonographic ADT has recently gained attention. However, it also resulted in measurement variability among examiners 15. Furthermore, these methods are not easily available because they need instruments. Our study highlighted a need for a more sophisticated ADT method.

We found that the examiner’s hand positions were inconsistent between examiners. Our results agree with a recent systematic review that addressed various ADT techniques. Further different methods have been proposed for improved diagnostic accuracy16,17, highlighting the absence of a standard ADT technique. However, subtle differences in stress direction may influence ankle kinematics and detection of talar displacement6,16,17. The knee position also plays a role because the tension of the gastrocnemius prevents the talar anterior translation with extended knees10. Similar to ADT, large inter-examiner differences have been reported for the pivot shift test of the knee18. Moreover, standardization of the pivot shift maneuver leads to diagnostic consistency among examiners 19. We did not assess the relationship between the ADT technique and kinematics because the number of examiners was limited. Further research is required to determine whether standardizing the technique produces consistent kinematics and sufficient diagnostic accuracy.

This study has several limitations. First, we used cadaveric ankles, which lack muscle contraction. However, measuring detailed kinematics using in vivo ankles is difficult. Second, the infrared markers for the kinematic measurement may have interfered with the examiners’ natural grasp of the ankle, although we carefully selected the marker positions to minimize the effect. Third, we did not measure the amount and direction of anterior drawer stress, which influences ankle kinematics. Fourth, we recruited examiners with a mean experience of 13 years. The measurements may be consistent if more experienced examiners performed ADT. Lastly, the number of examiners was determined based on availability. More examiners with formal power analysis may be necessary to determine the measurement differences between intact and unstable ankles.

In conclusion, the ankle kinematics and the examination techniques during ADT varied across examiners. The ankle instability assessments were also inconsistent. Our results highlighted the difficulty in performing the ADT correctly and emphasized the need for further research to establish a standardized technique and uniform evaluation.

Contributors

Guarantor of integrity of the entire study: SY, SO, TS. Study concepts and design: All authors. Clinical studies: SK, HN. Manuscript preparations: SK. Manuscript editing: SY.

Financial Support

The authors received no financial support for the research, authorship, and publication of this article.

Conflict of Interest

The authors declare that they have no conflicts of interest, either financial or non financial, with the contents of this article.

Seiji Ohtori is a member of the editorial board of Chiba Medical Journal.

Ethical approval

Ethical approval for this study was obtained from Chiba University Graduate School of Medicine Ethics Review Committee (APPROVAL NUMBER/ 3801).

Acknowledgements

The authors thank Dr. Tomonori Atsuta, Dr. Kentaro Amaha, Dr. Toru Omodani, Dr. Ryosuke Nakagawa, Dr. Kenji Takahashi, Dr. Kenichiro Takeshima, and Dr Tetsuro Yasui for participant of this study.

References

  • 1) Doherty C, Delahunt E, Caulfield B, Hertel J, Ryan J, Bleakley C. (2014) The incidence and prevalence of ankle sprain injury: a systematic review and metaanalysis of prospective epidemiological studies. Sports Med 44, 123-40.
  • 2) Netterström-Wedin F, Matthews M, Bleakley C. (2021) Diagnostic accuracy of clinical tests assessing ligamentous injury of the talocrural and subtalar joints: a systematic review with meta-analysis. Sports Health 14, 336-47.
  • 3) Larkins LW, Baker RT, Baker JG. (2020) Physical examination of the ankle: a review of the original orthopedic special test description and scientific validity of common tests for ankle examination. Arch Rehabil Res Clin Transl 2, 100072.
  • 4) Delahunt E, Bleakley CM, Bossard DS, Caulfield BM, Docherty CL, Doherty C, Fourchet F, Fong DT, Hertel J, Hiller CE, Kaminski TW, McKeon PO, Refshauge KM, Remus A, Verhagen E, Vicenzino BT, Wikstrom EA, Gribble PA. (2018) Clinical assessment of acute lateral ankle sprain injuries (ROAST): 2019 consensus statement and recommendations of the International Ankle Consortium. Br J Sports Med 52, 1304-10.
  • 5) Guillo S, Bauer T, Lee JW, Takao M, Kong SW, Stone JW, Mangone PG, Molloy A, Perera A, Pearce CJ, Michels F, Tourné Y, Ghorbani A, Calder J. (2013) Consensus in chronic ankle instability: aetiology, assessment, surgical indications and place for arthroscopy. Orthop Traumatol Surg Res 99, S411-9.
  • 6) Vaseenon T, Gao Y, Phisitkul P. (2012) Comparison of two manual tests for ankle laxity due to rupture of the lateral ankle ligaments. Iowa Orthop J 32, 9-16.
  • 7) Croy T, Koppenhaver S, Saliba S, Hertel J. (2013) Anterior talocrural joint laxity: diagnostic accuracy of the anterior drawer test of the ankle. J Orthop Sports Phys Ther 43, 911-9.
  • 8) Lange T, Freiberg A, Dröge P, Lützner J, Schmitt J, Kopkow C. (2015) The reliability of physical examination tests for the diagnosis of anterior cruciate ligament rupture--a systematic review. Man Ther 20, 402-11.
  • 9) Fujii T, Luo ZP, Kitaoka HB, An KN. (2000) The manual stress test may not be sufficient to differentiate ankle ligament injuries. Clin Biomech (Bristol, Avon). 15, 619-23.
  • 10) Wu G, Siegler S, Allard P, Kirtley C, Leardini A, Rosenbaum D, Whittle M, D’Lima D, Cristofolini L, Witte H, Schmid O, Stokes I. (2002) ISB recommendation on definitions of joint coordinate system of various joints for the reporting of human joint motion--part I: ankle, hip, and spine. International Society of Biomechanics. J Biomech 35, 543-8.
  • 11) Hanlon S, Caccese J, Knight CA, Swanik CB, Kaminski TW. (2016) Examining ankle-joint laxity using 2 knee positions and with simulated muscle guarding. J Athl Train 51, 111-7.
  • 12) Gribble PA. (2019) Evaluating and differentiating ankle instability. J Athl Train 54, 617-27.
  • 13) Stansfield RB, Diponio L, Craig C, Zeller J, Chadd E, Miller J, Monrad S. (2016) Assessing musculoskeletal examination skills and diagnostic reasoning of 4th year medical students using a novel objective structured clinical exam. BMC Med Educ 16, 268.
  • 14) Choi JH, Choi KJ, Chung CY, Park MS, Sung KH, Lee KM. (2021) Consistency and reliability of ankle stress radiography in patients with chronic lateral ankle instability. Orthop J Sports Med 9, 23259671211004099.
  • 15) Iwata S, Yamaguchi S, Kimura S, Hattori S, Mikami Y, Kawasaki Y, Shiko Y, Akagi R, Amaha K, Atsuta T, Ikegawa N, Koyama M, Nakagawa R, Omodani T, Ouchi H, Saito M, Takahashi K, Watanabe S, Sasho T, Ohtori S. (2023) Variability in sonographic anterior drawer test measurements of the ankle: experienced versus beginner examiners. J Orthop Sci Online ahead of print.
  • 16) Li Q, Tu Y, Chen J, Shan J, Yung PS, Ling SK, Hua Y. (2020) Reverse anterolateral drawer test is more sensitive and accurate for diagnosing chronic anterior talofibular ligament injury. Knee Surg Sports Traumatol Arthrosc 28, 55-62.
  • 17) Gomes JLE, Soares AF, Bastiani CE, de Castro JV. (2018) Anterolateral talar palpation: a complementary test for ankle instability. Foot Ankle Surg 24, 486-9.
  • 18) Kuroda R, Hoshino Y, Kubo S, Araki D, Oka S, Nagamune K, Kurosaka M. (2012) Similarities and differences of diagnostic manual tests for anterior cruciate ligament insufficiency: a global survey and kinematics assessment. Am J Sports Med 40, 91-9.
  • 19) Hoshino Y, Araujo P, Ahlden M, Moore CG, Kuroda R, Zaffagnini S, Karlsson J, Fu FH, Musahl V. (2012) Standardized pivot shift test improves measurement accuracy. Knee Surg Sports Traumatol Arthrosc 20, 732-6.

Others

Address correspondence to Dr. Satoshi Yamaguchi.
Graduate School of Global and Transdisciplinary Studies,
Chiba University, 133 Yahoi-cho, Inage-ku, Chiba-shi, Chiba
263-8522, Japan.
Phone: +81-43-226-2117.
Fax: +81-43-226-2116.
E-mail: y-satoshi@mvb.biglobe.ne.jp

go to the top