학술

The relationship between cognitive performance on generic cognitive tests and a sport themed reaction time test

PLOS ONE
CC BY
이 매체는 공공·자유 라이선스로 본문을 직접 표시합니다.

Figures
Abstract
In sport, generic cognitive tests are used to assess baseline cognitive function and monitor concussion. The understanding of how performance on these generic cognitive tests relates to sport-specific cognitive performance is unknown. This study assessed relationships between cognitive performance on generic cognitive tests versus a sport-themed reaction time (RT) test. Twenty (mean±SD, age = 24 ± 6years; height = 169.15 ± 6.21 cm; mass = 66.50 ± 7.92 kg) women’s Australian-rules football players participated. The tests included: (i) Deary Liewald; (ii) one-back; (iii) four-choice reaction time; (iv) two-back; (v) one-card learning; and, (vi) three-back. The sport-themed RT test replicated a reactive defending scenario with the participant responding to an attacking opponent changing direction. Performance accuracy and reaction time for correct responses were assessed for all tests, with balanced integration scores calculated to describe overall speed-accuracy performance. Pearson’s r correlations were used to explore the strength and statistical significance (Benjamini-Hochberg adjusted alpha of 0.05) of relationships between the generic cognitive and sport themed RT tests. A statistically significant correlation (r = 0.618, p = 0.005, CI: 0.230–0.840) for correct reaction time was found between the four-choice reaction time test and the sport-themed RT test suggesting generic cognitive tests of similar nature (i.e., filtering of multiple cues) relates closely to reactions to sport-specific cognitive stimuli. With one statistically significant relationship found between generic cognitive tests to a sport-themed test, this suggests future research is required to improve the ecological validity of cognitive testing in sport.
Citation: Rolley TL, Saunders N, Goodwill A, Major B, Shultz S, Fox AS (2026) The relationship between cognitive performance on generic cognitive tests and a sport themed reaction time test. PLoS One 21(11): e0362872. https://doi.org/10.1371/journal.pone.0362872
Editor: Filippo Bertozzi, ASPIRE Academy for Sports Excellence, QATAR
Received: November 17, 2025; Accepted: October 31, 2026; Published: November 20, 2026
Copyright: © 2026 Rolley et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data associated with this work is available at: https://doi.org/10.5281/zenodo.17032668.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Optimal performance in sport involves the successful execution of motor skills which relies heavily on the complex interplay of neurocognitive processes [1,2]. In elite sporting environments, cognitive function is placed under increased stress with high-level spatial and temporal constraints placed on the athlete as a result of sporting rules, teammates and opponents [1,2]. Under these constraints, an athlete’s ability to quickly and accurately focus on and process relevant cues to facilitate decision making is crucial [1,2]. Superior cognitive function (e.g., faster reaction times, information processing speeds) allows athletes to have increased time available for preparation and organization of appropriate motor outputs in response to the sporting environment around them [1,2]. With increased time available for preparation, improved coordination and execution of a movement is observed in superior athletic performance [3], subsequently contributing to a reduced biomechanical injury risk [4]. Given the association between cognitive function and sporting performance [3] and injury risk [4], assessing and monitoring cognitive performance in the sporting landscape is of crucial importance.
In the sporting landscape cognitive performance is regularly assessed and monitored in the diagnosis and management of concussion. Concussion is defined as a traumatic brain injury and typically occurs due to direct impact sustained to the head and neck, or transfer of forces from impact from another region of the body to the head [5]. Australian football (AF) has one of the highest incidence rates of concussion. Compared to other contact team sports such as rugby union, elite AF concussion rates are significantly higher with 9.74 versus 17.63 per 1000 playing hours respectively. Amongst clinical symptoms (e.g., headaches, dizziness, nausea) [5] and physical signs (e.g., loss of consciousness, balance and focus difficulties) [5], concussion is also known to negatively impact cognitive performance (e.g., slowed reaction times, poor memory) [6,7]. For women, the severity of these post-concussive symptoms is greater and more prolonged compared to men [8,9]. Considering the prevalence of concussion within sport generic cognitive testing batteries such as the Sport Concussion Assessment Tool (SCAT-5) [10] and Computerized Cognitive Assessment Tool for Sport (CogSport; Cogstate) [11,12] are regularly used. The SCAT-5 is considered the gold standard for acute concussion diagnosis due to its practicality and feasibility as a paper-and-pencil assessment tool [10]. The reliability and validity of this tool in assessing cognitive function is questioned however due to the subjective nature of some of the tasks and susceptibility to practice/learning effects [11,12]. Subsequently, the use of computerized neurocognitive tests to conduct baseline testing and monitor cognitive performance following sports related concussion has become increasingly popular. Computerized neurocognitive tests such as the CogSport, have increased diagnostic sensitivity of concussion and have an improved test-retest reliability in comparison to paper-and-pencil evaluations [11,12]. Using a standardised deck of playing cards, the CogSport battery includes generic tests that assess cognitive domains of reaction time, attention/decision-making, working memory and new learning [11,12].
Despite the benefits of implementing computerized tests such as CogSport, the generic nature of the tests and the use of playing cards as the stimulus may limit the ability to draw insights when wanting to understand sport-specific cognitive performance. In competition, cognitive demands on a player are significantly increased. Players are required to filter multiple cues, in externally paced and unpredictable environments whilst under increased time pressures. Therefore, the cognitive processing required in sporting competition may differ from those needed to identify visual characteristics of a playing card. Wilke and colleagues [13] investigated the ecological validity of generic cognitive tests in the sporting environment finding generic tests were unable to predict a player’s ability to effectively perform fast motor actions under time constraints [13]. A key limitation to these generic cognitive tests is the lack of major relevant bodily movement with most tests being pen and paper or computer-based [13]. Therefore, these generic cognitive tests are restricted in their ability to capture and assess motor-cognitive processes regularly placed under demand in sporting environments. Due to the importance of cognitive function in sporting environments the ability to accurately and reliably capture sport-specific measures of cognitive performance is crucial and currently lacking. Therefore, if the test used to assess a player’s cognitive performance does not appropriately reflect the cognitive demands of the sport, we are unlikely to understand a player’s ability to respond and manage cognitive demands experienced in the sporting environment.
With computerized cognitive assessment tools such as CogSport becoming increasingly popular assessments of cognitive function and management of concussion return to play protocols in the sporting landscape, it is warranted to assess whether generic cognitive tests reflect sport-specific cognitive performance. Therefore, the aim of this study was to investigate cognitive performance between generic cognitive tasks and a sport themed reaction time (RT) task. It is hypothesised that generic cognitive tests assessing similar cognitive domains (e.g., reaction time) of similar task complexity will have stronger relationships with the sport themed RT test.
Materials and methods
The generic cognitive tests undertaken in this study reflect those used in the Computerized Cognitive Assessment Tool for Sport (CogSport; Cogstate) plus the Deary Liewald Test of simple- and choice-reaction time. The inclusion of the Deary Liewald tests was due to the importance and relevance of reaction time in the sport-themed test. Table 1 (see page 5) provides an overview of each generic cognitive test and the sport themed RT test performed, alongside the relevant cognitive domain examined. The sport themed RT test was designed by the research team to best replicate an in-match scenario, aligning to similar approaches implemented by other studies comparing generic and sport-specific cognitive function [14]. The sport themed reaction time test aimed to replicate a reactive defending scenario with the participant responding to an attacking opponent (i.e., video stimulus player – see Fig 1) changing direction. The generic tests were developed as custom coded applications using Python with the sport themed RT test developed using E-Prime (Psychology Software Tools; E-Prime). Testing was completed on the same laptop following the same testing order (i.e., simple RT, two-back, sport-themed RT, three-back, one-card learning, one-back, choice RT) to ensure consistency across participants. Order of testing was determined to be bell-shaped (i.e., low cognitive demand, high cognitive demand, low cognitive demand) to control for difficulty and fatigue across the testing session. Familiarization trials for all tests were performed. Across all tests, arcsine transformed response accuracy (i.e., number of correct responses) and correct reaction time (i.e., time taken when a correct response is registered) were collected. A balanced integration score (BIS) [15] was calculated for each participant on each test defined by:
Participants instructed to respond as soon as they could identify what direction the stimulus player was moving towards (i.e., left, or right-hand side of the screen). The above is an example of a left-hand cut being the correct response.
where and were the participants standardised z-scores (standardised to the study cohort) for the percentage of correct responses and average reaction time on correct responses, respectively. The BIS equally weighted response accuracy and reaction time providing an indication of performance from a speed-accuracy trade-off perspective [15]. Relationships between response accuracy, correct reaction time and BIS on the generic cognitive tests and the sport themed RT test were assessed using Pearson’s r correlations (α = 0.05). To minimise false discovery rate and account for multiple correlations, p-values were adjusted using the Benjamini-Hochberg procedure. A threshold for response accuracy was set at 70% for data to be considered valid on a test. Correlations were interpreted as ‘weak’ (r = 0.1–0.39), ‘moderate’ (r = 0.40–0.69) and ‘strong’ (r = 0.70–0.89) [16].
Results
Data was normally distributed with two data points removed from the data set as outliers as they failed to meet the set threshold of 70%. One participant was removed from the two-back test (i.e., 62% response accuracy), and one participant was removed from the four-choice reaction time test (i.e., 42% response accuracy). Descriptive data for correct response time, response accuracy and BIS are shown in Fig 2. Using the Benjamini-Hochberg adjusted p-values, statistically significant positive correlations were found for correct reaction time between the four-choice reaction time test and the sport themed RT test (r = 0.618, p = 0.005, CI: 0.230–0.840). No other statistically significant correlations were found for correct reaction time and performance accuracy between generic cognitive tests and the sport themed RT test (see Fig 3). When speed and accuracy were considered (i.e., BIS), Benjamini-Hochberg adjusted p-values found no statistically significant correlations. The tests most closely positively correlated with the sport-themed RT test for BIS were the two-back test (r = 0.447) and the one-card learning test (r = 0.562) (see Fig 3).
Individual r and p-values for each relationship to the sport themed RT test are displayed on each panel, with an asterisk signifying p-values that remained statistically significant following alpha level adjustment.
Discussion
An athlete’s ability to quickly and effectively respond to cues (i.e., decision-making, processing speed, anticipation) is pivotal to sporting performance [3] and injury risk [4]. Given the importance of cognitive performance in the sporting landscape and regular use of generic cognitive tests in assessments, investigation into whether current cognitive assessment tools reflect sport-specific cognitive performance is warranted. Enhanced specificity to cognitive testing in sport may be particularly important in obtaining true insights into sport-specific cognitive function and subsequently improve athlete care and management in return from concussion. This study assessed the relationship between commonly implemented generic cognitive tests and a sport themed RT test. The four-choice reaction time test exhibited the strongest relationship with the sport themed RT test for correct reaction time (r = 0.618, p = 0.005, CI: 0.230–0.840), supporting the hypothesis that generic cognitive tests with greater complexity would be more reflective of cognitive sporting demands. No other statistically significant correlations were found for correct reaction time and performance accuracy between generic cognitive tests and the sport themed RT test.
The weak to moderate correlations between the majority of generic cognitive tests and the sport themed RT test may be explained by the test complexity construct (i.e., the more elements involved in a task, the greater the impact on performance) [17]. This hypothesis is supported by the only generic test reaching statistical significance being the four-choice reaction time test. The four-choice reaction time test was the only generic test requiring the processing of multiple cues at once, highlighting that a stronger relationship to sport-themed cognitive performance came with greater task complexity. When anticipating an opponent’s change of direction, multiple cues (e.g., postural cues, pattern recognition, sporting context) are filtered under strict time constraints [18]. Therefore, it is perhaps unsurprising that the generic cognitive test involving multiple cues exhibited a relationship with the sport-themed cognitive test for reaction time. Despite the relationship reaching statistical significance, it is important to note the wide 95% confidence intervals for the correlation statistic (i.e., 0.230–0.840) between the four-choice reaction time and sport-themed RT tests. This result is potentially driven by the small sample size of our study, but could also be indicative of considerable inter-individual variability in how well an individual’s results on these two tests are related. Our findings support the use of the four-choice reaction time as a potential measure of sport-specific cognitive performance, however users should still proceed with caution and consider supplementary sport-themed tasks as support.
The nature of test stimuli may have also played a role in the limited and weak relationships identified in the present study. The stimuli presented in the sport-themed RT test would likely be perceived as more contextually relevant to the participants of this study over the stimuli presented in the generic cognitive tests. While the generic cognitive tests included in the study assess the same cognitive outputs (i.e., reaction time and response accuracy), the nature of the stimuli triggering the response varied between these tests. Stimulus correspondence (i.e., the degree to which a test stimuli reflects the perceptual information in the real-world) is flagged as an important component of test ecological validity [19]. A plausible argument is that the generic cognitive tests may lack ecological validity as they are assessing general processing speed or attention, whereas the inclusion of sporting stimuli in the sport-themed RT test allows assessment of sport-specific perceptual-cognitive skill. Our findings are unable to prove this argument, however we propose that incorporating sporting stimuli into cognitive testing could improve task correspondence and enhance ecological validity.
The speed-accuracy trade-off refers to individuals sacrificing accuracy (i.e., correct responses) in prioritising quicker reaction times, and vice versa. In the sporting landscape, this may present as the balance between quicker movements versus precise execution [20]. To explore this concept in the present study, balance integration scores were calculated from response time and accuracy [15]. Whilst not reaching statistical significance, the two-back (r = 0.447, p = 0.063) and one-card learning (r = 0.562, p = 0.010, did not remain statistically significant following alpha level adjustment) tests were the most strongly correlated with the sport-themed test for BIS. Interestingly, other generic learning-focused tests (i.e., one-back and three-back tests) did not have the same strength of relationship with the sport-themed test. This may be explained by the one-back and three-back tests being easier and harder, respectively, when compared to the two-back and one-card learning tests. Therefore, the complexity of the two-back and one-card learning tests may represent a closer level of cognitive complexity as the sport-themed RT test. Given the lack of statistical significance and wide confidence intervals for these correlations, these results are speculative and require more detailed exploration in future research. Understanding the level of complexity in generic cognitive tests relative to other common reactive sport-specific scenarios, while also considering metrics that consider both speed and accuracy may aid in the design of cognitive testing batteries.
Limitations
This study is exploratory in nature with the data used coming from a larger study. It is important to acknowledge the limitations of this study. First, only females playing Australian-rules football were included. As such, the results and interpretations are restricted to this population group. The participant sample for the present study was also leveraged as a convenience sample from a larger study, and therefore sample size was dictated by a power analysis for different outcomes specific to that larger study. It is plausible that the present study was underpowered to detect statistical significance for weak correlations and important that our findings are considered in the context of the sample size used. The confidence intervals alongside all correlations provides context of the potential variation in our findings, and future research with larger samples could assist in further understanding of how well generic cognitive tests align to sport-themed cognitive performance. Second, the cognitive tests were all computerized with little motor output required (i.e., finger motor control to keyboard was main motor output) therefore disconnecting the perception-action coupling process which is critical in sport [21]. In controlled laboratory testing environments, insight into how an athlete responds to an externally paced, unpredictable and rapidly changing sporting environment is likely lost. To enhance sport-specific cognitive testing to motor control assessment (i.e., cognitive performance testing incorporating both cognitive and movement demands of the specific sport), the inclusion of gross motor skills (i.e., performing a handball and/or kick) as the response task to an opposition player’s movement may be of benefit. Developing such a test would provide a more realistic representation of the demands experienced during a match. Third, the sport themed RT test was developed by the research team based on understanding of AFLW match demands and style of play. The testhas not been validated as measure of sport-specific cognitive function for women playing Australian rules football. This approach has, however, been used in previous research assessing sport-specific cognitive performance [14]. Fourth, performance on the sport-themed test may be influenced by sporting experience, with those having greater experience potentially processing familiar cues faster. Our study included variability in competition level and sport-specific experience, which may have influenced performance on the tests. Further investigation into how experience (i.e., years of AF played), expertise (i.e., level of AF competition) and exposure (i.e., number of AF matches played) influences cognitive test performance is therefore warranted to explore this relationship. Additional research in this space may then allow for the consideration of expertise level in the ability to respond to sport-specific stimuli (i.e., athletes with higher levels of expertise are known to respond better to dynamic, sport-specific cues) [22–24].
Conclusion
The findings from this study suggest that while practical, generic cognitive tests may provide limited representation of sport-related cognitive performance. This was particularly evident when focusing on isolated measures of reaction time and response accuracy. Awareness of these limitations in reflecting sport-related cognitive performance is particularly relevant given the weight placed on generic cognitive tests in the assessment and management of concussion in sport [5]. Our results suggest that more meaningful insights may be drawn from generic cognitive assessment tools that include an appropriate level of task complexity reflecting the cognitive demands in sport, while also incorporating metrics that consider speed and accuracy together. An increased specificity of cognitive testing in sport may improve our understanding of cognitive performance, and enhance athlete management and care when returning from concussion.
Acknowledgments
The authors would like to thank the staff who assisted in participant recruitment and players who participated from North Melbourne AFLW/VFLW, St. Kilda AFLW, Port Melbourne VFLW, Geelong AFLW/VFLW, Southern Saints VFLW, Hawthorn VFLW, Caulfield Grammarians VAFA.
References
- 1. Mori S, Ohtani Y, Imanaka K. Reaction times and anticipatory skills of karate athletes. Hum Mov Sci. 2002;21(2):213–30. pmid:12167300
- 2. Mann DTY, Williams AM, Ward P, Janelle CM. Perceptual-cognitive expertise in sport: A meta-analysis. J Sport Exerc Psychol. 2007;29(4):457–78. pmid:17968048
- 3. Trecroci A, Duca M, Cavaggioni L, Rossi A, Scurati R, Longo S, et al. Relationship between cognitive functions and sport-specific physical performance in youth volleyball players. Brain Sci. 2021;11(2):227. pmid:33673260
- 4. Avedesian JM, Forbes W, Covassin T, Dufek JS. Influence of cognitive performance on musculoskeletal injury risk: A systematic review. Am J Sports Med. 2022;50(2):554–62. pmid:33739889
- 5. McCrory P, Meeuwisse W, Dvorak J, Aubry M, Bailes J, Broglio S, et al. Consensus statement on concussion in sport-the 5(th) international conference on concussion in sport held in Berlin, October 2016. Br J Sports Med. 2017;51(11):838–47.
- 6. Kay T, Harrington ED, Adams R, Anderson T, Berrol S, Cicerone K, et al. Definition of mild traumatic brain injury. J Head Trauma Rehabil. 1993;8(3):86–7.
- 7. Gardner A, Iverson GL, McCrory P. Chronic traumatic encephalopathy in sport: A systematic review. Br J Sports Med. 2014;48(2):84–90. pmid:23803602
- 8. Levin HS, Temkin NR, Barber J, Nelson LD, Robertson C, Brennan J, et al. Association of sex and age with mild traumatic brain injury-related symptoms: A TRACK-TBI study. JAMA Netw Open. 2021;4(4):e213046. pmid:33822070
- 9. Sicard V, Moore RD, Ellemberg D. Long-term cognitive outcomes in male and female athletes following sport-related concussions. Int J Psychophysiol. 2018;132(Pt A):3–8. pmid:29572188
- 10. Hänninen T, Parkkari J, Howell DR, Palola V, Seppänen A, Tuominen M, et al. Reliability of the Sport Concussion Assessment Tool 5 baseline testing: A 2-week test-retest study. J Sci Med Sport. 2021;24(2):129–34. pmid:32868203
- 11. Collie A, Maruff P, Makdissi M, McCrory P, McStephen M, Darby D. CogSport: Reliability and correlation with conventional cognitive tests used in postconcussion medical evaluations. Clin J Sport Med. 2003;13(1):28–32. pmid:12544161
- 12. James K, Saw AE, Saw R, Kountouris A, Orchard JW. Evaluation of CogSport for acute concussion diagnosis in cricket. BMJ Open Sport Exerc Med. 2021;7(2):e001061. pmid:33981449
- 13. Wilke J, Vogel O, Ungricht S. Traditional neuropsychological testing does not predict motor-cognitive test performance. Int J Environ Res Public Health. 2020;17(20).
- 14. Reinhard ML, Mann DL, Höner O. The role of generic cognitive skills: An empirical investigation into the association between generic and sport-specific cognitive skills and playing level in youth football. J Sci Med Sport. 2025;28(7):587–93. pmid:40044540
- 15. Liesefeld HR, Janczyk M. Combining speed and accuracy to control for speed-accuracy trade-offs(?) Behav Res Methods. 2019;51(1):40–60. pmid:30022459
- 16. Schober P, Boer C, Schwarte LA. Correlation coefficients: Appropriate use and interpretation. Anesth Analg. 2018;126(5):1763–8. pmid:29481436
- 17. Liu P, Li Z. Task complexity: A review and conceptualization framework. Int J Ind Ergon. 2012;42(6):553–68.
- 18. Williams AM, Jackson RC. Anticipation in sport: Fifty years on, what have we learned and what research still needs to be undertaken? Psychol Sport Exerc. 2019;42:16–24.
- 19. Schmuckler MA. What is ecological validity? A dimensional analysis. Infancy. 2001;2(4):419–36.
- 20. Fitts PM. The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol. 1954;47(6):381–91. pmid:13174710
- 21. Eagle SR, Kontos AP, Pepping G-J, Johnson CD, Sinnott A, LaGoy A, et al. Increased risk of musculoskeletal injury following sport-related concussion: A perception-action coupling approach. Sports Med. 2020;50(1):15–23. pmid:31228023
- 22. Lee MJC, Lloyd DG, Lay BS, Bourke PD, Alderson JA. Effects of different visual stimuli on postures and knee moments during sidestepping. Med Sci Sports Exerc. 2013;45(9):1740–8. pmid:23481170
- 23. Cortes N, Blount E, Ringleb S, Onate JA. Soccer-specific video simulation for improving movement assessment. Sports Biomech. 2011;10(1):22–34. pmid:21560749
- 24. Schroeder LE, Peel SA, Leverenz BH, Weinhandl JT. Type of unanticipated stimulus affects lower extremity kinematics and kinetics during sidestepping. J Sports Sci. 2021;39(6):618–28. pmid:33161872

관련 뉴스