Development, validation and reliability of a questionnaire to evaluate coaches' and players' perceptions, learning, and resources regarding the ruck in rugby union

Article


Brooks, M., Parmar, N. and Kraak, W. 2024. Development, validation and reliability of a questionnaire to evaluate coaches' and players' perceptions, learning, and resources regarding the ruck in rugby union. South African Journal of Sports Medicine. 36 (1). https://doi.org/10.17159/2078-516X/2024/v36i1a17109
TypeArticle
TitleDevelopment, validation and reliability of a questionnaire to evaluate coaches' and players' perceptions, learning, and resources regarding the ruck in rugby union
AuthorsBrooks, M., Parmar, N. and Kraak, W.
Abstract

Background: The absence of a valid and reliable research tool for evaluating the attitudes, behaviours, and learning resources of rugby coaches and players concerning the ruck event presents a critical gap in the current rugby research landscape.
Objectives: The objective of this study was twofold: firstly, to adapt an existing questionnaire that focussed on the tackle event, and secondly, to validate and establish the reliability of the instrument. The questionnaire is designed to explore the attitudes, behaviours, and learning resources of rugby coaches and players, with a particular emphasis on the ruck event and its potential impact on the field of rugby coach development, coaching practices, and player development.
Methods: To assess content, construct, clarity, and relevance validation, a seven-step design process was followed, resulting in a high-quality questionnaire evaluated by a panel of 12 experts. Subsequently, a test-retest procedure involving 15 coaches and 16 players highlights the effectiveness of this questionnaire, emphasising its potential to generate data that can impact the field of rugby coaching and player development.
Results: The validity and reliability assessment revealed that the expert panel found the questionnaire to be appropriate, and clear, and the mean time for completion was approximately 22 minutes. The ICC Agreement scores of 0.71 for players and 0.88 for coaches indicate moderate and good agreement respectively, further corroborated by narrow 95% Confidence Intervals. ICC Consistency scores (0.71 for players and 0.87 for coaches) affirmed high response consistency. In Kendall’s W scores, players achieved 0.85, while coaches reached 0.93, with significant F-statistics (p < 0.01) supporting strong agreement.
Conclusion: This study introduces a methodically developed questionnaire, recognised for its clarity, reliability, and consistency. It serves as a valuable resource for future research in rugby, possessing the potential to influence coach development, coaching practices, and player development. Therefore, it makes an important contribution to the field.

Sustainable Development Goals3 Good health and well-being
Middlesex University ThemeHealth & Wellbeing
Research GroupPerformance Analysis at the London Sport Institute
PublisherSouth African Sports Medicine Association
JournalSouth African Journal of Sports Medicine
ISSN1015-5163
Electronic2078-516X
Publication dates
Online27 May 2024
Publication process dates
Accepted13 Mar 2024
Deposited31 May 2024
Output statusPublished
Publisher's version
License
File Access Level
Open
Copyright Statement

The South African Journal of Sports Medicine reserves copyright of the material published. The work is licensed under a Creative Commons Attribution 4.0 (CC BY 4.0) International License.

Digital Object Identifier (DOI)https://doi.org/10.17159/2078-516X/2024/v36i1a17109
Web of Science identifierMEDLINE:38887607
Permalink -

https://repository.mdx.ac.uk/item/1162z4

Download files


Publisher's version
SAJSM+36+Brooks+final.pdf
License: CC BY 4.0
File access level: Open

  • 27
    total views
  • 13
    total downloads
  • 6
    views this month
  • 1
    downloads this month

Export as

Related outputs

Expected Pass Turnovers (xPT) - a model to analyse turnovers from passing events in football
Peters, A., Parmar, N., Davies, M., Reeves, M., Sormaz, M. and James, N. 2024. Expected Pass Turnovers (xPT) - a model to analyse turnovers from passing events in football. Journal of Sports Sciences. https://doi.org/10.1080/02640414.2024.2379697
The influence of situational variables on the attacking process in football
Kim, J., James, N., Gwon, U., Kim, B., Parmar, N., Pocrnjič, M. and Vučković, G. 2024. The influence of situational variables on the attacking process in football. Kinesiologia Slovenica. 30 (1), pp. 127-140. https://doi.org/10.52165/kinsi.30.1.127-140
Validating and identifying KPIs in ATP/WTA hard court tennis match play (2019–2023) using the PWOL method
Venn-Moncur, M., Parmar, N., White, C, Callingham, T and Nicholls, S 2024. Validating and identifying KPIs in ATP/WTA hard court tennis match play (2019–2023) using the PWOL method. International Journal of Sports Science & Coaching. https://doi.org/10.1177/17479541241235595
Evaluating goal threat in football using player and ball locations
Nordahl, O., Kim, J., James, N., Gwon, U., Parmar, N., Nicholls, S. and Vuckovic, G. 2024. Evaluating goal threat in football using player and ball locations. Kinesiologia Slovenica. 29 (3), pp. 26-48. https://doi.org/10.52165/kinsi.29.3.26-48
The importance of appearing trustworthy in the workplace: performance analysts’ perspectives
Nelson, L., James, N., Nicholls, S., Parmar, N. and Groom, R. 2023. The importance of appearing trustworthy in the workplace: performance analysts’ perspectives. Sport, Education and Society. https://doi.org/10.1080/13573322.2023.2288844
A narrative review of the most demanding scenarios in basketball: Current trends and future directions
Alonso Pérez-Chao, E., Portes, R., Gómez, M., Parmar, N., Lorenzo, A. and Jiménez-Sáiz, S.L. 2023. A narrative review of the most demanding scenarios in basketball: Current trends and future directions. Journal of Human Kinetics. 89, pp. 231-245. https://doi.org/10.5114/jhk/170838
The role of debriefing in enhancing learning and development in professional boxing
Kojman, Y., Beeching, K., Gomez, M., Parmar, N. and Nicholls, S. 2022. The role of debriefing in enhancing learning and development in professional boxing. International Journal of Performance Analysis in Sport. 22 (2), pp. 250-260. https://doi.org/10.1080/24748668.2022.2042640
Performance analysis practice within Olympic and Paralympic sports: a comparison of coach and analyst experiences
Nicholls, S., James, N., Wells, J. and Parmar, N. 2022. Performance analysis practice within Olympic and Paralympic sports: a comparison of coach and analyst experiences. International Journal of Performance Analysis in Sport. 22 (3), pp. 343-351. https://doi.org/10.1080/24748668.2022.2054623
The physical characteristics underpinning performance of wheelchair fencing athletes: a Delphi study of Paralympic coaches
Villiere, A., Mason, B., Parmar, N., Maguire, N., Holmes, D. and Turner, A. 2021. The physical characteristics underpinning performance of wheelchair fencing athletes: a Delphi study of Paralympic coaches. Journal of Sports Sciences. 39 (17), pp. 2006-2014. https://doi.org/10.1080/02640414.2021.1912454
Assessing group-based changes in high-performance sport. Part 2: effect sizes and embracing uncertainty through confidence intervals
Turner, A., Parmar, N., Jovonoski, A. and Hearne, G. 2021. Assessing group-based changes in high-performance sport. Part 2: effect sizes and embracing uncertainty through confidence intervals. Strength and Conditioning Journal. 43 (4), pp. 68-77. https://doi.org/10.1519/SSC.0000000000000613
Assessing group-based changes in high-performance sport. Part 1: null hypothesis significance testing and the utility of p values
Turner, A., Parmar, N., Jovonoski, A. and Hearne, G. 2021. Assessing group-based changes in high-performance sport. Part 1: null hypothesis significance testing and the utility of p values. Strength and Conditioning Journal. 43 (3), pp. 112-116. https://doi.org/10.1519/SSC.0000000000000625
A comparison of match demands using ball-in-play versus whole match data in professional soccer players of the English Championship
Mernagh, D., Weldon, A., Wass, J., Phillips, J., Parmar, N., waldron, M. and Turner, A. 2021. A comparison of match demands using ball-in-play versus whole match data in professional soccer players of the English Championship. Sports. 9 (6), pp. 1-8. https://doi.org/10.3390/sports9060076
Exploring elite soccer teams’ performances during different match-status periods of close matches’ comebacks
Gomez, M., Reus, M., Parmar, N. and Travassos, B. 2020. Exploring elite soccer teams’ performances during different match-status periods of close matches’ comebacks. Chaos, Solitons and Fractals. 132, pp. 1-5. https://doi.org/10.1016/j.chaos.2019.109566
A comparison of match demands using ball-in-play vs. whole match data in elite male youth soccer players
Wass, J., Mernagh, D., Pollard, B., Stewart, P., Fox, W., Parmar, N., Jones, B., Kilduff, L. and Turner, A. 2020. A comparison of match demands using ball-in-play vs. whole match data in elite male youth soccer players. Science and Medicine in Football. 4 (2), pp. 142-147. https://doi.org/10.1080/24733938.2019.1682183
The attacking process in football: a taxonomy for classifying how teams create goal scoring opportunities using a case study of Crystal Palace FC
Kim, J., James, N., Parmar, N., Ali, B. and Vučković, G. 2019. The attacking process in football: a taxonomy for classifying how teams create goal scoring opportunities using a case study of Crystal Palace FC. Frontiers in Psychology. 10, pp. 1-8. https://doi.org/10.3389/fpsyg.2019.02202
Total score of athleticism: holistic athlete profiling to enhance decision-making
Turner, A., Jones, B., Stewart, P., Bishop, C., Parmar, N., Chavda, S. and Read, P. 2019. Total score of athleticism: holistic athlete profiling to enhance decision-making. Strength and Conditioning Journal. 41 (6), pp. 91-101. https://doi.org/10.1519/SSC.0000000000000506
Determining unstable game states to aid the identification of perturbations in football
Kim, J., James, N., Parmar, N., Ali, B. and Vučković, G. 2019. Determining unstable game states to aid the identification of perturbations in football. International Journal of Performance Analysis in Sport. 19 (3), pp. 302-312. https://doi.org/10.1080/24748668.2019.1602439
Using principal component analysis to develop performance indicators in professional rugby league
Parmar, N., James, N., Hearne, G. and Jones, B. 2018. Using principal component analysis to develop performance indicators in professional rugby league. International Journal of Performance Analysis in Sport. 18 (6), pp. 938-949. https://doi.org/10.1080/24748668.2018.1528525
Team performance indicators that predict match outcome and points difference in professional rugby league
Parmar, N., James, N., Hughes, M., Jones, H. and Hearne, G. 2017. Team performance indicators that predict match outcome and points difference in professional rugby league. International Journal of Performance Analysis in Sport. 17 (6), pp. 1044-1056. https://doi.org/10.1080/24748668.2017.1419409
Determining, scoring and presenting successful performance in professional rugby league
Parmar, N. 2017. Determining, scoring and presenting successful performance in professional rugby league. PhD thesis Middlesex University London Sport Institute