Authors:
Nursohana Othman,Mohd Effendi @ Ewan MohdMatore,DOI NO:
https://doi.org/10.26782/jmcms.2020.06.00018Keywords:
content validity,expert panel,content validity ratio, Motor observation questionnaire for teachers (MOQ-T),Developmental coordination disorder (DCD),Abstract
Abstract There are limited studies that address the quality of measurement items in motor observation questionnaire for teachers (MOQ-T)even though their use has gained attention locally. One aspect of the item quality that can be reviewed is content validity through expert consensus. Therefore, this study aims to examine the content validity of MOQ-T instrument items using an expert panel. A total of 15 experts in the areas of measurement and evaluation, occupational therapy, motor development and special education were selected for this study through purposive sampling. A total of 18 MOQ-T items were analysed using Content Validity Ratio (CVR) analysis and the items were reviewed through email correspondence and face to face during meeting sessions with experts. The findings showed that all items are significant as they exceed the critical CVR value of 0.49. However, one new item was added as one of the items was broken down to two sentences in response to expert suggestions to avoid items that are 'double barrelled' where conjunctions like 'and’ are used to describe two different issues for one intended response. Subsequently, new items were derived to measure the skills needed. This study contributed to new MOQ-T with 19 items that can be used by teachers to study special needs students in Malaysia. For further research, it is proposed that new psychometric measurement theories, such as the Rasch measurement model can be added to improve the reliability of motor measurement items for teachers including MOQ-T. In addition, this study created an opportunity to review the localised version of MOQ-T that can be used for the initial screening of developmental coordination disorder (DCD) problems in the context of special needs students in Malaysia.Refference:
I. Ab Aziz, A., Yusof, Z.M. &Mokhtar, U.A.“Electronic document and records management system (edrms) adoption in public sector-instrument’s content validation using content validation ratio (CVR)”. Journal of Physics: Conference Series 1196(1), 2019.
II. Ahari, M.N., Azad, A., Alizadeh-Zarei, M., Ebadi, A., Parand, A. &Mohammadi, P. “Development and Validity of the School Interim Competency of Performance Skill Battery Scale (SICPSBS)”. International Journal of Paediatrics-Mashhad 6(11): 8451–8473, 2018.
III. Ahmad, N.A., Drus, S.M., Kasim, H. & Othman, M.M. “Assessing Content Validity of Enterprise Architecture Adoption Questionnaire (EAAQ) Among Content Experts”. Proceedings of 2019 IEEE 9th Symposium on Computer Applications & Industrial Electronics (ISCAIE) 160–165, 2019.
IV. Ali, N., Tretiakov, A. &Whiddett, D. “A Content Validity Study for a Knowledge Management System Success Model in Healthcare”. Journal of Information Technology Theory and Application (JITTA) 15(2): 3, 2014.
V. Almanasreh, E., Moles, R. & Chen, T.F. “Evaluation of methods used for estimating content validity”. Research in Social and Administrative Pharmacy 15(2): 214–221. http://dx.doi.org/10.1016/j.sapharm.2018.03.066, 2019.
VI. Asunta, P., Viholainen, H., Ahonen, T. &Rintala, P. “Psychometric properties of observational tools for identifying motor difficulties – a systematic review”. BMC Pediatrics 19(1): 1–13, 2019.
VII. Asunta, Piritta & Viholainen, Helena & Westerholm, Jari & Rintala, Pauli.“ Cultural Adaptation of Motor Observation Questionnaire for Teachers – development of Finnish version (MOQ-T-FI)”. Liikunta & Tiede. 52. 78-86, 2015.
VIII. Asunta, P., Viholainen, H., Ahonen, T. &Rintala, P. “Reliability and validity of theFinnish version of Motor Observation Questionnaire for Teachers (MOQ-T-FI)”:Abstracts of 11th International Conference on Developmental Coordination Disorder (DCD11) . Journal of Comorbidity 5(2): 32, 2015.
IX. Asunta, P., Viholainen, H,.Ahonen, T.,Cantell, M., Westerholm, J., Schoemaker, MM.,Rintala, P. 2017. “Reliability and validity of the Finnish version of the motor observation questionnaire for teachers”. Hum Movement Sci. 53:63–71, 2017.
X. Ayre, C. & Scally, A.J.“Critical values for Lawshe’s content validity ratio: Revisiting the original methods of calculation”. Measurement and Evaluation in Counselling and Development 47(1): 79–86, 2014.
XI. Baghestani, A.R., Ahmadi, F., Tanha, A. &Meshkat, M. “Bayesian Critical Values for Lawshe’s Content Validity Ratio”. Measurement and Evaluation in Counselling and Development 52(1): 69–73. https://doi.org/10.1080/07481756.2017.1308227, 2017.
XII. Bardid, F., Vannozzi, G., Logan, S.W., Hardy, L.L. & Barnett, L.M. “ A hitchhiker’s guide to assessing young people’s motor competence: Deciding what method to use”. Journal of Science and Medicine in Sport 22(3): 311–318. https://doi.org/10.1016/j.jsams.2018.08.007, 2019.
XIII. Bekwa, N.N.”The Development And evaluation of africanised items for multicultural cognitive assessment”. University of South Africa. PhD Dissertation. University of South Africa, 2016.
XIV. Braccialli, A.C., Araújo, R. de C.T. & Scherer, M. “Translation and cross-cultural adaptation of the Educational Technology Device Predisposition Assessment into Brazilian–Portuguese language”. Disability and Rehabilitation (10) 1–7. https://doi.org/10.1080/09638288.2019.1624839, 2019.
XV. Cairney J, Veldhuizen S. “Is developmental coordination disorder a fundamental cause of inactivity and poor health-related fitness in children?”.Dev Med Child Neurol. 55(s4):55–58, 2013.
XVI. Camden, C., Wilson, B., Kirby, A., Sugden, D. &Missiuna, C. 2015. “Best practice principles for management of children with developmental coordination disorder (DCD): Results of a scoping review”. Child: Care, Health and Development 41(1): 147–159, 2015.
XVII. Capistrano R, Ferrari EP, Souza LPD, Beltrame TS, Cardoso FL. “Concurrent validation of the MABC-2 motor tests and MABC-2 checklist according to the developmental coordination disorder questionnaire”. Br. Motriz: J Phys Ed. 21(1):100–6, 2015.
XVIII. Cohen, R. J., Swerdlik, M., &Sturman, E. “Psychological testing and assessment: and introduction of test and measurement (8thed.)”. New York: McGraw Hill, 2012
XIX. Colton, D. & Covert, R.W. “Designing and constructing instruments for social research and evaluation”. First Ed. San Francisco: John Wiley & Sons, Inc, 2007.
XX. Connell, L.E., Carey, R.N., de Bruin, M., Rothman, A.J., Johnston, M., Kelly, M.P. &Michie, S. “Links Between Behaviour Change Techniques and Mechanisms of Action: An Expert Consensus Study”. Annals of Behavioural Medicine 53(8): 708–720, 2019.
XXI. Creswell, J.W. “Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research” (Enhanced Pearson eText with Loose-Leaf Version–Access Card Package). New York: Pearson Education, Inc, 2015.
XXII. Creswell, J. W., & Creswell, J. D. “Research design: Qualitative, quantitative, and mixed methods approaches”. Thousand Oaks: Sage publications, 2017.
XXIII. Deming, W. E. “Sample design in business research (Vol. 23)”. New York: John Wiley & Sons, 1990.
XXIV. De Milander M, Coetzee FF, Venter A. “Teachers’ ability to identify children with developmental coordination disorder”. African Journal for Physical Activity and Health Sciences 2(Issue-41):990–1005, 2016.
XXV. DeVellis, R.F. “Scale Development Theory and Applications (Fourth Edition)”. Thousand Oaks: SAGE Publication, 2016.
XXVI. Dimitropoulou, D., Evaggelinou, C., Kourtesis, T., Ellinoudis, T. “Teacher rating checklists as assessment tools for the detection of Developmental Coordination Disorder: Their suitability for use by educators”. PANR Journal June 21, 2018. Retrieved from https://www.panr.com.cy/?p=1739., 2018.
XXVII. Dixon, D. & Johnston, M. “Content validity of measures of theoretical constructs in health psychology: Discriminant content validity is needed”. British Journal of Health Psychology 2019 ept. 24 (3): 477–484, 2019.
XXVIII. Doderer L, Miyahara M. “Critical triangulation of a movement test, questionnaires, and observational assessment for children with DCD”. Int J TherRehabil. 20(9):435–42, 2013.
XXIX. Dussart G. “Identifying the clumsy child in school: an exploratory study”. Br J Special Education 21(2):81–6, 1994.
XXX. Dutt, A., Tan, M., Alagumalai, S. & Nair, R. “Development and Validation of the Ability in Behaviour Assessment and Interventions for Teachers Using Delphi Technique and Rasch Analysis”. Journal of Autism and Developmental Disorders 49(5): 1976–1987. http://dx.doi.org/10.1007/s10803-019-03887-4, 2019.
XXXI. Engel-Yeger B, Hanna-Kassis A, Rosenblum S. “Can gymnastic teacher predict leisure activity preference among children with developmental coordination disorders (DCD)?” Res DevDisabil. 33(4):1006–13, 2012.
XXXII. GhazaliDarusalam,&SufeanHussin. “MetodologipenyelidikandalamPendidikan”. Kuala Lumpur: PenerbitUniversiti Malaya, 2016.
XXXIII. Giofrè, D., Barbato, L., Cornoldi, C. &Schoemaker, M.M. “Il MOQ-T: Un questionario per gliinsegnanti di facile utilizzo per la rilevazionedeisintomi del disturbodellacoordinazionemotoria”. PsicologiaClinicadelloSviluppo 19(3): 499–509, 2015.
XXXIV. Giofrè, D., Cornoldi, C. &Schoemaker, M.M. “Identifying developmental coordination disorder: MOQ-T validity as a fast screening instrument based on teachers’ ratings and its relationship with praxic and visuospatial working memory deficits”. Research in Developmental Disabilities 35(12): 3518–3525. http://dx.doi.org/10.1016/j.ridd.2014.08.032, 2014.
XXXV. Green D, Bishop T, Wilson BN, Crawford S, Hooper R, Kaplan B, Baird G.“ Is questionnaire-based screening part of the solution to waiting lists for children with developmental coordination disorder?” .Br J OccupTher. 68(1):2–10,2005.
XXXVI. Hamid Salehi, MahshidZarezadeh, S.B. “Validity and Reability of Persian Motor Obsevation Questionnaire for Teachers (PMOQ-T)”. Iranian Journal of Psychiatry & Clinical Psychology 18(3): 211–219. http://ijpcp.iums.ac.ir/article-1-1887-en.html, 2012.
XXXVII. Hasmayuzee, N., Hashim, B., Haron, Z. &Surat, S. “Ciri-CiriPsikometrikInstrumen Music Model of Academic Motivation Inventory (MMAMI)”.Proceeding of Seminar AntarabangsaIsu-IsuPendidikan (ISPEN2018), 2018.
XXXVIII. Hughes, C., Foley, S., White, N. & Devine, R.T. “School readiness in children with special educational needs and disabilities: Psychometric findings from a new screening tool, the Brief Early Skills, and Support Index”. British Journal of Educational Psychology 88(4): 06–627, 2018.
XXXIX. Hyrkäs, K., Appelqvist-Schmidlechner, K. &Oksa, L. “Validating an instrument for clinical supervision using an expert panel”. International Journal of Nursing Studies 40(6): 619–625, 2003.
XL. IlkerE,,Sulaiman A., &Musa, R.S.A. “Comparison of Convenience Sampling and Purposive Sampling Comparison of Convenience Sampling and Purposive Sampling”. American Journal of Theoretical and Applied Statistics 5 (1). January 2016:. 1-4, 2016.
XLI. James, C., MacKenzie, L. & Capra, M. “Content validity of the WorkHab functional capacity evaluation”. Australian Occupational Therapy Journal 66(3): 380–392, 2019.
XLII. Jongmans, M.J., Smits-Engelsman, B.C.M. &Schoemaker, M.M. “Consequences of Comorbidity of Developmental Coordination Disorders and Learning Disabilities for Severity and Pattern of Perceptual-Motor Dysfunction”. Journal of Learning Disabilities 36(6): 528–537, 2003.
XLIII. Junaid K, Harris SR, Fulmer KA, Carswell A. “Teachers’ use of the MABC checklist to identify children with motor coordination difficulties”. PediatrPhysTher. 12(4):158–63, 2000.
XLIV. Kadar, M., Ibrahim, S., Razaob, N.A., Chai, S.C. &Harun, D. “Validity and reliability of a Malay version of the Lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia”. Australian Occupational Therapy Journal 65(1): 63–68, 2018.
XLV. Kuisma, S. &Vaahtio, S. “Motoristentaitojenhavainnointijaarviointi päiväkodissa”.https://www.theseus.fi/bitstream/10024/116974/1/Kuisma_Satu_ja+Vaahtio_Satu.pdf, 2016.
XLVI. Lawshe, C.H. “Quantitative Approach to Content Validity”. Personnel Psychology 28(4): 563–575, 1975.
XLVII. Lynn, M. “Determination and quantification of content validity”. Nursing Research, 35(6), 382-385. http://dx.doi.org/10.1097/00006199-198611000-00017, 1986.
XLVIII. Mehdizadeh, A., Shafiee, M., Khadem-Rezaiyan, M., Sardar, M.A., Vatanparast, H., Rose, E., Rajabzadeh, M. &Nematy, M. “Evidence for the Validity of the Children’s Attraction to Physical Activity (CAPA) Scale in Iranian Preschool Children”. Journal of Pediatric Nursing 44: 52–57, 2019.
XLIX. MichalisAnastasiadis, Thomas Kourtessis, E.Z.“Educator’s ability to identify students with coordination disorders: A review of literature”. Arab Journal of Nutrition and Exercise (AJNE) 2(3): 139-151, 2017.
L. Mohd Effendi @ Ewan MohdMatore, HisyamsaniIdris, Normawati Abdul Rahman& Ahmad ZamriKhairani. “KesahanKandunganPakarInstrumen IKBAR BagiPengukuran AQ MenggunakanNisbahKesahanKandungan”. Proceeding of International Conference On Global Education V (ICGE V) (May): 979–997, 2017.
LI. Mohd Effendi MohdMatore& Ahmad ZamriKhairani. “Assessing the Content Validity of IKBAR using Content Validity Ratio”. Australian Journal of Basic and Applied Sciences 9(7): 255–257, 2015a.
LII. Mohd Effendi MohdMatore& Ahmad ZamriKhairani. “Face Validity of IKBAR using CVR method”. International Journal of Advances in Science, Engineering and Technology 3(2): 63–66, 2015b.
LIII. Nakai A, “The Development and Cross-Cultural Adaptation of the Developmental Coordination Disorder Questionnaire (DCDQ) and the Motor Observation Questionnaire for teachers (MOQ-T) for Japanese Children”. Presented at the 57thAnnual Meeting; 2010 Oct 26–31, AACAP, 2010.
LIV. NetelenbosJB.“Teachers’ ratings of gross motor skills suffer from low concurrent validity”. Hum Movement Sci. 24(1):116–37. https://doi.org/1 0.1016/j.humov.2005.02.001, 2005.
LV. Nowak, A. &Schoemaker, M. “Psychometric properties of the Polish version of the Motor Observation Questionnaire for teachers (MOQ-T)”. Human Movement 19(2): 31–38, 2018.
LVI. Nunnally, J.C. & Bernstein, I.H. “Psychometric Theory 3rd Edition”. New York: McGraw Hill, 1994.
LVII. Rubio D.M, Marla Berg-Weger, S.S.T. & E. Suzanne Lee, and S.R. “Objectifying content validity: Conducting a content validity study in social work research”. Social Work Research V.27(2): 94-104, 2003.
LVIII. Piek, J.P., Barrett, N.C., Dyck, M.J. &Reiersen, A.M. “Can the Child Behavior Checklist be used to screen for motor impairment?”. Developmental Medicine and Child Neurology 52(2): 200–204, 2010.
LIX. Piek JP, Edwards K. “The identification of children with developmental coordination disorder by class and physical education teachers”. Br J Educ Psychol. 67(1):55–6, 1997.
LX. Piek, J.P., Hands, B. &Licari, M.K.“Assessment of motor functioning in the preschool period”. Neuropsychology Review 22(4): 402–413, 2012.
LXI. Prado, M., Magalhães, L. & Wilson, B. “Cross-cultural adaptation of the Developmental Coordination Disorder Questionnaire for Brazilian children”. Brazilian Journal of Physical Therapy 13(3): 236–243, 2009.
LXII. Ramli, N.F., Talib, OManaf, U.K. A. & Hassan, S.A. “Content Validity of STEMTIP Using CVR Method”. International Journal of Academic Research in Business and Social Sciences 8(7): 1118–1125, 2018.
LXIII. Rodrigues, I.B., Adachi, J.D., Beattie, K.A. &MacDermid, J.C. “Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis”. BMC Musculoskeletal Disorders 18(1): 1–9, 2017.
LXIV. Rosenblum S. “The development and standardization of the children activity scales (ChAS-P/T) for the early identification of children with developmental coordinationdisorders”.ChildCareHealthDev. 32(6):619–32, 2006.
LXV. Schoemaker, M. M. “Manual of the motor observation questionnaire for teachers”. Groningen: Internal Publication. Center for Human Movement Sciences, 2003.
LXVI. Schoemaker, M.M., Flapper, B., Verheij, N.P., Wilson, B.N., Reinders-Messelink, H.A. & de Kloet, A. “Evaluation of the developmental coordination disorder questionnaire as a screening instrument”. Developmental Medicine and Child Neurology 48(8): 668–673, 2006.
LXVII. Schoemaker, M.M., Flapper, B.C.T., Reinders-Messelink, H.A. &Kloet, A. de. “Validity of the motor observation questionnaire for teachers as a screening instrument for children at risk for developmental coordination disorder”. Human Movement Science 27(2): 190–199, 2008.
LXVIII. Schoemaker MM, Niemeijer AS, Flapper BC, Smits-Engelsman BC. “Validity and reliability of the movement assessment battery for children-2 checklist for children with and without motor impairments”. Dev Med Child Neurol. 54(4):368–75, 2012.
LXIX. Sekaran, U. &Bougie, R. “Research Methods for Business A Skill-Building Approach”. Illinois: Wiley, 2016.
LXX. Shalbafan, M., Najarzadegan, M., Soraya, S., Rashedi, V., Najafian, R., Ahmadkhaniha, H., Seddigh, R., Hassanzadeh, M., Saeedi, V. &Kamalzadeh, L. “Validity and Reliability of the Persian Version of Internet Sex Screening Test in Iranian Medical Students”. Sexual Addiction & Compulsivity 26 2019 3-4: 1–10, 2019.
LXXI. Shorten, A. &Moorley, C. “Selecting the sample”. Evidence-Based Nursing 17(2): 32–33, 2014.
LXXII. Shrotryia, V.K. &Dhanda, U. “Content Validity of Assessment Instrument for Employee Engagement”. SAGE Open January-March 2019: 1-7, 2019.
LXXIII. Sourani, A. &Sohail, M. “The Delphi Method: Review and Use in Construction Management Research”. International Journal of Construction Education and Research 11(1): 54–76, 2015.
LXXIV. Stevenson, W.A. “Examining School Readiness”. PhD Dissertation: University of Kentucky, 2019.
LXXV. Swami, V. & Barron, D. “Translation and validation of body image instruments: Challenges, good practice guidelines, and reporting recommendations for test adaptation”. Body Image 1–17. https://doi.org/10.1016/j.bodyim.2018.08.014, 2018.
LXXVI. Swan, M.A. & Hobbs, B.B. “Querying Rural Content Experts Using an Online Questionnaire”. Online Journal of Rural Nursing and Health Care 18(2): 189–203, 2018.
LXXVII. Syed SofianSyed,Mohammad Aziz Shah MohdArip, Muhammad BazlanMustafa,MohdHanafiMohdYasin“Pembinaan Dan KesahanInventoriKebijaksanaanEmosi”Confrence.KUIS.edu.my. 014-ISRA-2017:1–8, 2017.
LXXVIII. Taherdoost, H. “Validity and Reliability of the Research Instrument; How to Test the Validation of a Questionnaire/Survey in a Research”. SSRN Electronic Journal 5(3): 28–36, 2018.
LXXIX. Tamuri, A.H. “The Validity and Reliability of Da’ Wah Education” :108–118, 2019.
LXXX. ThalissaManiaes, Ana Paula Carraro&IndiaraSoares Oliveira. “Evaluation of the Translation, Cross-cultural Adaptation and Properties of Measurement of the FACT-BMT Questionnaire”. Journal of Pharmacy and Pharmacology 7(1): 1–14, 2019.
LXXXI. Tin, A.C. &Wah, L.L. “Instrumen penilaiankualitimodulpengajaran: Pengujianciripsikometrik”. Jurnal Kurikulum Pengajaran Asia Pasifik 4(4): 1–19, 2016.
LXXXII. Tsai, T.I., Luck, L., Jefferies, D. & Wilkes, L.”Challenges in adapting a survey: Ensuring cross-cultural equivalence”. Nurse Researcher 26(1): 21–25,2018.
LXXXIII. Tsang, S., Royse, C.F. &Terkawi, A.S. “ Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine”. Saudi Journal of Anaesthesia 13(3): 281,2017.
LXXXIV. Van Dellen, T., & Kalverboer, A. F. “Groninger Motorische Observatielijst [Groningen Motor Observation Scale]”. Laboratory for experimental psychology, Groningen State University,1990.
LXXXV. Vermeulen, J., Peersman, W., Quadvlieg, L., Fobelets, M., De Clercq, G., Swinnen, E. &Beeckman, K.Development and validation of the Midwife Profiling Questionnaire assessing women preferred perinatal care professional and knowledge of midwives’ legal competences. Sexual and Reproductive Healthcare 16(September 2017): 23–32. https://doi.org/10.1016/j.srhc.2018.01.003, 2018.
LXXXVI. Wilson, B.N., Crawford, S.G., Green, D., Roberts, G., Aylott, A., & Kaplan, B. “Psychometric Properties of the Revised Developmental Coordination Disorder Questionnaire”. Physical & Occupational Therapy in Pediatrics, 29(2):182-202,2009.
LXXXVII. Wilson, P.H., Smits-Engelsman, B., Caeyenberghs, K., Steenbergen, B., Sugden, D., Clark, J., Mumford, N. & Blank, R. “Cognitive and neuroimaging findings in developmental coordination disorder: new insights from a systematic review of recent research””. Developmental Medicine and Child Neurology 59(11): 1117–1129,2017.
LXXXVIII. Wilson, F. R., Pan, W., &Schumsky, D. A. Recalculation of the Critical Values for Lawshe’s Content Validity Ratio”. Measurement and Evaluation in Counseling and Development, 45(3), 197–210, 2012.
LXXXIX. World Health Organization. “The World Health Organization quality of life assessment (WHOQOL): Position paper 1995”.Social Science and Medicine, 41(10): 1403-1409,1995.
XC. Wright HC, Sugden DA, Ng R, Tan J. “Identification of children with movement problems in Singapore: usefulness of the movement ABC checklist”. APAQ. 11(2):150–7, 1994.
XCI. Wright HC, Sugden DA. “A two-step procedure for the identification of children with developmental co-ordination disorder in Singapore”. Dev Med Child Neurology 38(12):1099–105, 1996.
XCII. Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H. & Nikanfar, A.-R. “Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication”. Journal of Caring Sciences 4(2): 165–178. http://dx.doi.org/10.15171/jcs.2015.017, 2015.
View Download