Content Validity of KIP-K Scholarship Instruments at Higher Education Using Aiken's Coefficient Validity Scale
AbstractThis study aims to analyze the KIP-K Scholarship instrument at PTKIN IAIN Langsa while developing non-test instruments (questionnaires). This instrument is used to obtain information about students who apply for KIP-K scholarships. The instrument of content validity is obtained through a quantitative analysis by nine selected experts and a qualitative approach with an expert review of a set of questionnaires that have been arranged. In determining the content validity and reliability level, the experts analyzed a questionnaire quantitatively consisting of 29 items with three components: economic, household, and academic and non-academic students’ achievements. The data from this expert judgment is calculated using the formula Aiken V. While expert reviews are qualitatively similar to suggestions and feedback, they are used to refine constructed items. The result of these students’ economic condition, household, and academic and non-academic achievements was above 0.72 with a significance level of 5%, namely 0.92, 0.96, and 0.96. All of the 29 items are very valid (V > 0.72, V1 > 0.50) and reliable (α = 0,944). The conclusion that each component is closely related indicates information on the feasibility of distributing KIP-K. The instruments embodied at IAIN Langsa have high validity, and the level of reliability is excellent. This instrument can obtain complete information on prospective students who will become KIP-K scholarship recipients in 2022. |
Keywords
Full Text:
References
Ahmed, B. (2021). Role of Higher Education Commission in Supporting Students with Lower Economic Conditions in Attaining Higher Education. Elementary Education Online, 20(4), 2292–2298.
Aiken, L. R. (1985). Three Coefficients for Analyzing The Reliability and Validity of Ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012
Aiken, R. (1996). Rating Scales & Checklists; Evaluating Behavior, Personality, and attitude. Canada: John Wiley & Sons Inc.
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of Methods Used for Estimating Content Validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Amjad, M., Zahida A, S., & Faheem, M. (2015). Impact of Socio-Economic Background of Students on their Achievements at Secondary Level. Pakistan Journal of Social Sciences (PJSS), 35(2), 981–995.
Babaee, M., Lê, Q., & Lê, T. (2013). How are The Concepts “Reliability” and “Validity” Dealt with in Qualitative Research? In Conducting Research in a Changing and Challenging World.
Bland, J. M. (1997). Statistics notes: Marketing. UK. McGraw-Hill International. Cronbach's alpha. BMJ, 314, 572. https://doi.org/10.1136/bmj.314.7080.572
Bolarinwa, O. (2015). Principles and Methods of Validity and Reliability Testing of Questionnaires Used in Social and Health Science Researches. Nigerian Postgraduate Medical Journal, 22(4), 195. https://doi.org/10.4103/1117-1936.173959
Cronbach, L. J. (1951). Coefficient Alpha and The Internal Structure of Tests. Psychometrika, 16(3), 297-334 (293). https://doi.org/10.1007/BF02310555
Daali, S. N. (2013). Teori Skor pada Pengukuran Mental. Jakarta: Nagarani Citrayasa.
Elangovan, N., & Sundaravel, E. (2021). Method of Preparing A Document For Survey Instrument Validation by Experts. MethodsX, 8(April), 101326. https://doi.org/10.1016/j.mex.2021.101326
Embretson, S. E. (2007). Construct Validity: A Universal Validity System or Just Another Test Evaluation Procedure? Educational Researcher, 36(8), 449–455. https://doi.org/10.3102/0013189x07311600
Hajri, T., Zulihar, M., & Muhammad, Y. (2016). Pengaruh Beasiswa Bidikmisi terhadap Prestasi Belajar Mahasiswa. Jurnal Ilmiah Mahasiswa Pendidikan Kewarganegaraan Unsyiah, 1(19), 49–60.
Hanea, A. M., McBride, M. (2018). Classical meets modern in the IDEA protocol for structured expert judgement. Journal of Risk Research, 21(4), 417–433. https://doi.org/10.1080/13669877.2016.1215346
Hsiao, Y., Qi, H., Hoy, R., Dale, P. (2021). Hierarchy and Reliability of the Preschool Language Scales – Fifth Edition: Mokken Scale Analysis. Journal of Speech, Language, and Hearing Research, 64(October), 3983–3995. https://doi.org/10.1044/2021_JSLHR-21-00043
Kamara, S. S., & Dadhabai, S. (2022). Assessment Factors Influencing Students’ Academic Achievement Academic Achievement. Journal of Management Information and Decision Sciences, 25(1), 1–13.
Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and Reliability of Measurement Instruments used in Research. American Journal of Health-System Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364
Lulaj, E. (2022). The Correlation of Financial-Stress and Educational-Teaching Factors on Students during Online Learning in the Covid-19 (Cov19) Pandemic. International Journal of Instruction, 15(2), 435–454. https://doi.org/10.29333/iji.2022.15224a
Mbandlwa, Z. (2021). The Comparison of The Academic Performance of Students That are Staying at Student Residences and Those Who Are Staying in Their Homes. Elementary Education Online, 20(4), 1562–1571.
Nur, M., Sabaruddin, S., & Fadli, M. (2021). Development of Student’s Satisfaction Instruments on The Thematic Community Service Lectures Management Using Rasch Model Analysis. Tarbawi: Jurnal Keilmuan Manajemen Pendidikan, 7(02), 283-292.
Patricia, S., Arias, A., Luis, J., & Gómez, P. (2019). Content Validity Analysis of ISD-1: An Instrument for Social Diagnosis in Care Homes for Older Persons. European Journal of Social Work, 22(3), 526–540. https://doi.org/10.1080/13691457.2017.1364705
Retnawati, H. (2016). Proving Content Validity of Self-Regulated Learning Scale. Research and Evaluation in Education, 2(2), 155-164. https://doi.org/10.21831/reid.v2i2.11029
Risnawati, Tahir, T., Hasan, M., Dinar, M., & Rahmatullah. (2021). Analisis Pola Konsumsi Mahasiswa Penerima Beasiswa Bidikmisi. Implementasi Merdeka Belajar Di Masa Pandemi Covid-19: Peluang Dan Tantangan, 619–625. Lampung: FKIP Universitas Lampung.
Rodelli, M., Koutra, K., & Birna, K. (2022). Conceptual Development and Content Validation of a Multicultural Instrument to Assess the Normalization of Gender ‑ Based Violence against Women. Sexuality & Culture, 26(1), 26–47. https://doi.org/10.1007/s12119-021-09877-y
Sabaruddin, S., Mansor, R., Rusmar, I., & Husna, F. (2020). Student with Special Needs and Mathematics Learning: A Case Study of An Autistic Student. JRAMathEdu (Journal of Research and Advances in Mathematics Education), 5(3), 317–330. https://doi.org/10.23917/jramathedu.v5i3.11192
Saks, J., Fuller, A. (2020). Meta-Study of Measurement and Evaluation in Counseling and Development ( MECD ) Publication Patterns from 2000–2019. Measurement And Evaluation In Counseling and Development, 53(4), 279–288. https://doi.org/10.1080/07481756.2020.1735222
Shirali, G., Shekari, M., & Angali, K. A. (2018). Assessing Reliability and Validity of an Instrument for Measuring Resilience Safety Culture in Sociotechnical Systems. Safety and Health at Work, 9(3), 296–307. https://doi.org/10.1016/j.shaw.2017.07.010
Shrotryia, V. K., & Dhanda, U. (2019). Content Validity of Assessment Instrument for Employee Engagement. SAGE Open, 15(2), 1–7. https://doi.org/10.1177/2158244018821751
Suciati, Munadi, S., Sugiman, & Ratna Febriyanti, W. D. (2020). Design and Validation of Mathematical Literacy Instruments for Assessment for Learning in Indonesia. European Journal of Educational Research, 9(2), 865-875. https://doi.org/10.12973/eu-jer.9.2.865
Sugiyarto. (2018). Pengaruh Pendapatan Mahasiswa terhadap Tingkat Konsumsi Mahasiswa. Prosiding Kearifan Lokal Untuk Menjawab Tantangan Global, 169–178. Pamulang: Universitas Pamulang.
Suyanti, K. (2015). Indikator Sosial Ekonomi Wilayah dan Ketahanan Pangan Rumah Tangga Perempuan Miskin di Aceh. Agrisep, 16(1), 1–9.
Syakir, S, J. (2021). Validity and Reliability of Technology Entrepreneurship Module for Public. Elementary Education Online, 20(5), 1722–1726. https://doi.org/10.17051/ilkonline.2021.05.189
Taherdoost, H. (2016). Validity and Reliability of the Research Instrument ; How to Test the Validation of a Questionnaire / Survey in a Research Hamed Taherdoost To cite this version. International Journal of Academic Research in Management, 5(3), 28–36. https://doi.org/10.2139/ssrn.3205040
Telenius, E. W., Engedal, K., & Bergland, A. (2015). Inter-rater Reliability of The Berg Balance Scale, 30 S Chair Stand Test and 6 M Walking Test, and Construct Validity of The Berg Balance Scale in Nursing Home Residents with Mild-To-Moderate Dementia. BMJ Open, 5(9), e008321. https://doi.org/10.1136/bmjopen-2015-008321
Yasin, R. M. (2015). Validity and Reliability Learning Transfer Item Using Rasch Measurement Model. Procedia - Social and Behavioral Sciences, 204. https://doi.org/10.1016/j.sbspro.2015.08.143
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
| 10.33650/al-tanzim.v6i3.3680 |
|
Refbacks
- There are currently no refbacks.
Copyright (c) 2022 Sabaruddin, Muhammad Nur, M Fadli, Mazlan
