Content Validation of KIP-K Scholarship Instruments at Higher Education Using Aiken's Coefficient Validity Scale

DOI: https://doi.org/10.33650/al-tanzim.v6i3.3680

Authors (s)


(1) * Sabaruddin Sabaruddin   (Mathematics Department, Institut Agama Islam Negeri Langsa, Aceh)  
        Indonesia
(2)  Muhammad Nur   (Islamic Education Department, Institut Agama Islam Negeri Langsa, Aceh)  
        Indonesia
(3)  M. Fadli   (Arabic Education Department, Institut Agama Islam Negeri Langsa, Aceh)  
        Indonesia
(4)  Mazlan Mazlan   (Mathematics Department, Institut Agama Islam Negeri Langsa, Aceh)  
        Indonesia
(*) Corresponding Author

Abstract


This study aims to analyze the KIP-K Scholarship instrument at PTKIN IAIN Langsa while developing non-test instruments (questionnaires). This instrument is used to obtain information about students who apply for KIP-K scholarships. The instrument's content validity is obtained by a quantitative analysis approach by nine selected experts and a qualitative approach with an expert review of a set of questionnaires that have been arranged. In determining the content validity and reliability level, the experts analyzed a questionnaire quantitatively consisting of 29 items in the three components; economic, household, and academic and non-academic students’ achievements. The data from this expert judgment is calculated by the formula Aiken V. While expert reviews are qualitatively similar to suggestions and feedback, they are used to refine constructed items. The result of these students’ economic condition, household, and academic and non-academic achievements was above 0.72 with a significance level of 5%, namely 0.92, 0.96, and 0.96. All of the 29 items are very valid (V > 0.72, V1 > 0.50) and reliable (α = 0,944). The conclusion that each component is closely related indicates information on the feasibility of distributing KIP-K. The instruments embodied at IAIN Langsa have high validity, and the level of reliability is excellent. This instrument can obtain complete information on prospective students who will become KIP-K scholarship recipients in 2022.



Keywords

Content validity, KIP-K, Scholarship Instruments, Aiken's Coefficient



Full Text: PDF



References


Ahmad Syakir, J. (2021). Validity and Reliability of Technology Entrepreneurship Module for Public University Undergraduates in Malaysia. Elementary Education Online, 20(5), 1722–1726. https://doi.org/10.17051/ilkonline.2021.05.189

Ahmed, B. (2021). Role of Higher Education Commission in Supporting Students with Lower Economic Conditions in Attaining Higher Education. Elementary Education Online, 20(4), 2292–2298. https://doi.org/10.17051/ilkonline.2021.04.262

Aiken, L. R. (1985). Three Coefficients for Analyzing The Reliability and Validity of Ratings. Educational and Psychological Measurement, 45(1), 131-142.

Aiken, R. (1996). Rating Scales & Checklists; Evaluating Behavior, Personality, and attitude. Canada: John Wiley & Sons Inc.

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of Methods Used for Estimating Content Validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066

Amjad, M., Zahida A, S., & Faheem, M. (2015). Impact of Socio-Economic Background of Students on their Achievements at Secondary Level. Pakistan Journal of Social Sciences (PJSS), 35(2), 981–995.

Babaee, M., Lê, Q., & Lê, T. (2013). How are The Concepts “Reliability” and “Validity” Dealt with in Qualitative Research? In Conducting Research in a Changing and Challenging World.

Bland, J. M., & Altman, D. G. (1997). Statistics notes: Marketing. UK. McGraw-Hill International. Cronbach's alpha. BMJ, 314, 572.

Bolarinwa, O. (2015). Principles and Methods of Validity and Reliability Testing of Questionnaires Used in Social and Health Science Researches. Nigerian Postgraduate Medical Journal, 22(4), 195. https://doi.org/10.4103/1117-1936.173959

Cronbach, L. J. (1951). Coefficient Alpha and The Internal Structure of Tests. Psychometrika, 16(3), 297-334 (293). https://doi.org/10.1007/BF02310555

Daali, S. N. (2013). Teori Skor pada Pengukuran Mental. Jakarta: Nagarani Citrayasa.

Elangovan, N., & Sundaravel, E. (2021). Method of Preparing A Document For Survey Instrument Validation by Experts. MethodsX, 8(April), 101326.

Embretson, S. E. (2007). Construct Validity: A Universal Validity System or Just Another Test Evaluation Procedure? Educational Researcher, 36(8), 449–455. https://doi.org/10.3102/0013189x07311600

Hajri, T., Zulihar, M., & Muhammad, Y. (2016). Pengaruh Beasiswa Bidikmisi Terhadap Prestasi Belajar Mahasiswa Program Studi Pendidikan Pancasila dan Kewarganegaraan Fakultas Keguruan dan Ilmu Pendidikan Universitas Syiah Kuala. Jurnal Ilmiah Mahasiswa Pendidikan Kewarganegaraan Unsyiah, 1(19), 49–60.

Hanea, A. M., McBride, M., Burgman, M., & Wintle, B. (2018). Classical meets modern in the IDEA protocol for structured expert judgement. Journal of Risk Research, 21(4), 417–433.

Hsiao, Y., Qi, H., Hoy, R., Dale, P. S., Stump, G. S., Davison, D., & Xia, Y. (2021). Hierarchy and Reliability of the Preschool Language Scales – Fifth Edition: Mokken Scale Analysis. Journal of Speech, Language, and Hearing Research •, 64(October), 3983–3995.

Kamara, S. S., & Dadhabai, S. (2022). Assessment Factors Influencing Students’ Academic Achievement Academic Achievement. Journal of Management Information and Decision Sciences, 25(1), 1–13.

Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and Reliability of Measurement Instruments used in Research. American Journal of Health-System Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364

Lulaj, E. (2022). The Correlation of Financial-Stress and Educational-Teaching Factors on Students during Online Learning in the Covid-19 (Cov19) Pandemic. International Journal of Instruction, 15(2), 435–454.

Mbandlwa, Z. (2021). The Comparison of The Academic Performance of Students That are Staying at Student Residences and Those Who Are Staying in Their Homes. Elementary Education Online, 20(4), 1562–1571.

Nur, M., Sabaruddin, S., & Fadli, M. (2021). Development of Student’s Satisfaction Instruments on The Thematic Community Service Lectures Management Using Rasch Model Analysis. Tarbawi: Jurnal Keilmuan Manajemen Pendidikan, 7(02), 283-292.

Patricia, S., Arias, A., Luis, J., & Gómez, P. (2019). Content Validity Analysis of ISD-1: An Instrument for Social Diagnosis in Care Homes for Older Persons. European Journal of Social Work, 22(3), 526–540.

Retnawati, H. (2016). Proving Content Validity of Self-Regulated Learning Scale (The comparison of Aiken Index and expanded Gregory Index). Research and Evaluation in Education, 2(2), 155-164.

Risnawati, Tahir, T., Hasan, M., Dinar, M., & Rahmatullah. (2021). Analisis Pola Konsumsi Mahasiswa Penerima Beasiswa Bidikmisi Program Studi Pendidikan Ekonomi Fakultas Ekonomi Universitas Negeri Makassar. Implementasi Merdeka Belajar Di Masa Pandemi Covid-19: Peluang Dan Tantangan, 619–625. Lampung: FKIP Universitas Lampung.

Rodelli, M., Koutra, K., & Birna, K. (2022). Conceptual Development and Content Validation of a Multicultural Instrument to Assess the Normalization of Gender ‑ Based Violence against Women. Sexuality & Culture, 26(1), 26–47.

Sabaruddin, S., Mansor, R., Rusmar, I., & Husna, F. (2020). Student with Special Needs and Mathematics Learning: A Case Study of An Autistic Student. JRAMathEdu (Journal of Research and Advances in Mathematics Education), 5(3), 317–330. https://doi.org/10.23917/jramathedu.v5i3.11192

Saks, J., Fuller, A., Erford, B. T., & Bardhoshi, G. (2020). Meta-Study of Measurement and Evaluation in Counseling and Development ( MECD ) Publication Patterns from 2000–2019. Measurement And Evaluation In Counseling And Development, 53(4), 279–288.

Shirali, G., Shekari, M., & Angali, K. A. (2018). Assessing Reliability and Validity of an Instrument for Measuring Resilience Safety Culture in Sociotechnical Systems. Safety and Health at Work, 9(3), 296–307. https://doi.org/10.1016/j.shaw.2017.07.010

Shrotryia, V. K., & Dhanda, U. (2019). Content Validity of Assessment Instrument for Employee Engagement. SAGE Open, 15(2), 1–7. https://doi.org/10.1177/2158244018821751

Suciati, Munadi, S., Sugiman, & Ratna Febriyanti, W. D. (2020). Design and Validation of Mathematical Literacy Instruments for Assessment for Learning in Indonesia. European Journal of Educational Research, 9(2), 865-875. https://doi.org/10.12973/eu-jer.9.2.865

Sugiyarto. (2018). Pengaruh Pendapatan Mahasiswa terhadap Tingkat Konsumsi Mahasiswa Program Pendidikan D-III Sekretari Universitas Pamulang. Prosiding Kearifan Lokal Untuk Menjawab Tantangan Global, 169–178. Pamulang: Universitas Pamulang.

Suyanti, K. (2015). Indikator Sosial Ekonomi Wilayah dan Ketahanan Pangan Rumah Tangga Perempuan Miskin di Aceh. Agrisep, 16(1), 1–9.

Taherdoost, H. (2016). Validity and Reliability of the Research Instrument ; How to Test the Validation of a Questionnaire / Survey in a Research Hamed Taherdoost To cite this version. International Journal of Academic Research in Management, 5(3), 28–36.

Telenius, E. W., Engedal, K., & Bergland, A. (2015). Inter-rater Reliability of The Berg Balance Scale, 30 S Chair Stand Test and 6 M Walking Test, and Construct Validity of The Berg Balance Scale in Nursing Home Residents with Mild-To-Moderate Dementia. BMJ Open, 5(9), e008321. https://doi.org/10.1136/bmjopen-2015-008321

Yasin, R. M., Yunus, F. A. N., Rus, R. C., Ahmad, A., & Rahim, M. B. (2015). Validity and Reliability Learning Transfer Item Using Rasch Measurement Model. Procedia - Social and Behavioral Sciences, 204. https://doi.org/10.1016/j.sbspro.2015.08.143

Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6


Article View

Abstract views : 124 times | PDF files viewed : 16 times

Dimensions, PlumX, and Google Scholar Metrics

10.33650/al-tanzim.v6i3.3680


Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Sabaruddin, Muhammad Nur, M Fadli, Mazlan

Creative Commons License
 
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Al-Tanzim : Jurnal Manajemen Pendidikan Islam
Published by Islamic Faculty of Nurul Jadid University, Probolinggo, East Java, Indonesia.