Content Validity of KIP-K Scholarship Instruments at Higher Education Using Aiken's Coefficient Validity Scale

DOI: https://doi.org/10.33650/al-tanzim.v6i3.3680

Authors (s)


(1) * Sabaruddin Sabaruddin   (Institut Agama Islam Negeri Langsa)  
        Indonesia
(2)  Muhammad Nur   (Institut Agama Islam Negeri Langsa)  
        Indonesia
(3)  M. Fadli   (Institut Agama Islam Negeri Langsa)  
        Indonesia
(4)  Mazlan Mazlan   (Institut Agama Islam Negeri Langsa)  
        Indonesia
(*) Corresponding Author

Abstract


This study aims to analyze the KIP-K Scholarship instrument at PTKIN IAIN Langsa while developing non-test instruments (questionnaires). This instrument is used to obtain information about students who apply for KIP-K scholarships. The instrument of content validity is obtained through a quantitative analysis by nine selected experts and a qualitative approach with an expert review of a set of questionnaires that have been arranged. In determining the content validity and reliability level, the experts analyzed a questionnaire quantitatively consisting of 29 items with three components: economic, household, and academic and non-academic students’ achievements. The data from this expert judgment is calculated using the formula Aiken V. While expert reviews are qualitatively similar to suggestions and feedback, they are used to refine constructed items. The result of these students’ economic condition, household, and academic and non-academic achievements was above 0.72 with a significance level of 5%, namely 0.92, 0.96, and 0.96. All of the 29 items are very valid (V > 0.72, V1 > 0.50) and reliable (α = 0,944). The conclusion that each component is closely related indicates information on the feasibility of distributing KIP-K. The instruments embodied at IAIN Langsa have high validity, and the level of reliability is excellent. This instrument can obtain complete information on prospective students who will become KIP-K scholarship recipients in 2022.

Keywords

Content validity, KIP-K, Scholarship Instruments, Aiken's Coefficient



Full Text: PDF



References


Ahmed, B. (2021). Role of Higher Education Commission in Supporting Students with Lower Economic Conditions in Attaining Higher Education. Elementary Education Online, 20(4), 2292–2298.

Aiken, L. R. (1985). Three Coefficients for Analyzing The Reliability and Validity of Ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012

Aiken, R. (1996). Rating Scales & Checklists; Evaluating Behavior, Personality, and attitude. Canada: John Wiley & Sons Inc.

Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of Methods Used for Estimating Content Validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066

Amjad, M., Zahida A, S., & Faheem, M. (2015). Impact of Socio-Economic Background of Students on their Achievements at Secondary Level. Pakistan Journal of Social Sciences (PJSS), 35(2), 981–995.

Babaee, M., Lê, Q., & Lê, T. (2013). How are The Concepts “Reliability” and “Validity” Dealt with in Qualitative Research? In Conducting Research in a Changing and Challenging World.

Bland, J. M. (1997). Statistics notes: Marketing. UK. McGraw-Hill International. Cronbach's alpha. BMJ, 314, 572. https://doi.org/10.1136/bmj.314.7080.572

Bolarinwa, O. (2015). Principles and Methods of Validity and Reliability Testing of Questionnaires Used in Social and Health Science Researches. Nigerian Postgraduate Medical Journal, 22(4), 195. https://doi.org/10.4103/1117-1936.173959

Cronbach, L. J. (1951). Coefficient Alpha and The Internal Structure of Tests. Psychometrika, 16(3), 297-334 (293). https://doi.org/10.1007/BF02310555

Daali, S. N. (2013). Teori Skor pada Pengukuran Mental. Jakarta: Nagarani Citrayasa.

Elangovan, N., & Sundaravel, E. (2021). Method of Preparing A Document For Survey Instrument Validation by Experts. MethodsX, 8(April), 101326. https://doi.org/10.1016/j.mex.2021.101326

Embretson, S. E. (2007). Construct Validity: A Universal Validity System or Just Another Test Evaluation Procedure? Educational Researcher, 36(8), 449–455. https://doi.org/10.3102/0013189x07311600

Hajri, T., Zulihar, M., & Muhammad, Y. (2016). Pengaruh Beasiswa Bidikmisi terhadap Prestasi Belajar Mahasiswa. Jurnal Ilmiah Mahasiswa Pendidikan Kewarganegaraan Unsyiah, 1(19), 49–60.

Hanea, A. M., McBride, M. (2018). Classical meets modern in the IDEA protocol for structured expert judgement. Journal of Risk Research, 21(4), 417–433. https://doi.org/10.1080/13669877.2016.1215346

Hsiao, Y., Qi, H., Hoy, R., Dale, P. (2021). Hierarchy and Reliability of the Preschool Language Scales – Fifth Edition: Mokken Scale Analysis. Journal of Speech, Language, and Hearing Research, 64(October), 3983–3995. https://doi.org/10.1044/2021_JSLHR-21-00043

Kamara, S. S., & Dadhabai, S. (2022). Assessment Factors Influencing Students’ Academic Achievement Academic Achievement. Journal of Management Information and Decision Sciences, 25(1), 1–13.

Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and Reliability of Measurement Instruments used in Research. American Journal of Health-System Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364

Lulaj, E. (2022). The Correlation of Financial-Stress and Educational-Teaching Factors on Students during Online Learning in the Covid-19 (Cov19) Pandemic. International Journal of Instruction, 15(2), 435–454. https://doi.org/10.29333/iji.2022.15224a

Mbandlwa, Z. (2021). The Comparison of The Academic Performance of Students That are Staying at Student Residences and Those Who Are Staying in Their Homes. Elementary Education Online, 20(4), 1562–1571.

Nur, M., Sabaruddin, S., & Fadli, M. (2021). Development of Student’s Satisfaction Instruments on The Thematic Community Service Lectures Management Using Rasch Model Analysis. Tarbawi: Jurnal Keilmuan Manajemen Pendidikan, 7(02), 283-292.

Patricia, S., Arias, A., Luis, J., & Gómez, P. (2019). Content Validity Analysis of ISD-1: An Instrument for Social Diagnosis in Care Homes for Older Persons. European Journal of Social Work, 22(3), 526–540. https://doi.org/10.1080/13691457.2017.1364705

Retnawati, H. (2016). Proving Content Validity of Self-Regulated Learning Scale. Research and Evaluation in Education, 2(2), 155-164. https://doi.org/10.21831/reid.v2i2.11029

Risnawati, Tahir, T., Hasan, M., Dinar, M., & Rahmatullah. (2021). Analisis Pola Konsumsi Mahasiswa Penerima Beasiswa Bidikmisi. Implementasi Merdeka Belajar Di Masa Pandemi Covid-19: Peluang Dan Tantangan, 619–625. Lampung: FKIP Universitas Lampung.

Rodelli, M., Koutra, K., & Birna, K. (2022). Conceptual Development and Content Validation of a Multicultural Instrument to Assess the Normalization of Gender ‑ Based Violence against Women. Sexuality & Culture, 26(1), 26–47. https://doi.org/10.1007/s12119-021-09877-y

Sabaruddin, S., Mansor, R., Rusmar, I., & Husna, F. (2020). Student with Special Needs and Mathematics Learning: A Case Study of An Autistic Student. JRAMathEdu (Journal of Research and Advances in Mathematics Education), 5(3), 317–330. https://doi.org/10.23917/jramathedu.v5i3.11192

Saks, J., Fuller, A. (2020). Meta-Study of Measurement and Evaluation in Counseling and Development ( MECD ) Publication Patterns from 2000–2019. Measurement And Evaluation In Counseling and Development, 53(4), 279–288. https://doi.org/10.1080/07481756.2020.1735222

Shirali, G., Shekari, M., & Angali, K. A. (2018). Assessing Reliability and Validity of an Instrument for Measuring Resilience Safety Culture in Sociotechnical Systems. Safety and Health at Work, 9(3), 296–307. https://doi.org/10.1016/j.shaw.2017.07.010

Shrotryia, V. K., & Dhanda, U. (2019). Content Validity of Assessment Instrument for Employee Engagement. SAGE Open, 15(2), 1–7. https://doi.org/10.1177/2158244018821751

Suciati, Munadi, S., Sugiman, & Ratna Febriyanti, W. D. (2020). Design and Validation of Mathematical Literacy Instruments for Assessment for Learning in Indonesia. European Journal of Educational Research, 9(2), 865-875. https://doi.org/10.12973/eu-jer.9.2.865

Sugiyarto. (2018). Pengaruh Pendapatan Mahasiswa terhadap Tingkat Konsumsi Mahasiswa. Prosiding Kearifan Lokal Untuk Menjawab Tantangan Global, 169–178. Pamulang: Universitas Pamulang.

Suyanti, K. (2015). Indikator Sosial Ekonomi Wilayah dan Ketahanan Pangan Rumah Tangga Perempuan Miskin di Aceh. Agrisep, 16(1), 1–9.

Syakir, S, J. (2021). Validity and Reliability of Technology Entrepreneurship Module for Public. Elementary Education Online, 20(5), 1722–1726. https://doi.org/10.17051/ilkonline.2021.05.189

Taherdoost, H. (2016). Validity and Reliability of the Research Instrument ; How to Test the Validation of a Questionnaire / Survey in a Research Hamed Taherdoost To cite this version. International Journal of Academic Research in Management, 5(3), 28–36. https://doi.org/10.2139/ssrn.3205040

Telenius, E. W., Engedal, K., & Bergland, A. (2015). Inter-rater Reliability of The Berg Balance Scale, 30 S Chair Stand Test and 6 M Walking Test, and Construct Validity of The Berg Balance Scale in Nursing Home Residents with Mild-To-Moderate Dementia. BMJ Open, 5(9), e008321. https://doi.org/10.1136/bmjopen-2015-008321

Yasin, R. M. (2015). Validity and Reliability Learning Transfer Item Using Rasch Measurement Model. Procedia - Social and Behavioral Sciences, 204. https://doi.org/10.1016/j.sbspro.2015.08.143

Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6


Article View

Abstract views : 457 times | PDF files viewed : 310 times

Dimensions, PlumX, and Google Scholar Metrics

10.33650/al-tanzim.v6i3.3680


Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Sabaruddin, Muhammad Nur, M Fadli, Mazlan

Creative Commons License
 
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Al-Tanzim : Jurnal Manajemen Pendidikan Islam
Published by Postgraduate of Nurul Jadid University, Probolinggo, East Java, Indonesia.