|Year : 2018 | Volume
| Issue : 4 | Page : 174-179
Psychometric properties of persian version of academic success inventory for college students
Hamidreza Sadeghi-Gandomani1, Mohsen Adib-Hajbaghery2
1 Department of Medical Surgical Nursing, Faculty of Nursing and Midwifery, Kashan University of Medical Sciences, Kashan, Iran
2 Trauma Nursing Research Center, Faculty of Nursing and Midwifery, Kashan University of Medical Sciences, Kashan, Iran
|Date of Web Publication||6-Sep-2018|
Trauma Nursing Research Center, Faculty of Nursing and Midwifery, Kashan University of Medical Sciences, Kashan
Source of Support: None, Conflict of Interest: None
Background: The students' average achievement test scores cannot predict the students' academic success appropriately. Objectives: This study aimed to determine the psychometric properties of Persian version of the Academic Success Inventory for College Students (ASICS). Methods: The study was conducted in four steps of translation, face and content validity, exploratory factor analysis, and reliability assessment. Results: The final version of the Persian version has 38 items. Ten factors with an eigenvalue more than one were extracted. Internal consistency of the scale was 0.75. Item-total correlation ranged from 0.33 to 0.7 for all items and the mean item-total correlation was between 2.20 and 2.90. Conclusion: The Persian version of ASICS showed appropriate psychometric properties. It can be used to assess the academic success of Iranian college students.
Keywords: Academic success, Nursing students, Psychometrics, Scale
|How to cite this article:|
Sadeghi-Gandomani H, Adib-Hajbaghery M. Psychometric properties of persian version of academic success inventory for college students. Nurs Midwifery Stud 2018;7:174-9
|How to cite this URL:|
Sadeghi-Gandomani H, Adib-Hajbaghery M. Psychometric properties of persian version of academic success inventory for college students. Nurs Midwifery Stud [serial online] 2018 [cited 2018 Dec 13];7:174-9. Available from: http://www.nmsjournal.com/text.asp?2018/7/4/174/240682
| Introduction|| |
Traditionally, most universities use students' average achievement test scores and students' scores in standardized tests such as American College Test and Student's Academic Skills Test to predict the students' academic success. Some researchers have also used students' high school grade point average (GPA) or their scores in standardized achievement test to predict their academic success. However, these criteria are influenced by a complex of mediating factors, and cannot predict the students' academic success appropriately. Evidence showed that a number of mediating factors such as the student's coping skills, self-confidence, and nonacademic activities can indirectly affect his or her academic success. Therefore, it is suggested that capabilities different from the students' scores and GPA should be measured to judge their potentials and academic success.
According to our knowledge, no standardized tools are available to accurately measure the students' academic success in Iran. Valid and reliable instruments are needed to measure the academic success and facilitate planning and interventions in this area.,
A number of instruments are designed to measure certain aspects of academic success, such as motivation, career decision-making, or learning skills. However, these instruments focused on limited aspects and some are not adequately valid and reliable to measure the different aspects of academic success.,
Due to the previous instruments' limitations, in 2009, Prevatt et al. designed the Academic Success Inventory for College Students (ASICS). A number of studies assessed and confirmed the validity and reliability of this self-report questionnaire., The initial scale consisted of 72 items and was developed based on theory, empirical precedent, and interviews with experts in the field of academic success. Then, in a pilot study on 315 undergraduate students at a large public university in the southeastern United States, the scale was examined. Initial analyses revealed that ten out of fourteen subscales had good evidence of reliability (coefficient alpha >0.80). Based on feedback from course instructors of the pilot participants, a subscale was added to measure self-organizing skills. Furthermore, based on responses to open-ended questions, a subscale was added to measure the efficacy of the instruction. The final measure had 62 items. In another study, the ASICS was reexamined on 929 students enrolled in a large public university in the southeastern United States. Data were collected over the course of two semesters from undergraduate students in classes on education, sociology, communications, and career development. An exploratory factor analysis (EFA) and confirmatory factor analysis indicated a 10-factor, 50-item structure explaining 64% of the variance. Finally, the internal consistency of the 50-item measure was also examined. The Cronbach's alpha of the overall ASICS was 0.93, and 0.61–0.93 for the subscales. The 50-item ASICS is a self-reporting scale with Likert scale scoring and consists of 10 subscales, including basic academic skills (12 items), internal motivation/confidence (8 items), perceived instructor efficacy (5 items), concentration (4 items), external motivation/future (4 items), socializing (4 items), career decidedness (4 items), lack of anxiety (3 items), personal adjustment (3 items), and current external motivation (3 items). Students are initially asked to select one class that has been the hardest or most difficult to them within the past year. They are then instructed to answer all items with respect to that class. All items are rated from 1 (strongly disagree) to 7 (strongly agree). Negatively worded items are reverse scored so that higher scores on items reflect more positive functioning. The total score of this scale is between 50 and 350. Festa-Dreher in the Florida State University examined the 50-item ASICS through an item response theory analysis and reconfirmed its validity and reliability. However, no study is available on the validity and reliability of this scale on an eastern academic environment. However, it is important to assess if the ASICS is valid and reliable to be used as an instrument for assessing the academic success of Iranian college students.
This study was conducted in order to translate and determine the psychometric properties of the Persian version of the ASICS.
| Methods|| |
This methodological study was conducted in four steps, including translation, face and content validity, EFA, and reliability of the instrument.
Translation of the ASICS was based on the Wild et al.'s model. First, two people who were fluent in Persian and English languages (the first author and a specialist in English) independently translated all the items of the original/English version of the ASICS to Persian and the research team produced the consolidated forward version. Then, another bilingual expert performed back translation. The results were consistent with the original version.
To assess face validity of the Persian ASICS, 15 experts in nursing were asked to read the items to evaluate the readability, fluency, clarity, and comprehensibility of the items. Furthermore, to ensure the instrument is appropriate for the target population, 10 nursing students read the draft of the instrument and assessed the instrument's readability, clarity, and wording.
Content validity of the instrument was assessed, and Content Validity Index (CVI) and Content Validity Ratio (CVR) were calculated. Fifteen experts in nursing education were invited to assess if the items are essential, relevant, simple, and clear. The study objectives were explained to the experts and the first draft of the instrument and the validation guidelines were provided for them.
The CVI for individual items were calculated based on experts' scores for individual items on a 4-point Likert scale (1 = it is not relevant, 2 = it needs serious revision, 3 = it is relevant but needs minor revision, 4 = it is quite relevant). The CVI for the total instrument was also calculated based on the proportion of items rated as either 3 or 4. A CVI score over 0.79 indicates a good content validity. Items with a CVI score from 0.70 to 0.79 needed revision or editing, and items with a CVI score <0.70 are considered as inappropriate.
The CVR was calculated using the experts' opinions about the necessity of the individual items. Each expert in the panel was asked to determine if each item is essential and useful. Then, CVR for the individual items was calculated using Formula 1. According to the Lawshe's table, items with a CVR score over 0.49 were considered to be essential. Other items were omitted from the final instrument.
After the content validity was confirmed, EFA was performed to discover the factors.,
The Kaiser–Meyer–Olkin (KMO) test and the Bartlett's test of sphericity were used to determine the sampling adequacy and appropriateness of the factor analysis model, respectively. EFA was conducted using principal component analysis with varimax rotation, and the suitable number of factors was determined using eigenvalue criterion (eigenvalue >1) and scree plot. A loading with an absolute value of 0.35 was used as the cutoff point, and items with a factor loading exceeding 0.35 were considered to belong to a subscale.
The minimum number of cases needed for performing EFA is four times the number of items in the instrument. Then, according to the 39 items in the final Persian version of the ASICS, 156 individuals were required to conduct EFA; however, we recruited 180 individuals to compensate the possible dropouts. A simple random sampling method was used to select nursing students among a list of eligible students. The list was prepared by the Education Office in the Nursing and Midwifery School, Kashan University of Medical Sciences. Inclusion criteria included nursing students with Iranian nationality during their second or higher semesters. The first author invited the students to participate in the study, explained the study, and scheduled time for returning the questionnaires. If the students agreed, they completed the instrument. All the students were briefed about how to respond and scheduled a time for returning the completed questionnaire. The study was conducted from April to June 2015.
Reliability was examined using Cronbach's alpha coefficient. Item-total correlation was also used to assess the correlations between individual items and the overall scale score.
Permission to conduct this study was obtained from the Research Ethics Committee in the Kashan University of Medical Sciences (approval code: IR.KAUMS.REC.1394.73). The participants signed an informed consent before participation in the study and were assured about data confidentially.
Data analysis was performed by SPSS version 13 (SPSS INC., Chicago, IL, USA). Descriptive statistics was used to describe the demographics. EFA, KMO, and Bartlett testes were used. CVR of the individual items was calculated using Formula 1, in which “n” represents the number of experts who indicated the items were essential and “N” represents the total number of experts. CVI was also calculated using Formula 2.
| Results|| |
Face and content validity
For face validity, one item was revised considering the experts' views to improve the readability and clarity. All the 50 items had a CVI over 0.9. The mean CVI of simplicity, relevance, and clarity of the items were 0.91, 0.95, and 0.92, respectively. The CVR of the total items was over 0.8 except 11 items that had a CVR <0.5 and were deleted.
The construct validity of the Persian ASICS was evaluated through administering the 39-item instrument on 180 nursing students. Of the 180 questionnaires distributed, 150 questionnaires were returned. Sixteen questionnaires were answered incompletely. Finally, 134 questionnaires were analyzed. Totally, 68.7% of the students (n = 92) were male; 57.5% were Iranian, 86.6% were single, and 75.4% resided in a dorm. Among the students, 23.1% were in third semester while 24.6% in fourth semester, 20.9% in fifth semester, 17.9% in sixth semester, 8.2% in seventh semester, and 5.2% in eighth semester.
First, the KMO index (=0.815) and Bartlett's test of sphericity (χ2 = 2826.692) showed the adequacy of samples size for EFA (P < 0.0001) and appropriateness of the correlation matrix.
The distribution of cumulative variance after varimax rotation showed that only 10 factors can predict 67.36% of the total variance of academic success score. The factor loading values for the items in the 10 factors (subscales) are presented in [Table 1]. Except one item which was deleted, the factor loading value was >0.35 for all items in all subscales. The factor loading value ranged from 0.37 to 0.87 for 38 items that were remained the same in the final version of the Persian ASICS. The scree plot of the ASICS showed that only 10 factors had an eigenvalue >1 [Figure 1].
|Table 1: Correlation coefficient of the individual items with the total scale and factor loading values for items in the 10 factors with varimax rotation of the Academic Success Inventory for College Students|
Click here to view
|Figure 1: The scree plot of the Academic Success Inventory for College Students|
Click here to view
Factor 1 (general academic skills), containing two items and with the eigenvalue of 5.16, predicts 9.65% of the total variance of the academic success score. Factor 2 (personal adjustment and concentration), consisting of four items and with the eigenvalue of 4.23, predicts 8.07% of the total variance of the academic success score. Factor 3 (self-regulation strategies), containing four items and with the eigenvalue of 3.55, predicts 7.26% of the total variance of the academic success score. Factor 4 (career decidedness), consisting of five items and with the eigenvalue of 2.46, predicts 7.18% of the total variance of the academic success score. Factor 5 (lack of anxiety), containing two items and with the eigenvalue of 2.27, predicts 6.85% of the total variance of the academic success score. Factor 6 (internal motivation), consisting of five items and with the eigenvalue of 1.93, predicts 6.18% of the total variance of the academic success score. Factor 7 (self-confidence), consisting of five items and with the eigenvalue of 1.81, predicts 5.89% of the total variance of the academic success score. Factor 8 (perceived instructor efficacy), containing four items and with the eigenvalue of 1.68, predicts 5.81% of the total variance of the academic success score. Factor 9 (socializing), containing five items and with the eigenvalue of 1.61, predicts 5.68% of the total variance of the academic success score. Factor 10 (external motivation), containing two items and with the eigenvalue of 1.53, predicts 5.36% of the total variance of the academic success score.
| Reliability Assessment|| |
Cronbach's alpha coefficient was 0.75 for the total scale and ranged from 0.51 to 0.75 for the subscales [Table 1].
[Table 1] shows the correlation coefficient of the individual items with the total scale. [Table 1] also presents the Cronbach's alpha if each item is deleted. As presented in [Table 1], all items had a correlation coefficient >0.3 with the total scale. Moreover, item analysis revealed that the Corrected Item-Total Correlation (CITC) ranged from 0.33 to 0.7 for all items and the mean CITC of items was between 2.20 and 2.90 [Table 1].
| Discussion|| |
This study was conducted to validate and assess the psychometric properties of the Persian version of the ASICS. The results showed that the Persian version of the ASICS possessed appropriate psychometric properties. Twelve items of the original instrument were omitted in the process of validation and EFA. However, the CVR was >0.80 for the remaining 38 items. According to the Lawshe's table and the number of the experts, the minimum CVR in this study was 0.49.
In the current study, the overall CVI for the Persian version of the ASICS was greater than 0.90. This index was calculated using the Waltz and Bausell criteria, and the overall CVI showed an appropriate content validity., Prevatt et al. did not report the CVR of the original ASICS. In this study, the high level of content validity indices might be attributed to the validity of the tool and the precise process applied for confirming the face and content validity of the scale.
Using EFA, we identified 10 factors or subscales with eigenvalue >1 in the Persian ASICS. These 10 factors could explain 67% of the total variance of the academic success score. The highest proportion of variance could be explained by the first and second subscales (”general academic skills” and “personal adjustment and concentration”). The first and second subscales explained 9.65% and 8.07% of the total variance, respectively. Other factors could explain >5% of total variance, separately. Researchers expect to extract factors that each account for at least 5% of the variance or having the eigenvalue of 1 or greater. The original ASICS also has 10 factors with slightly different labels that explained 64% of the total variance of the academic success score. The 10 extracted factors confirm the Welles point of view that the academic success is a multidimensional concept and cannot be measured by students' GPA.
In this study, the Cronbach's alpha coefficient was 0.75 for the total instrument and 0.51–0.75 for the subscales. The Cronbach's alpha of the original ASICS was 0.93 and ranged between 0.61 and 0.93 for the subscales. Weinstein and Palmer also examined the internal consistency of the ASICS and the Cronbach's alpha ranged from 0.73 to 0.87 for the subscales. According to LoBiondo and Haber, a reliability coefficient of 0.7 is appropriate. Therefore, it can be concluded that the Persian version of the ASICS has an acceptable reliability. The difference in the reported reliability coefficients among the studies might be associated with the differences in characteristics of samples, the number of questions in final versions of instruments, and the scoring systems used in studies. In this study, a random sample of students regardless of the status of their academic achievement completed the instrument. However, Prevatt et al. recruited a larger sample of students from different fields in a big university in the United States. They also selected students with both groups of high and weak academic achievement. However, in the present study, we used a random sample of nursing students in a nursing school. Although in reliability testing, researchers try to test the instrument; however, the characteristics of respondents can affect the reliability. A higher heterogeneity in a sample may result in a higher level of reliability. Therefore, the higher reliability coefficient of the original version of the ASICS might be attributed to the higher level of heterogeneity in the sample.
In the current study, no item had a correlation <0.3 with the total ASICS score. LoBiondo and Haber argued that an item must be deleted if its deletion can add at least 0.3 to the overall alpha coefficient. In the present study, deleting no item could increase the overall alpha coefficient of Persian version of the ASICS. Therefore, the 38 items were remained in the final version of the instrument.
| Conclusion|| |
The Persian version of the ASICS showed appropriate psychometric properties. It contains 10 subscales that assess important aspects of academic success. The Persian version of the ASICS also has appropriate validity and reliability and can be used to assess the academic success of Iranian college students. However, further studies with larger sample sizes and with a wide variety of participants' characteristics are suggested. In this study, we used a simple random sampling method to recruit the nursing students. In some cases, this method might not be successful in recruiting equal numbers of the subgroups, such as gender subgroups. Therefore, the number of males was higher than the females in our sample. A stratified random sampling method is suggested to be used in the future studies.
This manuscript was obtained from a research project approved by the Research Council of Kashan University of Medical Sciences and Health Services (grant number: 94073). We would like to take this opportunity to express our gratitude to the nursing students for cooperating in this study.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Rothstein JM. College performance predictions and the SAT. J Econom 2004;121:297-317.
Sanaeinasab H, Saffari M. Influential factors on academic achievement of university students. Educ Strateg Med Sci 2013;5:243-9.
Robbins SB, Lauver K, Le H, Davis D, Langley R, Carlstrom A, et al.
Do psychosocial and study skill factors predict college outcomes? A meta-analysis. Psychol Bull 2004;130:261-88.
Pritchard ME, Wilson GS. Using emotional and social factors to predict student success. J Coll Stud Dev 2003;44:18-28.
Prevatt F, Li H, Welles T, Festa-Dreher D, Yelland S, Lee J. The Academic Success Inventory for College Students: Scale development and practical implications for use with students. J Coll Admission 2011;2:26-31.
Faye C, Sharpe D. Academic motivation in university: The role of basic psychological needs and identity formation. Can J Behav Sci 2008;40:189-99.
Graunke SS, Woosley SA. An exploration of the factors that affect the academic success of college sophomores. Coll Stud J 2005;39:367-76.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al.
Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR task force for translation and cultural adaptation. Value Health 2005;8:94-104.
Polit DF, Beck CT. Resource Manual for Nursing Research: Generating and Assessing Evidence for Nursing Practice. 9th
ed. China: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2012.
Lawshe CH. A quantitative approach to content validity. Pers Psychol 1975;28:563-75.
Nunnally JC, Bernstein IH, Berge JM. Psychometric Theory. New York: McGraw-Hill; 1967.
Raminmehr H. Quantitative Research Method Using Structure Equation Modeling. Tehran: Termeh; 2012.
LoBiondo-Wood G, Haber J. Nursing Research: Methods and Critical Appraisal for Evidence-Based Practice. New York: Mosby; 2005.
Waltz CF, Strickland OL, Lenz ER. Measurement in Nursing and Health Research. New York: Springer Publishing Company; 2010.
Weinstein CE, Palmer DR. Learning and Study Strategies Inventory High School Version. 3rd
ed. Clearwater: H & H Publishing; 1990.
Seif AA. Educational Measurement, Assessment and Evaluation. 25th
ed. Tehran: Doran Publications; 2015.