3. METHODOLOGY
3.6. Data Collection Instruments
3.6.3. The Perception Scale Related to the Benefits of Cultural
3.6.3.1. The Reliability and Validity Values of Perception and Opinion
The findings related to the distribution of the study group where the reliability and validity activities of the perception scale of benefits of cultural awareness are conducted.
Table 3.9. The Distribution of the Numbers of Study Group of Reliability and Validity Activities
Department of English Language and Literature
Total
Reliability Study (test-retest application)
38 38
Reliability Study
(internal consistency application)
38 38
Validity Study
(factor analysis application)
38 38
When the Table 3.9. is analyzed, it may be seen that the data obtained from 38 students in the applications of internal consistency, item analysis and factor analysis related to test-retest application of perception scale related to cultural awareness was employed.
In Table 3.10., the values of arithmetical averages and standard deviations of the items of the Scale of the Perception for Cultural Awareness were given.
Table 3.10. The Values of Arithmetical Average and Standard Deviation of the Scale of the Perception for Cultural Awareness
Items N X Ss
Item 1 38 3.47 .86
Item 2 38 4.21 .69
Item 3 38 3.23 .99
Item 4 38 2.87 1.05
Item 5 38 3.62 .89
Item 6 38 4.18 .97
Item 7 38 3.49 1.24
Item 8 38 2.73 .89
Item 9 38 3.42 .82
Item 10 38 2.48 .93
Item 11 38 4.09 .92
Item 12 38 3.34 .80
Item 13 38 2.90 .92
Item 14 38 2.82 .83
Item 15 38 3.74 .95
Item 16 38 3.99 1.15
Item 17 38 3.38 1.19
Item 18 38 3.65 .77
Item 19 38 3.34 1.16
Item 20 38 2.86 1.08
Item 21 38 4.33 .58
Item 22 38 3.80 .91
Item 23 38 3.69 1.12
When arithmetical averages of the Items of the Perception Scale of Cultural Awareness in Table 3.10. are analyzed, it may be seen that Item 21 has the highest average while Item 8 has the lowest average. When the standard deviations of the items are analyzed, it may be seen that Item 7 has the biggest standard deviations with 1.24. Since Item 21 has the lowest standard deviation value with 0.58, it was determined that this question has a more homogenous structure.
In order to determine the internal consistency of the entire Scale of Perception for the Benefits of Cultural Awareness, Cronbach Alpha, Spearman-Brown and Guttman techniques were employed.
Table 3.11. The Internal Consistency Coefficients of the Entire Scale of Perception for the Benefits of Cultural Awareness
Internal Consistency Coefficients
N r p
Cronbach Alpha 38 0.83 p < .01
Spearman-Brown 38 0.78 p < .01
Guttman 38 0.81 p < .01
When Table 3.11. is analyzed, it may be seen that the highest reliability in the internal consistency coefficients which has been estimated in order to test the reliability of the total reliability of the scale was found in the technique of Cronbach Alpha (0.83) while the techniques of Spearman-Brown (0.78) and Guttman (0.81) had the lowest reliability levels. The levels of those values at 0.70 and over indicate that the Scale of Perception for the Benefits of Cultural Awareness has the internal reliability. After analysis of the internal consistency of the Scale of Perception for the Benefits of Cultural Awareness, the processes of Item analysis started.
During the Item analysis process, the analysis of Item total, Item remaining and Item distinctiveness were conducted, respectively. The values of Item total, Item remaining and Item distinctiveness were separately obtained for every item in the scale and the results were tested for statistical significance. During the process of Item total analysis, the significance of the correlation between the scores obtained from the items in the scale and the Total Score was analyzed.
Table 3.12. The Results of Item Total Analysis of the Perception Scale of the Benefits of Cultural Awareness
Items- Total Score N r p
Item 1-Total Score 38 .63 p < .01
Item 2-Total Score 38 .71 p < .01
Item 3-Total Score 38 .61 p < .01
Item 4-Total Score 38 .55 p < .01
Item 5-Total Score 38 .52 p < .01
Item 6-Total Score 38 .69 p < .01
Item 7-Total Score 38 .46 p < .01
Item 8-Total Score 38 .76 p < .01
Item 9-Total Score 38 .47 p < .01
Item 10-Total Score 38 .55 p < .01
Item 11-Total Score 38 .74 p < .01
Item 12-Total Score 38 .57 p < .01
Item 13-Total Score 38 .60 p < .01
Item 14-Total Score 38 .79 p < .01
Item 15-Total Score 38 .66 p < .01
Item 16-Total Score 38 .72 p < .01
Item 17-Total Score 38 .68 p < .01
Item 18-Total Score 38 .54 p < .01
Item 19-Total Score 38 .69 p < .01
Item 20-Total Score 38 .63 p < .01
Item 21-Total Score 38 .71 p < .01
Item 22-Total Score 38 .79 p < .01
Item 23-Total Score 38 .54 p < .01
It may be seen that all the items in the Scale of Perception for the Benefits of Cultural Awareness are statistically significant at the level of 0.01 (p< .01). For Item remaining analysis, the Cronbach Alpha model was employed. The adaptive values of the correlation between Cronbach Alpha and Items were analyzed.
Table 3.13. The Results of Item Remaining in the Scale of Perception for the Benefits of Cultural Awareness
Items N r Alpha (0.954)
Item 1 38 .61 p < .01
Item 2 38 .70 p < .01
Item 3 38 .60 p < .01
Item 4 38 .53 p < .01
Item 5 38 .49 p < .01
Item 6 38 .68 p < .01
Item 7 38 .45 p < .01
Item 8 38 .74 p < .01
Item 9 38 .45 p < .01
Item 10 38 .53 p < .01
Item 11 38 .76 p < .01
Item 12 38 .56 p < .01
Item 13 38 .59 p < .01
Item 14 38 .77 p < .01
Item 15 38 .64 p < .01
Item 16 38 .70 p < .01
Item 17 38 .66 p < .01
Item 18 38 .52 p < .01
Item 19 38 .68 p < .01
Item 20 38 .62 p < .01
Item 21 38 .69 p < .01
Item 22 38 .78 p < .01
Item 23 38 .53 p < .01
All the items in the Scale of Perception for the Benefits of Cultural Awareness are statistically significant at the level of 0.01(p< .01). For the analysis of Item remaining, total scores of the scale were used as base and the total scores of the group was ranked from the highest to the lowest. Afterwards, the unrelated group
“t” test was employed for the average of each item between the group with the highest score of 27% and the lowest score of 27%.
Table 3.14. The Results of the General Perception Scale for the Benefits of Cultural Awareness
Items Group N X ss T Sd P
Item 1 Lower 10 4.94 .24
10.46 37 p <.01
Upper 10 3.21 1.48
Item 2 Lower 10 4.93 .26
10.18 37 p <.01
Upper 10 3.24 1.49
Item 3 Lower 10 4.83 .44
9.83 37 p <.01
Upper 10 3.38 1.26
Item 4 Lower 10 4.73 .57
13.07 37 p <.01
Upper 10 2.63 1.34
Item 5 Lower 10 4.46 .82
10.28 37 p <.01
Upper 10 2.73 1.29
Item 6 Lower 10 4.93 .26
10.82 37 p <.01
Upper 10 3.15 1.47
Item 7 Lower 10 4.40 .91
9.40 37 p <.01
Upper 10 2.78 1.27
Item 8 Lower 10 4.89 .35
9.85 37 p <.01
Upper 10 3.15 1.56
Item 9 Lower 10 4.74 .77
8.43 37 p <.01
Upper 10 3.11 1.58
Item 10 Lower 10 4.61 .70
11.06 37 p <.01
Upper 10 3.07 1.58
Item 11 Lower 10 4.84 .43
10.23 37 p <.01
Upper 10 3.07 1.39
Item 12 Lower 10 4.67 .72
9.69 37 p <.01
Upper 10 2.89 1.50
Item 13 Lower 10 4.68 .61
10.04 37 p <.01
Upper 10 2.90 1.49
Item 14 Lower 10 4.81 .47
10.32 37 p <.01
Upper 10 3.18 1.35
Item 15 Lower 10 4.61 .87
8.38 37 p <.01
Upper 10 3.09 1.40
Item 16 Lower 10 4.60 .72
8.98 37 p <.01
Upper 10 3.02 1.41
Item 17 Lower 10 4.85 .48
11.51 37 p <.01
Upper 10 3.00 1.39
Item 18 Lower 10 4.74 .54
12.42 37 p <.01
Upper 10 2.94 1.20
Item 19 Lower 10 4.70 .66
9.33 37 p <.01
Upper 10 3.16 1.34
Item 20 Lower 10 4.67 .55
8.78 37 p <.01
Upper 10 3.13 1.41
Item 21 Lower 10 4.67 .55
9.20 37 p <.01
Upper 10 3.20 1.35
Item 22 Lower 10 4.57 .67 9.36 37 p <.01
Upper 10 3.04 1.33
Item 23 Lower 10 4.56 .65
8.53 37 p <.01
Upper 10 3.08 1.37
All the items in the Scale of Perception for the Benefits of Cultural Awareness are statistically significant at the level of 0.01 (p< .01). After the process of item analysis, the results of item total, item remaining and distinctiveness were compared. In order to keep an item reliable in the scale, it should provide statistically significant results at the level of 0.01 in all three systems. Factor analysis procedures were employed for testing the structural validity of the Scale of Perception for the Benefits of Cultural Awareness. In the first stage of the factor analysis, the conformity of the data obtained from the sampling group through Kaiser-Meyer-Olkin (KMO) Sampling Proficiency Test and Bartlett Sphericity Test was tested.
Table 3.15. The Results of Kaiser-Meyer Olkin and Bartlett Tests Conducted for the Scale of Perception for the Benefits of Cultural Awareness
Kaiser-Meyer-Olkin 0.908
Barlett’s Test 3038.134
Sd 276
P 0.00
When Table 3.15. is analyzed, it was determined that Kaiser-Meyer-Olkin (KMO) value was KMO = 0.908 while Bartlett Sphericity Test value was χ2=3038.134;
sd=276 (p=0.000). KMO value which is above 0.60 and the significance of the value of Bartlett Sphericity Test about 0.05 are regarded enough to carry out factor analysis (Çokluk et al., 2010). The exploratory factor analysis is “an analysis designed to reveal the relations between unknown secret variants and the observed variants” (Çokluk et al., 2010). The exploratory factor analysis was applied to the data related to 23 items in the experimental applications and it was aimed to determine the basic factors related to the measured characteristics.
During this process, an analysis was conducted for the basic components and factor loads were also analyzed. In this direction, 5 items with item load lower than 0.32 were excluded and the analyses were repeated on the remaining items.
Table 3.16. The Factor Loads of the Scale of Perception for the Benefits of Cultural Awareness and Cronbach Alpha Value of the Factors
New No Old No Expression FactorLoad
1 1 .79
2 3 .53
3 4 .51
4 6 .71
5 7 .49
6 8 .83
7 9 .77
8 10 .57
9 12 .50
10 13 .84
11 14 .74
12 15 .54
13 16 .63
14 17 .71
15 18 .54
16 20 .82
17 21 .64
18 23 .53
At the end of those processes, it was found that total 18 items remaining in the scale centralized in a single factor. It was also determined that KMO value of the scale with 18 items was 0.918 while the value of Bartlett Sphericity Test was χ2= 3478.912; sd=486; p=0.000. The factor loads of the remaining 18 items in the scale were between 0.49 and 0.84. It was determined that the Items included in the scale explained the 35.835% of the total variance. According to Büyüköztürk (2007) and Tavşancıl (2005), the level of the explained variance about 30% and over is considered enough in the single-factor designs (Çokluk et al., 2010).