This chapter has been peer-reviewed, accepted, and endorsed by the National Council of Professors of Educational Administration (NCPEA) as a significant contribution to the scholarship and practice of education administration. Formatted and edited in Connexions by Theodore Creighton and Brad Bizzell, Virginia Tech, Janet Tareilo, Stephen F. Austin State University, and Thomas Kersten, Roosevelt University.
Theodore B. Creighton, is a Professor at Virginia Tech and the Publications Director for NCPEA Publications, the Founding Editor of Education Leadership Review, and the Senior Editor of the NCPEA Connexions Project. |
Brad E. Bizzell, is a recent graduate of the Virginia Tech Doctoral Program in Educational Leadership and Policy Studies, and is a School Improvement Coordinator for the Virginia Tech Training and Technical Assistance Center. In addition, Dr. Bizzell serves as an Assistant Editor of the NCPEA Connexions Project in charge of technical formatting and design.
|
Janet Tareilo, is a Professor at Stephen F. Austin State University and serves as the Assistant Director of NCPEA Publications. Dr. Tareilo also serves as an Assistant Editor of the NCPEA Connexions Project and as a editor and reviewer for several national and international journals in educational leadership. |
Thomas Kersten is a Professor at Roosevelt University in Chicago. Dr. Kersten is widely published and an experienced editor and is the author of Taking the Mystery Out of Illinois School Finance, a Connexions Print on Demand publication. He is also serving as Editor in Residence for this book by Slate and LeBouef. |
Nonparametric One-Way Analysis of Variance
In this set of steps, readers will calculate either a parametric or a nonparametric statistical analysis, depending on whether the data for the dependent variable reflect a normal distribution. A parametric statistical procedure requires that its data be reflective of a normal curve whereas no such assumption is made in the use of a nonparametric procedure. Of the two types of statistical analyses, the parametric procedure is the more powerful one in ascertaining whether or not a statistically significant difference, in this case, exists. As such, parametric procedures are preferred over nonparametric procedures. When data are not normally distributed, however, parametric analyses may provide misleading and inaccurate results. According, nonparametric analyses should be used in cases where data are not reflective of a normal curve. In this set of steps, readers are provided with information on how to make the determination of normally or nonnormally distributed data. For detailed information regarding the assumptions underlying parametric and nonparametric procedures, readers are referred to the Hyperstats Online Statistics Textbook at http://davidmlane.com/hyperstat/ or to the Electronic Statistics Textbook (2011) at http://www.statsoft.com/textbook/
For this nonparametric analysis of variance procedure to be appropriately used, at least half of the standardized skewness coefficients and the standardized kurtosis coefficients must be outside the normal range (+/-3, Onwuegbuzie & Daniel, 2002). Research questions for which nonparametric analysis of variance procedures are appropriate involve asking for differences in a dependent variable by group membership (i.e., more than two groups may be present). The research question, “What is the difference in science performance among middle school students as a function of ethnic membership?” could be answered through use of a nonparametric analysis of variance procedure.
√ Split your file on the basis on your independent variable/fixed factor/grouping variable |
After you do this, your screen should resemble the following:
Your screen will show that all cases are going to be analyzed and a “do not create groups”. You will need to click the compare groups and move the dependent variable over to the “Group Based on”.
√ Analyze |
* Descriptive Statistics |
* Frequencies |
√ Move over the dependent (outcome) variable |
√ Click on Statistics |
Your screen will look like this. |
* Skewness [Note. Skewness refers to the extent to which the data are normally distributed around the mean. Skewed data involve having either mostly high scores with a few low ones or having mostly low scores with a few high ones.] Readers are referred to the following sources for a more detailed definition of skewness: http://www.statistics.com/index.php?page=glossary&term_id=356 and http://www.statsoft.com/textbook/basic-statistics/#Descriptive%20statisticsb |
To standardize the skewness value so that its value can be constant across datasets and across studies, the following calculation must be made: Take the skewness value from the SPSS output and divide it by the Std. error of skewness. If the resulting calculation is within -3 to +3, then the skewness of the dataset is within the range of normality (Onwuegbuzie & Daniel, 2002). If the resulting calculation is outside of this +/-3 range, the dataset is not normally distributed. |
* Kurtosis [Note. Kurtosis also refers to the extent to which the data are normally distributed around the mean. This time, the data are piled up higher than normal around the mean or piled up higher than normal at the ends of the distribution.] Readers are referred to the following sources for a more detailed definition of kurtosis: http://www.statistics.com/index.php?page=glossary&term_id=326 and http://www.statsoft.com/textbook/basic-statistics/#Descriptive%20statisticsb |
To standardize the kurtosis value so that its value can be constant across datasets and across studies, the following calculation must be made: Take the kurtosis value from the SPSS output and divide it by the Std. error of kurtosis. If the resulting calculation is within -3 to +3, then the kurtosis of the dataset is within the range of normality (Onwuegbuzie & Daniel, 2002). If the resulting calculation is outside of this +/-3 range, the dataset is not normally distributed.
|
* Continue |
* OK |
Note: Before you continue to another application you must “UNSPLIT” the files before moving on to other steps: |
√ Data |
√ Split Files |
√ Analyze all cases, do not create groups |
√ OK |
Check for Skewness and Kurtosis values falling within/without the parameters of normality (-3 to +3). Note that each variable below has its own skewness value and its own kurtosis value. Thus, a total of three standardized skewness coefficients and three standardized kurtosis coefficients can be calculated from information in the table below.
Table 10.1. Skewness and Kurtosis Coefficients | CH005TC09R | CL005TC09R | CW005TC09R |
N Valid | 3125 | 1805 | 1877 |
Missing | 5197 | 6517 | 6445 |
Skewness | -1.129 | -.479 | -2.197 |
Std. Error of Skewness) | .044 | .058 | .056 |
Kurtosis | 1.818 | -.412 | 6.991 |
Std. Error of Kurtosis | .008 | .115 | .113 |
Copy skewness and kurtosis information into the skewness and kurtosis calculator |
Compute Descriptive Statistics on the Dependent Variable |
* Do so via the ANOVA procedure. |
* Note. Do not use the ANOVA statistical significance information provided in the output. Use only the Ms, SDs, and ns. |
* The screen shot will occur in the next step (Mean and standard deviation) |
Run Nonparametric One-Way ANOVA on Data |
* Analyze |
* Nonparametric Tests |
* k Independent Samples |
* Keep the default of Kruskal-Wallis H checked |
* Test Variable would be your Dependent Variable (e.g., test scores) |
* Grouping Variable would be your Independent Variable (categories) |
* Define Groups |
* Insert the number for your lowest numbered group and then the number for your highest numbered group. |
Note: Click on view than value labels to find the code for each group. |
* Continue |
** To obtain the Means and Standard Deviation: |
* Click on options |
* Highlight Descriptive |
* Click Continue |
Check for Statistical Significance |
Numerical sentence is written as: Χ2= 430.66, p < .001 |
Table 10.2. Test Statisticsa,b | Performance IQ (Wechsler Performance Intelligence 3) |
Chi-Square | 430.661 |
df | 1 |
Asymp. Sig. | .000 |
a. Kruskal Wallis Test |
b. Grouping Variable: Disability Group Membership |
If you have a statistically significant finding in your nonparametric ANOVA, you need to run the appropriate nonparametric post hocs. Refer to your steps on running the nonparametric independent samples t-test.
Calculate Nonparametric Independent Samples
t
-test on Data |
√ Analyze |
√ Nonparametric Tests |
√ 2 Independent Samples |
√ Test Variable would be your Dependent Variable (e.g., test scores) |
√ Grouping Variable would be your dichotomous Independent Variable |
√ Define Groups |
√ Group One is No. 1 and Group Two is No. 2 (or whatever numbers you used to identify each group) |
Note: Click on view then value lables to find the code for each group |
√ Continue |
√ OK |
Note. The above procedure is repeated for each pairwise comparison. Thus, if you have three groups, you would have three calculations. Correct for inflated error by using the Bonferroni method of adjustment. Take the number of pairwise comparisons you are calculating and divide .05 by that. |
Check for Statistical Significance |
1. Go to the Test Statistics Box and look at the cell in the bottom right column to check for statistical significance. |
If you have any value less than .05 then you have statistical significance. Remember to replace the third zero with a 1, if the value is .000 (i.e., for a sig value of .000, thus it would read .001). |
Table 10.3. Test Statisticsa | Performance IQ (Wechsler Performance Intelligence 3) |
Mann-Whitney U | 6765.500 |
Wilcoxon W | 44166.500 |
Z | -20.752 |
Asymp. Sig. (2-tailed) | .000 |
a. Grouping Variable: Disability Group Membership |
To determine how to report the results of these nonparametric followup procedures, see the chapter on nonparametric independent samples t-test in this book.
Writing Up Your Nonparamteric ANOVA
So, how do you "write up" your Research Questions and your Results? Schuler W. Huck (2000) in his seminal book entitled, Reading Statistics and Research, points to the importance of your audience understanding and making sense of your research in written form. Huck further states:
This book is designed to help people decipher what researchers are trying to communicate in the written or oral summaries of their investigations. Here, the goal is simply to distill meaning from the words, symbols, tables, and figures included in the research report. To be competent in this arena, one must not only be able to decipher what's presented but also to "fill in the holes"; this is the case because researchers typically assume that those receiving the research report are familiar with unmentioned details of the research process and statistical treatment of data.
A Note from the Editors
Researchers and Professors John Slate and Ana Rojas-LeBouef understand this critical issue, so often neglected or not addressed by other authors and researchers. They point to the importance of doctoral students "writing up their statistics" in a way that others can understand your reporting and as importantly, interpret the meaning of your significant findings and implications for the preparation and practice of educational leadership. Slate and LeBouef provide you with a model for "writing up your Nonparametric ANOVA statistics."
Click here to view: Writing Up Your Nonparametric ANOVA Statistics