SUMMARY OF THE RESEARCH
PROBLEM STATEMENT (what is the primary research question):
HYPOTHESIS (what does the author predict):
Do the authors provide a good rationale for the question
Do the authors provide adequate support for the study’s utility
MEASUREMENT OF VARIABLES
SAMPLING (random assignment/random selection):
INSTRUMENTATION (how do they measure; is it operationally defined):
DATA ANALYSIS (statistical validity):
Authors’ CONCLUSIONS (do the authors’ conclusions coincide with the results, Construct Validity?):
Possible Threats to Internal Validity
History, Maturation, Instrumentation, Testing or Practice Effect, Statistical regression (regression toward the mean), Selection, Mortality, Sequencing, Participant Effects, or Experimenter Effects
Possible Threats to External Validity
Unique program features, experimental arrangements, other threats
Does the article make sense?
Is the article useful?
Do you have confidence in the findings? Why or why not?
What might you change if you were to redo this study?
What significance do you see from this study for society in general?
What significance do you see from this study for public administrators?