Empirical Article Review Form
Please complete this form by bolding the number that corresponds to your opinion about each of the items. When you have completed the form, please save it to your computer, then upload it to Manuscript Central as an attachment to your Score Sheet. Your written comments should be typed or pasted into the appropriate box in the Score Sheet in Manuscript Central
|
Review of literature:
|
|
Superficial
|
1
|
2
|
3
|
4
|
5
|
In-Depth
|
|
Limited to functional area
|
1
|
2
|
3
|
4
|
5
|
Draws upon educational and/or psychological literature to support intended learning effects of the innovation
|
|
No hypotheses, or hypotheses do not follow from the literature review
|
1
|
2
|
3
|
4
|
5
|
Hypotheses follow logically from the literature review
|
|
Did not reference earlier articles in DSJIE
|
1
|
2
|
3
|
4
|
5
|
Referenced earlier articles in DSJIE
|
|
Description of the innovative approach:
|
|
Incomplete, contains holes
|
1
|
2
|
3
|
4
|
5
|
Complete, could easily be replicated
|
|
Nothing particularly new or exciting
|
1
|
2
|
3
|
4
|
5
|
Highly innovative, a really great idea
|
|
Inappropriate for this topic or area
|
1
|
2
|
3
|
4
|
5
|
Very appropriate for this topic or area
|
|
Data analysis:
|
|
No measures or inappropriate measures of learning effects
|
1
|
2
|
3
|
4
|
5
|
Appropriate measures of learning effects
|
|
Limited to descriptive data, or no data at all
|
1
|
2
|
3
|
4
|
5
|
Moves beyond descriptive data to examine relationships between variables
|
|
Inappropriate and/or improperly executed statistical analysis
|
1
|
2
|
3
|
4
|
5
|
Appropriate and properly executed statistical analysis
|
|
Discussion of findings:
|
|
Overstated, or does not follow from analysis of results
|
1
|
2
|
3
|
4
|
5
|
Follows from analysis of results
|
|
No suggestions or hints for readers who would like to use this approach
|
1
|
2
|
3
|
4
|
5
|
Makes suggestions for implementation by readers
|
|
Overall impression:
|
|
Research does not follow standards for academic research; inappropriate for a high quality journal
|
1
|
2
|
3
|
4
|
5
|
Based on rigorous academic standards; appropriate for a high quality journal
|
|
Poorly organized, difficult to follow
|
1
|
2
|
3
|
4
|
5
|
Well-organized, clearly written
|
|
Trivial
|
1
|
2
|
3
|
4
|
5
|
Highly significant, breaks new ground
|