Search JMU Web | Find JMU People | Site Index   

Description of Testscoring Reports and Statistics

Remark Test Scoring Report List

The following is a list of reports sent to each instructor via the web from the Remark Test Scoring System. Click on the link in the Report Title column for detailed information regarding a specific report.

URL Title Report Title Report Description
Section1.html Test Statistics Provides an overview of test results.
Section2.html Respondent Statistics Provides the grade, total score and percent score alphabetically by student.
Section3.html-Graph2.jpg Graph Frequency Distribution A graph and table displaying the number of students whose test scores fall within each bin of two percentage points (e.g. 98-100.) The graph is helpful for visualizing the distribution (e.g. to see if there are any natural breaks in the distribution or a "tail" of low scores.
Section 3.html Frequency Distribution Numeric data of the maximum and minimum score and the number of students that fall within the range.
Section4.html Item Statistics This report may be disregarded. This report is generated by default but does not provide any pertinent information to instructors regarding test assessment. This report is useful for attitude scoring and course evaluations.
Section5.html Item Analysis Provides statistical information for individual test questions.
.csv file .csv file Provides a list of students (open in Excel) with their response for each test question. Column CY provides the overall test score in percent format and column CX provides the raw score. With some cut/paste manipulation, this report allows instructors to cut and paste data into Blackboard.

Top of Page

Remark Test Statistics Report

Statistics Sample Value Description Notes
Number of Tests Graded 72 The total number of tests that were graded  
Number of Graded Items 57 The number of items on the test that were graded.  
Total Points Possible 57.00 Total number of points on the test.  
Maximum Score 51.00 The highest score from the tests that were graded.  
Minimum Score 26.00 The lowest scored from the tests that were graded.  
Median Score 43.00 The median of the scores from the graded test. Fifty percent of the values lie above the medial and 50% lie below. The median is more useful as a measure of the center of the distribution than is the mean when the distribution is skewed (the peak of the distribution is not centered between the minimum and maximum values.)
Range of Scores 25.00 The range is the distance between the highest score and the lowest score. Max Score (94) less Min Score (53)
Percentile (25) 38.00 25% of the data values lie below the 25th percentile. In this example, 25% of the students scored below 38.
Percentile (75) 45.00 75% of the data values lie below the 75th percentile. In this example, 75% of the students scored below 45.
Mean Score 41.26 The average score of all the graded tests.  
Standard Deviation 5.87 A statistic used to characterize the dispersion among the measure in a given population. It is calculated by taking the square root of the variance. The larger the standard deviation, the greater the variability among students in test scores.
Mean Percent Score 72.39 The average proportion correct score of all the graded tests.  
KR 20 (Kuder-Richardson Formula 20) 0.90 An overall measure of internal consistency of the graded test, often used as a measure of the reliability of the test scores. The KR 20 indicates how well the test items relate one another, or how a single skill/construct is influencing students' performance on the test. KR 20 ranges between 1 (indicating perfect correlations between items) and 0 (indicating no relationship between items). It is possible for the KR 20 value to be negative, and this indicates that the test scores are being influenced strongly by more than one skill or construct. Since all tests have some error, reliability coefficients never reach 1.0. Generally, if the KR20 value is above .80, the test is producing reliable scores; if it is below .50, the test scores would not be considered to be very reliable.

Top of Page

Remark Respondent Statistics

The Respondent Statistics provides a variety of statistics based on the current grade operation. By default, the Grade, Total Score and Percent Scores for each student is displayed. An example of the Remark Respondent Statistic table follows:

Respondent Grade ** Total Score Percent Score
Adams, Amy
101111111
C- 40.00 70.18
Bennigan, Bridget
101222222
C 44.00 77.19
Calhoun, Casey
101333333
F 29.00 50.88
Doe, David
101444444
C+ 45.00 78.95
Evans, Ethan
101555555
B 49.00 85.96

** Note: The letter grade contained in the instructor's report is NOT contained in the data sent to the student. The letter grades are automatically generated by the system based on a ten point grading scale. The grades may not apply to your individual grading scale. Unfortunately, the grade column cannot be removed from the generated report.



Statistic Meaning Note
Respondent Student name and e-ID  
Grade Letter grade for the test See note above
Total Score Student's score for the test  
Percent Score Corresponding percent score for the test.  

Top of Page

Frequency Distribution - Graph & Numeric Formats

Graph Format Numeric Format
Frequency distribution chart, example
Interval Percent Score Frequency
1 98.00 - 100 1
2 96.00 - 97.99 3
3 94.00 - 95.99 2
4 92.00 - 93.99 5
.
.
.
.
.
.
 
57 0 - 1.99 0

Top of Page

Remark Item Analysis

The Item Analysis provides an in-depth look at individual question statistics. Each item displays in a separate table. The following is an example of the results you receive from the Remark system.


Item Analysis: q1

Label Value Frequency Percent Point Biserial
A 1 7 10.00 -0.18
B 2 4 5.71 -0.32
C 2 7 10.00 -0.30
D 4 52 74.29 0.50
E 5 0 0.00 -
Total 70 100.00  

Statistic Description Notes
Label The label, or answer, designated on the form Correct response is indicated by the bold, italic font.
Value The corresponding numeric value for each label or answer.  
Frequency The number of times a particular label, or answer, was chosen  
Percent The corresponding percentage of the frequency. Use the percent statistic of the test item to determine the difficulty ranking of test items previously provided in the old Raven test system.
Point Biserial A measurement of the discrimination of an item. It indicates the relationship between a response for a given item and the overall test score of the respondent. A high value indicates that students scoring well on the test chose this response. The point biserial statistic applies to grading only. This statistic may be used in place of the Upper 1/3 and Lower 1/3 statistic. The point biserial value should be positive for the correct response (indicating that students who choose the correct response have higher mean total scores than students who do not choose this response), and negative or zero for the incorrect response (indicating that students who choose the incorrect response have lower mean total scores than students who did not choose the incorrect response).
Total The percentage of students who answered the question.  

Top of Page

Remark Item Statistics Report

Please disregard this report. This report is generated by default but does not provide any pertinent information to instructors regarding test assessment. This report is useful for attitude scoring and course evaluations. Unfortunately, we are not able to remove the production of this report at this time, however, instructors will only receive a one page report which resembles the following.

q1 q2 q3 q4 q5
q6 q7 q8 q9 q10...

Top of Page

.csv File

Provides a list of students (open in Excel) with their response for each test question. Column CY provides the overall test score in percent format and column CX provides the raw score. With some cut/paste manipulation, this report allows instructors to cut and paste data into Blackboard. Note: The letter grade generated by the system is determined on a ten-point scale and may not coincide with your individual grading scale.

An example of a .csv file


Top of Page