Remark Office OMR (bubblesheets)

The university offers bubble sheet scanning for instructors. Bubble sheets can be purchased from UVic Printing and Duplicating Services. Once they are filled in by students, the bubble sheets must be dropped off with a cover sheet at the Computer Help Desk in Clearihue A037. Processing is usually completed and delived by campus mail within four days unless pickup indicated.

There are currently three officially recognized bubblesheets at UVic:

  • UVic A -- Blue (General Purpose Five Response Answer Sheet)
  • UVic B -- Green (General Purpose Ten Response Answer Sheet)
  • UVic C -- White (General Purpose Five Response Answer Sheet with Names)

To use the bubblesheets please follow these steps:

  • Get a supply of the new forms from your department or through UVic Printing and Duplicating Services.
  • Prepare your answer key on the new forms.
  • Have your students complete their responses using the new forms.
  • Submit the forms and new coversheet for grading to the helpdesk.

If you would like to create and scan your own exams, please visit the Systems site to download your personal copy of Remark Office OMR. For a simple review of how to use Remark, please look at the How to Use Remark pamphlet - Elliott Lee, 2015, Department of Psychology.

The Remark OMR test scoring software uses updated exam answer forms and coversheets. Paper copies of the coversheet are available at the Computer Help Desk if you are dropping your forms off in person. Exam forms can be ordered through UVic Printing and Duplicating Services. Printing and Duplicating Services sells a Five Response (Blue) version, a Ten Response (Green) version, and a Five Response with Name (White) version of the exam answer forms. 

The coversheet can be printed from this link UVic Multiple-Choice Exam Coversheet.

Please note that the exam answer form sample is for informational purposes only.

UVic Sample Multiple-Choice Exam Answer Form

If you have any questions about the exam answer forms or coversheets, please contact the LTSI .

Why are we changing the test scoring software?

The change to the University of Victoria’s test scoring was initiated by requests from faculty and instructors who indicated the old software was no longer meeting their needs.
 
The Remark software produces easy to read reports in a user friendly PDF format. Summary exam results will be provided in a file that can be readily imported to Excel or another preferred program.

The exam answer forms have been updated. Please note this is a sample form only for information purposes. Forms can be ordered through UVic Printing and Duplicating Services. The bubblesheet forms previously referred to as ‘FORM A’ and ‘FORM B’ have been replaced with new forms called ‘UVic 5’ and ‘UVic 10’. The new forms are easier to complete for students and contain fields instructors will find useful. Students can now use pencil (#2 HB or darker) or pens to record their responses on the new forms.

When will the new test scoring system start?

The test scoring system has been running in Pilot mode since September 2013. A number of instructors of large courses have been participating in the pilot project and providing feedback to the Test Scoring working group to aid in the exam form design and choices for the reporting to instructors. The new system will be fully and exclusively in place for January 2015.

How do I start to use the new test scoring system?

From the instructors’ point of view there should be very little difference in how the system works.
  • Get a supply of the new forms from your department or through Printing and Duplicating Services
  • Prepare your answer key on the new form and complete the exam scanning coversheet.
  • Have your students complete their responses using the new forms. 
  • Submit the forms and coversheet for grading to the helpdesk.

How can I use the new bubble-sheet-test-marking software to improve the quality of my tests?

The new system provides the indices of question/test quality that were output by the old system, and presents them in a much clearer, more user-friendly way. Instructors can see at a glance how many students chose each option to each question, and they can easily tell which items were more versus less correlated with accuracy on the rest of the test. This will make it easy for instructors to spot problematic questions (e.g., perhaps there was an error in the key, or two of the response options are equally correct, or none of them is, or there was an unintended ambiguity in the question). Tests are better and fairer when such problems are resolved (e.g., by correcting errors in the key, or allowing either of two responses, or treating a question as a bonus question or dropping it altogether). With the new system it will be much easier for instructors to ask Operations to re-score a test with a revised key without the previous need for re-scanning; just email opertwo@uvic.ca to advise you will need to make a change to your answer key. Provide a revised coversheet with the details of the information you will need to change ( for example, drop question 13, change question 12 to allow both A and B as correct choices ). A photocopy of the original coversheet with changes noted is acceptable. For general advice on creating multiple choice tests, analyzing their results, and (when appropriate) rescoring them, see the Online Resources page.


How will I get my results?

All results will be emailed back to the instructor in a secure environment. The completed exam forms will be returned by intercampus mail.

What is the turnaround time?

The turnaround time should be similar to the turnaround with the old system. Exams submitted for processing will generally be returned within three days via intercampus mail.

Where do I submit the forms for scanning?

Submit the completed test scoring forms, your answer sheet and the cover sheet into the Central Computer Help Desk (Clearihue A037).

Do I get the forms back?

Yes. The completed exam forms will be returned by intercampus mail.

What should I tell my students?

  • Students should be advised to bring student ID and to know their UVic student number (V00xxxxxx) as they will be asked to record the full student number on the test form.
  • Students can now use pen or HB Pencil to complete their exam. To change a response, the student can either fully erase or use a large X to cross out and incorrect response.

What do I need to do to support CAL in helping students with disabilities take tests in my course?

It is the responsibility of the instructor to provide the Centre for Accessible Learning (CAL) with all exam materials including the correct blank bubble sheet forms which they will be using for their student’s exam.

What is the process if I need to change my answer key?

If you need to amend your answer key, contact opertwo@uvic.ca within two weeks of receiving your test results and provide a revised coversheet with the details of your changes.

Can I have bonus questions?

Yes.

Can I have questions with more than one correct answer?

Yes.

Have the forms changed?

Yes. The bubblesheet forms referred to as ‘FORM A’ and ‘FORM B’ have been replaced with new forms called ‘UVic 5’ and ‘UVic 10’. The new forms are easier to complete for students and contain fields instructors will find useful. Since the forms are designed and printed at UVic they will be less expensive to produce and will cost less for departments.

Where do I order the new bubblesheet forms from?

The new bubblesheet forms are available from Printing and Duplicating Services.

Can we still use the old bubblesheet forms?

FORM A and FORM B will only work with the aging Scantron system and cannot be used with the new system. If you have a supply of the old forms you can continue to use them ONLY through to the end of Dec 2014. From January 2015 we will not be able to process the old forms.

What was the consultation process for the change to the test scoring system?

The Test Scoring Faculty Advisory Committee has met regularly for the past several years exploring this opportunity to find an improved solution for test scoring for faculty and instructional staff. There has been considerable consultation with the instructors of large courses that use test scoring on the campus. The Advisory Committee has invited any interested instructors to join its meetings. Others have kindly submitted written feedback. The Advisory Committee worked closely with University Systems to define campus needs, to solicit RFPs and to select the best vendor option for the campus. An LTSI communications luncheon was held on the subject for departmental assistants on Jan 31, 2014 and regular updates have been provided to the Senate Committee on Learning and Teaching as part of the updates on activities from the LTSI Executive Director.

Can I do my own marking by managing the software myself?

Yes. This is in no way required or expected but, if instructors wish to scan and perform the full process of marking and analysing their own exams, then licences and training will be available. If you are interested please contact the LTSI .

LTSI video (51 min): Assessing the quality of multiple-choice test items: UVic's New Condensed Test Report by Marty Wall

We gratefully thank the Technology Integrated Learning group and Client Technologies at UVic for providing the production of this video.

Additional resources

Listed below are some available online resources for review when formulating multiple choice tests:

Improving Multiple Choice Questions

Developing Multiple Choice Tests Tips & Techniques

General Guidelines for Developing Multiple-Choice Items

Technical Guidelines Construction of Multiple-Choice Questions


For a more in-depth treatment, both McPherson Library and the UVic Division of Learning and Teaching Support and Innovation (LTSI) has the following book:
Haladyna, Thomas M. (2004).  Developing and validating multiple-choice test items.
Mahway, New Jersey, Lawrence Erlbaum Associates, Inc.
LB3060.32
M85H35

Also, the LTSI periodically offers a workshop on constructing and analyzing multiple-choice examinations. See the LTSI Events and Workshops page for current courses.

The new Remark OMR test scoring software produces easy to read reports in a user friendly PDF format. Below are samples of reports available through the Remark OMR test scoring software:

Class Frequency Distribution Report (#103)

Test Statistics Report (#104)

Condensed Test Report (#106)

Condensed Item Analysis Report (#204)

If you have any questions about the test scoring software reports, please contact the LTSI .