WO2005114614A3 - Method and system for generating and processing an assessment examination - Google Patents

Method and system for generating and processing an assessment examination Download PDF

Info

Publication number
WO2005114614A3
WO2005114614A3 PCT/US2005/016742 US2005016742W WO2005114614A3 WO 2005114614 A3 WO2005114614 A3 WO 2005114614A3 US 2005016742 W US2005016742 W US 2005016742W WO 2005114614 A3 WO2005114614 A3 WO 2005114614A3
Authority
WO
WIPO (PCT)
Prior art keywords
answer sheet
answer
examination
examinee
grading
Prior art date
Application number
PCT/US2005/016742
Other languages
French (fr)
Other versions
WO2005114614A2 (en
Inventor
Preston Cody
Original Assignee
Educational Testing Service
Preston Cody
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Educational Testing Service, Preston Cody filed Critical Educational Testing Service
Publication of WO2005114614A2 publication Critical patent/WO2005114614A2/en
Publication of WO2005114614A3 publication Critical patent/WO2005114614A3/en

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/06—Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers

Abstract

Methods and systems for generating and processing an assessment examination answer sheet are disclosed. An answer sheet is formatted by question, column or section using a layout tool and includes calibration marks, and examinee and examination identifiers. The format is stored in a computer-readable form, such as an XML file. A conventional printer prints the answer sheet prior to a test administration. Upon completion, a scanned image of the answer sheet is produced using a conventional scanner. The calibration marks are used to determine relative positions of answer sheet elements and to determine light and dark answer values. The examinee and examination identifiers identify the examinee and the proper stored format. Automatic grading ensues. A graphical user interface ('GUI') assists grading of the answer sheet. The GUI may use confidence level indicators to denote answer choices or questions for which the grading system cannot precisely determine the intended response.
PCT/US2005/016742 2004-05-14 2005-05-12 Method and system for generating and processing an assessment examination WO2005114614A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US57102104P 2004-05-14 2004-05-14
US60/571,021 2004-05-14
US10/951,068 US8155578B2 (en) 2004-05-14 2004-09-27 Method and system for generating and processing an assessment examination
US10/951,068 2004-09-27

Publications (2)

Publication Number Publication Date
WO2005114614A2 WO2005114614A2 (en) 2005-12-01
WO2005114614A3 true WO2005114614A3 (en) 2009-04-09

Family

ID=35309848

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/016742 WO2005114614A2 (en) 2004-05-14 2005-05-12 Method and system for generating and processing an assessment examination

Country Status (2)

Country Link
US (1) US8155578B2 (en)
WO (1) WO2005114614A2 (en)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040083229A1 (en) * 2001-09-04 2004-04-29 Porter Robert Austin Apparatus and method for automatically grading and inputting grades to electronic gradebooks
US8128414B1 (en) 2002-08-20 2012-03-06 Ctb/Mcgraw-Hill System and method for the development of instructional and testing materials
CA2516160A1 (en) * 2003-02-14 2004-09-02 Ctb/Mcgraw-Hill System and method for creating, assessing, modifying, and using a learning map
US8155578B2 (en) 2004-05-14 2012-04-10 Educational Testing Service Method and system for generating and processing an assessment examination
US7980855B1 (en) 2004-05-21 2011-07-19 Ctb/Mcgraw-Hill Student reporting systems and methods
US7697160B1 (en) * 2004-10-28 2010-04-13 Mark Gordon Brosius Resolution and device independent plain-paper input system
JP4872214B2 (en) * 2005-01-19 2012-02-08 富士ゼロックス株式会社 Automatic scoring device
US20070009871A1 (en) * 2005-05-28 2007-01-11 Ctb/Mcgraw-Hill System and method for improved cumulative assessment
US20070031801A1 (en) * 2005-06-16 2007-02-08 Ctb Mcgraw Hill Patterned response system and method
JP2007003636A (en) * 2005-06-22 2007-01-11 Fuji Xerox Co Ltd Teaching material processing apparatus, teaching material processing method, and teaching material processing program
US7831195B2 (en) 2006-12-11 2010-11-09 Sharp Laboratories Of America, Inc. Integrated paper and computer-based testing administration system
US20080227075A1 (en) * 2007-03-15 2008-09-18 Ctb/Mcgraw-Hill, Llc Method and system for redundant data capture from scanned documents
US8457544B2 (en) * 2008-12-19 2013-06-04 Xerox Corporation System and method for recommending educational resources
US8699939B2 (en) 2008-12-19 2014-04-15 Xerox Corporation System and method for recommending educational resources
US8736898B2 (en) * 2007-10-17 2014-05-27 Xerox Corporation Automated user feedback
US20090282009A1 (en) * 2008-05-09 2009-11-12 Tags Ltd System, method, and program product for automated grading
US8472860B2 (en) * 2008-05-13 2013-06-25 Benny G. Johnson Artificial intelligence software for grading of student problem-solving work
US20100047757A1 (en) * 2008-08-22 2010-02-25 Mccurry Douglas System and method for using interim-assessment data for instructional decision-making
US20100075291A1 (en) * 2008-09-25 2010-03-25 Deyoung Dennis C Automatic educational assessment service
US20100075292A1 (en) * 2008-09-25 2010-03-25 Deyoung Dennis C Automatic education assessment service
US20100075290A1 (en) * 2008-09-25 2010-03-25 Xerox Corporation Automatic Educational Assessment Service
US8261985B2 (en) * 2009-04-07 2012-09-11 Avante Corporation Limited Manual recount process using digitally imaged ballots
US8261986B2 (en) 2009-10-21 2012-09-11 Kevin Kwong-Tai Chung System and method for decoding an optically readable markable sheet and markable sheet therefor
WO2011094214A1 (en) * 2010-01-29 2011-08-04 Scantron Corporation Data collection and transfer techniques for scannable forms
US8892990B2 (en) * 2012-03-07 2014-11-18 Ricoh Co., Ltd. Automatic creation of a table and query tools
US9449031B2 (en) 2013-02-28 2016-09-20 Ricoh Company, Ltd. Sorting and filtering a table with image data and symbolic data in a single cell
US9607524B2 (en) * 2013-09-03 2017-03-28 Xerox Corporation Method and system for generating and evaluating assessment sheets
US20150199598A1 (en) * 2014-01-11 2015-07-16 Kenneth W. Iams Apparatus and Method for Grading Unstructured Documents Using Automated Field Recognition
MY190013A (en) * 2014-12-22 2022-03-22 Mimos Berhad Method for automatic diagrammatic question generation and answer assessment
JP2016212284A (en) * 2015-05-11 2016-12-15 富士通株式会社 Point rating rule application object specification program, erroneous judgment rule setting program, point rating rule application object specification method, erroneous judgment rule setting method, application object specification device, and erroneous judgment rule setting unit
CN104915667B (en) * 2015-05-27 2018-04-24 华中科技大学 A kind of answering card identifying and analyzing method and system based on mobile terminal
US10242048B2 (en) 2016-01-26 2019-03-26 International Business Machines Corporation Dynamic question formulation to query data sources
USD885479S1 (en) 2018-03-20 2020-05-26 Forum Education, LLC Scannable answer sheet
WO2020006121A1 (en) * 2018-06-27 2020-01-02 Gened Corp. System and method for generative assessment item development, encoding and analysis
CN109241869A (en) * 2018-08-16 2019-01-18 邯郸职业技术学院 The recognition methods of answering card score, device and terminal device
CN109711284A (en) * 2018-12-11 2019-05-03 江苏博墨教育科技有限公司 A kind of test answer sheet system intelligent recognition analysis method
CN109857320B (en) * 2019-01-17 2021-01-05 武汉天量数据技术有限公司 Answer sheet updating method and device, display equipment and readable storage medium
CN110276340A (en) * 2019-05-28 2019-09-24 杭州布谷科技有限责任公司 Answer sheet generates and recognition methods and device
CN110766015A (en) * 2019-10-11 2020-02-07 深圳市鹰硕技术有限公司 Answer sheet identification method, device, server, system and storage medium
CN112734705A (en) * 2020-12-30 2021-04-30 广东德诚大数据科技有限公司 Answer sheet abnormity detection method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5011413A (en) * 1989-07-19 1991-04-30 Educational Testing Service Machine-interpretable figural response testing
US5711673A (en) * 1993-09-17 1998-01-27 National Computer Systems Method for interpreting a plurality of response marks on a scannable surface
US5775918A (en) * 1993-12-30 1998-07-07 Ricoh Company, Ltd. System for making examination papers and having an automatic marking function
US6234806B1 (en) * 1997-06-06 2001-05-22 Educational Testing Service System and method for interactive scoring of standardized test responses
US6751351B2 (en) * 2001-03-05 2004-06-15 Nsc Pearson, Inc. Test question response verification system

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4217487A (en) * 1978-05-26 1980-08-12 National Computer Systems, Inc. Self-calibrating apparatus for photoelectrically scanning answer documents
US4978305A (en) * 1989-06-06 1990-12-18 Educational Testing Service Free response test grading method
US5134669A (en) * 1990-06-13 1992-07-28 National Computer Systems Image processing system for documentary data
US5672060A (en) * 1992-07-08 1997-09-30 Meadowbrook Industries, Ltd. Apparatus and method for scoring nonobjective assessment materials through the application and use of captured images
US5987149A (en) * 1992-07-08 1999-11-16 Uniscore Incorporated Method for scoring and control of scoring open-ended assessments using scorers in diverse locations
US5437554A (en) * 1993-02-05 1995-08-01 National Computer Systems, Inc. System for providing performance feedback to test resolvers
US5321611A (en) * 1993-02-05 1994-06-14 National Computer Systems, Inc. Multiple test scoring system
US5433615A (en) * 1993-02-05 1995-07-18 National Computer Systems, Inc. Categorized test item reporting system
WO1998043223A1 (en) * 1997-03-21 1998-10-01 Educational Testing Service System and method for on-line essay evaluation
US5991595A (en) * 1997-03-21 1999-11-23 Educational Testing Service Computerized system for scoring constructed responses and methods for training, monitoring, and evaluating human rater's scoring of constructed responses
US6267601B1 (en) * 1997-12-05 2001-07-31 The Psychological Corporation Computerized system and method for teaching and assessing the holistic scoring of open-ended questions
US6079624A (en) * 1997-12-08 2000-06-27 William C. Apperson Data processing form using a scanning apparatus
US6741724B1 (en) * 2000-03-24 2004-05-25 Siemens Dematic Postal Automation, L.P. Method and system for form processing
US6652287B1 (en) * 2000-12-21 2003-11-25 Unext.Com Administrator and instructor course management application for an online education course
US7068861B2 (en) * 2001-09-04 2006-06-27 Renaissance Learning, Inc. Device and method for inspecting markings
US7162198B2 (en) * 2002-01-23 2007-01-09 Educational Testing Service Consolidated Online Assessment System
US6816702B2 (en) * 2002-03-15 2004-11-09 Educational Testing Service Consolidated online assessment system
US7298902B2 (en) * 2004-01-20 2007-11-20 Educational Testing Service Method and system for performing image mark recognition
US8155578B2 (en) 2004-05-14 2012-04-10 Educational Testing Service Method and system for generating and processing an assessment examination

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5011413A (en) * 1989-07-19 1991-04-30 Educational Testing Service Machine-interpretable figural response testing
US5711673A (en) * 1993-09-17 1998-01-27 National Computer Systems Method for interpreting a plurality of response marks on a scannable surface
US5775918A (en) * 1993-12-30 1998-07-07 Ricoh Company, Ltd. System for making examination papers and having an automatic marking function
US6234806B1 (en) * 1997-06-06 2001-05-22 Educational Testing Service System and method for interactive scoring of standardized test responses
US6751351B2 (en) * 2001-03-05 2004-06-15 Nsc Pearson, Inc. Test question response verification system

Also Published As

Publication number Publication date
US20050255439A1 (en) 2005-11-17
US8155578B2 (en) 2012-04-10
WO2005114614A2 (en) 2005-12-01

Similar Documents

Publication Publication Date Title
WO2005114614A3 (en) Method and system for generating and processing an assessment examination
US11802839B2 (en) Quantifying color changes in chemical test pads induced by different concentrations of analytes under different lighting conditions
EP1659534A3 (en) Restoration of truncated imaging data of X-ray ct apparatus
EP1376216A3 (en) Face image photographing apparatus and face image photographing method
US20060092442A1 (en) Color accuracy check
EP1445664A3 (en) Registrating process and system for shifting laterally image on image (IOI) and image on paper (IOP)
EP2023595A3 (en) Image-processing apparatus, image-processing method, and computer program
CA2399193A1 (en) Versatile system for creating test images in a digital printing apparatus
KR101945692B1 (en) Record handling method and system
CN106405118A (en) Ovulation test paper detection method and system
CN103837537B (en) A kind of without Grains metal inkjet forme dot area percentage measuring method
JP7127288B2 (en) Coloring reaction observation assistance system, coloration reaction observation assistance method and program
TW398134B (en) Multiple purpose composite target for digital imaging test and calibration
Kournetas et al. Assessing the reliability of a digital preparation assistant system used in dental education
US8649601B1 (en) Method and apparatus for verifying answer document images
Mahé et al. Screening test accuracy studies: how valid are our conclusions? Application to visual inspection methods for cervical screening
Pollitt et al. Could comparative judgements of script quality replace traditional marking and improve the validity of exam questions
CN205749302U (en) It is easy to the testing calibration plate automatically identified
CN101166222A (en) Image forming apparatus, image processing method and image processing program
EP1650945A1 (en) Apparatus and method for automatically analysing a filled in questonnaire
EP1800862A3 (en) Method and apparatus for irradiating a screen used in silk-screen printing
US9195875B1 (en) Method and apparatus for defining fields in standardized test imaging
US8488220B1 (en) Method and apparatus for calibrating imaging equipment
Abbas An automatic system to grade multiple choice questions paper based exams
Axelrod et al. The oral trail making test

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase