WO1993017407A1

WO1993017407A1 - Intelligent learning system

Info

Publication number: WO1993017407A1
Application number: PCT/AU1993/000070
Authority: WO
Inventors: Richard Storey Mckie; C. Leon Dearden
Original assignee: Hunter Technology Group Pty. Ltd.
Priority date: 1992-02-19
Filing date: 1993-02-19
Publication date: 1993-09-02
Also published as: AU3487393A; JPH07506678A

Abstract

An electronic study or learning system derives instructions from data carriers (10) such as bar codes printed in e.g. a workbook. The device may consist of a simple processor (30) with very little memory (33), and a standard optical reader (20). A student's progress may be recorded or monitored for later review.

Description

intelligent Learning System Technical Field

The present invention relates to electronic learning and testing systems, and in particular systems in which the test, course of study or the like are printed documents. Background Art

Computer based electronic learning and training aids are in increasing use for instructional and educational purposes. Known systems of this type generally utilise bar coded worksheets, where the user swipes a code using an optical reader which is connected to a central processing network. In these known systems, the bar code is usually used to indicate a score or survey result to the central network. This information is then stored or processed in or through the central network. Unfortunately, such networks are cumbersome, and they also require substantial memory, particularly in cases where a number of users are connected to the network simultaneously.

Systems exist for recording the bare results of surveys and the like using a bar code based system. However, such systems merely record outcomes - they are not adapted to guide a course of progress in study using the outcome of previous questions, nor to provide indications about the correctness or otherwise of the answers.

Summary of Invention

It is an object of the present invention to provide a system which overcomes at least some of the deficiencies of the prior art.

According to one aspect the present invention provides a system for recording answers to a set of visually presented questions, comprising; a question carrier, said carrier including at least a set of questions; a set of possible answers to said question, each answer being associated with a machine readable data carrier, and optionally including further data carriers not associated with a particular question; means for selectively reading said data carriers in response to a user's command; and local data processing means communicating with the means for selectively reading , the arrangement being such that the user causes the means for selectively reading to read said data carriers, the means for selectively reading communicates a signal corresponding to the data in said data carrier to said processing means, said data including information additional to the mere answer. According to another aspect the present invention provides a system for recording answers to a set of visually presented questions, comprising; a question carrier, said carrier including at least a set of questions; a set of possible answers to said question, each answer being associated with a machine readable data carrier, and optionally including further data carriers not associated with a particular question; means for selectively reading said data carriers in response to a user's command; and local data processing means including data storage communicating with the means for selectively reading , the arrangement being such that after reading a question, the user causes the means for selectively reading to read the data carrier associated with a selected answer, the means for selectively reading communicates a signal corresponding to the data in said data carrier to said processing means, said processing means in response to said signal recording an indication of the answer selected, and in response to at least some of said signals performing a further processing operation or providing feedback to the user.

Preferably the data carrier and answers on printed pages. Preferably the answers and questions are on the same page. Preferably the data carrier is a bar code, and the means for selectively reading is an optical scanning device.

The data carriers associated with a particular answer may provide the correct answer to the question -to a user, direct the processor to instruct the user to go to a particular question next, or in some cases refuse to accept the answer because intervening questions have not been answered. Additional data carriers may carry information about which set of questions is now being answered, resetting, that a section is completed, or similar information as may be required to guide the user. The system may also store information about the time taken to answer some or all questions, the order they were answered in, or similar information as may be desired for a given application. It will be appreciated that a key advantage of the present system is that the processing means need not be specifically programmed for a given course of study - all necessary instructions for the processor, beyond data formats and the like, are provided by the data carriers associated with the answers or otherwise provided on the question or answer sheets. Thus, a -general purpose, relatively simple hardware component may be used with as wide a variety of material as desired in an interactive learning system. Brief Description of Drawings

An embodiment of the present invention will now be described with reference to the accompanying figures, in which:

Figure 1 illustrates a question and answer page according to the present invention;

Figure 2 is a schematic diagram of a system according to the present invention; and Figure 3 is schematic flowchart illustrating one aspect of the operation of the present invention. Description

The present invention will be described in more detail in relation to a system where bar codes are used as data carriers, on a printed question and answer page, using an optical scanner.

However, the present invention may be implemented using different formats for each of these components. A magnetic type reader system or any other suitable record carrier may be used - bar coding is chosen because of convenience and ease of printing. Any suitable scanning arrangement may be used - the example uses a hand held "wand" type reader of the type used in libraries and similar applications. These are widely available commercially.

The preferred embodiment has as its information carrying component a printed sheet 10, or more properly a set of such sheets, shown in Figure 1. A question 12 has a set of possible answers 14, each with an associated bar code. A user "swipes" the code with a reader 20 (see Figure 2) to record an answer.

Much of the sheet set may be text which the user is required to read, in for instance, a continuing or remote education situation. Questions are posed periodically which, for instance, must be correctly answered. The user may then be directed to different parts of a workbook based on the answers, or to particular further questions. Additional codes may be used to indicate, for example, the beginning and end of a session, or preferences of the user. All of this information, about correctness, next question, etc. is preferably provided in the answer bar codes or introductory or ancillary bar codes. The system can be readily arranged to ensure questions are answered in the correct order, if required.

Details such as the timing of responses, the order of questions answered, the total time taken for completion etc. can be stored in the processor 30 or some associated memory device 33 and transferred in real time or off-line to a remote processor.

The same reader and publishing system can be used to set up examinations in which the candidate receives no response as to correctness but can be timed or have the time of operation limited by the reader. If desired, readers can be plugged into the examining body's network to facilitate data transfer.

The invention enables the code reader 20 to have a high degree of internal processing ability but little or no variable memory specific to any particular text. The need for external memory containing the correct outcomes or feedback responses is therefore substantially eliminated. The invention allows a significant reduction in electronic memory and battery requirements in an information system of this type and can reduce the entire system to one which is hand-held, so that the processor 30 shown in figure 2 is incorporated within the hand held reader unit 20. in one preferred form of the invention, a text based educational program is provided through which a student works at their own pace with a preferably pen¬ like optical electronic reader 20 providing negative and positive feedback as appropriate. The student may be obliged to work on problems in the order anticipated by the author and, where appropriate, the student may be prevented from deviating from the program. No external, supplementary or attached electronic memory specific to the text is required. All necessary instruction codes and feedback content can be contained within the codes, which also represent the choice made by the user. Because these codes determine the feedback given to the user at the same time as the correct response is stored, the system is entirely flexible as to use in examinations, when no feedback to correctness is given, or use as a study tool, when feedback provides information as to correctness and encourages progress or direct revision. The reader logs response times and timing of responses can be set by the instruction codes to count entries during a specified time or to time a specified number of entries. In some testing applications, the timing aspect provides additional performance data. This may be stored in memory device 33.

The same codes used for course direction can communicate to the reader a range of instructions for external control purposes and the reader can be interfaced to a wide variety of add-on devices to permit additional functions to be added. In most configurations envisaged by the invention, the code reader also makes a record of student progress as electronic memory which can be read at a later date in electronic form and downloaded to, for example, a personal computer if desired. In some configurations, detachable memory can be provided to facilitate this data transfer.

It is envisaged that the reader 20 can also be equipped with specific feedback techniques, including constructions providing a synthesised audible voice or music 34, and mechanical devices providing feedback to the deaf, e.g. braille or vibrations, and other similar sensory stimulation devices. The system can also be used to control external video and audio recording devices to provide educational sequences.

Bar codes according to the present embodiment are normally 5 digits long; additional digits may be added for some applications. Although any suitable bar code convention may be adopted, Code 3 of 9 is used for instructions.

The structure of the code is an instruction digit (A) followed by a choice number (C), then a question number (Q) and a data digit (B), followed by a section number (S). A prefix character (P) is also used in some codes. All 3 of 9 codes

begin and end with an "*". This has no value.

* P A C Q B S *

A character in the range 0 - 9 and A - Z can be assigned to each of these positions. In general, "0" is not used as a choice, question or section address, leaving 35 characters per position (an exception is the special requirement for choice in type 2 questions).

Up to 35 choices are allowed (provided no more than 10 are correct), up to 35 Questions are allowed in up to 35 sections per course or course segment. Special software can be readily written to substantially increase the total question outcomes per course or to use an alternate bar coding protocol if needed but the present format has been chosen to facilitate simple and easy coding for course authors. The instruction code A calls a series of routines held in memory device 30, preferably a ROM and may also be used to hand data to the processor. Reaction to the code and response to the user is defined by these routines. The signal to be returned or outcome directed can be called from memory device 30 or from an external address. Choice Answers

Four basic answer routines are illustratively defined. These can have a time limit or be sequential (no time limit) and provide instantaneous feedback as to correctness or provide no feedback as to correctness (as in an exam). A simple time trial is also possible. Up to 10 out of up to 35 choices can be correct (for example, in the following list which ten are alike?) Correct answers are signified by a code in which B = C + a [Where "a" is a constant set by the Log On code. The default is set = 1]. The number of correct choices sought is determined by a number (from 0 to 9) in position A (where 0 -= 1 correct choice and 9 = 10 correct choices required to get the question correct).

The following table sets out an illustrative character equivalent of numeric values input to the reader 20. The characters 36 - 42 are not normally used and are reserved for special functions.

Instructions and Data

A series of special codes is provided to define section starts and ends, to reset the system, direct branching, insert external data into the memory and so on. Visual signals may be provided by LEDS 21 , 22, 23 (red , green and yellow illustratively).

tape Long Green Musical bar Save completed Completed/

Verified Brief descriptions of question formats are set out below. Scoring

The processor holds the following data. Within a Section

For each question one byte holds v t t t t t t t Where

1 A time count for each question attempted "ttttttt" (up to 254 seconds = 4.23 minutes)

2 If attempt right or wrong [{value} v = 1 : Correct]

3 All questions attempted this section [all entries where "ttttttt" <> 0] This data is transferred automatically to external memory (if attached) at each section end. A summary of these results is automatically held in internal memory within a course.

If the memory is not attached, a forced save to tape can be programmed at each section end, if required. Within a Course

A summary of each section results is kept as one byte per section as follows, t t s s s s s s Where

1 The sections undertaken are logged in the order completed (depending on branching instructions this order may vary).

2 A total score for each section (out of 35) is stored at "ssssss"

3 Time taken each section (T) as a quartile of the time allowed for each section (at "tt")

Where "tt": 00 = 0 < T < 0.5 TA (Time allowed)

01 = 0.5 TA <T<TA 10 = TA < T < 1.5 TA 11 = T > 1.5 TA A forced save of this record can be programmed at the end of each course or within a course. Code Format Details Set-up Codes Log On (7 Characters)

* O *

Letter "O" codes log on, "a" codes the choice increment for correct. These are followed by 2 course codes and three student codes. Signal: Log On (tune)

New Section (must be given at each section start) P A F Q T S

* (C) or (T.S, S time *

B E,M) (minutes)

Prefix (P) is used for Type 3 questions {no prefix is normal, "C" sets column format} A or B indicate new section {A causes section to increment section by 1 when the end is reached, B anticipates an end code or branching instruction} F codes format as below, Q codes number of questions in this section, B codes time allowed in minutes, S codes this section number. The format is re-established at the start of each section.

Several variations in feedback and direction are possible using toggles set by the value of "C" at the start of each section (or by a branching instruction). These are:

Exam mode gives no feedback as to correct or not. The timed exam option allows overwriting to change answers and accumulates the time taken at each try (last answer entered deemed to be intended). In all other cases the first answer given is recorded. Full response mode advises if correct or not and the timed option allows a second, or further, attempt but only the first attempt scores. Timed sections can be answered in any order within the section until the time limit is reached. Sequential sections require every answer to be attempted in the sequence established by the text author. At time out the score is given or the use of a section end code will provide a score before the time limit is reached. In untimed sections the score is given when the student reaches the end (indicated by Q).

Note that in equipment used continuously for exams, full response mode can be disabled. Type 1 Questions

One correct choice or multiple correct answers from a larger choice - {for. example "which four of the following are alike?". All 4 correct answers = question correct, score 1}.

* o C Q B S *

to

9 0 to 9 codes number of correct answers sought (1 to 10), C codes choice, Q codes question number, B codes correct answer (where B - C + a; default a = 1 can be changed by the Log On code), S codes section number. Type 2 Questions

Referred result string. Score is obtained by entering the correct sequence of bar codes in a string. Each string of up to 36 entries is one question, (raw score =

1 )

* R C Q B S *

R codes referred string C codes this choice (note that the first choice in the string must be 0), Q codes this question number, B codes next choice (note the last choice in the string must be Z), S codes this section number. Type 3 Questions

Matching columns or groups. Score is obtained by matching the correct pairs (or more) of bar codes in two (to ten) columns {or groups} of up to 35 rows {or groups} (one complete section) scores 1 for each row {or group} matched.

Coded as for type 1 questions. Note that a New Section code with a prefix "C" is required. Type 4 Questions

Time Trial (used for dexterity testing). * T C Q B S *

T codes time trial, C codes choice (NOTE always starts at 1 and ends at Z), Q codes question number (NOTE always end at Z), B codes time allowed in minutes, S codes section number. Type 5 Data Entries Data Entry (used for biographical, external marking or survey work maximum

35 items per section - before save).

* D C Q B S *

D codes data, C codes alpha numeric character to be input, Q is current address and codes save location in Question Score matrix, B indicates shift (upper case = 0 lower case = 1 ), S codes section number.

Other Codes Section End

{Required for Sections commencing with a "B" start code, where there is no branching instruction or save commend. Also useful in "A" format timed sections to end and get the score before the allowed time is up. Allows redirection and "if" statements at a section end [e.g. "if your answer was ... stroke this code and go to question ..."] and/or non-consecutive section numbering}

* Z C Q 0 S *

Z codes Section end, C codes next Section, Q = 0, 0 not used, S codes this section. Note: Q must be set to 0, this ensures the code must be stroked before progression is allowed

Branch If {GO TO S (with format C) if Score < (or >) B, else go to next section} L C next B S

L or H codes branch type, C codes new format (over-rides normal section format), Next Si codes new section to go to if score meets the criteria (set by type), B codes Score required out of 35, S codes this section number, {Next Section = Si (can be this Section if required) L Branch to Si if score < B (low) else S = S + 1 (Go to next Section)

H Branch to Si if score > B (high) else S = S + 1 (Go to next Section) Set Next Address (within a section)

{Allows "if" statements to be inserted within a section e.g. "if your answer was ... stroke this code and go to question ..."} * N C Q B S *

N codes next address command, C not used, Q codes this question address, B codes next question to go to, S codes current section number. Go Anywhere (from current section)

{Sets new section to $ (wild card) can go to any section. S is current section. 0 must be in code "-" can be anything}

* $ - 0 - S *

Save, Read

* S C < / / e n> *

K S or K code if a save or read request, C codes baud rate (0 = 300 [tape], 1 =

600 and 2 = 1200), balance codes save file name <filen> (5 chars). All memory content is saved (or replaced in the case of a read). Forced Verify (at any point)

{Forced Verify can be activated by using this command after a save to ensure the save command has been completed correctly and to address the next section to go to}

* V C Q B S *

V codes Verify command, C codes Next Section Number, Q codes this question number, B codes Next Question number (only used when saving in this section), S codes this section. {If next section number is set C = 0 then a full erase of the memory is initiated e.g. at the end of a course} Erase Memory (Course End or Reboot)

{Course end should not be activated until save command and verify have been completed. CAUTION this case wipes the entire internal results memory and resets everything}

* E 0 0 0 0 *

E codes erase other codes must be 0. Reset (Warm Reboot) {Resets CPU and all current flags (e.g. back to Section 1 , Question 1 ) but preserves score memory}

* X 0 0 0 0 *

Mark (Chime out a mark already held in memory)\

{Q codes question and S codes the Section for which a mark is required "-" can be anything. If Q = 0 Section score is given, If S = 0 Question mark is given}

* M - Q - S *

Scores and progress are recorded in memory 33. Scores can be recalled at any time using a bar coded marking sheet, can be down-loaded to a small detachable solid state memory, audio cassette tape or telephone modem or the processor 30 can be connected directly to a PC.

Distance education is made more efficient and effective because the invention overcomes the postage costs of bulky materials and the heavy marking load.

The present invention is ideally suited to competency based training. Bench- mark competency standards can be established throughout a course of instruction. If desired, students can be assembled for supervised examinations and their processors linked into a network or down-loaded at its conclusion.

The present invention can be used as supervisor's marking tool. The reader 20/processor 30 stores supervisor's marks entered from a plastic laminated assessment sheet. The system may be arranged to require that the data is entered sequentially from the assessment sheet or can allow non-sequential entry and verify that the assessment is complete. The author of the assessment sheet can choose which ever format suits the application. Applications include:

Driver and operator assessment. Plant and laboratory supervision and inspections. Machinery and equipment certification and pre-use checks. Practical examinations. it will be apparent from the foregoing that the present invention provides a novel and greatly simplified solution to the problems of the existing art. It will be also appreciated that the foregoing represents just one embodiment of the inventive concept of the present invention. Those skilled in the art will appreciate that a number of variations are possible without departing from the true spirit of the invention, and the present disclosure is intended to include any and all such variations.

Claims

1. A system for recording answers to a set of visually presented questions, comprising; a question carrier, said carrier including at least a set of questions; a set of possible answers to each said question, each answer being associated with a machine readable data carrier, and optionally including further data carriers not associated with a particular answer; means for selectively reading said data carriers in response to a user's command; and local data processing means communicating with the means for selectively reading , the arrangement being such that the user causes the means for selectively reading to read said data carriers, the means for selectively reading communicates a signal corresponding to the data in said data carrier to said processing means, wherein at least some of the data in said data carriers contain instructions for the processing means.

2. A system for recording answers to a set of visually presented questions, comprising; a question carrier, said carrier including at least a set of questions; a set of possible answers to each said question, each answer being associated with a machine readable data carrier, and optionally including further data carriers not associated with a particular question; means for selectively reading said data carriers in response to a user's command; and local data processing means including data storage communicating with the means for selectively reading , the arrangement being such that the user causes the means for selectively reading to read one of said data carriers, the means for selectively reading communicates a signal corresponding to the data in said data carrier to said processing means, said processing means in response to said signal recording an indication of the answer selected, and in response to at least some of said signals performing a further processing operation or providing feedback to the user.

3. A system according to claim 1 or 2, wherein said data includes an indication as to the correctness of an answer selected, in response to which the processor provides feedback to the user as to the correctness of an answer selected.

4. A system according to claim 1 or 2, wherein said data includes an indication of the next question to be answered, and said processor provides an error signal to the user if any other question is answered.

5. A reader processor device for a question/answer system, comprising means for selectively reading a data carrier, processing means, and data storage means, the arrangement being such that answers and optionally further information are stored in response to data contained in the data carriers which are read, and that said processor is adapted to receive processing instructions from said data in said data carriers and provide feedback to a user.

6. A question and answer set for use in a learning system, comprising a question carrier, said carrier including at least a set of questions, and a set of possible answers to each said question, each answer being associated with a machine readable data carrier, and optionally including further data carriers not associated with a particular question; at least some of said data carriers including data processing instructions for a reader/ processor device, such that when the reader/ processor device reads the data carrier, it stores data and performs processing operations in response to instructions contained in the data carrier.