Búsqueda Imágenes Maps Play YouTube Noticias Gmail Drive Más »
Iniciar sesión
Usuarios de lectores de pantalla: deben hacer clic en este enlace para utilizar el modo de accesibilidad. Este modo tiene las mismas funciones esenciales pero funciona mejor con el lector.

Patentes

  1. Búsqueda avanzada de patentes
Número de publicaciónUS6086382 A
Tipo de publicaciónConcesión
Número de solicitudUS 09/253,851
Fecha de publicación11 Jul 2000
Fecha de presentación22 Feb 1999
Fecha de prioridad30 Sep 1994
TarifaPagadas
También publicado comoUS5618182, US5885087, US6514084
Número de publicación09253851, 253851, US 6086382 A, US 6086382A, US-A-6086382, US6086382 A, US6086382A
InventoresC. Douglass Thomas
Cesionario originalRobolaw Corporation
Exportar citaBiBTeX, EndNote, RefMan
Enlaces externos: USPTO, Cesión de USPTO, Espacenet
Method and apparatus for improving performance on multiple-choice exams
US 6086382 A
Resumen
A computerized learning approach that enables a user to improve their performance on multiple-choice exams is disclosed. Although the learning approach includes various aspects and implementations, in general, the invention forces test-takers to practice their examination skills and subject matter knowledge in a systematic way. The systematic way forces the users to follow a proven problem-solving approach designed to improve their performance. The invention provides important performance feedback to user's, for example, elapsed time per question and percentage of correctly answered questions. The invention can also pinpoint for the user the substantive areas of the exam which the user is either weak or strong. Further, the invention is able to assist the user in predicting his/her eventual score.
Imágenes(10)
Previous page
Next page
Reclamaciones(27)
What is claimed is:
1. A computer readable medium containing computer instructions for improving a user's performance on multiple choice examinations, said computer readable medium comprising:
computer program code, executable by a computer, for causing a question and a plurality of answer choices to be displayed;
computer program code, executable by a computer, for causing a per-question time duration to be displayed, the per-question time duration being associated with an amount of time a user spends answering the question after the question and the answer choices are displayed;
computer program code, executable by a computer, for receiving the user's selection of one of the answer choices;
computer program code, executable by a computer, for determining whether the answer choice selected by the user is the correct answer choice; and
computer program code, executable by a computer, for displaying, at a user's request, a portion of an outline that is linked to the particular topic of the question that has been presented to the user, the outline containing detailed information on a plurality of topics in at least one subject matter area.
2. A computer readable medium as recited in claim 1, wherein after displaying the portion of the outline that is linked to the particular topic of the question, said computer program code for displaying the portion of the outline allows the user to transition to other adjacent portions within the outline that pertain to other topics which are not linked to the question.
3. A computer readable medium as recited in claim 2, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for causing a visual indication of whether the selected answer choice is the correct answer choice to be displayed, the visual indication being displayed after the user has selected one of the answer choices and said computer program code for determining has determined whether the answer choice selected by the user is the correct answer choice.
4. A computer readable medium as recited in claim 2, wherein said computer program code for displaying the portion of the outline operates to display the portion of the outline with a visual appearance that strongly resembles that of a corresponding portion of a printed version of the outline available to the user.
5. A computer readable medium as recited in claim 1, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for causing a visual indication of whether the selected answer choice is the correct answer choice to be displayed, the visual indication being displayed immediately and automatically after the user has selected one of the answer choices and said computer program code for determining has determined whether the answer choice selected by the user is the correct answer choice.
6. A computer readable medium as recited in claim 1, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for causing an explanation of the correct answer choice for the question to be displayed.
7. A computer readable medium as recited in claim 1, wherein said computer program code for causing the per-question time duration begins timing of the per-question time once the question and the answer choices are displayed and stops the timing of the per-question time once the user has selected one of the answer choices.
8. A computer readable medium as recited in claim 1, wherein said computer program code for displaying the portion of the outline operates to display the portion of the outline with a visual appearance that strongly resembles that of a corresponding portion of a printed version of the outline available to the user.
9. A computer readable medium as recited in claim 1, wherein said computer program code for displaying the portion of the outline operates to display the portion of the outline in a separate window from a window in which the question and the answer choices are displayed.
10. A computer readable medium containing computer instructions that are useful for improving a user's performance on multiple choice examinations, said computer readable medium comprising:
computer program code, executable by a computer, for causing a question and a plurality of answer choices to be displayed;
computer program code, executable by a computer, for causing a per-question time duration to be displayed, the per-question time duration being associated with an amount of time a user spends answering the question after the question and the answer choices are displayed;
computer program code, executable by a computer, for receiving the user's selection of one of the answer choices;
computer program code, executable by a computer, for determining whether the answer choice selected by the user is the correct answer choice; and
computer program code, executable by a computer, for causing an explanation of the correct answer choice for the question to be displayed.
11. A computer readable medium as recited in claim 10, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for displaying, at a user's request, a portion of an outline that is linked to the particular topic of the question that has been presented to the user, the outline containing detailed information on a plurality of topics in at least one subject matter area.
12. A computer readable medium as recited in claim 11, wherein said computer program code for displaying on the portion of the outline operates to display the portion of the outline with a visual appearance that strongly resembles that of a corresponding portion of a printed version of the outline available to the user.
13. A computer readable medium as recited in claim 11, wherein after displaying the portion of the outline that is linked to the particular topic of the question, said computer program code for displaying the portion of the outline allows the user to transition to other adjacent portions within the outline that pertain to other topics which are not linked to the question.
14. A computer readable medium as recited in claim 13, wherein said computer program code for displaying on the portion of the outline operates to display the portion of the outline with a visual appearance that strongly resembles that of a corresponding portion of a printed version of the outline available to the user.
15. A computer readable medium as recited in claim 13, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for displaying a visual indication of whether the selected answer choice is the correct answer choice, the visual indication being displayed immediately and automatically after the user has selected one of the answer choices and said computer program code for determining has determined whether the answer choice selected by the user is the correct answer choice.
16. A computer readable medium as recited in claim 10, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for displaying a visual indication of whether the selected answer choice is the correct answer choice, the visual indication being displayed after the user has selected one of the answer choices and said computer program code for determining has determined whether the answer choice selected by the user is the correct answer choice.
17. A computer readable medium as recited in claim 10, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for displaying an audio indication of whether the selected answer choice is the correct answer choice, the audio indication being displayed after the user has selected one of the answer choices and said computer program code for determining has determined whether the answer choice selected by the user is the correct answer choice.
18. A computer readable medium as recited in claim 10,
wherein said computer program code for displaying the question and the answer choices operates to sequentially display a series of questions and their associated answer choices, the questions being associated with topics of a multiple choice examination, and each of the questions being assigned to one of the topics, and
wherein said computer readable media further comprises:
computer program code, executable by a computer, for displaying performance information for the user including a percentage correct for at least one of the topics associated with the questions.
19. A computer readable medium as recited in claim 18, wherein said computer readable media further comprises:
computer program code, executable by a computer, for displaying performance information for the user including an average time per question for individual topics associated with the questions.
20. A computer readable medium as recited in claim 10,
wherein said computer program code for displaying the question and the answer choices operates to sequentially display a series of questions and their associated answer choices, the questions being associated with subjects of a multiple choice examination, and each of the questions being assigned to one of the subjects, and
wherein said computer readable media further comprises:
computer program code, executable by a computer, for displaying performance information for the user including a percentage correct for at least one of the subjects associated with the questions.
21. A computer readable medium as recited in claim 10, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for displaying, at a user's request, a relevant portion of substantive information that is linked to the particular topic of the question that has been presented to the user, the substantive information containing detailed information on a plurality of topics.
22. A computer readable medium as recited in claim 10, wherein said computer program code for displaying the question and the answer choices operates to sequentially display a series of questions and their associated answer choices, and
wherein said computer program code for automatically advancing to the next question after the user selects one of the answer choices for the current question.
23. A computer readable medium as recited in claim 10, wherein said computer program code for causing the per-question time duration begins timing of the per-question time once the question and the answer choices are displayed and stops the timing of the per-question time once the user has selected on of the answer choices.
24. A computer readable medium containing computer instructions that are useful for improving a user's performance on multiple choice examinations, said computer readable medium comprising:
computer program code, executable by a computer, for displaying a question and a plurality of answer choices to a user;
computer program code, executable by a computer, for receiving the user's selection of one of the answer choices;
computer program code, executable by a computer, for determining whether the answer choice selected by the user is the correct answer choice;
computer program code, executable by a computer, for displaying a visual indication of whether the selected answer choice is the correct answer choice, the visual indication being displayed immediately and automatically after the user has selected one of the answer choices and said computer program code for determining has determined whether the answer choice selected by the user is the correct answer choice; and
computer program code for displaying an explanation of the correct answer choice for the question.
25. A computer readable medium as recited in claim 24, wherein said computer readable medium further comprises:
computer program code, executable by a computer, for displaying, at a user's request, a portion of an outline that is linked to the particular topic of the question that has been presented to the user, the outline containing detailed information on a plurality of topics in at least one subject matter area.
26. A computer readable medium as recited in claim 25, wherein after displaying the portion of the outline that is linked to the particular topic of the question, said computer program code for displaying the portion of the outline allows the user to transition to other adjacent portions within the outline that pertain to other topics which are not linked to the question.
27. A computer readable medium as recited in claim 26, wherein said computer program code for displaying on the display screen the appropriate portion of the outline with a visual appearance that strongly resembles that of a corresponding portion of a printed version of the substantive outline available to the user.
Descripción

This is a continuation application of prior U.S. application Ser. No. 08/810,547, filed on Mar. 3, 1997 and now U.S. Pat. No. 5,885,087 which is a continuation application of U.S. application Ser. No. 08/315,976, filed on Sep. 30, 1994 and now U.S. Pat. No. 5,618,182, the disclosures of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a computerized learning approach, and more particularly, to a method and apparatus for improving performance on multiple-choice exams.

2. Description of the Related Art

Multiple-choice examinations are very common today. These examinations typically test a set of predetermined subject areas and are usually time limited. One's performance on these exams is very important.

The Multistate Bar Examination (MBE) is a particular multiple-choice exam for which this invention was developed. The MBE is a rigorous multiple-choice examination which tests six substantive areas of law in a time limited manner. The MBE forms a significant portion of the bar examination for most of the states in the United States. The ability of the test-takers to achieve a passing score on this portion of the bar examination is critical. It is the difference between being able to practice law in a particular state, and not. Consequently, those who desire to pass the bar examination spend a great deal of time studying for the MBE.

Known study approaches make use of written materials and rely on a user's discipline and drive to keep them working. Several bar review courses provide potential examinees with workbooks which provide several hundred practice questions that the user can work through as he/she sees fit. At the back of these workbooks are contained answers and explanations for the questions.

A major problem with these known and traditional approaches is that they do not, and cannot, force the user to study in a consistent, systematic and effective way. As a result, users typically study in a haphazard way which varies with their mood, desire and drive. The danger with these conventional approaches is that user's tend not to develop a consistent problem-solving approach, but instead develop and utilize inefficient and undesirable study habits. Another serious problem is that users also tend not to fully understand a question, and why one answer choice is correct, while the other answer choices are incorrect.

Thus, there is a need for a system which offers greater efficiency and effectiveness by requiring the user to study in a consistent and systematic way.

SUMMARY OF THE INVENTION

Broadly speaking, the invention relates to a computerized learning approach that enables a user to improve performance on multiple-choice exams.

A first aspect of the invention concerns a computerized learning method which forces a user to continue attempting to answer a question until the user has selected the correct answer choice. This aspect can be implemented by a computerized learning method which displays a question and a plurality of answer choices on a display screen, awaits the user's selection of one of the answer choices, compares the selected answer choice with a predetermined correct answer choice for the question, and subsequently awaits selection of another one of the answer choices when the selected answer choice is not the correct answer choice. Alternatively, the method can force the user to indicate whether each of the answer choices are correct or incorrect.

Another aspect of the invention concerns a computerized learning method which displays an elapsed time for the user to select an answer choice for the question. This enables the user to monitor and evaluate his/her time performance on practice questions for the multiple choice exam. This aspect of the invention can be implemented by a computerized learning method which displays a question and a plurality of answer choices on a display screen, enables a timer to monitor a time duration for the user to answer the question, awaits selection of one of the answer choices by the user, displays a visual indication of the time duration, stops the time duration timer when one of the answer choices is selected, and determines whether the selected answer choice is the correct answer choice for the question. Further, a visual indication of a predetermined time may be displayed together with the visual indication of the time duration.

Yet another aspect of the invention provides the user with assistance so that the user can better understand the question to be answered or the knowledge needed to answer the question. This aspect can be implemented in one or a combination of the following ways. Typically, however, this aspect is invoked only when the answer choice selected by the user is not the correct answer choice. A first implementation provides the user with a hint towards the correct answer choice. A second implementation displays, for the user, substantive information relevant to answering the question. A third implementation displays an explanation of the correct answer choice once the user has selected the correct answer choice.

Still another aspect of the invention concerns a computerized learning method which provides detailed performance information to the user. For example, the invention can plot the time duration for each question or set of questions to produce a graph on a display screen. The graph may also include a visual indication of a predetermined time duration. Another example is that the invention can plot the percentage of correctness to produce a graph on the display screen. Here, the graph may also indicate a visual indication of a target percentage. The can also predict the user's future performance using the thus far obtained performance data on the user.

The invention can also be implemented as an apparatus to improve a user's performance on multiple-choice exams. The apparatus includes a computer having a display screen associated therewith, and a computer program executed by the computer. The computer program includes at least means for displaying a question and a plurality of answer choices on the display screen, means for awaiting selection of one of the answer choices by the user, means for determining whether the selected answer choice is the correct answer choice for the question, and means for awaiting selection of another one of the answer choices when the selected answer choice is not the correct answer choice.

Another apparatus implementing the invention concerns a computer diskette. The computer diskette includes practice questions for a multiple-choice exam, correct answers for the practice questions, and a stored computer program for improving performance on the multiple-choice exam. When the computer program is executed by a computer, the program operates to carry out any aspects of the methods discussed above. The computer diskette can also include hints for each of the practice questions, specific topic identifiers for each of the questions; and a substantive outline containing detailed information on at least one area of knowledge being tested by the multiple-choice exam.

The invention forces test-takers to practice their examination skills and subject matter knowledge in a systematic way. The systematic way forces the users to follow a proven problem-solving approach designed to improve their performance. Additionally, the invention provides important performance feedback to user's, for example, elapsed time per question and percentage of correctly answered questions. The invention can also pinpoint for the user the substantive areas of the exam which the user is either weak or strong. Further, the invention is able to assist the user in predicting his/her eventual score.

The various aspects of the invention discussed above may also be combined in various ways to produce additional implementations of the invention. In addition, other aspects and advantages of the invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principals of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like elements, and in which:

FIG. 1 is a block diagram of an embodiment of an apparatus according to the invention;

FIGS. 2A and 2B are block diagrams of a first embodiment of a learning method according to the invention;

FIG. 3 is a block diagram of a substantive information routine according to the invention;

FIG. 4 is a block diagram of a performance evaluation routine according to the invention;

FIGS. 5A, 5B and 5C are graphs illustrating a user's performance;

FIG. 6 is a block diagram of a second embodiment of a learning method according to the invention; and

FIGS. 7A and 7B are block diagrams of a third embodiment of a learning method according to the invention.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments of the invention are discussed below with reference to FIGS. 1-7. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.

FIG. 1 is a block diagram of an embodiment of an apparatus according to the invention. The apparatus 2 includes a computer 4, a display screen 6, an input device 8, and a memory 10. The memory 10 provides storage for an operating system 12, a learning program 14, practice questions 16, user's performance information 18, and miscellaneous information 20.

The computer 4 is preferably a microcomputer, such as a desktop or notebook computer. However, the computer 4 could also be a larger computer such as a workstation or mainframe computer. The computer 4 could also be remotely located from the user who would interact with the computer over a network.

The memory 10 is connected to the computer 4. The memory 10 can consist of one or more of various types of data storage devices, including semiconductor, diskette and tape. In any case, the memory 10 stores information in one or more of the various types of data storage devices. The computer 4 of the apparatus 2 implements the invention by executing the learning program 14. While executing the learning program 14, the computer 4 retrieves the practice questions 16 from the memory 10 and displays them to the user on the display screen 6. The user then uses the input device 8 to select an answer choice for the question being displayed. When the learning program 14 is executed by the computer 4, a learning method according to the invention is carried out. The details of various learning methods associated with the learning program 14 are described in detail below in FIGS. 2A, 2B, 3, 4, 6, 7A and 7B.

The learning method according to the invention will cause performance information 18 and miscellaneous information 20 to be produced. The performance information 18 may, for example, include a correct/incorrect indicator and an elapsed time for each question or set of questions. The performance information 18 may also include a subject and a topic for each question. The miscellaneous information 20 can include any additional data storage as needed by the computer 4, e.g., various flags and other values which indicate options selected by the user or indicate user's state of progress. The user's performance information 18 and miscellaneous information 20 are stored to, or retrieved, from the memory 10 as needed by the computer 4. The operating system 12 is used by the computer 4 to control basic computer operations. Examples of operating systems include Windows, DOS, OS/2 and UNIX.

FIGS. 2A and 2B are block diagrams of a first embodiment of a learning method according to the invention. The learning method 22 begins by displaying 24 a question and a plurality of answer choices to a user. For example, the question and its answer choices can be retrieved from the various practice questions 16 stored in the memory 10 and then displayed on the display screen 6. Preferably, the question and its answer choices are very similar to the questions and answers which actually appear on the MBE. It is also preferable that the questions and answers be displayed in a format and font which are very close to those used in the MBE. The closer the appearance and the format of the question and its answer to that of the MBE, the more comfortable the user will be on the actual MBE exam.

Once the question and its answer choices are displayed 24, a question timer is started 26. The question timer operates to keep track of the amount of time elapsed from the time the question was displayed until the user selects an answer choice. Due to the fact that the MBE is a severely time limited exam, keeping track of the users time performance for each question is very important. As the question timer monitors the elapsed time, a visual indication of the elapsed time is displayed 28. For example, a digital stopwatch, a bar graph, or some other graphical technique could be displayed 28 on the display screen 6 to provide a visual indication of the elapsed time to the user. By displaying 28 a visual indication of the elapsed time, the user becomes sensitized to the amount of time he/she spends to answer questions and how he/she is doing time-wise with respect to a predetermined duration of time. Alternatively, an audio signal could be used with reduced effectiveness. The visual indication of the elapsed time is far superior to an audio signal because the user is able to see the elapsed time as he/she attempts to determine the correct answer choice for the question.

Next, a decision 30 is made based on whether the user has selected an answer choice for the question. If the user has not yet selected an answer choice, the learning method 22 awaits the user's selection while periodically updating the visual indication of the elapsed time being displayed 28. Once the user has selected an answer choice for the question, the question timer is stopped 32. The question timer is stopped at this time so that only the time for the user to select his/her first answer choice is measured.

A decision 34 is then made based on a comparison of the selected answer choice and a predetermined answer choice for the question. If the selected answer choice is not the correct answer choice (that is, the selected answer choice does not equal the predetermined answer choice), then the learning method 22 forces the user to keep working on the question. Initially, the learning method 22 displays 36 a hint towards the correct answer choice. For example, a hint for the particular question could be retrieved from the memory 10 and displayed on the display screen 6 for the user. The hint might identify the issue or state the appropriate rule of law for the question. Next, the learning program 22 again awaits the user's selection 38 of another answer choice. Preferably, the learning method 22 prevents the user from selecting an answer choice he/she already incorrectly selected.

Once the user selects 38 another answer choice, a decision 40 is made based on a comparison of the selected answer choice and the predetermined answer choice for the question. If the selected answer choice is still not the correct answer choice, then the learning method 22 again forces the user to keep working on the question. However, for the next go around, the learning method 22 may provide additional assistance to the user by displaying 42 (or provide the option of displaying) substantive information relevant to the question. For example, the substantive information could be a portion of a substantive outline of a subject of the MBE. The portion would be the portion of the outline which discussed the rules of law the user needs to understand and correctly answer the question.

In any case, once the user selects the correct answer choice (after block 34 or 40), an explanation of the correct answer choice is displayed 44. By displaying such information to the user, the user is encouraged to verify that his/her reasoning for choosing the correct answer choice was correct, or if his/her reasoning was incorrect, to help the user understand the proper approach to the question.

Next, a decision 46 is made based on whether a question set is complete. Although not previously mentioned, the questions are preferably presented to the user in sets of questions. Preferably, a set could include about fifteen questions. The user is required to work through at least one entire question set in a single sitting. This forces the user to concentrate on the questions and the problem-solving approach for a reasonable period of time (typically 30-60 minutes), even if the user works through a single set. Using sets of questions also helps to balance users' performance parameters over the set. Users' performance parameters tend to be fairly consistent over a reasonable sized set, whereas question by question the parameters tend to have large variations. In this regard, if the question set is not yet complete, the learning method 22 will reset the question timer 48 and return to the beginning of the method 22 to display a next question of the question set. On the other hand, once the question set is complete, the learning method 22 is completed, at least for the given question set.

FIG. 3 is a block diagram of a substantive information routine according to the invention. The substantive routine 49 is performed by the computer 4 to display 42 substantive information relevant to the question as shown in FIG. 2B. The substantive routine 49 begins by identifying a subject and topic for the question. The topic is preferably a heading section within a substantive legal outline for a particular subject of the MBE. For example, the substantive information for a question concerning contract law might have topics such as assignment, statue of fraud, acceptance, etc.

After the subject and topic are identified 50 for the question, the computer 4 searches 52 the substantive information for the topic. For example, the contracts legal outline could be searched for the heading "assignment" using known word searching techniques. Alternatively, the searching 52 could be performed by a table look-up into a table containing information on the location of topics within the outline. A portion of the substantive information pertaining to the topic is then displayed 54. For example, the portion could be the information in the contracts legal outline in the section identified by the heading "assignment". Preferably, in a Windows environment, a separate viewing window would be opened to contain the portion of the outline, and the question and answer choices would be displayed concurrently with the outline viewing window. It is also preferable that the displayed substantive information (e.g., portion of legal outline) have the same format and font as the printed outline which the user has available for studying.

A decision 56 is then made based on whether the question has been answered correctly or the user has requested removal of the portion of the outline being displayed. Once the substantive routine 49 determines 56 that the question has been answered correctly or the user has requested removal of the window displaying the portion of the outline, the substantive routine 49 removes 58 the display 54 of the substantive information. Otherwise, the displayed 54 substantive information remains so that the user can read the pertinent portion of the outline and scroll to other sections if so desired

FIG. 4 is a block diagram of a performance evaluation routine according to the invention. As the user works through the learning method 22, performance information 18 is routinely saved by the computer 4 to the memory 10. At the end of a question set, the performance evaluation routine 60 would enable a user to display performance information to the user in a useful way to enable the user to understand his/her performance. Specifically, the performance evaluation routine 60 begins by displaying 62 the question number, elapsed time, a correct/incorrect indicator, and subject and topic categories for each question in the question set. For example, the displayed information might be displayed in a table such as Table 1 below.

              TABLE 1______________________________________Question No.     Subject   Topic      Result Time______________________________________1         Evidence  Hearsay    Correct                                 3:212         Contracts Assignment Incorrect                                 1:383         Contracts Acceptance Correct                                 2:20.         .         .          ..         .         .          ..         .         .          .15        CrimLaw   Battery    Correct                                 1:58______________________________________

Next, a percentage of questions in the question set which were answered correctly is computed and displayed 64. For example, if the user answers eight of the fifteen questions correctly, the percentage displayed would be 53.33%. This percentage is useful to the user because the user can directly compare his/her set percentage with the percentage the user eventually desires to achieve on the MBE, which is usually at least 65% and typically between 70 and 75%. An average elapsed time for the user to answer the questions in the question set is also be computed and displayed 64.

A decision 66 is then made based on whether the user desires to eliminate the correctly answered questions from the master questions set. Although this decision may be made mandatory to prevent the user from repeating questions and thereby polluting his/her performance data, the decision 66 is shown here as being the user's choice. If the user desires to eliminate the correctly answered questions from the set, then the questions answered correctly are disabled 68. This disabling 68 can be achieved by setting an enable/disable flag associated with each of the questions. Such flags are located in the memory 10, e.g., with the practice questions 16 or the miscellaneous storage 20. Nevertheless, the questions which have not been answered correctly can be repeated in a review mode, but are preferably not repeated in the practice or study mode, as such would corrupt the user's performance data.

Thereafter, a decision 70 is made based on whether the user desires to view his/her performance history. Here, the computer 4 makes use of the performance data 18 for each question or set of questions to produce elaborate performance feedback to the user. If the user desires to view his/her performance history, the user's performance history is displayed 72. Although the performance data could be displayed in tables, preferably, graphical presentations are made. For example, (i) graphs of users time verses question set or (ii) correctness verses question set can be displayed as shown in FIGS. 5A and 5B, respectfully. FIG. 5A is a graph 74 illustrating average elapsed time per question for a set. A target elapsed time value 76 is also depicted to provide the user with a reference for their desired performance. FIG. 5B is a graph 78 illustrating average correctness (as a percentage) for a set. A target correctness percentage 80 is also depicted to provide a reference for their desired performance. The graphs 74, 78 are produced by plotting the average elapsed time and a percentage of correctness for the question sets the user has completed. The plotted points can be connected together with line segments. Alternatively, bar graphs could be used.

In any case, these graphs 74, 78 allow the user to see just how his/her performance is improving. Namely, the user can see the target values for each performance measure (time, correctness) and how they are fairing and whether their performance is improving, worsening or stable. Although graphs 74, 78 primarily pertain to overall values, similar graphs can also be produced by subject or topic so as to inform the user if certain of the subject areas or topics of the exam are hurting his/her overall performance. In fact, the graphs of several subjects or topics can be simultaneously shown to the user. For example, the average time and average correctness for each of the subjects of the exam could be simultaneously placed on graphs 74, 78 using different colors or other visually distinguishing marks. Such graphs 74, 78 would also inform the user of the user's relative performance by subject or topic.

The invention can also be used to predict the user's performance. In particular, the invention can determine and display a user's rate of performance improvement, overall or set to set. This rate would provide the user with some indication as to how his/her performance will improve with future sets. Alternatively, the invention can use the acquired performance data 18 on the user to extrapolate out a general trend of his/her performance to determine if he/she is on track to meet the goals. In this regard, a line or curve of best fit for the user could be computed using known methods and displayed for the user. FIG. 5C is a graph 81 of a curve which uses the user's performance data for sets 1-5 to extrapolate out an estimated future performance of the user. Note that in computing the extrapolated curve it is preferable to use a maximum value for the performance measure. Using a maximum value prevents the extrapolated curve from being overly biased by inconsistent performance data, particularly when only a few set of questions have been answered. The maximum values are statistical approximations of users' maximum performance values, preferably about 75% for correctness and about 1.5 minutes for elapsed time. From the graph 81 in FIG. 5C, the user will understand that based on his/her performance so far that to meet the target correctness percentage 80 at least 11 sets will need to be completed.

FIG. 6 is a block diagram of a second embodiment of a learning method according to the invention. The learning method 82 in this embodiment forces the user to indicate whether each of the answer choices is correct or incorrect. By forcing the user to consider all the answer choices, the learning method makes the user practice the problem-solving approach employed by most exam takers, namely to make an educated guess at the correct answer after eliminating answer choices known to be incorrect.

In any case, the learning method 82 begins by displaying a question and a plurality of answer choices. Next, the user chooses 86 one of the answer choices. The learning method 82 then asks the user to indicate 88 whether the chosen answer choice is the correct answer choice. Note, here the user can select any of the answer choices, not just the correct answer choice, and thereafter, indicate whether it is correct or incorrect.

If the user indicates that the selected answer choice is a correct answer, a decision 90 is made based on whether the selected answer choice is the correct answer choice. On the other hand, if the user indicates that the selected answer choice is an incorrect answer, a decision 92 is made based on whether the selected answer choice is not the correct answer choice.

When either decision 90, 92 is answered in the affirmative, then a correct message is displayed 94 to the user. Alternatively, when either decision 90, 92 is answered in the negative, then an incorrect message is displayed 96 to the user. Following either block 94 or block 96, the learning method 82 displays 98 an explanation indicating why the selected answer choice is the correct/incorrect answer choice, thereby allowing the user to confirm the reasoning or analysis behind his/her answer choice.

Thereafter, a decision 100 is made based on whether all the answer choices have been selected by the user. If not, blocks 86-98 of the learning method 82 are repeated until all the answer choices have been selected, thereby forcing the user to indicate whether each of the multiple answer choices is either correct or incorrect. Once all the answer choices have been selected, a decision 102 is made based on whether the question set is complete. If the question set is not yet completed, then the learning method 82 returns to block 84 where the next question and answer choices are displayed for a user according to the learning method 82. On the other hand, if the question set is complete, then the learning method 82 is completed.

FIGS. 7A and 7B are block diagrams of a third embodiment of a learning method according to the invention. In this embodiment, the learning method 104 sequences through the answer choices prompting the user to indicate whether he/she believes the answer choice to be correct or incorrect. The user can also answer "unsure" if the user cannot make an educated guess at the present time.

The learning method 104 begins by displaying 106 a question and a plurality of answer choices to the user. Next, a selected answer (SA) is set 108 to "A", indicating a first answer choice. The learning method 104 then prompts the user to decide 110 whether SA is the correct answer choice. If the user answers in the affirmative, then block 112 is performed. Block 112 represents blocks 90 and 94-98 shown in FIG. 6. On the other hand, if the user answers negatively, then block 114 is performed. Block 114 represents blocks 92-98 shown in FIG. 6. A third option is also available to the user. If the user is unsure as to whether or not SA is the correct answer choice, the user can skip the answer choice.

Thereafter, the learning method 104 performs similar processing for the remaining answer choices. Namely, the selected answer (SA) is set 116, 120, 124 to the other answer choices and the user is prompted for a decision 118, 122, 126 just as was done for the first answer choice. Blocks 112, 114 are also used in the same manner for each of the answer choices.

Once all the answer choices have been processed (answered or skipped), then the same process repeats 128 for the answer choices which the user may have skipped. The process repeats 128 until the user indicates whether each answer choice is correct or incorrect. Hence, skipping answer choices simply delays the decision because the learning method will prompt the user for an answer. After all the answer choices have been indicated as being correct or incorrect, a decision 130 is made based on whether the question set is complete. If the question set is not yet complete, the learning method 104 returns to block 106 to process the next question in the same manner. When the question set is eventually completed, the learning method 104 is completed.

Although not shown, the second and third embodiments of the learning method (like the first embodiment) can also provide the user with a hint or the option of accessing substantive information to help the user answer the question. Performance information can be displayed at the users option.

The above-described embodiments of the learning method can also be combined. A first stage could be designed to focus on the fundamentals of the proven problem-solving approach. Namely, it may be preferable to start the user in either the second or third embodiments of the learning method because these embodiments stress the basic problem approach. Hence, the second and third embodiments force the user to learn and follow the desired problem-solving approach. The basic problem-solving approach is to read the question, then while reading the answer choices, discarding those answer choices deemed clearly wrong. Thereafter, the remaining answer choices are re-read, and the best answer choice is selected. The question or portions thereof can be re-read as needed.

A second stage could be designed as a practice mode. Here, since the user would have already become comfortable with the basic problem-solving approach, the first embodiment of the learning method would be used. The first embodiment is particularly useful because it operates similar to actual exam conditions and offers important performance feedback.

Moreover, within the second stage, various levels of study could be possible. In a first level, all the questions in a set can be for the same subject. This allows the user to concentrate on questions of the same subject. This is beneficial because it frees the user from having to decide which subject category the question pertains to and because the user can concentrate on learning the detailed rules pertaining to the subject. Thereafter, in a second level, the questions in a set can be from various subjects. Although the second level would be more difficult than the first level, it would more closely represent the actual exam.

A third level may also be provided. In the third level, the question in a set would again be from mixed subjects but would be more difficult questions than those in the second level. This level would serve as advanced level studying for the user.

A fourth level may be provided to permit a user to focus on a specific topic which he/she wishes to study in depth. For example, if the performance information indicates that the user is struggling with assignments (topic) in contracts (subject), then the fourth level can be used to practice on question pertaining to assignments. A fifth level may be provided to allow the user to repeat questions he/she previously answered incorrectly.

A third stage could be designed as an exam practice mode. In this stage the user would actually take practice exams under exam-like conditions. The computer system would provide the user with questions, record the user answers, and time the exam.

The many features and advantages of the invention are apparent from the written description, and thus, it is intended by the appended claims to cover all such features and advantages of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention.

Citas de patentes
Patente citada Fecha de presentación Fecha de publicación Solicitante Título
US3546791 *20 Jun 196815 Dic 1970Koos Eugenia MEducational television system
US4592546 *26 Abr 19843 Jun 1986David B. LocktonGame of skill playable by remote participants in conjunction with a live event
US4593904 *19 Mar 198410 Jun 1986Syntech International, Inc.Player interactive video gaming device
US4798543 *31 Mar 198317 Ene 1989Bell & Howell CompanyInteractive training method and system
US4829431 *27 Dic 19839 May 1989Texas Instruments IncorporatedMethod and apparatus for correlating test information
US4867685 *24 Sep 198719 Sep 1989The Trustees Of The College Of AeronauticsAudio visual instructional system
US5002491 *28 Abr 198926 Mar 1991ComtekElectronic classroom system enabling interactive self-paced learning
US5018082 *7 May 199021 May 1991Fujitsu LimitedGuidance message display timing control using time intervals
US5033969 *13 Mar 199023 Jul 1991Pioneer Electronic CorporationSupport device for resolving questions about reproduced information
US5035625 *24 Jul 198930 Jul 1991Munson Electronics, Inc.Computer game teaching method and system
US5178545 *8 Feb 199112 Ene 1993Tutor Toys, Inc.Electronic puzzle game with unknown random time of play
US5204813 *8 Jun 199020 Abr 1993Assessment Systems, Inc.Computer-controlled testing process and device for administering an examination
US5211563 *25 Jun 199218 May 1993Hitachi, Ltd.Computer assisted learning support system and processing method therefor
US5218537 *18 Mar 19928 Jun 1993Texas Instruments IncorporatedSystem and method for using a computer to generate and teach grammar lessons
US5228859 *10 Dic 199120 Jul 1993Interactive Training TechnologiesInteractive educational and training system with concurrent digitized sound and video output
US5257185 *21 May 199026 Oct 1993Ann W. FarleyInteractive, cross-referenced knowledge system
US5267865 *11 Feb 19927 Dic 1993John R. LeeInteractive computer aided natural learning method and apparatus
US5302132 *1 Abr 199212 Abr 1994Corder Paul RInstructional system and method for improving communication skills
US5306154 *5 Mar 199226 Abr 1994Hitachi, Ltd.Intelligent education and simulation system and method
US5310349 *30 Abr 199210 May 1994Jostens Learning CorporationInstructional management system
US5316485 *27 Ene 199331 May 1994Matsushita Electric Industrial Co., Ltd.Learning machine
US5379213 *28 Ene 19923 Ene 1995Fleetwood Furniture Company, Inc.Test scoring system and method
US5411271 *3 Ene 19942 May 1995Coastal Amusement Distributors, Inc.Electronic video match game
US5421730 *27 Nov 19916 Jun 1995National Education Training Group, Inc.Interactive learning system providing user feedback
US5456607 *14 Feb 199410 Oct 1995Antoniak; Peter R.Knowledge testing computer game method employing the repositioning of screen objects to represent data relationships
US5586889 *22 Sep 199424 Dic 1996Goodman; MiltonHand held teach and test device
US5618182 *30 Sep 19948 Abr 1997Thomas; C. DouglassMethod and apparatus for improving performance on multiple-choice exams
US5885087 *3 Mar 199723 Mar 1999Robolaw CorporationMethod and apparatus for improving performance on multiple-choice exams
Otras citas
Referencia
1 *Computer based Testing (CBT) Program Supplement to the 1992 93 GRE Information Bulletin, Educational Testing Service, 1992, pp. 1 and 7 9.
2 *Computer based Testing (CBT) Program Supplement to the 1993 94 GRE Information and Registration Bulletin, Educational Testing Service, 1993, pp. 1, 9 and 11.
3Computer-based Testing (CBT) Program Supplement to the 1992-93 GRE Information Bulletin, Educational Testing Service, 1992, pp. 1 and 7-9.
4Computer-based Testing (CBT) Program Supplement to the 1993-94 GRE Information and Registration Bulletin, Educational Testing Service, 1993, pp. 1, 9 and 11.
5 *SmartStudy software program, BAR/BRI Multistate Testing: Bar Review, by Engineering Associates and Harcourt Brace Legal & Professional Publications, Inc., 1993, 16 pages.
6 *The Law in a Flash Series (Product Catelog), Professional Flash Cards, Ltd., 1993 (TestMaster Computer Software).
7 *The SMH Personal Tutor, SMH Bar Review, printed in National Jurist, Feb./Mar. 1994. (Product Brochure).
Citada por
Patente citante Fecha de presentación Fecha de publicación Solicitante Título
US6554617 *5 Abr 200029 Abr 2003Dolan F. J. "Steve"Vocabulary teaching aid system and method
US665228330 Dic 199925 Nov 2003Cerego, LlcSystem apparatus and method for maximizing effectiveness and efficiency of learning retaining and retrieving knowledge and skills
US674302429 Ene 20011 Jun 2004John Mandel IvlerQuestion-response processing based on misapplication of primitives
US6808393 *21 Nov 200126 Oct 2004Protigen, Inc.Interactive assessment tool
US6904263 *1 Ago 20017 Jun 2005Paul GrudnitskiMethod and system for interactive case and video-based teacher training
US692652829 Abr 20039 Ago 2005F. J. Steve DolanVocabulary teaching aid system and method
US69866641 Dic 200317 Ene 2006Robolaw CorporationMethod and apparatus for improving performance on multiple-choice exams
US705227714 Dic 200130 May 2006Kellman A.C.T. Services, Inc.System and method for adaptive learning
US707412812 May 200311 Jul 2006Drb Lit Ltd.Method and system for enhancing memorization by using a mnemonic display
US70800572 Ago 200118 Jul 2006Unicru, Inc.Electronic employee selection systems and methods
US72867937 May 200223 Oct 2007Miele Frank RMethod and apparatus for evaluating educational performance
US731062624 Ene 200518 Dic 2007Kronos Talent Management Inc.Electronic employee selection systems and methods
US735764031 Mar 200415 Abr 2008Drb Lit Ltd.Lock-In Training system
US736443231 Mar 200429 Abr 2008Drb Lit Ltd.Methods of selecting Lock-In Training courses and sessions
US73901919 Feb 200524 Jun 2008Drb Lit Ltd.Computer system configured to sequence multi-day training utilizing a database
US7513775 *3 Oct 20067 Abr 2009Exam Innovations, Inc.Presenting answer options to multiple-choice questions during administration of a computerized test
US75587672 Ago 20017 Jul 2009Kronos Talent Management Inc.Development of electronic employee selection systems and methods
US756205911 Ago 200414 Jul 2009Kronos Talent Management Inc.Development of electronic employee selection systems and methods
US760677812 Jun 200120 Oct 2009Previsor, Inc.Electronic predication system for assessing a suitability of job applicants for an employer
US7618259 *13 May 200417 Nov 2009Hewlett-Packard Development Company, L.P.Worksheet wizard—system and method for creating educational worksheets
US781372612 Feb 200812 Oct 2010Responsive Innovations, LLPWireless communication system
US792249428 Ago 200112 Abr 2011International Business Machines CorporationMethod for improved administering of tests using customized user alerts
US804134720 Ene 200618 Oct 2011Responsive Innovations, LlcTransmitter controlled communication links
US80462518 Oct 200425 Oct 2011Kronos Talent Management Inc.Electronic employee selection systems and methods
US808655811 Ago 200927 Dic 2011Previsor, Inc.Computer-implemented system for human resources management
US815038017 Sep 20103 Abr 2012Responsive Innovations, LlcWireless communication system
US816561412 Ago 200924 Abr 2012Turning Technologies, LlcTransmitter controlled communication links
US823138929 Abr 200531 Jul 2012Wireless Generation, Inc.Real-time observation assessment with phoneme segment capturing and scoring
US826597717 Feb 201111 Sep 2012Kronos Talent Management Inc.Electronic employee selection systems and methods
US854309913 Mar 201224 Sep 2013Turning Technologies, LlcWireless communication system
US860788814 Feb 200817 Dic 2013Michael Jay NusbaumSelf-contained automatic fire extinguisher
US866740022 Jun 20094 Mar 2014Amplify Education, Inc.System and method for real-time observation assessment
US869394223 Ago 20048 Abr 2014Frank R. MieleMethod and apparatus for evaluating educational performance
US8834166 *24 Sep 201016 Sep 2014Amazon Technologies, Inc.User device providing electronic publications with dynamic exercises
US899700416 Ene 201431 Mar 2015Amplify Education, Inc.System and method for real-time observation assessment
US906933225 May 201130 Jun 2015Amazon Technologies, Inc.User device providing electronic publications with reading timer
US929926530 Nov 200529 Mar 2016Kellman Act Services, Inc.System and method for adaptive perceptual learning
US20020042786 *2 Ago 200111 Abr 2002Unicru, Inc.Development of electronic employee selection systems and methods
US20020046199 *2 Ago 200118 Abr 2002Unicru, Inc.Electronic employee selection systems and methods
US20020055866 *12 Jun 20019 May 2002Dewar Katrina L.Computer-implemented system for human resources management
US20030027121 *1 Ago 20016 Feb 2003Paul GrudnitskiMethod and system for interactive case and video-based teacher training
US20030049592 *24 Mar 200113 Mar 2003Nam-Kyo ParkDatabase of learning materials and method for providing learning materials to a learner using computer system
US20030191680 *10 Abr 20039 Oct 2003Dewar Katrina L.Computer-implemented system for human resources management
US20030195786 *10 Abr 200316 Oct 2003Dewar Katrina L.Computer-implemented system for human resources management
US20030200136 *10 Abr 200323 Oct 2003Dewar Katrina L.Computer-implemented system for human resources management
US20030215774 *29 Abr 200320 Nov 2003Steve Dolan F. J.Vocabulary teaching aid system and method
US20040081952 *15 Oct 200329 Abr 2004Burns Barclay FredOnline learning system
US20040162798 *27 Ago 200319 Ago 2004Masayuki MamotoKnowledge information providing apparatus
US20050003337 *31 Mar 20046 Ene 2005Berman Dennis R.Lock-In Training system
US20050191603 *27 Abr 20051 Sep 2005Scientific Learning CorporationMethod and apparatus for automated training of language learning skills
US20050191609 *11 Feb 20051 Sep 2005Adaptigroup LlcMethod and system for improving performance on standardized examinations
US20050196730 *14 Dic 20018 Sep 2005Kellman Philip J.System and method for adaptive learning
US20050196732 *27 Abr 20058 Sep 2005Scientific Learning CorporationMethod and apparatus for automated training of language learning skills
US20050221267 *31 Mar 20046 Oct 2005Berman Dennis RMethods of selecting Lock-In Training courses and sessions
US20050233292 *9 Feb 200520 Oct 2005Berman Dennis RComputer system configured to sequence multi-day training utilizing a database
US20050233293 *9 Feb 200520 Oct 2005Berman Dennis RComputer system configured to store questions, answers, and keywords in a database that is utilized to provide training to users
US20050246299 *8 Oct 20043 Nov 2005Unicru, Inc.Electronic employee selection systems and methods
US20050255438 *13 May 200417 Nov 2005John ManosWorksheet wizard
US20050273350 *24 Ene 20058 Dic 2005Unicru, Inc.Electronic employee selection systems and methods
US20050282135 *4 Ago 200522 Dic 2005Berman Dennis RLock-in training method utilizing the entry of a portion of a keyword
US20060078856 *30 Nov 200513 Abr 2006Kellman A.C.T. Services, Inc.System and method for adaptive learning
US20060166685 *20 Ene 200627 Jul 2006Adkins Kevin GTransmitter controlled communication links
US20060168134 *31 Ene 200627 Jul 2006Wireless Generation, Inc.Method and System for Real-Time Observation Assessment
US20070009873 *28 Jul 200611 Ene 2007Berman Dennis RLock-in training system
US20070009875 *31 Jul 200611 Ene 2007Berman Dennis RLock-in training system
US20070009876 *31 Jul 200611 Ene 2007Drb Lit Ltd.Lock-in training system
US20070009877 *31 Jul 200611 Ene 2007Berman Dennis RLock-in training system
US20070009878 *31 Jul 200611 Ene 2007Berman Dennis RLock-in training system
US20070048723 *16 Ago 20061 Mar 2007Caveon, LlcSecurely administering computerized tests over a network
US20070065797 *20 Sep 200522 Mar 2007Ross ElgartSystem and method of preparing for essay examinations
US20070166686 *3 Oct 200619 Jul 2007Caveon, LlcPresenting answer options to multiple-choice questions during administration of a computerized test
US20070269788 *4 May 200722 Nov 2007James FlowersE learning platform for preparation for standardized achievement tests
US20080076107 *26 Oct 200727 Mar 2008Berman Dennis RLock in training system with retention round display
US20080108298 *7 Nov 20068 May 2008Selen Mats ACertified two way source initiated transfer
US20080276264 *7 Jul 20086 Nov 2008Selen Mats ACertified two way source initiated transfer
US20090011395 *3 Jul 20078 Ene 2009Michael Aaron SchmidtSystem and methods for matching requirements and standards in employment and education-related environments
US20090017434 *14 Jul 200815 Ene 2009Dror AvigdorMethod And System Of Computerized Examination Strategy Analyzer
US20090023125 *18 Sep 200822 Ene 2009Berman Dennis RLock-in training system progress display
US20090075246 *16 Sep 200819 Mar 2009The Learning Chameleon, Inc.System and method for quantifying student's scientific problem solving efficiency and effectiveness
US20090263778 *22 Jun 200922 Oct 2009Wireless Generation, Inc.System and Method For Real-Time Observation Assessment
US20100042574 *11 Ago 200918 Feb 2010Dewar Katrina LComputer-implemented system for human resources management
US20100057708 *3 Sep 20084 Mar 2010William Henry BillingsleyMethod and System for Computer-Based Assessment Including a Search and Select Process
US20100287110 *22 Jul 201011 Nov 2010Kronos Talent Management Inc.Electronic employee selection systems and methods
US20100287111 *22 Jul 201011 Nov 2010Kronos Talent Management Inc.Electronic employee selection systems and methods
US20110145161 *17 Feb 201116 Jun 2011Kronos Talent Management Inc.Electronic employee selection systems and methods
US20140324832 *3 Jul 201430 Oct 2014Amazon Technologies, Inc.Reading material suggestions based on reading behavior
USRE39435 *2 Sep 200319 Dic 2006Drb Lit Ltd.Learning system with learner-constructed response based methodology
WO2004036375A2 *15 Oct 200329 Abr 2004The Learning Internet, Inc.Online learning system
WO2004036375A3 *15 Oct 200324 Feb 2005Learning Internet IncOnline learning system
WO2007044431A2 *5 Oct 200619 Abr 2007Caveon, LlcPresenting answer options to multiple-choice questions during administration of a computerized test
WO2007044431A3 *5 Oct 200623 Abr 2009Caveon LlcPresenting answer options to multiple-choice questions during administration of a computerized test
Clasificaciones
Clasificación de EE.UU.434/323, 434/322, 434/362, 706/927, 702/182, 434/118
Clasificación internacionalG09B7/06, G09B7/04
Clasificación cooperativaY10S706/927, G09B7/04, G09B7/06
Clasificación europeaG09B7/04, G09B7/06
Eventos legales
FechaCódigoEventoDescripción
24 Abr 2001CCCertificate of correction
28 Ene 2004REMIMaintenance fee reminder mailed
23 Abr 2004SULPSurcharge for late payment
23 Abr 2004FPAYFee payment
Year of fee payment: 4
21 Ene 2008REMIMaintenance fee reminder mailed
9 Jul 2008SULPSurcharge for late payment
Year of fee payment: 7
9 Jul 2008FPAYFee payment
Year of fee payment: 8
20 Feb 2012REMIMaintenance fee reminder mailed
11 Jul 2012REINReinstatement after maintenance fee payment confirmed
11 Jul 2012LAPSLapse for failure to pay maintenance fees
28 Ago 2012FPExpired due to failure to pay maintenance fee
Effective date: 20120711
17 Dic 2012PRDPPatent reinstated due to the acceptance of a late maintenance fee
Effective date: 20121220
20 Dic 2012SULPSurcharge for late payment
20 Dic 2012FPAYFee payment
Year of fee payment: 12