WO1998005018A1 - Electronic mentor training system and method - Google Patents

Electronic mentor training system and method Download PDF

Info

Publication number
WO1998005018A1
WO1998005018A1 PCT/US1997/013355 US9713355W WO9805018A1 WO 1998005018 A1 WO1998005018 A1 WO 1998005018A1 US 9713355 W US9713355 W US 9713355W WO 9805018 A1 WO9805018 A1 WO 9805018A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
training
computer
computer software
software application
Prior art date
Application number
PCT/US1997/013355
Other languages
French (fr)
Inventor
William A. Hitchcock
Robert C. Allen
Original Assignee
Electronic Data Systems Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronic Data Systems Corporation filed Critical Electronic Data Systems Corporation
Priority to AU40479/97A priority Critical patent/AU4047997A/en
Publication of WO1998005018A1 publication Critical patent/WO1998005018A1/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/0053Computers, e.g. programming
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/453Help systems

Definitions

  • the present invention relates generally to electronic systems and methods, more particularly, to a system and method for an electronic mentor to provide training to users on a variety of computer software applications.
  • Another conventional method used to solve the lack of computer application training has been to send all users to computer training classes . These training classes are designed to give users the ability to use the computer software application.
  • This conventional solution has several limitations. Due to the disparity m proficiency levels of the various users, computer software application training classes do not provide "just enough" training for every user. Computer software application training classes and/or computerized training courses cannot be tailored to every individual user's proficiency level. Each user receives the entire training course. As a result, many users receive training they do not need. This time spent on wasted training also results in lost productivity because a training class takes the users away from their work station.
  • the present invention provides a computer software application training system and method that substantially eliminates or reduces disadvantages and problems associated with previously developed computer software application training systems and methods.
  • the present invention provides a system and method for training a user on a variety of computer software applications.
  • the computer is directed by a computer program to perform a diagnosis of the skill level of a user on a computer software application, to prescribe a training plan that will allow the user to achieve a minimum skill level on the computer software application, and to provide the user access to a plurality of training software programs to enable a user to complete the training plan.
  • the present invention can store input made by the user in a data base and can analyze that data to provide reports on the amount and effectiveness of the training.
  • the system can also receive updates to the computer program, such as when a new version of a computer software application is released.
  • the present invention provides an important technical advantage by reducing or eliminating wasted training.
  • the present invention accomplishes this by diagnosing the proficiency level of each user in one or more computer software applications and providing a training plan specifically tailored to each user's proficiency level to raise each user's proficiency level to a predetermined level in each application.
  • the present invention provides another technical advantage by providing the training directly to the user at the computer at the user's work station.
  • the present invention can increase productivity m the workplace by allowing the user to access training, dynamic help and job aids directly from the user's workstation.
  • the present invention provides yet another technical advantage by reducing the number of technical support personnel needed to support the users on various computer software applications.
  • the present invention provides training tailored to the user's proficiency level, provides a dynamic help for the user to access, and provides a bulletin board of frequently asked questions that can give users quick answers without having to contact a technical support person.
  • the present invention provides another technical advantage by providing a training prescription tailored for a specific job type that provides a training strategy for particular users based on the job the user performs.
  • the present invention provides another technical advantage by allowing continuous and ongoing re reshment/update of the present invention.
  • the present invention can continuously accept updates to the diagnostics, prescriptions, and training treatments. This can occur when, for example, a new version of a computer software application is released.
  • the present invention provides another technical advantage by allowing an organization to measure the amount and effectiveness of training.
  • the present invention can monitor, for example, the number of users that have taken the diagnostics, the average scores from the diagnostics (for the organization or any subset thereof) , the number of users who have accessed the computer-based training, how many times a particular user has accessed the training. This measurement can provide a baseline against which an organization can later compare to determine improvements in user proficiency on various computer software applications.
  • FIGURE 1 shows a diagram of a process flow incorporating the teachings of the present invention*
  • FIGURE 2 shows a flow diagram illustrating the functional relationships among specified elements of an embodiment of the present invention,*
  • FIGURE 3 shows an embodiment of the user interface main menu screen of the present invention that allows users to access the present invention
  • FIGURE 4 shows an embodiment of a user interface sub-menu that can be accessed from the user interface main menu of FIGURE 3.
  • FIGURES Preferred embodiments of the present invention are illustrated in the FIGURES, like numerals being used to refer to like and corresponding parts of the various drawings .
  • the present invention provides an integrated learning support system to train users on a variety of computer software applications.
  • the present invention can be directly accessed by users from their desk top computers.
  • the present invention provides a system that diagnoses a user's personal learning needs, provides individual learning prescriptions that guide training through a choice of curricula, provides desk top delivery of the curricula, and measures before and after results of the training.
  • the present invention includes a software distribution engine that drives a series of software programs to enable the integrated learning support system.
  • the present invention can be continuously updated and refreshed to match updates to the computer software applications.
  • the present invention provides a cost effective way to distribute computer-based training materials over local area networks while minimizing disruption in normal production work.
  • Computer software application means any computer-based operations involved in performing the user's ob.
  • Computer applications include, for example, standard computer applications (such as Lotus Notes, Windows, Microsoft Word, Excel, etc%), specialized computer applications (for example, computer applications written by the company for its employees to use) , and Internet applications.
  • Computer applications further include network infrastructure configurations to encompass, for example, the use of the printers, the use of routing in the network, and other operations performed over the network. It should be understood that the present invention can be used for a variety of computer software applications and network configurations. The present invention involves using different diagnostics, prescriptions, treatments, measurement, and feedback for each application.
  • FIGURE 1 illustrates a process flow 10 incorporating the teachings of the present invention that includes one embodiment of the distribution engine 15 of the learning support system ("electronic mentor") comprising diagnostic 12, prescription 14, learning treatments 16, measurement 18, and feedback 20.
  • the distribution engine 15 can also include a portion of the dynamic system updates 22.
  • the electronic mentor also incorporates long-term system updates 24 designed to keep the electronic mentor current.
  • FIGURE 1 shows the long-term updates 24 existing separately from the distribution engine 15, but it should be understood that all or a portion of the long-term updates 24 could reside within the distribution engine 15.
  • the distribution engine 15 represents a computer program that interfaces between the computer programs within the diagnosis, prescription, learning treatments, measurement, and feedback portions of the electronic mentor.
  • the distribution engine 15 also provides the interface between these computer programs and the user.
  • the interface between the user and the electronic mentor can also include a graphical interface (shown in FIGURE 5) that provides a user access to the commands to operate the distribution engine 15 and, thereby, to operate the electronic mentor.
  • the diagnostic 12 comprise at least one computer program containing a series of test questions. A series of test questions can be written for each computer application that an organization uses. These test questions are written to diagnose a user's skill level (proficiency) in the particular computer software application.
  • test questions can be updated ("refreshed") as each new version of a computer software application is released through either dynamic 22 or long term 24 system updates.
  • a user can access the diagnostic 12 through a graphical interface driven by the distribution engine 15. The questions provides the basis for the diagnosis.
  • the diagnostic 12 evaluates the answers a user provides and diagnoses the skill level of the user with respect to that computer software application.
  • the diagnostic 12 of the electronic mentor creates a profile on the user based on the answers the user provided during the diagnostic evaluation.
  • the prescription 14 includes at least one computer software program that evaluates the answers a user provided during the diagnostic 12 and provides a prescription that defines the type of training a user needs to meet an organization's minimum skill level for the particular computer software application. A user can then follow the prescription provided to meet that predetermined proficiency level.
  • the diagnosis and prescription process can be repeated for any number of computer software applications and for any number of users.
  • the learning treatment 16 can comprise at least one computer program and can begin with the user taking computer-based training (CBTs) by following instruction provided in the prescription 14.
  • CBTs computer-based training
  • the present invention provides a user access to a variety of treatments, including dynamic help, job aids, modular computer-based training (CBT) , and classroom computer training.
  • the dynamic help, job aids, and computer-based training represent example of computer software programs (learning treatment 18) that preferably reside within the distribution engine 15 of the present invention
  • the computer-based training contained within and accessed through the distribution engine 15 can include dynamic help, job aids, and computer-based training (CBT) modules. These three classifications represent different levels of training.
  • the dynamic help provides the least amount of training and is designed for a fairly proficient user.
  • the dynamic help software program can collect (upload) questions from individual users to allow posting of answers within the dynamic help user interface.
  • the dynamic help can also include a bulletin board to post announcements or other information on particular computer software applications
  • Job aids can describe procedures for computer software application use for a user who has some familiarity with that computer software application.
  • the job aid software programs can describe use procedures related to a computer software application in more detail than the dynamic help.
  • CBT modules are designed for those users who foundation knowledge or more in-depth training on am computer software application.
  • a user can access any of the computer-aided training ( ob aid, dynamic help, CBTs, etc . . .) directly from the user's the computer terminal at the user's work station.
  • a user can access most or all of the training recommended in the prescription directly from his or her computer terminal. This allows users to complete training at times that are convenient to the user.
  • the programs contained within learning treatment 18 can be constructed in modules so that the total computer-based training can be broken up into more convenient segments that fit more readily into a user's schedule.
  • the electronic mentor can also ask the user questions in the diagnostic 12 that define the types of training the user prefers (i.e., computer based training versus classroom training).
  • the software could prescribe classroom training, rather than computer based training, for a user with that preference.
  • the electronic mentor can also allow the user to schedule classroom training (as opposed to computer-based training) directly from a catalog contained within the distribution engine ' 15 of the electronic mentor of the present invention.
  • the level of treatment 18 prescribed by the prescription 14 depends on the results of the diagnostic 12. For example, two users might both be diagnosed as needing training on Microsoft Word as a treatment. However, user 1 may be more proficient than user 2 based on the diagnostic 12.
  • the prescription 14 of the electronic mentor may only prescribe one CBT module of training in Microsoft Word for user 1, while prescribing four CBT modules in Microsoft Word for user 2.
  • a user may need different levels of training on different computer software applications. For example, the present invention may prescribe a user four CBT modules of training on using the Access database as a treatment, but may only prescribe referring to the dynamic help for training in Microsoft Word, and may not prescribe any training in Excel .
  • the treatment recommendations in the prescription 14 a user can reach the determined minimum skill level for each of the computer software programs.
  • Measurement 18 of the present invention preferably includes a measurement software program that stores information input by the user during the previous steps of diagnosis, prescription, and treatment in a database. Each time the user makes an input during one of these portions, the measurement software program will store the data from that input for later use during the feedback 20 feature of the present invention. This storage of data allows the present invention to create a profile on the user based on the user's inputs. The profile of a user will be constantly updated each time the user accesses the electronic mentor.
  • the feedback 20 of the distribution engine 15 comprises at least one computer software program that can access the stored user input data to provide reports on the total amount of training accessed and the effectiveness of the training provided to the users. For example, by accessing the stored data, the feedback 20 can provide reports detailing how many job aids have been downloaded, how many times dynamic help has been accessed, how many CBT modules have been accessed, and how many CBT modules have been completed by each user accessing the electronic mentor system.
  • the feedback 20 can also provide a report on the skill level of users before and after training by comparing results of the diagnostic 12 before and after training. This information can give the company an indication of the effectiveness of the training provided to the users. In this way, the organization receives an objective analysis of the proficiency level of their employees on various computer software applications.
  • the feedback 20 can sort users to provide a report on proficiency level by server, by work group, by organization, or by other characteristic.
  • the organization can use this information to measure the level of training the users are getting and if the training process is working. In another example, if the measurement 18 indicates that the organization as a whole has a low proficiency rating in use of network resources, this information can be sent to the organization. The organization can then decide to create a special class that can be accessed through the mentor. Alternatively, the organization can send out a bulletin over the electronic mentor noting the deficiency and encouraging (or requiring) users to begin the treatment prescribed by the electronic mentor by a specified date.
  • the present invention can receive real-time system updates that continuously refresh the information contained within the software programs in the distribution engine 15. For example, as the users access the dynamic help function of the present invention, this function can be continuously updated based on the questions posed by the users. Users' questions can be analyzed, and answers can be posted within the dynamic help user interface.
  • the distribution engine 15, as shown in FIGURE 1, can provide an automated dynamic system update program 22 that can perform a portion of the dynamic update.
  • the remainder of dynamic updates can either be performed through manual inputs into the various portions of the distribution engine 15. Alternatively, all of the dynamic updates can be performed manually or through a computer program contained within the distribution engine 15.
  • the present invention also allows dynamic update of the diagnosis, prescription, and treatment programs contained within the distribution engine 15 when a new version of a computer software application is released. For example, if the present invention provides training on Microsoft Word (assume version 2.0), a new version of Microsoft Word (assume version 2.1) could be released after implementing the present invention. Prior to the new version release, the diagnostic 12 includes a program containing a test question set for Microsoft Word version
  • the prescription 14 will depend on the old diagnostic 12 and the treatment 16 will provide training treatment designed to teach a user to better use the old version 2.0.
  • the new version Upon release of the new version
  • the programs within the diagnostic 12, the prescription 14, and the treatment 16 can be updated to correspond with the latest software version (version 2.1).
  • the diagnostic test questions contained within a diagnosis program can be modified (if necessary) to test for proficiency on the new software version.
  • Each of the tools used within the electronic mentor system (such as the test questions, the help features, the training and job aids, etc..) can be continuously updated and supplied to the organization (and users) on an ongoing basis.
  • the distribution engine 15 can reside in a server separately from the business organization's graphical user interface. The distribution engine 15 can be updated and the users can access the updated programs immediately through the graphical user interface . In this way, the electronic mentor training system of the present invention can provide training on the latest releases of computer software applications without having to load a new version of the electronic mentor.
  • the electronic mentor could be configured in a versioned format and when updates to the computer applications occur, a new version of the electronic mentor could be sent to the business organization.
  • the dynamic system update 22 allows the CBT's, the dynamic help, the bulletin board containing the frequently asked questions, the test question sets, and the other software program supported portions of the distribution engine 15 of the electronic mentor to be changed on an ongoing and continuous basis to keep abreast of changes to the computer software applications. This reduces the problem of sending users to computer training and having that training become obsolete within a couple of years.
  • the distribution engine 15 programs can reflect the latest version of the computer applications due to the dynamic update 22 function.
  • the continuous update allows a user to build on previous knowledge and receive training compatible with the lack of proficiency caused by the update to the computer software application.
  • the electronic mentor of the present invention can also include a feature that tells a user that the mentor has been updated and what area(s) within the mentor have been updated.
  • the software program within the distribution engine 15 that performs the dynamic system update 22 can conduct a comparison of the previous version of the computer software application with the new version to indicate what features have changed and what features have been added or deleted. In an alternative embodiment, this comparison can be performed manually and loaded into a program residing within the distribution engine 15 that a user can access.
  • Providing long term updates 24 can be a manual step of loading system updates into the distribution engine 15.
  • Long term system updates 24 can include changes to the architecture of the distribution engine 15, such as, adding a new computer software application.
  • a particular embodiment of the present invention can originally have diagnosis, prescription, and treatment software packages for Access and Microsoft Word.
  • a long term system update can include adding Microsoft Mail and Word Perfect diagnosis, prescription, and treatment software packages to provide training on these two additional software applications .
  • FIGURE 2 is an exemplary functional relationship diagram 30 illustrating the inter-relationship between various portions of the electronic mentor of the present invention.
  • the diagnostic program, prescription program, and treatment program of the electronic mentor are defined based on a particular business organization's computer software application training needs.
  • the software programs contained in the distribution engine 15 are built to include both standard and custom content.
  • the standard content for a Microsoft Mail diagnostic program would include test questions on operations routinely performed in Microsoft Mail for any set of potential users.
  • Custom content would include those items tested for, prescribed and treated that are unique to a particular organization or company.
  • the content of the diagnosis, prescription, and treatment software programs for Microsoft Word could include additional testing and training, in addition to the standard content diagnosis, prescription and treatment software programs on Microsoft Word.
  • the distribution engine 15 software programs are developed to include the content of the software packages, skill assessment construction tools (to build a profile of the user to include skill level on a particular computer software application) , and any other specialized content.
  • the skill assessment tools can be built using a software authoring program.
  • the test questions used in the diagnostic program 12 can be built using a test construction set software program.
  • the distribution engine 15 software packages, including the training CBT modules, the job aids, the skill assessment (test set questions) , and the training course schedules are built.
  • the diagnosis, prescription, and treatment software programs are installed into the distribution engine 15.
  • the distribution engine 15 represents the overall software program that provides the interface between the 1) diagnosis, prescription, and treatment software packages, 2) the user graphical interface, 3) the users, and the 4) dynamic and long-term system update programs and/or personnel.
  • the distribution engine 15 also includes the measurement and feedback software programs that track and store the data input by users that are used to measure the amount and effectiveness of the training.
  • the data input by the users includes the number of times dynamic help and job aids are accessed, the number of users that have completed diagnoses, the user scores on the diagnosis tests, the number of users that have completed CBTs, the number of CBTs completed, the user scores on the diagnosis tests after completing training, and so forth. Based on this user data, feedback 20 can generate reports to indicate the amount of training performed by users, and the effectiveness of that training.
  • the distribution engine 15 further provides information to knowledge sources 40.
  • the knowledge sources 40 can include computer software programs that automatically respond to questions from users.
  • the knowledge sources 40 can further include computer software programmers, computer application experts, network infrastructure experts, computer support staff, and others, who can provide both dynamic and long term updates to the various software packages contained within the distribution engine 15 of the present invention.
  • the knowledge sources can perform updates to the current software packages within the distribution engine 15 (such as updates to adjust diagnostic questions) , to expanded scope software packages to add these software packages to the distribution engine (for example, adding another computer software application) , or implementing a long-term design update (such as a change to the distribution engine architecture) .
  • FIGURE 5 shows one embodiment of a system 90 used to implement the present invention.
  • the electronic mentor distribution engine 15 is preferably loaded on a server 91 connected to a plurality of user computers 92. Both the server 91 and the user computer 92 can have a memory device 94, a data storage device 93, and a processor 96.
  • the distribution engine 15 software programs will be stored in a memory device 94 in the server 91 and the data will be stored in a storage device 93 in the server 91.
  • the server processor 96 can execute commands contained within the distribution engine 15 software programs.
  • the electronic mentor system will typically include a user graphical interface (similar to that shown in FIGURES 3 and 4) loaded on the user's computer 92 that a user accesses via an input/output device 98, such as a display coupled to a keyboard and/or pointing device (e.g., mouse) as shown in FIGURE 5.
  • the graphical user interface serves to connect the user to the distribution engine 15.
  • the distribution engine 15 can be loaded on a server 91 located at the business organization, or can be loaded off-site and accessed through an interface program contained within a server at the organization's site. It should be understood that the implementation of the present invention can occur through a variety of means that enable the users at an organization to access the present invention through some or all of the computers located at the organization.
  • FIGURE 3 shows an exemplary embodiment of the graphical user interface main menu 60 that a user will see upon entering the electronic mentor system of the present invention.
  • the user can click on the topic to explore by pointing a pointing device on one of the several icons on the main menu screen.
  • a user will click on the "Skill Assessment" icon 62.
  • the user will then see a menu of computer software applications icon.
  • the user can get a diagnosis on any of the computer software applications on the menu by clicking on an icon.
  • the diagnostic 12 will then provide a series of questions that the user will answer covering a range of topics about the computer software application chosen.
  • the diagnostic 12 can indicate to the user at the end of each question whether the user correctly answered.
  • the user's total score of correct answers can be displayed at the end of the diagnosis .
  • the present invention builds a user profile that defines the user's skill level on the computer software application.
  • the electronic mentor will compare the user's proficiency to the minimum skill level defined by the business organization on that particular computer software application. If the user does not meet the defined skill level, the electronic mentor of the present invention evaluates the level of the deficiency and the program within prescription 14 will prescribe an appropriate training program (i.e., treatment) to remedy the deficiency.
  • the prescription 14 can include a software program for evaluating different areas within a computer software application to determine if a user was deficient in a particular area. For example, a user may have proficiency in sending and receiving mail in Microsoft Mail, but may be deficient in opening personal folders for storing mail.
  • the electronic mentor provides a treatment plan that is tailored to the individual needs of the user. This is in contrast to the typical training class that instructs all the participants in the same areas, even though the participants may have vastly different levels of expertise in that computer software application.
  • the customized prescribed treatments are listed for the user on the computer terminal and user can print the prescription for future reference.
  • the treatment 16 contains computer-based training the user can access to implement the prescription. As shown in FIGURE 3, a user can access this computer-based training through the present invention.
  • a user can access a job aids menu screen 80 such as the one shown in FIGURE 4.
  • This screen provides an interface to job aids for various computer software applications.
  • the icon for the desired computer software application for example, the "Windows” icon 82
  • the user can access the job aids for that computer software application.
  • FIGURE 3 if a user clicks on the "Applications" icon 66, the user will access a screen listing the CBTs for the computer software applications; if the user clicks on the "Dynamic Help" icon 68, the user will access the dynamic help for these applications; if the user clicks on the "Course Catalog” icon 70, the user will access a list of courses that can be scheduled by clicking in the "Available Course Dates" icon 72.
  • the other icons listed in FIGURE 3 provide access to other information available to the user, according to this particular example.
  • a user can receive most or all training through computer-based training at the user's terminal.
  • a user can also get the training needed without getting excess (or wasted) training.
  • the treatment prescribed might be the dynamic help feature of the electronic mentor of the present invention. This treatment would typically be prescribed for a user who has a proficiency in a computer application that is near, but does not meet, the required proficiency level.
  • a user simply points to the dynamic help icon 68 with a pointer (such as a mouse) and starts that dynamic help application.
  • a pointer such as a mouse
  • the present invention increases a user's training efficiency by 1) allowing the user to get trained at their computer and 2) allowing the user to decide when the training will occur to maximize time efficiency.
  • the training method of the electronic mentor should also reduce the number of system administrators and technical support personnel by allowing the users to do more of the basic training and updating of skills by themselves.
  • the present invention also provides computer-based answers to frequently asked questions through the dynamic help feature, thus reducing the number of calls to a help desk. These factors reduce training costs associated with maintaining large numbers of support personnel.
  • the dynamic updates provided to the diagnosis, prescription, and treatment programs ensure a more efficient training program by maintaining up-to-date training.
  • Users that have used the present invention to raise their proficiency level on a computer software application can re-initiate the diagnosis when a new version of the computer software program is released to determine if the user needs further training due to changes resulting from the new version.
  • the present invention also provides an organization a measurement of both the effectiveness and the amount of training.
  • the present invention can establish the competency level of the users on a particular computer application.
  • the present invention can establish the average, the median, the mean proficiency of the business organization's users (or a subset thereof) by analyzing the users' scores from the diagnoses performed prior to treatment.
  • the invention can analyze the proficiency information to provide a comparison between the user's scores before and after training according to the prescription. This will show the level of user improvement on the computer software application due to the training treatment .
  • the present invention can also show the precise number of training events (accessing dynamic help, downloading job aids, completed CBTs, etc..) to indicate to the organization the amount of training that occurred to result in the improvement.

Abstract

A system and method for training a user on any number of computer software applications. The computer is directed by at least one computer program within a distribution engine (15) to perform a diagnosis of the skill level of a user on a computer software application, prescribe a training plan that will allow the user to achieve a minimum skill level on the computer software application, and provide the use access to a plurality of training software programs to enable a user to complete the training plan.

Description

ELECTRONIC MENTOR TRAINING SYSTEM AND METHOD
TECHNICAL FIELD OF THE INVENTION
The present invention relates generally to electronic systems and methods, more particularly, to a system and method for an electronic mentor to provide training to users on a variety of computer software applications.
BACKGROUND OF THE INVENTION
Computer-based technologies have permeated every segment of today's work environments. Companies have spent billions of dollars on new computer technologies over the last two decades. Often, these companies have not realized a significant return on the investment m these new computer technologies . One factor leading to this problem is the inability for companies to keep the users of the computer software applications (such as software applications and network infrastructures) properly trained.
One solution to this problem is to provide a technical support staff to answer questions users may have concerning application of these computer software platforms. This solution costly. Support personnel may answer the same question for a number of users. Furthermore, support personnel typically cannot provide systematic training, but rather provide "fire-fighting" type training to get a user through a particular problem. This will not provide the user a comprehensive understanding of the computer software application.
Another conventional method used to solve the lack of computer application training has been to send all users to computer training classes . These training classes are designed to give users the ability to use the computer software application. This conventional solution has several limitations. Due to the disparity m proficiency levels of the various users, computer software application training classes do not provide "just enough" training for every user. Computer software application training classes and/or computerized training courses cannot be tailored to every individual user's proficiency level. Each user receives the entire training course. As a result, many users receive training they do not need. This time spent on wasted training also results in lost productivity because a training class takes the users away from their work station.
Further lost productivity occurs because training classes, even when the training is not wasted, cannot be scheduled to optimize when the class occurs for each individual user. Users will often not want to spend the time required "off-the-job" to attend training classes away from their work station. Conventional classroom training and computer-based training are not typically accessible When and "where needed for a large workforce that is geographically distributed.
Conventional training solutions are also fixed in time. The training is only good for a particular version of the computer software application. Thus, the training classes must be repeated periodically as computer software applications are replaced or upgraded in order to maintain the users' training.
Furthermore, these conventional training solutions do not provide a method to evaluate the amount of training each individual user needs to bring the individual up to the required proficiency level . These conventional systems do not measure the proficiency level of the users, compare proficiency levels at a later date, track the training accessed by the users, or provide feedback on the effectiveness of the training system.
SUMMARY OF THE INVENTION
The present invention provides a computer software application training system and method that substantially eliminates or reduces disadvantages and problems associated with previously developed computer software application training systems and methods.
More specifically, the present invention provides a system and method for training a user on a variety of computer software applications. The computer is directed by a computer program to perform a diagnosis of the skill level of a user on a computer software application, to prescribe a training plan that will allow the user to achieve a minimum skill level on the computer software application, and to provide the user access to a plurality of training software programs to enable a user to complete the training plan.
In another embodiment, the present invention can store input made by the user in a data base and can analyze that data to provide reports on the amount and effectiveness of the training. The system can also receive updates to the computer program, such as when a new version of a computer software application is released.
The present invention provides an important technical advantage by reducing or eliminating wasted training. The present invention accomplishes this by diagnosing the proficiency level of each user in one or more computer software applications and providing a training plan specifically tailored to each user's proficiency level to raise each user's proficiency level to a predetermined level in each application.
The present invention provides another technical advantage by providing the training directly to the user at the computer at the user's work station. The present invention can increase productivity m the workplace by allowing the user to access training, dynamic help and job aids directly from the user's workstation.
The present invention provides yet another technical advantage by reducing the number of technical support personnel needed to support the users on various computer software applications. The present invention provides training tailored to the user's proficiency level, provides a dynamic help for the user to access, and provides a bulletin board of frequently asked questions that can give users quick answers without having to contact a technical support person.
The present invention provides another technical advantage by providing a training prescription tailored for a specific job type that provides a training strategy for particular users based on the job the user performs. The present invention provides another technical advantage by allowing continuous and ongoing re reshment/update of the present invention. The present invention can continuously accept updates to the diagnostics, prescriptions, and training treatments. This can occur when, for example, a new version of a computer software application is released.
The present invention provides another technical advantage by allowing an organization to measure the amount and effectiveness of training. The present invention can monitor, for example, the number of users that have taken the diagnostics, the average scores from the diagnostics (for the organization or any subset thereof) , the number of users who have accessed the computer-based training, how many times a particular user has accessed the training. This measurement can provide a baseline against which an organization can later compare to determine improvements in user proficiency on various computer software applications.
BRTEF DESCRIPTION OF THE DRAWINGS
For a more complete understanding of the present invention and the advantages thereof, reference is now made to the following description taken in conjunction with the accompanying drawings in which like reference numerals indicate like features and wherein:
FIGURE 1 shows a diagram of a process flow incorporating the teachings of the present invention*
FIGURE 2 shows a flow diagram illustrating the functional relationships among specified elements of an embodiment of the present invention,*
FIGURE 3 shows an embodiment of the user interface main menu screen of the present invention that allows users to access the present invention; and FIGURE 4 shows an embodiment of a user interface sub-menu that can be accessed from the user interface main menu of FIGURE 3.
DETAILED DESCRIPTION OF THE INVENTION
Preferred embodiments of the present invention are illustrated in the FIGURES, like numerals being used to refer to like and corresponding parts of the various drawings .
The present invention provides an integrated learning support system to train users on a variety of computer software applications. The present invention can be directly accessed by users from their desk top computers. The present invention provides a system that diagnoses a user's personal learning needs, provides individual learning prescriptions that guide training through a choice of curricula, provides desk top delivery of the curricula, and measures before and after results of the training. The present invention includes a software distribution engine that drives a series of software programs to enable the integrated learning support system. The present invention can be continuously updated and refreshed to match updates to the computer software applications.
Conventional stand alone computer software application training does not typically address application-to-application or network navigation procedures. As more large businesses and corporations standardize their client/server computing and communications networks to achieve global connectivity, enterprise specific navigation training and job performance support will become as important as applications training to workforce capability and productivity. The present invention allows training m these areas as well .
The present invention provides a cost effective way to distribute computer-based training materials over local area networks while minimizing disruption in normal production work.
In conjunction with the present invention, an organization or company preferable defines minimum skill levels an employee should have in various computer software applications. Herein, the term "computer software application" means any computer-based operations involved in performing the user's ob. Computer applications include, for example, standard computer applications (such as Lotus Notes, Windows, Microsoft Word, Excel, etc...), specialized computer applications (for example, computer applications written by the company for its employees to use) , and Internet applications. Computer applications further include network infrastructure configurations to encompass, for example, the use of the printers, the use of routing in the network, and other operations performed over the network. It should be understood that the present invention can be used for a variety of computer software applications and network configurations. The present invention involves using different diagnostics, prescriptions, treatments, measurement, and feedback for each application. Thus, the electronic mentor of the present invention can provide an enabling system to train a user on a virtually unlimited variety of computer software applications. FIGURE 1 illustrates a process flow 10 incorporating the teachings of the present invention that includes one embodiment of the distribution engine 15 of the learning support system ("electronic mentor") comprising diagnostic 12, prescription 14, learning treatments 16, measurement 18, and feedback 20. As shown in FIGURE 1, the distribution engine 15 can also include a portion of the dynamic system updates 22. The electronic mentor also incorporates long-term system updates 24 designed to keep the electronic mentor current. FIGURE 1 shows the long-term updates 24 existing separately from the distribution engine 15, but it should be understood that all or a portion of the long-term updates 24 could reside within the distribution engine 15. The distribution engine 15 represents a computer program that interfaces between the computer programs within the diagnosis, prescription, learning treatments, measurement, and feedback portions of the electronic mentor. The distribution engine 15 also provides the interface between these computer programs and the user. The interface between the user and the electronic mentor can also include a graphical interface (shown in FIGURE 5) that provides a user access to the commands to operate the distribution engine 15 and, thereby, to operate the electronic mentor. The diagnostic 12 comprise at least one computer program containing a series of test questions. A series of test questions can be written for each computer application that an organization uses. These test questions are written to diagnose a user's skill level (proficiency) in the particular computer software application. The test questions can be updated ("refreshed") as each new version of a computer software application is released through either dynamic 22 or long term 24 system updates. A user can access the diagnostic 12 through a graphical interface driven by the distribution engine 15. The questions provides the basis for the diagnosis. The diagnostic 12 evaluates the answers a user provides and diagnoses the skill level of the user with respect to that computer software application. The diagnostic 12 of the electronic mentor creates a profile on the user based on the answers the user provided during the diagnostic evaluation.
From the diagnostic 12, the present invention moves to the prescription 14 to define a prescription having the treatment the user needs to reach the predetermined minimum skill level for each computer application. The prescription 14 includes at least one computer software program that evaluates the answers a user provided during the diagnostic 12 and provides a prescription that defines the type of training a user needs to meet an organization's minimum skill level for the particular computer software application. A user can then follow the prescription provided to meet that predetermined proficiency level. The diagnosis and prescription process can be repeated for any number of computer software applications and for any number of users.
The learning treatment 16 can comprise at least one computer program and can begin with the user taking computer-based training (CBTs) by following instruction provided in the prescription 14. The present invention provides a user access to a variety of treatments, including dynamic help, job aids, modular computer-based training (CBT) , and classroom computer training. The dynamic help, job aids, and computer-based training represent example of computer software programs (learning treatment 18) that preferably reside within the distribution engine 15 of the present invention
The computer-based training contained within and accessed through the distribution engine 15 can include dynamic help, job aids, and computer-based training (CBT) modules. These three classifications represent different levels of training. The dynamic help provides the least amount of training and is designed for a fairly proficient user. The dynamic help software program can collect (upload) questions from individual users to allow posting of answers within the dynamic help user interface. The dynamic help can also include a bulletin board to post announcements or other information on particular computer software applications Job aids can describe procedures for computer software application use for a user who has some familiarity with that computer software application. The job aid software programs can describe use procedures related to a computer software application in more detail than the dynamic help. CBT modules are designed for those users who foundation knowledge or more in-depth training on am computer software application.
Because the treatments are contained within the distribution engine 15 of the electronic mentor, a user can access any of the computer-aided training ( ob aid, dynamic help, CBTs, etc . . .) directly from the user's the computer terminal at the user's work station. A user can access most or all of the training recommended in the prescription directly from his or her computer terminal. This allows users to complete training at times that are convenient to the user. Furthermore, the programs contained within learning treatment 18 can be constructed in modules so that the total computer-based training can be broken up into more convenient segments that fit more readily into a user's schedule.
The electronic mentor can also ask the user questions in the diagnostic 12 that define the types of training the user prefers (i.e., computer based training versus classroom training). Thus, during the prescription stage, the software could prescribe classroom training, rather than computer based training, for a user with that preference. Optionally, the electronic mentor can also allow the user to schedule classroom training (as opposed to computer-based training) directly from a catalog contained within the distribution engine '15 of the electronic mentor of the present invention.
The level of treatment 18 prescribed by the prescription 14 depends on the results of the diagnostic 12. For example, two users might both be diagnosed as needing training on Microsoft Word as a treatment. However, user 1 may be more proficient than user 2 based on the diagnostic 12. The prescription 14 of the electronic mentor may only prescribe one CBT module of training in Microsoft Word for user 1, while prescribing four CBT modules in Microsoft Word for user 2. Furthermore, a user may need different levels of training on different computer software applications. For example, the present invention may prescribe a user four CBT modules of training on using the Access database as a treatment, but may only prescribe referring to the dynamic help for training in Microsoft Word, and may not prescribe any training in Excel . By following the treatment recommendations in the prescription 14, a user can reach the determined minimum skill level for each of the computer software programs.
From treatment 16, the electronic mentor process flow moves to the measurement 18. Measurement 18 of the present invention preferably includes a measurement software program that stores information input by the user during the previous steps of diagnosis, prescription, and treatment in a database. Each time the user makes an input during one of these portions, the measurement software program will store the data from that input for later use during the feedback 20 feature of the present invention. This storage of data allows the present invention to create a profile on the user based on the user's inputs. The profile of a user will be constantly updated each time the user accesses the electronic mentor.
The feedback 20 of the distribution engine 15 comprises at least one computer software program that can access the stored user input data to provide reports on the total amount of training accessed and the effectiveness of the training provided to the users. For example, by accessing the stored data, the feedback 20 can provide reports detailing how many job aids have been downloaded, how many times dynamic help has been accessed, how many CBT modules have been accessed, and how many CBT modules have been completed by each user accessing the electronic mentor system. The feedback 20 can also provide a report on the skill level of users before and after training by comparing results of the diagnostic 12 before and after training. This information can give the company an indication of the effectiveness of the training provided to the users. In this way, the organization receives an objective analysis of the proficiency level of their employees on various computer software applications. The feedback 20 can sort users to provide a report on proficiency level by server, by work group, by organization, or by other characteristic. The organization can use this information to measure the level of training the users are getting and if the training process is working. In another example, if the measurement 18 indicates that the organization as a whole has a low proficiency rating in use of network resources, this information can be sent to the organization. The organization can then decide to create a special class that can be accessed through the mentor. Alternatively, the organization can send out a bulletin over the electronic mentor noting the deficiency and encouraging (or requiring) users to begin the treatment prescribed by the electronic mentor by a specified date. During dynamic system updates 22, the present invention can receive real-time system updates that continuously refresh the information contained within the software programs in the distribution engine 15. For example, as the users access the dynamic help function of the present invention, this function can be continuously updated based on the questions posed by the users. Users' questions can be analyzed, and answers can be posted within the dynamic help user interface.
The distribution engine 15, as shown in FIGURE 1, can provide an automated dynamic system update program 22 that can perform a portion of the dynamic update. The remainder of dynamic updates can either be performed through manual inputs into the various portions of the distribution engine 15. Alternatively, all of the dynamic updates can be performed manually or through a computer program contained within the distribution engine 15.
The present invention also allows dynamic update of the diagnosis, prescription, and treatment programs contained within the distribution engine 15 when a new version of a computer software application is released. For example, if the present invention provides training on Microsoft Word (assume version 2.0), a new version of Microsoft Word (assume version 2.1) could be released after implementing the present invention. Prior to the new version release, the diagnostic 12 includes a program containing a test question set for Microsoft Word version
2.0. Likewise, the prescription 14 will depend on the old diagnostic 12 and the treatment 16 will provide training treatment designed to teach a user to better use the old version 2.0. Upon release of the new version
2.1, the programs within the diagnostic 12, the prescription 14, and the treatment 16 can be updated to correspond with the latest software version (version 2.1). The diagnostic test questions contained within a diagnosis program can be modified (if necessary) to test for proficiency on the new software version. Each of the tools used within the electronic mentor system (such as the test questions, the help features, the training and job aids, etc..) can be continuously updated and supplied to the organization (and users) on an ongoing basis. The distribution engine 15 can reside in a server separately from the business organization's graphical user interface. The distribution engine 15 can be updated and the users can access the updated programs immediately through the graphical user interface . In this way, the electronic mentor training system of the present invention can provide training on the latest releases of computer software applications without having to load a new version of the electronic mentor. In an alternative embodiment, the electronic mentor could be configured in a versioned format and when updates to the computer applications occur, a new version of the electronic mentor could be sent to the business organization.
The dynamic system update 22 allows the CBT's, the dynamic help, the bulletin board containing the frequently asked questions, the test question sets, and the other software program supported portions of the distribution engine 15 of the electronic mentor to be changed on an ongoing and continuous basis to keep abreast of changes to the computer software applications. This reduces the problem of sending users to computer training and having that training become obsolete within a couple of years. Each time a user accesses the electronic mentor, the distribution engine 15 programs can reflect the latest version of the computer applications due to the dynamic update 22 function. The continuous update allows a user to build on previous knowledge and receive training compatible with the lack of proficiency caused by the update to the computer software application.
The electronic mentor of the present invention can also include a feature that tells a user that the mentor has been updated and what area(s) within the mentor have been updated. The software program within the distribution engine 15 that performs the dynamic system update 22 can conduct a comparison of the previous version of the computer software application with the new version to indicate what features have changed and what features have been added or deleted. In an alternative embodiment, this comparison can be performed manually and loaded into a program residing within the distribution engine 15 that a user can access. Providing long term updates 24 , as shown in FIGURE 1, can be a manual step of loading system updates into the distribution engine 15. Long term system updates 24 can include changes to the architecture of the distribution engine 15, such as, adding a new computer software application. For example, a particular embodiment of the present invention can originally have diagnosis, prescription, and treatment software packages for Access and Microsoft Word. A long term system update can include adding Microsoft Mail and Word Perfect diagnosis, prescription, and treatment software packages to provide training on these two additional software applications .
FIGURE 2 is an exemplary functional relationship diagram 30 illustrating the inter-relationship between various portions of the electronic mentor of the present invention. During the initial design 32, the diagnostic program, prescription program, and treatment program of the electronic mentor are defined based on a particular business organization's computer software application training needs. The software programs contained in the distribution engine 15 are built to include both standard and custom content. For example, the standard content for a Microsoft Mail diagnostic program would include test questions on operations routinely performed in Microsoft Mail for any set of potential users. Custom content would include those items tested for, prescribed and treated that are unique to a particular organization or company. For example, if an organization had a need for specialized training in word processing (for example, a temporary secretary agency) , the content of the diagnosis, prescription, and treatment software programs for Microsoft Word could include additional testing and training, in addition to the standard content diagnosis, prescription and treatment software programs on Microsoft Word.
After the initial design 32, the development 34 of the diagnostic, prescription, and treatment software program modules defined in the initial design occurs. The distribution engine 15 software programs are developed to include the content of the software packages, skill assessment construction tools (to build a profile of the user to include skill level on a particular computer software application) , and any other specialized content. The skill assessment tools can be built using a software authoring program. For example, the test questions used in the diagnostic program 12 can be built using a test construction set software program. At the produce or build content 36 stage, the distribution engine 15 software packages, including the training CBT modules, the job aids, the skill assessment (test set questions) , and the training course schedules are built. At this stage the diagnosis, prescription, and treatment software programs are installed into the distribution engine 15.
The distribution engine 15 represents the overall software program that provides the interface between the 1) diagnosis, prescription, and treatment software packages, 2) the user graphical interface, 3) the users, and the 4) dynamic and long-term system update programs and/or personnel. The distribution engine 15 also includes the measurement and feedback software programs that track and store the data input by users that are used to measure the amount and effectiveness of the training. The data input by the users includes the number of times dynamic help and job aids are accessed, the number of users that have completed diagnoses, the user scores on the diagnosis tests, the number of users that have completed CBTs, the number of CBTs completed, the user scores on the diagnosis tests after completing training, and so forth. Based on this user data, feedback 20 can generate reports to indicate the amount of training performed by users, and the effectiveness of that training. This provides a tool that can be used to update the diagnosis, prescription, and treatment program modules if necessary. The feedback software program allows updating (both dynamic and long term) the diagnosis, prescription, and treatment software programs. As shown in FIGURE 2, the distribution engine 15 further provides information to knowledge sources 40. The knowledge sources 40 can include computer software programs that automatically respond to questions from users. The knowledge sources 40 can further include computer software programmers, computer application experts, network infrastructure experts, computer support staff, and others, who can provide both dynamic and long term updates to the various software packages contained within the distribution engine 15 of the present invention. As shown in FIGURE 2, the knowledge sources can perform updates to the current software packages within the distribution engine 15 (such as updates to adjust diagnostic questions) , to expanded scope software packages to add these software packages to the distribution engine (for example, adding another computer software application) , or implementing a long-term design update (such as a change to the distribution engine architecture) .
FIGURE 5 shows one embodiment of a system 90 used to implement the present invention. To implement the electronic mentor of the present invention to provide training to users within an organization, the electronic mentor distribution engine 15 is preferably loaded on a server 91 connected to a plurality of user computers 92. Both the server 91 and the user computer 92 can have a memory device 94, a data storage device 93, and a processor 96. Typically, the distribution engine 15 software programs will be stored in a memory device 94 in the server 91 and the data will be stored in a storage device 93 in the server 91. The server processor 96 can execute commands contained within the distribution engine 15 software programs. The electronic mentor system will typically include a user graphical interface (similar to that shown in FIGURES 3 and 4) loaded on the user's computer 92 that a user accesses via an input/output device 98, such as a display coupled to a keyboard and/or pointing device (e.g., mouse) as shown in FIGURE 5. The graphical user interface serves to connect the user to the distribution engine 15. The distribution engine 15 can be loaded on a server 91 located at the business organization, or can be loaded off-site and accessed through an interface program contained within a server at the organization's site. It should be understood that the implementation of the present invention can occur through a variety of means that enable the users at an organization to access the present invention through some or all of the computers located at the organization.
To initiate the electronic mentor training system, a user must access the distribution engine 15. A user graphical interface will typically reside on the user's computer, with the majority of the distribution engine 15 software modules (such as the diagnosis, prescription, and treatment software programs) residing on server. FIGURE 3 shows an exemplary embodiment of the graphical user interface main menu 60 that a user will see upon entering the electronic mentor system of the present invention.
As shown in FIGURE 3, the user can click on the topic to explore by pointing a pointing device on one of the several icons on the main menu screen. To begin a diagnosis, a user will click on the "Skill Assessment" icon 62. Upon doing so, the user will then see a menu of computer software applications icon. The user can get a diagnosis on any of the computer software applications on the menu by clicking on an icon. The diagnostic 12 will then provide a series of questions that the user will answer covering a range of topics about the computer software application chosen. The diagnostic 12 can indicate to the user at the end of each question whether the user correctly answered. The user's total score of correct answers can be displayed at the end of the diagnosis .
Based on the user's answers to the diagnosis test questions, the present invention builds a user profile that defines the user's skill level on the computer software application. The electronic mentor will compare the user's proficiency to the minimum skill level defined by the business organization on that particular computer software application. If the user does not meet the defined skill level, the electronic mentor of the present invention evaluates the level of the deficiency and the program within prescription 14 will prescribe an appropriate training program (i.e., treatment) to remedy the deficiency. The prescription 14 can include a software program for evaluating different areas within a computer software application to determine if a user was deficient in a particular area. For example, a user may have proficiency in sending and receiving mail in Microsoft Mail, but may be deficient in opening personal folders for storing mail. In this way, the electronic mentor provides a treatment plan that is tailored to the individual needs of the user. This is in contrast to the typical training class that instructs all the participants in the same areas, even though the participants may have vastly different levels of expertise in that computer software application. With the present invention, the customized prescribed treatments are listed for the user on the computer terminal and user can print the prescription for future reference.
The treatment 16 contains computer-based training the user can access to implement the prescription. As shown in FIGURE 3, a user can access this computer-based training through the present invention. By clicking on the "Job Aids" icon 64, a user can access a job aids menu screen 80 such as the one shown in FIGURE 4. This screen provides an interface to job aids for various computer software applications. By clicking on the icon for the desired computer software application (for example, the "Windows" icon 82) , the user can access the job aids for that computer software application. Similarly, referring to FIGURE 3, if a user clicks on the "Applications" icon 66, the user will access a screen listing the CBTs for the computer software applications; if the user clicks on the "Dynamic Help" icon 68, the user will access the dynamic help for these applications; if the user clicks on the "Course Catalog" icon 70, the user will access a list of courses that can be scheduled by clicking in the "Available Course Dates" icon 72. The other icons listed in FIGURE 3 provide access to other information available to the user, according to this particular example.
As FIGURES 3 and 4 illustrate, a user can receive most or all training through computer-based training at the user's terminal. A user can also get the training needed without getting excess (or wasted) training. For example, the treatment prescribed might be the dynamic help feature of the electronic mentor of the present invention. This treatment would typically be prescribed for a user who has a proficiency in a computer application that is near, but does not meet, the required proficiency level. To access the dynamic help, a user simply points to the dynamic help icon 68 with a pointer (such as a mouse) and starts that dynamic help application. Thus, the user gets a relatively small amount of training that is tailored to the user's proficiency level. This prevents wasting time and the cost of sending a relatively advanced user to training that covers more basic elements of the computer application. In addition to the cost savings due to avoidance of wasted training, the present invention increases a user's training efficiency by 1) allowing the user to get trained at their computer and 2) allowing the user to decide when the training will occur to maximize time efficiency. The training method of the electronic mentor should also reduce the number of system administrators and technical support personnel by allowing the users to do more of the basic training and updating of skills by themselves. The present invention also provides computer-based answers to frequently asked questions through the dynamic help feature, thus reducing the number of calls to a help desk. These factors reduce training costs associated with maintaining large numbers of support personnel.
Furthermore, the dynamic updates provided to the diagnosis, prescription, and treatment programs ensure a more efficient training program by maintaining up-to-date training. Users that have used the present invention to raise their proficiency level on a computer software application can re-initiate the diagnosis when a new version of the computer software program is released to determine if the user needs further training due to changes resulting from the new version. The present invention also provides an organization a measurement of both the effectiveness and the amount of training. By recording the user inputs, the present invention can establish the competency level of the users on a particular computer application. The present invention can establish the average, the median, the mean proficiency of the business organization's users (or a subset thereof) by analyzing the users' scores from the diagnoses performed prior to treatment. After users complete the treatments prescribed, the users can again take the diagnostic. At this point, the invention can analyze the proficiency information to provide a comparison between the user's scores before and after training according to the prescription. This will show the level of user improvement on the computer software application due to the training treatment . The present invention can also show the precise number of training events (accessing dynamic help, downloading job aids, completed CBTs, etc..) to indicate to the organization the amount of training that occurred to result in the improvement.
Although the present invention has been described in detail, it should be understood that various changes, substitutions and alterations can be made hereto without departing from the spirit and scope of the invention as described by the appended claims.

Claims

WHAT IS CLAIMED IS:
1. A system for training a user on a computer software application, comprising: a storage device operable to store data; a memory device operable to store a computer program,- an input/output device operable to provide a user interface between the user and the system,* and a processor coupled to the storage device, the input/output device, memory device, the processor operable to execute the computer program such that the system is directed by the computer program to: perform a diagnosis of a skill level of a user on the computer software application; prescribe a training plan that will allow the user to achieve a predetermined minimum skill level on the computer software application; and provide the user access to a plurality of training software programs to enable a user to complete the training plan.
2. The system of Claim 1, wherein the processor is further operable to execute the computer program such that the system is directed by the computer program to: store input made by the user on the storage device,* analyze the user input; and provide reports containing the analyzed user input .
3. The system of Claim 1, wherein the system is further directed by the computer program to receive updates to the computer program to provide accurate diagnosis, updated prescribed training plans, and updated training software programs.
4. The system of Claim 3 wherein the updates to the computer program are initiated due to updates in a computer software application.
5. The system of Claim 1, wherein the system is further directed by the computer program to provide a set of questions to the user in order to perform the diagnosis of a user's skill level on the computer software application.
6. The system of Claim 2, wherein the system is further directed by the computer program to compare the user's skill level based on the diagnosis to a predetermined minimum skill level required on the computer software application prior to prescribing a training plan.
7. The system of Claim 2, wherein the system is further directed by the computer program to store input made by the user in a data base on the storage device.
8. The system of Claim 2, wherein the system is further directed by the computer program to analyze the user input to provide reports on a number of training software programs the user has accessed.
9. The system of Claim 2, wherein the system is further directed by the computer program to analyze the user input to compare the user's skill level on the computer software application prior to the user performing the training recommended in the prescribed training plan to the user's skill level on the computer software aoplication after performing training recommended in the prescribed training plan.
10. The system of Claim 1, wherein the system further provides training to a plurality of users on a plurality of computer software applications, and further wherein the system is further directed by the computer program to provide a plurality of users direct access to a plurality of computer software programs at a computer terminal .
11. A computer-readable memory configured to represent a computer program for directing operation of a computer, comprising: a distribution engine module comprising ; a diagnosis module operable to direct a computer to perform a diagnosis of a skill level of a user on a computer software application; a prescription module operable to direct a computer to compare the user's skill level based on the diagnosis of the user to a predetermined minimum skill level required on the computer software application, and further operable to provide a training plan that will allow the user to achieve the predetermined minimum skill level required on the computer software application; and a treatment module operable to provide access to a plurality of training software programs to enable a user to complete the training plan; a graphical user interface operable to provide a user with an interface to the distribution engine.
12. The system of Claim 11, wherein the distribution engine further comprises; a measurement module operable to record input made by a user,* and a feedback module operable to analyze the user input and provide reports containing the analyzed user input .
13. The system of Claim 11, further comprising a dynamic system update module to allow changes to be incorporated to the diagnosis module, the prescription module, and the treatment module of the distribution engine module .
14. The system of Claim 11, further comprising a long term system update module to allow architectural changes to be made to the distribution engine module.
15. The system of Claim 12, wherein the measurement and feedback modules work in concert to report a total amount of training accessed and a comparative skill level of a user prior to and after completing the prescribed training plan.
16. A method for providing a user training on a computer software application, the method performed by a computer executing a computer program, the process comprising: diagnosing a user's skill level on the computer software application,* comparing the user's skill level on the computer software application to a predetermined minimum skill level required for the user on the computer software application; prescribing a training plan based on the diagnosis and comparison that will provide the user training to achieve the predetermined minimum skill level; and providing the user access to a plurality of computer based training programs to train the user on the computer software application.
17. The method of Claim 16, further comprising; recording input made by the user in a data base; analyzing the input to determine the effectiveness of the user training method; and analyzing the input to determine an amount of computer based training accessed.
18. The method of Claim 16, further comprising using the prescribed training plan to train the user on the computer software application.
19. The method of Claim 16, further comprising updating the computer program based on the analyzed input .
20. The method of Claim 16, further comprising updating the computer program when a new version of the computer software application is released.
21. The method of Claim 16, wherein diagnosing a user's skill level on a computer software application further comprises; preparing a test construction set for diagnosing a user's proficiency on the computer software application; accepting a user's answers to questions contained in the test construction set; and scoring the user's answers to the questions by comparing the user's answers to correct answers.
22. The method of Claim 16, wherein providing the user access to a plurality of computer based training programs to train the user on the computer software application further comprises building a plurality of software modules contained within the computer program for training the user.
23. The method of Claim 22, further comprising continuously updating the software modules based on changes and updates to the computer software application.
24. The method of Claim 17, wherein analyzing the input to determine the effectiveness of the user training method further comprises comparing the user's skill level prior to the user receiving training on the computer software application to the user's skill level after the user receives training on the computer software application .
PCT/US1997/013355 1996-07-29 1997-07-29 Electronic mentor training system and method WO1998005018A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU40479/97A AU4047997A (en) 1996-07-29 1997-07-29 Electronic mentor training system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/681,745 US5823781A (en) 1996-07-29 1996-07-29 Electronic mentor training system and method
US08/681,745 1996-07-29

Publications (1)

Publication Number Publication Date
WO1998005018A1 true WO1998005018A1 (en) 1998-02-05

Family

ID=24736603

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1997/013355 WO1998005018A1 (en) 1996-07-29 1997-07-29 Electronic mentor training system and method

Country Status (3)

Country Link
US (1) US5823781A (en)
AU (1) AU4047997A (en)
WO (1) WO1998005018A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6643652B2 (en) 2000-01-14 2003-11-04 Saba Software, Inc. Method and apparatus for managing data exchange among systems in a network
US6721747B2 (en) 2000-01-14 2004-04-13 Saba Software, Inc. Method and apparatus for an information server
US6850893B2 (en) 2000-01-14 2005-02-01 Saba Software, Inc. Method and apparatus for an improved security system mechanism in a business applications management system platform
US7089583B2 (en) 2000-01-14 2006-08-08 Saba Software, Inc. Method and apparatus for a business applications server
US10481878B2 (en) 2008-10-09 2019-11-19 Objectstore, Inc. User interface apparatus and methods
WO2020086596A3 (en) * 2018-10-25 2020-06-04 Autodesk, Inc. Techniques for analyzing the proficiency of users of software applications

Families Citing this family (166)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6688888B1 (en) 1996-03-19 2004-02-10 Chi Fai Ho Computer-aided learning system and method
US6014134A (en) * 1996-08-23 2000-01-11 U S West, Inc. Network-based intelligent tutoring system
US6098092A (en) * 1996-11-08 2000-08-01 Silicon Graphics, Inc. Server to dynamically generate graphics for the world wide web
US6091930A (en) * 1997-03-04 2000-07-18 Case Western Reserve University Customizable interactive textbook
US20040230495A1 (en) * 1997-04-04 2004-11-18 Mikhail Lotvin Computer systems and methods supporting on-line interaction with content, purchasing, and searching
US5907831A (en) * 1997-04-04 1999-05-25 Lotvin; Mikhail Computer apparatus and methods supporting different categories of users
US6409514B1 (en) * 1997-10-16 2002-06-25 Micron Electronics, Inc. Method and apparatus for managing training activities
US6882824B2 (en) 1998-06-10 2005-04-19 Leapfrog Enterprises, Inc. Interactive teaching toy
US6801751B1 (en) * 1999-11-30 2004-10-05 Leapfrog Enterprises, Inc. Interactive learning appliance
US9792659B2 (en) 1999-04-13 2017-10-17 Iplearn, Llc Computer-aided methods and apparatus to access materials in a network environment
US6398556B1 (en) 1998-07-06 2002-06-04 Chi Fai Ho Inexpensive computer-aided learning methods and apparatus for learners
US6126448A (en) * 1998-07-06 2000-10-03 Ho; Chi Fai Computer-aided learning methods and apparatus for a job
US6085184A (en) * 1998-12-22 2000-07-04 Ac Properties B.V. System, method and article of manufacture for a dynamic toolbar in a tutorial system
US6535861B1 (en) 1998-12-22 2003-03-18 Accenture Properties (2) B.V. Goal based educational system with support for dynamic characteristics tuning using a spread sheet object
US6067537A (en) * 1998-12-22 2000-05-23 Ac Properties B.V. System, method and article of manufacture for a goal based educational system with support for dynamic personality feedback
US6029156A (en) * 1998-12-22 2000-02-22 Ac Properties B.V. Goal based tutoring system with behavior to tailor to characteristics of a particular user
US6745170B2 (en) 1999-02-08 2004-06-01 Indeliq, Inc. Goal based educational system with support for dynamic characteristic tuning
US6064998A (en) * 1998-12-22 2000-05-16 Ac Properties, B.V. System, method and article of manufacture for a simulation engine with an expert system example processing engine
US6073127A (en) * 1998-12-22 2000-06-06 Ac Properties B.V. System, method and article of manufacture for a goal based system with dynamic feedback information
US6016486A (en) * 1998-12-22 2000-01-18 Ac Properties B.V. System method and article of manufacture for a goal based system utilizing an activity table
US5987443A (en) 1998-12-22 1999-11-16 Ac Properties B. V. System, method and article of manufacture for a goal based educational system
US6542880B2 (en) 1998-12-22 2003-04-01 Indeliq, Inc. System, method and article of manufacture for a goal based system utilizing a table based architecture
US6029159A (en) * 1998-12-22 2000-02-22 Ac Properties B.V. System, method and article of manufacture for a simulation enabled accounting tutorial system
US6023691A (en) * 1998-12-22 2000-02-08 Ac Properties B.V. Goal based stimulator utilizing a spreadsheet architecture
US6029158A (en) 1998-12-22 2000-02-22 Ac Properties B.V. System, method and article of manufacture for a simulation enabled feedback system
US6125358A (en) * 1998-12-22 2000-09-26 Ac Properties B.V. System, method and article of manufacture for a simulation system for goal based education of a plurality of students
US6134539A (en) * 1998-12-22 2000-10-17 Ac Properties B.V. System, method and article of manufacture for a goal based education and reporting system
US6782374B2 (en) 1998-12-22 2004-08-24 Accenture Global Services Gmbh System, method and article of manufacturing for a runtime program analysis tool for a simulation engine
US6018730A (en) 1998-12-22 2000-01-25 Ac Properties B.V. System, method and article of manufacture for a simulation engine with a help website and processing engine
US6032141A (en) * 1998-12-22 2000-02-29 Ac Properties B.V. System, method and article of manufacture for a goal based educational system with support for dynamic tailored feedback
US6026386A (en) * 1998-12-22 2000-02-15 Ac Properties B.V. System, method and article of manufacture for a goal based educational system with support for dynamic media control
US6003021A (en) * 1998-12-22 1999-12-14 Ac Properties B.V. System, method and article of manufacture for a simulation system for goal based education
US6067538A (en) * 1998-12-22 2000-05-23 Ac Properties B.V. System, method and article of manufacture for a simulation enabled focused feedback tutorial system
US6018732A (en) * 1998-12-22 2000-01-25 Ac Properties B.V. System, method and article of manufacture for a runtime program regression analysis tool for a simulation engine
US6101489A (en) 1998-12-22 2000-08-08 Ac Properties, B.V. System, method and article of manufacture for a goal based system utilizing a time based model
US6023692A (en) * 1998-12-22 2000-02-08 Ac Properties B.V. Goal based tutoring system with behavior to control flow of presentation
US6018731A (en) * 1998-12-22 2000-01-25 Ac Properties B.V. System, method and article of manufacture for a goal based system utilizing a spreadsheet and table based architecture
US6347333B2 (en) * 1999-01-15 2002-02-12 Unext.Com Llc Online virtual campus
US6970858B1 (en) 1999-02-08 2005-11-29 Accenture, Llp Goal based system utilizing an activity table
US7194444B1 (en) 1999-02-08 2007-03-20 Indeliq, Inc. Goal based flow of a control presentation system
US7054848B1 (en) 1999-02-08 2006-05-30 Accenture, Llp Goal based system utilizing a time based model
US7156665B1 (en) 1999-02-08 2007-01-02 Accenture, Llp Goal based educational system with support for dynamic tailored feedback
US7089222B1 (en) 1999-02-08 2006-08-08 Accenture, Llp Goal based system tailored to the characteristics of a particular user
US7065513B1 (en) 1999-02-08 2006-06-20 Accenture, Llp Simulation enabled feedback system
US7386524B2 (en) 1999-02-08 2008-06-10 Accenture Global Services Gmbh Simulation enabled focused feedback tutorial system
US7065512B1 (en) 1999-02-08 2006-06-20 Accenture, Llp Dynamic toolbar in a tutorial system
US20030023686A1 (en) * 1999-05-05 2003-01-30 Beams Brian R. Virtual consultant
US20020138590A1 (en) * 2000-05-05 2002-09-26 Beams Brian R. System method and article of manufacture for creating a virtual university experience
AU4826100A (en) 1999-05-05 2000-11-17 Accenture Properties (2) Bv System, method and article of manufacture for creating collaborative simulationswith multiple roles for a single student
US7152092B2 (en) 1999-05-05 2006-12-19 Indeliq, Inc. Creating chat rooms with multiple roles for multiple participants
US6611822B1 (en) 1999-05-05 2003-08-26 Ac Properties B.V. System method and article of manufacture for creating collaborative application sharing
AU5742000A (en) * 1999-06-16 2001-01-02 Knowledgebase.Com Method and system for skills assessment
US6299452B1 (en) * 1999-07-09 2001-10-09 Cognitive Concepts, Inc. Diagnostic system and method for phonological awareness, phonological processing, and reading skill testing
US20030069866A1 (en) * 1999-07-29 2003-04-10 Hiromasa Ohno Management system for education and training, computer for management of training, terminal device for trainee, terminal device for manager, and method for management of education and training
US20020086275A1 (en) * 1999-07-30 2002-07-04 Boney James L. Methods and apparatus for computer training relating to devices using a resource control module
US6514085B2 (en) * 1999-07-30 2003-02-04 Element K Online Llc Methods and apparatus for computer based training relating to devices
ATE297585T1 (en) * 1999-07-30 2005-06-15 Element K Online Llc METHOD AND DEVICE FOR COMPUTER-ASSISTED TRAINING IN THE USE OF DEVICES
US6736642B2 (en) * 1999-08-31 2004-05-18 Indeliq, Inc. Computer enabled training of a user to validate assumptions
US6370355B1 (en) * 1999-10-04 2002-04-09 Epic Learning, Inc. Blended learning educational system and method
US6368110B1 (en) * 1999-10-04 2002-04-09 Epic Learning Educational homeroom for providing user specific educational tools and information
US6970885B1 (en) * 1999-10-05 2005-11-29 General Electric Company Method and system for enabling training of field service personnel and field service of machines
US6766311B1 (en) 1999-11-09 2004-07-20 Worldcom, Inc. State transition system and method in interactive computer-based training
US6755657B1 (en) 1999-11-09 2004-06-29 Cognitive Concepts, Inc. Reading and spelling skill diagnosis and training system and method
US6371765B1 (en) * 1999-11-09 2002-04-16 Mciworldcom, Inc. Interactive computer-based training system and method
US9640083B1 (en) 2002-02-26 2017-05-02 Leapfrog Enterprises, Inc. Method and system for providing content for learning appliances over an electronic communication medium
US9520069B2 (en) 1999-11-30 2016-12-13 Leapfrog Enterprises, Inc. Method and system for providing content for learning appliances over an electronic communication medium
WO2001043002A1 (en) * 1999-12-08 2001-06-14 Skill/Vision Co., Ltd. Recorded medium on which program for displaying skill achievement level, display device, and displaying method
US6341212B1 (en) * 1999-12-17 2002-01-22 Virginia Foundation For Independent Colleges System and method for certifying information technology skill through internet distribution examination
US6681098B2 (en) * 2000-01-11 2004-01-20 Performance Assessment Network, Inc. Test administration system using the internet
US6691159B1 (en) * 2000-02-24 2004-02-10 General Electric Company Web-based method and system for providing assistance to computer users
GB0006721D0 (en) * 2000-03-20 2000-05-10 Mitchell Thomas A Assessment methods and systems
US6438353B1 (en) 2000-03-29 2002-08-20 General Electric Method, system and storage medium for providing training to multiple users
WO2001075790A2 (en) * 2000-04-03 2001-10-11 3-Dimensional Pharmaceuticals, Inc. Method, system, and computer program product for representing object relationships in a multidimensional space
US20020051956A1 (en) * 2000-05-09 2002-05-02 Thomsen David J. System and method for remote learning, such as for costs and benefits personnel and professionals
US6711378B2 (en) * 2000-06-30 2004-03-23 Fujitsu Limited Online education course with customized course scheduling
US6507726B1 (en) * 2000-06-30 2003-01-14 Educational Standards And Certifications, Inc. Computer implemented education system
WO2002009391A2 (en) * 2000-07-10 2002-01-31 Educational Testing Service System and methods for computer-based testing using network-based synchronization of information
WO2002015155A1 (en) * 2000-08-14 2002-02-21 Mdi Education Systems, Inc. Information delivery system
JP3883795B2 (en) * 2000-08-24 2007-02-21 富士通株式会社 Attendance class selection device, attendance class selection method, and storage medium
US6871195B2 (en) * 2000-09-13 2005-03-22 E-Promentor Method and system for remote electronic monitoring and mentoring of computer assisted performance support
AUPR009000A0 (en) * 2000-09-13 2000-10-05 Guignard, Paul Dr Intelligent courseware developement and delivery environment
US20020048743A1 (en) * 2000-10-20 2002-04-25 Arthrex, Inc. Interactive template for animated surgical technique CD-ROM
US6606480B1 (en) 2000-11-02 2003-08-12 National Education Training Group, Inc. Automated system and method for creating an individualized learning program
US7260355B2 (en) * 2000-11-02 2007-08-21 Skillsoft Corporation Automated individualized learning program creation system and associated methods
US6551107B1 (en) 2000-11-03 2003-04-22 Cardioconcepts, Inc. Systems and methods for web-based learning
WO2002052528A1 (en) * 2000-11-13 2002-07-04 Element K Online Llc. Method and system for assessment of user performance
JP2002157380A (en) * 2000-11-20 2002-05-31 Fujitsu Ltd Enterprise training planning method and enterprise training information acquiring method
US20030009742A1 (en) * 2000-12-06 2003-01-09 Bass Michael D. Automated job training and performance tool
US7483842B1 (en) * 2001-02-21 2009-01-27 The Yacobian Group System and method for determining recommended action based on measuring and analyzing store and employee data
US6688889B2 (en) 2001-03-08 2004-02-10 Boostmyscore.Com Computerized test preparation system employing individually tailored diagnostics and remediation
US6767211B2 (en) * 2001-03-13 2004-07-27 Carolyn W. Hall Method and apparatus for behaviorally reinforced training with guided practice
US6789047B1 (en) 2001-04-17 2004-09-07 Unext.Com Llc Method and system for evaluating the performance of an instructor of an electronic course
US6974328B2 (en) * 2001-06-08 2005-12-13 Noyo Nordisk Pharmaceuticals, Inc. Adaptive interactive preceptored teaching system
US6790045B1 (en) 2001-06-18 2004-09-14 Unext.Com Llc Method and system for analyzing student performance in an electronic course
US20030035646A1 (en) * 2001-08-20 2003-02-20 Vat 19, Llc Digital video device having a verification code thereon and method of generating a verification code
JP3904869B2 (en) * 2001-09-26 2007-04-11 株式会社東芝 Learning support apparatus and learning support method
US6941105B1 (en) 2001-10-24 2005-09-06 Novell, Inc. System and method to reduce the time and complexity of information technology classroom setup
US20030082508A1 (en) * 2001-10-30 2003-05-01 Motorola, Inc. Training method
US20040110118A1 (en) * 2001-11-13 2004-06-10 Clark Harry Kennedy Method and system for assessment of user performance
US20030099924A1 (en) * 2001-11-28 2003-05-29 Sougo Tsuboi Learning support method and learning support system
US6988239B2 (en) * 2001-12-19 2006-01-17 Ge Mortgage Holdings, Llc Methods and apparatus for preparation and administration of training courses
US20030139965A1 (en) * 2002-01-22 2003-07-24 Latin Commodities S.A. Method for evaluating corporate network users knowledge level through an on-line query system
US20040005536A1 (en) * 2002-01-31 2004-01-08 Feng-Qi Lai Universal electronic placement system and method
US7698360B2 (en) * 2002-02-26 2010-04-13 Novell, Inc. System and method for distance learning
US7331791B2 (en) * 2002-03-05 2008-02-19 Novell, Inc. System and method for evaluating a person's information technology skills
JP3737068B2 (en) * 2002-03-27 2006-01-18 富士通株式会社 Optimal question presentation method and optimal question presentation device
AU2003228705A1 (en) * 2002-04-26 2003-11-10 Kumon North America, Inc. Method and system for monitoring and managing the educational progress of students
US6687485B2 (en) 2002-05-21 2004-02-03 Thinksmark Performance Systems Llc System and method for providing help/training content for a web-based application
KR20050027093A (en) * 2002-05-24 2005-03-17 에스엠티엠 테크놀러지스 엘엘씨 Method and system for skills-based testing and training
US20040029091A1 (en) * 2002-07-08 2004-02-12 Marat Gitman Clock - learning aid and combination
US20040029087A1 (en) * 2002-08-08 2004-02-12 Rodney White System and method for training and managing gaming personnel
US20040046792A1 (en) * 2002-09-09 2004-03-11 Knowledge Impact, Inc. Application training simulation system and methods
US20080027995A1 (en) * 2002-09-20 2008-01-31 Cola Systems and methods for survey scheduling and implementation
JP2004294493A (en) * 2003-03-25 2004-10-21 Fujitsu Ltd Learning program and recording medium
US20040219492A1 (en) * 2003-05-01 2004-11-04 International Business Machines Corporation Method, system and program product for designing an educational program and providing educational content
US9472114B2 (en) * 2003-05-01 2016-10-18 International Business Machines Corporation Computer-implemented method, system and program product for providing an educational program
US20050108021A1 (en) * 2003-07-31 2005-05-19 Greg Anderson System and method for routing and managing service requests
US20050191606A1 (en) * 2004-02-27 2005-09-01 Semadeni Joseph H. Method for educational development
US20060228690A1 (en) * 2005-04-08 2006-10-12 Microsoft Corporation Smart buttons: training tracker and motivator
WO2006113852A2 (en) * 2005-04-19 2006-10-26 Interactive Alchemy, Inc. System and method for adaptive electronic-based learning programs
JP2007025497A (en) * 2005-07-20 2007-02-01 Fujitsu Ltd Educational assistance program and educational assistant device
US7552199B2 (en) * 2005-09-22 2009-06-23 International Business Machines Corporation Method for automatic skill-gap evaluation
US8121985B2 (en) 2005-10-24 2012-02-21 Sap Aktiengesellschaft Delta versioning for learning objects
US7467947B2 (en) * 2005-10-24 2008-12-23 Sap Aktiengesellschaft External course catalog updates
US7840175B2 (en) 2005-10-24 2010-11-23 S&P Aktiengesellschaft Method and system for changing learning strategies
US8571462B2 (en) 2005-10-24 2013-10-29 Sap Aktiengesellschaft Method and system for constraining learning strategies
US20070118804A1 (en) * 2005-11-16 2007-05-24 Microsoft Corporation Interaction model assessment, storage and distribution
WO2007063605A1 (en) * 2005-12-02 2007-06-07 Netman Co., Ltd. Action improvement system
US8133057B2 (en) * 2006-06-30 2012-03-13 Oracle America, Inc. Method and system for providing training media to a mobile device
US20080052361A1 (en) * 2006-08-24 2008-02-28 American Express Travel Related Services Company, Inc. Method and system for managing a process through an e-mail client
US10013268B2 (en) * 2006-08-29 2018-07-03 Prometric Inc. Performance-based testing system and method employing emulation and virtualization
US20090066348A1 (en) * 2006-09-06 2009-03-12 Young Shik Shin Apparatus and method for quantitative determination of target molecules
US8212805B1 (en) 2007-01-05 2012-07-03 Kenneth Banschick System and method for parametric display of modular aesthetic designs
US20090089751A1 (en) * 2007-09-28 2009-04-02 Microsoft Corporation Exposing features of software products
WO2009098544A1 (en) * 2008-02-08 2009-08-13 Jean-Marc Satta Human capital management computer system and method
US8318482B2 (en) 2008-06-06 2012-11-27 Aurora Algae, Inc. VCP-based vectors for algal cell transformation
US10796342B1 (en) * 2008-08-18 2020-10-06 Saba Software, Inc Method and system for unified human capital management
US8644755B2 (en) 2008-09-30 2014-02-04 Sap Ag Method and system for managing learning materials presented offline
US20100169134A1 (en) * 2008-12-31 2010-07-01 Microsoft Corporation Fostering enterprise relationships
US20100184500A1 (en) * 2009-01-06 2010-07-22 Peter Beasley System and method of using gaming software technology to motivate the use of business software
US8940340B2 (en) * 2009-01-22 2015-01-27 Aurora Algae, Inc. Systems and methods for maintaining the dominance of Nannochloropsis in an algae cultivation system
US8533028B2 (en) * 2009-01-28 2013-09-10 Accenture Global Services Gmbh Method for supporting accreditation of employee based on training
US8314228B2 (en) 2009-02-13 2012-11-20 Aurora Algae, Inc. Bidirectional promoters in Nannochloropsis
US9187778B2 (en) 2009-05-04 2015-11-17 Aurora Algae, Inc. Efficient light harvesting
US8865468B2 (en) * 2009-10-19 2014-10-21 Aurora Algae, Inc. Homologous recombination in an algal nuclear genome
US8809046B2 (en) 2011-04-28 2014-08-19 Aurora Algae, Inc. Algal elongases
US8769867B2 (en) * 2009-06-16 2014-07-08 Aurora Algae, Inc. Systems, methods, and media for circulating fluid in an algae cultivation pond
US20100325948A1 (en) * 2009-06-29 2010-12-30 Mehran Parsheh Systems, methods, and media for circulating and carbonating fluid in an algae cultivation pond
US8709765B2 (en) * 2009-07-20 2014-04-29 Aurora Algae, Inc. Manipulation of an alternative respiratory pathway in photo-autotrophs
US8748160B2 (en) * 2009-12-04 2014-06-10 Aurora Alage, Inc. Backward-facing step
US20160367895A1 (en) * 2009-12-18 2016-12-22 Peter Beasley System and method of using software games to encourage use of it configuration management systems
US20110320943A1 (en) * 2010-06-29 2011-12-29 Brainstorm, Inc. Process and Apparatus for Computer Training
US8655793B2 (en) * 2011-01-03 2014-02-18 Pugazendhi Asaimuthu Web-based recruitment system
US8722359B2 (en) 2011-01-21 2014-05-13 Aurora Algae, Inc. Genes for enhanced lipid metabolism for accumulation of lipids
MX2013012565A (en) 2011-04-28 2013-11-21 Aurora Algae Inc Algal desaturases.
US8752329B2 (en) 2011-04-29 2014-06-17 Aurora Algae, Inc. Optimization of circulation of fluid in an algae cultivation pond
WO2013166065A1 (en) 2012-04-30 2013-11-07 Aurora Algae, Inc. ACP Promoter
US20140113257A1 (en) * 2012-10-18 2014-04-24 Alexey N. Spiridonov Automated evaluation of programming code
US9384671B2 (en) 2013-02-17 2016-07-05 Ronald Charles Krosky Instruction production
US20150248739A1 (en) * 2014-02-28 2015-09-03 Linkedin Corporation Recommendation system of educational opportunities to members in a social network
US20170287349A1 (en) * 2016-03-31 2017-10-05 Cae Inc. Method and system for updating a simulation plan for training personnel on system maintenance
US20160253173A1 (en) * 2016-04-07 2016-09-01 Michael Lewis Moravitz Word processing plus/basic
US20180061258A1 (en) * 2016-08-26 2018-03-01 Microsoft Technology Licensing, Llc Data driven feature discovery
US11017839B2 (en) 2017-01-13 2021-05-25 Mediatek Inc. DRAM, memory controller and associated training method
US11823588B2 (en) * 2018-01-05 2023-11-21 Autodesk, Inc. Real-time orchestration for software learning workshops
US11846967B1 (en) * 2022-11-08 2023-12-19 Whatfix Private Limited System and method for creating at least one step for providing digital guidance to an underlying application

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0602790A2 (en) * 1992-11-02 1994-06-22 BORLAND INTERNATIONAL, Inc. Directing operation of computer systems
US5388993A (en) * 1992-07-15 1995-02-14 International Business Machines Corporation Method of and system for demonstrating a computer program
US5395243A (en) * 1991-09-25 1995-03-07 National Education Training Group Interactive learning system
US5421730A (en) * 1991-11-27 1995-06-06 National Education Training Group, Inc. Interactive learning system providing user feedback
US5481667A (en) * 1992-02-13 1996-01-02 Microsoft Corporation Method and system for instructing a user of a computer system how to perform application program tasks
US5493658A (en) * 1992-03-26 1996-02-20 International Business Machines Corporation Interactive online tutorial system with monitoring function for software products
US5496177A (en) * 1993-03-23 1996-03-05 International Business Machines Corporation Method and apparatus for presenting new computer software functions to a user based upon actual usage
US5535422A (en) * 1992-03-26 1996-07-09 International Business Machines Corporation Interactive online tutorial system for software products
US5602982A (en) * 1994-09-23 1997-02-11 Kelly Properties, Inc. Universal automated training and testing software system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4622013A (en) * 1984-05-21 1986-11-11 Interactive Research Corporation Interactive software training system
US5311422A (en) * 1990-06-28 1994-05-10 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration General purpose architecture for intelligent computer-aided training
US5263167A (en) * 1991-11-22 1993-11-16 International Business Machines Corporation User interface for a relational database using a task object for defining search queries in response to a profile object which describes user proficiency
US5267865A (en) * 1992-02-11 1993-12-07 John R. Lee Interactive computer aided natural learning method and apparatus
US5302132A (en) * 1992-04-01 1994-04-12 Corder Paul R Instructional system and method for improving communication skills
US5597312A (en) * 1994-05-04 1997-01-28 U S West Technologies, Inc. Intelligent tutoring method and system
US5577186A (en) * 1994-08-01 1996-11-19 Mann, Ii; S. Edward Apparatus and method for providing a generic computerized multimedia tutorial interface for training a user on multiple applications

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5395243A (en) * 1991-09-25 1995-03-07 National Education Training Group Interactive learning system
US5421730A (en) * 1991-11-27 1995-06-06 National Education Training Group, Inc. Interactive learning system providing user feedback
US5481667A (en) * 1992-02-13 1996-01-02 Microsoft Corporation Method and system for instructing a user of a computer system how to perform application program tasks
US5493658A (en) * 1992-03-26 1996-02-20 International Business Machines Corporation Interactive online tutorial system with monitoring function for software products
US5535422A (en) * 1992-03-26 1996-07-09 International Business Machines Corporation Interactive online tutorial system for software products
US5388993A (en) * 1992-07-15 1995-02-14 International Business Machines Corporation Method of and system for demonstrating a computer program
EP0602790A2 (en) * 1992-11-02 1994-06-22 BORLAND INTERNATIONAL, Inc. Directing operation of computer systems
US5496177A (en) * 1993-03-23 1996-03-05 International Business Machines Corporation Method and apparatus for presenting new computer software functions to a user based upon actual usage
US5602982A (en) * 1994-09-23 1997-02-11 Kelly Properties, Inc. Universal automated training and testing software system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6643652B2 (en) 2000-01-14 2003-11-04 Saba Software, Inc. Method and apparatus for managing data exchange among systems in a network
US6721747B2 (en) 2000-01-14 2004-04-13 Saba Software, Inc. Method and apparatus for an information server
US6850893B2 (en) 2000-01-14 2005-02-01 Saba Software, Inc. Method and apparatus for an improved security system mechanism in a business applications management system platform
US7072934B2 (en) 2000-01-14 2006-07-04 Saba Software, Inc. Method and apparatus for a business applications server management system platform
US7089583B2 (en) 2000-01-14 2006-08-08 Saba Software, Inc. Method and apparatus for a business applications server
US10481878B2 (en) 2008-10-09 2019-11-19 Objectstore, Inc. User interface apparatus and methods
WO2020086596A3 (en) * 2018-10-25 2020-06-04 Autodesk, Inc. Techniques for analyzing the proficiency of users of software applications

Also Published As

Publication number Publication date
US5823781A (en) 1998-10-20
AU4047997A (en) 1998-02-20

Similar Documents

Publication Publication Date Title
US5823781A (en) Electronic mentor training system and method
US5800181A (en) Computer system and method for process safety management
Davis et al. Diagnosis of an information system failure: A framework and interpretive process
Panel Digital transformation: A framework for ICT literacy
US20040024569A1 (en) Performance proficiency evaluation method and system
McGraw Performance support systems: Integrating Al, hypermedia, and CBT to enhance user performance
Lauer et al. Knowledge Management Audit-a methodology and case study
JP2001501320A (en) Automated system for exam and electronic command delivery and student management
WO2006078981A2 (en) System, program products, and methods of human resource planning and development
Clegg et al. Users' reactions to information technology: some multivariate models and their implications
US20100100408A1 (en) Professional continuing competency optimizer
Borthick et al. Research on Computing in Accounting Education: Opportunities and Impediments.
US20040096811A1 (en) Computer-assisted system for designing training programs
US20030059761A1 (en) On-line homework solution system
Franklin et al. Communicating student ratings to decision makers: Design for good practice
Maslowski et al. The formative evaluation of a web-based course-management system within a university setting
Ley et al. Competency management using the competence performance approach: modeling, assessment, validation, and use
van Latum et al. No improvement without feedback: Experiences from goal-oriented measurement at schlumberger
Benford et al. Ceilidh as a course management support system
Burner From performance analysis to training needs assessment
Bernstein et al. Eliminating aversion to software process in computer science students and measuring the results
Hansen Computer-Based Adaptive Testing Models for the Air Force Technical Training Environment Phase I: Development of a Computerized Measurement System for Air Force Technical Training. AFHRL-TR-74-48.
Hansen Navy Computer Managed Instruction: Past, Present, and Future.
Freshwater Employers’ Experiences with Graduates of Industrial Systems Technology Community College Programs in Northeast Alabama: A Phenomenological Study
Rahayu et al. Application of Education Management Information System in the Learning Process at SMP Muhammadiyah Weleri

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU BR CA JP KR MX NZ

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 1998509108

Format of ref document f/p: F

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA