US20160042358A1 - Mapping user actions to historical paths to determine a predicted endpoint - Google Patents

Mapping user actions to historical paths to determine a predicted endpoint Download PDF

Info

Publication number
US20160042358A1
US20160042358A1 US14/723,698 US201514723698A US2016042358A1 US 20160042358 A1 US20160042358 A1 US 20160042358A1 US 201514723698 A US201514723698 A US 201514723698A US 2016042358 A1 US2016042358 A1 US 2016042358A1
Authority
US
United States
Prior art keywords
historical
user
endpoint
log
path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US14/723,698
Inventor
Aaron M. Cohen
Paul Komar
Shaun Ruske
Brian C. Schimpf
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Priority to US14/723,698 priority Critical patent/US20160042358A1/en
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION reassignment INTERNATIONAL BUSINESS MACHINES CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: COHEN, AARON M., KOMAR, PAUL, RUSKE, SHAUN, SCHIMPF, BRIAN C.
Publication of US20160042358A1 publication Critical patent/US20160042358A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/01Customer relationship services
    • G06Q30/015Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
    • G06Q30/016After-sales
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/02Knowledge representation; Symbolic representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/02Knowledge representation; Symbolic representation
    • G06N5/022Knowledge engineering; Knowledge acquisition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/04Inference or reasoning models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/04Inference or reasoning models
    • G06N5/048Fuzzy inferencing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network

Definitions

  • the present invention relates to user support systems, and more specifically, to support systems that help users to use computer programs.
  • Help menus commonly are provided, but sometimes the help menus themselves can be difficult to navigate. Moreover, help menus sometimes only cover basic features provided computer programs and lack instructions for implementing more advanced features. Sometimes a telephone number is provided which a user can call to request further assistance, either from an automated system or from a person manning a help desk. The solution to the user's inquiry, however, is not always easily obtained. Indeed, an automated system may not even be programmed to cover all potential feature implementations, and a person manning the help desk also may lack knowledge necessary to implement certain features in the manner in which the user wishes to use such features.
  • a method includes receiving a first signature log generated by a first processing system, the first signature log being a computer readable data structure and including a first listing of at least a recorded series of user inputs received by a computer program.
  • the method also includes comparing, by a path search engine executing using a processor, the first listing of the recorded series of user inputs to at least one historical log indicating at least one historical path, each historical path including at least second listing of a series of historical user inputs that corresponds to a historical endpoint in the computer program.
  • the method also includes, responsive to comparing the first listing of the recorded series of user inputs to the at least one historical log, identifying the at least one historical path to which the recorded series of user inputs at least partially corresponds and identifying the at least one historical endpoint as a predicted endpoint in the computer program.
  • the method also includes, selecting, based on the predicted endpoint, a predicted path corresponding to the predicted endpoint in the computer program, and outputting the predicted path.
  • FIG. 1 is a block diagram illustrating an example of a user support system.
  • FIG. 2 is a block diagram illustrating another example of a user support system.
  • FIG. 3 is a block diagram illustrating example architecture for a processing system executing one or more modules/applications of the user support system of FIG. 1 .
  • FIG. 4 is a block diagram illustrating example architecture for a client system.
  • FIG. 5 is a flow chart illustrating an example of a method of selecting a predicted path corresponding to a predicted endpoint in a computer program.
  • a user of a computer program can provide a series of user inputs to the computer program attempting to access a desired task, function or process (hereinafter “endpoint”) initiated by a computer program.
  • the user inputs can be recorded by the computer program, or another application or service, in a log file.
  • triggered events e.g., presentation of menus, etc.
  • calls exchanged between modules of a computer program, between a computer program and another computer program e.g., calls between a web browser and a web application
  • the data recorded in the log file is referred to herein as a “signature.”
  • the series of user inputs provided by the user may not result in the endpoint being initiated.
  • the signature may not lead to the desired endpoint.
  • the user then may initiate a help function of the computer program or contact a support system to request help in reaching the desired endpoint.
  • the help function or support system can compare the present signature to a historical log containing one or more historical paths.
  • Each historical path can include a listing of a series of historical user inputs that correspond to a historical endpoint in the computer program.
  • Each path also can list events triggered by the user inputs, calls, and the like.
  • each historical path can be a signature previously recorded when a historical endpoint was accessed, for example during testing or debugging of the computer program, while a support engineer was helping another user, etc.
  • one or more historical paths to which the present signature corresponds, at least in part, can be identified and one or more historical endpoints corresponding to the identified historical paths can be identified.
  • an identifier for a predicted endpoint in the computer program can be generated. For example, based on the present signature, and its determined correspondence to a plurality of historical paths, one of the corresponding historical paths can be identified as being most relevant to the signature. The historical endpoint of that historical path can be identified, and a corresponding identifier can be generated indicating that historical endpoints as a predicted endpoint.
  • a predicted path corresponding to the predicted endpoint can be selected, and the predicted path can be output. For example, the predicted path can be presented to the user or a support person helping the user.
  • processing system means a system that includes at least one processor.
  • a processing system include, but are not limited to, a server, a workstation, a desktop computer, a mobile computer, a laptop computer, a netbook computer, a tablet computer, a smart phone, a set top box, a gaming system and an internet appliance.
  • processor means at least one hardware circuit (e.g., an integrated circuit) configured to carry out instructions contained in program code.
  • a processor include, but are not limited to, a central processing unit (CPU), an array processor, a vector processor, a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA), an application specific integrated circuit (ASIC), programmable logic circuitry, and a controller.
  • a signature means a listing of a series of events detected by, or initiated by, a computer program.
  • a signature can include a listing of a series of user inputs received by a computer program, the series of user inputs entered by a user with an intent to access a desired endpoint.
  • Such signature also can include a listing of events, for example presentation of menu items, initiated by the computer program responsive to user inputs.
  • the signature further can include a listing of calls between modules of the computer program, a listing of calls between the computer program and another computer program, and the like, initiated by the computer program responsive to user inputs.
  • a signature may be stored in a log.
  • path means a signature that actually leads to a desired endpoint.
  • historical path means a path stored on a computer readable storage medium which is configured to be accessed for future processing.
  • a historical path may be contained in a historical log and may be accessed for comparison to received signature.
  • the term “user input” means an input by a user into a computer program.
  • a user input include, but are not limited to, a user selection of one or more keys of a keyboard or keypad, a user selection of a button, a user selection of an icon, key, button, field or the like presented by a graphical user interface, a user control of a mouse, touchpad, or the like, a user selection of a menu item presented by a user interface, a user entry of information into a field presented by a user interface, and detection of a user gesture (e.g., by a sensor or touch screen).
  • a user gesture e.g., by a sensor or touch screen
  • log means a computer readable data structure, formatted for interpretation by a processor, in which user inputs are recorded.
  • a log also can include a listing of events, for example presentation of menu items, initiated by a computer program responsive to the user inputs.
  • historical log means a log stored on a computer readable storage medium which is configured to be accessed for future processing.
  • endpoint means a task, function or process initiated by a computer program in response to at least one user input.
  • a user may enter a series of user inputs into a computer program with the intent to access a task, function or process.
  • historical endpoint means an endpoint led to by a historical path.
  • the term “predicted endpoint” means an endpoint predicted by a processing system as corresponding to a desired endpoint based on a series of user inputs received by a computer program.
  • predicted path means a path selected by a processing system that leads to a predicted endpoint.
  • use case means a set of conditions or variables used to determine whether a computer program, or a feature of the computer program, is working as intended.
  • a use case can be, for example, a test case.
  • the term “responsive to” means responding or reacting readily to an action or event. Thus, if a second action is performed “responsive to” a first action, there is a causal relationship between an occurrence of the first action and an occurrence of the second action, and the term “responsive to” indicates such causal relationship.
  • computer readable storage medium means a storage medium that contains or stores program code for use by or in connection with an instruction execution system, apparatus, or device.
  • a “computer readable storage medium” is not a transitory, propagating signal per se.
  • the term “substantially” means largely but not wholly. For example, if a signature log substantially matches a historical log, a large portion of events listed in the signature log may match events listed in the historical log, though there may not be a match for all events. Similarly, if a signature log substantially matches a historical log, each event listed in the signature log may match a corresponding event in the historical log, but the historical log also may lists additional events not listed in the signature log.
  • output means storing in memory elements, writing to display or other peripheral output device, sending or transmitting to another system, exporting, or the like.
  • real time means a level of processing responsiveness that a user or system senses as sufficiently immediate for a particular process or determination to be made, or that enables the processor to keep up with some external process.
  • the term “user” means a person (i.e., a human being).
  • FIG. 1 is a block diagram illustrating an example of a user support system (hereinafter “system”) 100 .
  • the system 100 can include a requirements management tool 110 and a quality management tool 120 and a path search engine 130 .
  • the requirements management tool 110 , quality management tool 120 and path search engine 130 can be software modules/applications executed by a single processing system or executed among a plurality of processing systems communicatively linked via at least one network.
  • the network is the medium used to provide communications links between various devices and data processing systems connected together within system 100 .
  • the network may include connections, such as wire, wireless communication links, or fiber optic cables.
  • the network can be implemented as, or include, any of a variety of different communication technologies such as a wide area network (WAN), a local area network (LAN), a wireless network, a mobile network, a Virtual Private Network (VPN), the Internet, the Public Switched Telephone Network (PSTN), or the like.
  • WAN wide area network
  • LAN local area network
  • VPN Virtual Private Network
  • PSTN Public Switched Telephone Network
  • the requirements management tool 110 can receive computer program requirements 112 for a computer program 140 .
  • the computer program requirements 112 can specify functionality expected of the computer program 140 , including stated requirements the computer program 140 is to achieve.
  • the computer program requirements 112 can be communicated to a quality management tool 120 .
  • use cases 122 e.g., test cases
  • use cases 122 e.g., test cases
  • one or more quality engineers can read the computer program requirements 112 and generate the use cases 122 .
  • One or more links between the computer program requirements 112 and the generated the use cases 122 can be established. Such links can indicate, for example, the status of the computer program requirements 112 with regard to the use cases 122 , how many use cases 122 have been created for each computer program requirement 112 , etc.
  • the quality management tool 120 can be accessed by one or more quality engineers to execute the use cases 122 with the computer program 140 . While executing each of the use cases 122 , the quality engineers can enter one or more user inputs with the goal of reaching a particular endpoint. The user inputs entered can be tracked and entered into a historical log 124 as a historical path. In addition, events triggered by the user inputs, calls, and the like can be tracked and entered into the historical log 124 . In one arrangement, the computer program 140 can be instrumented with program code that generates identifiers corresponding to the user inputs, events, calls, etc., and these identifiers can be stored in the historical log.
  • the historical log 124 can maintain a historical signature corresponding to the testing implemented using the use case, and the historical signature can be associated with the use case in a suitable manner. For example, and identifier indicating the use case can be included in the historical log 124 . Further, the endpoint that is reached by each particular set of user inputs can be indicted in the historical log 124 as a historical endpoint.
  • the historical log 124 generated for each use case can be stored in a suitable data structure, for example in a database, data table, or the like.
  • the path search engine 130 can be configured to receive signatures recorded by client systems while the computer program 140 is used, and search the historical logs 124 to find historical signatures that, at least in part, match the received signatures.
  • the path search engine 130 can interface with the quality management tool 120 to access the historical logs 124 , or the path search engine 130 can access the historical logs 124 directly from the data structure in which they are stored.
  • a client system 160 can execute the computer program 140 , or the client system 160 can access the computer program 140 via a network (e.g., if the computer program 140 is a web application or other computer program hosted remote to the client system 160 ).
  • a user of the client system 160 can contact the tended support system 150 to request assistance accessing a certain feature (endpoint) of the client system 160 .
  • the tended support system 150 can be a software module/application executing on a processing system that executes the path search engine 130 , or can be executed on a processing system communicatively linked to the processing system executing the path search engine 130 , for example via the network. Further, the tended support system 150 can be communicatively linked to other components of the system 100 , such as the quality management tool 120 and the path search engine 130 , via the network.
  • the user can contact the tended support system 150 via e-mail, text messaging or the like implemented via the client system 160 , or the user can place a telephone or video call to the tended support system 150 .
  • the client system 160 can be communicatively linked to the tended support system 150 via a suitable network, for example network previously described.
  • a support engineer can respond to the user's inquiry.
  • the support engineer can request that the user provide access to the computer program 140 to retrieve a signature log 162 generated in response to user inputs by the user into the computer program 140 attempting to access the feature.
  • the user can provide the requested access and the support engineer can access the signature log 162 .
  • the support engineer can instruct the user on how to send the signature log 162 , and the user can send the signature log 162 to the support engineer accordingly.
  • the signature log 162 can be a rolling log that is continuously updated each time a user enters a user input, triggers an event/action, etc.
  • the signature log 162 can list user inputs and corresponding events/actions.
  • the signature log 162 can list a user input that triggers presentation of a menu, list user inputs selecting one or more menu items from the menu, list user inputs that initiate other events/actions in the computer program, etc.
  • the signature log 162 can be arranged so that the user inputs and initiated events/actions are listed sequentially.
  • the signature log 162 also can indicate a computing environment in which the computer program 140 is being used by the client system 160 .
  • the signature log can indicate the operating system being used, hardware/software resources available and/or being used to execute the computer program 140 , etc.
  • the computer program 140 is a web application
  • the web browser executing on the client system 160 to access the computer program 140 , plugins, and the like also can be indicated in the signature log 162 .
  • the signature log 162 can be readily compared to historical paths to determine which historical path(s) correspond to the computing environment in which the computer program 140 is being used, and the endpoint the user desires to access.
  • the tended support system 150 or support engineer can parse from the signature log 162 the most recent user inputs, actions/events, etc. and include only the parsed items in the version of the signature log 162 communicated to the path search engine 130 .
  • the parsed items can be those user inputs, actions/events, etc. beginning with a user selection of a primary menu item in the computer program 140 , for instance a menu item presented by a main menu of the computer program 140 .
  • the engineer can open a support ticket with the system 100 , for example with the quality management tool 120 , and communicate the signature log 162 to the path search engine 130 .
  • the signature log 162 can be associated with the support ticket in a suitable manner. For example, when sending the signature log 162 to the path search engine 130 , the tended support system 150 can append to the signature log 162 an identifier corresponding to the support ticket.
  • the path search engine 130 can automatically compare the signature log 162 to historical logs 124 to identify one or more historical logs 124 that match, at least in part, the signature log 162 .
  • the signature log 162 does not precisely match any of the historical logs 124 , or if the signature log 162 does precisely match a particular historical log 124 , the endpoint associated with the historical log 124 may not be the user's desired endpoint.
  • a user may have started down the appropriate path to reach the desired endpoint, but may be unsure as to a next user input/selection that is required to continue along that path to reach the desired endpoint.
  • the path search engine 130 can identify not only that particular historical log 124 , but also one or more other historical logs 124 which at least partially match the signature log 162 .
  • the path search engine 130 can identify one or more other historical logs 124 that match, at least in part, the signature log 162 .
  • a historical log 124 includes a path of seven user inputs that access a particular endpoint, and the signature log 162 lists the first five of those user inputs as recently being entered by the user, that historical log 124 can be selected as potentially corresponding to the user's desired endpoint.
  • the signature log 162 lists the first five of those user inputs as recently being entered by the user
  • that historical log 124 can be selected as potentially corresponding to the user's desired endpoint.
  • the user may have entered a number of appropriate user selections, but inadvertently selected an incorrect menu item along the way.
  • the path search engine 130 can, in real time, identify the use cases 122 corresponding to the identified historical log(s) 124 , and communicate the identified historical logs 164 and corresponding use cases to the tended support system 150 . If any of the identified historical logs 164 indicate corresponding support tickets (e.g., support tickets corresponding to use cases associated with the historical logs 164 ), those support tickets also can be communicated to the tended support system 150 for presentation to the support engineer. Based on interactions with the user, the support engineer can determine what feature (endpoint) of the computer program 140 the user is attempting to access.
  • support tickets e.g., support tickets corresponding to use cases associated with the historical logs 164
  • the support engineer can ask the user “what are you trying to accomplish?” The support engineer can review the use cases and support tickets, if any, to determine whether any of the use cases actually reach the endpoint the user is trying to reach. If so, the support engineer can review the corresponding historical log and explain to the user how to reach that endpoint, or initiate communication, from the tended support system 150 to the client system 160 , a predicted path 166 the user can follow to reach the desired endpoint.
  • the path search engine 130 can identify a deviation between the signature log 162 and the historical log 164 .
  • Such deviation can be, for example, user inputs listed in the historical log 164 that are not listed in the signature log 162 , user inputs listed in the signature log 162 that are not listed in the historical log 164 , and the like.
  • the deviation can help the support engineer to identify incorrect or missing user inputs preventing the user from accessing the desired endpoint. They support engineer can convey such information to the user.
  • the support engineer can attempt to determine an appropriate path to arrive at the desired endpoint. If the support engineer is able to determine an appropriate path, the support engineer can explain the path to the user.
  • the support engineer also can initiate, via the tended support system 150 , recording of user inputs by the support engineer into the computer program 140 , as well as other events corresponding to the user inputs. When the support engineer has arrived at the desired endpoint, the support engineer can stop the recording. The recording can be processed by the tended support system 150 to determine the appropriate path (new path), for reaching the desired endpoint, and the support engineer can initiate communication of such path to the user, or instruct the user how to follow the new path.
  • the new path and corresponding endpoint can be communicated from the tended support system 150 to the quality management tool 120 , for example in a new signature log.
  • a corresponding support ticket also can be communicated to the quality management tool 120 .
  • the quality management tool 120 can generate a new historical log including the new path, as a historical path, leading to the desired endpoint, and store the new historical log with the other historical logs 124 for future reference.
  • An identifier can be added to the new historical log 124 to indicate an association (e.g., a link) between the new path and the corresponding (desired) endpoint.
  • An identifier also can be added to the newly generated historical log 124 to indicate an association (e.g., a link) between the new path and the support ticket generated for the present help session.
  • an association e.g., a link
  • the support ticket can be presented to the support engineer or the user.
  • the support ticket can provide specific information regarding the first user's issue, and may include statements by the first user as to what issue the first user encountered.
  • a corresponding use case can be automatically generated and stored with the use cases 122 .
  • the use case can, for example, identify the corresponding endpoint and indicate the functionality provided by the endpoint.
  • the use case also can provide instructions on how to follow the intended path.
  • the corresponding use case can be included with the use cases identified by the path search engine 130 .
  • the present operations can create a linkage between support tickets and use cases 122 , as well as requirements upon which use cases 122 are generated.
  • support engineers and/or users can retrieve use cases 122 , as well as associated requirements, corresponding to support tickets, and support engineers and/or users can retrieve support tickets corresponding to use cases 122 .
  • This linkage can greatly enhance operation of the system 100 , improving support provided to users.
  • the signature log 162 can indicate user inputs, actions/events, etc. that define a path that should lead to the desired endpoint, but does not due to some defect (e.g., bug) in the computer program 140 .
  • the path/point information 168 communicated to the quality management tool 120 can indicate such defect. Based on such indication, the quality management tool 120 can automatically generate a defect notification and communicate that notification to a system (not shown) that tracks software defects, and a corrective action notification can be generated. Further, the support engineer can work with the user to find an alternate path to the desired endpoint. If such alternate path is found, the path/endpoint 168 information for that path also can be communicated to the quality management tool 120 . Further, the corresponding support ticket generated for the present issue can include notes and/or statements by the user and/or support engineer regarding the issue being resolved, including what user inputs, events/actions, etc. were tried, specific problems/error messages encountered, etc.
  • FIG. 2 is a block diagram illustrating another example of a user support system 200 .
  • the user and/or client system 160 can contact an automated support system 250 .
  • the automated support system 250 can be a software module/application executing on a processing system that executes the path search engine 130 , or can be executed on a processing system communicatively linked to the processing system executing the path search engine 130 , for example via the network.
  • the automated support system 250 can be communicatively linked to other components of the system 200 , such as the quality management tool 120 and the path search engine 130 , via the network.
  • the client system 160 can be communicatively linked to the automated support system 250 a suitable network, such as that previously described.
  • the user/client system 160 can contact the automated support system 250 via a help menu presented by the computer program 140 , via a web page presented by the automated support system 250 accessed by the user/client system 160 , or the user/client system 160 can contact the automated support system 250 in any other suitable manner.
  • the system 200 can implement the functions/processes previously described for FIG. 1 , though the automated support system 250 can automatically implement functions previously described.
  • the automated support system 250 can prompt the user/client system 160 to communicate the signature log 162 to the automated support system 250 .
  • the computer program 140 or another application or service, can communicate the signature log 162 to the automated support system 250 .
  • the path search engine 130 can communicate to the automated support system 250 the identified historical logs/use cases 164 .
  • Each historical log can identify a historical endpoint to which the use case corresponds. From among the identified historical logs/use cases 164 , the automated support system 250 can select one of the historical logs 164 that most closely matches the signature log 162 . The automated support system 250 then can communicate with the client system 160 to present a message to a user, for example via the user interface of the client system 160 , indicating the corresponding use case and prompting the user to enter a user input indicating whether that use case corresponds to the user's desired endpoint.
  • the historical endpoint corresponding to the historical log 124 /use case can be identified as a predicted endpoint since that endpoint is identified by comparing the signature log 162 to the historical logs 124 .
  • the message can state “Based on your recent actions you may be trying to setup a new project team in the repository. Is that correct?” Buttons or icons corresponding to “Yes” and “No” also can be presented with the message. If the user selects the “Yes” button, the automated support system 250 can identify the corresponding predicted endpoint and select the predicted path 166 that is followed to arrive at the predicted endpoint. The automated support system 250 can communicate to the client. In this regard, the predicted path 166 can include instructions (e.g., guidance) for accessing the predicted endpoint.
  • the predicted path 166 can include a statement “You need to establish a connection to the database before you can take this action.”
  • the predicted path 166 can include, or provide a link to, instructions that explain how to make the connection to the database.
  • the automated support system 250 can access user permissions corresponding to the user of the client system 160 and, based on the user permissions, determine whether the user has the necessary privileges to implement the actions/events indicted by the predicted path 166 . For instance, if a connection to a database is required, the automated support system 250 can determine whether the user is assigned the privileges necessary to establish the connection to the database. If not, the message presented to the user can state, for example, “You do not have the required permissions to do this, you need Admin privilege on the project area.”
  • the automated support system 250 can select a historical log 164 that next closely matches the signature log 162 .
  • the automated support system 250 can again present, via the client system 160 , a corresponding message to the user asking the user whether the use case corresponding to that historical log 164 corresponds to the user's desired endpoint, and prompting the user for a response. Again, based on the user's input, a next course of action can be implemented. This process can continue until the user selects “Yes” for a particular use case, or all use cases corresponding to the identified historical logs 164 have been presented to the user.
  • each of the use cases can be presented to the user in a message, and the user can be prompted to select one of the use cases or select a button or icon indicating that none of the use cases correspond to the desired endpoint.
  • the corresponding historical endpoint can be identified as a predicted endpoint, and the predicted path 166 to arrive at the predicted endpoint can be selected and communicated to the user/client system 160 .
  • the automated support system 250 can escalate the user's inquiry. For example, the automated support system 250 can transfer the inquiry to the tended support system 150 of FIG. 1 , and a support engineer can interact with the user to attempt to guide the user to the desired endpoint. Again, if the support engineer finds a suitable path to the endpoint, that path/endpoint 168 ( FIG. 1 ) can be communicated to the quality management tool 120 , as previously described.
  • the signature log 162 can indicate a path that should be valid, but is not valid due to a defect in the computer program 140 .
  • the path search engine 130 can identify the endpoint that should correspond to the signature log 162 , and select another path/use case that arrives at the same endpoint.
  • the path search engine 130 can communicate the other path/use case to the automated support system 250 .
  • the automated support system 250 can communicate the predicted path 166 to the user/client system 160 as an alternate path the user should use to reach the desired endpoint.
  • the historical log 124 that corresponds to the signature log 162 can identify a support ticket corresponding to an instance when it was discovered that the path that should be valid was discovered to be invalid due to the software defect.
  • the path search engine 130 can communicate that support ticket to the automated support system 250 , which can communicate the support ticket, or a portion thereof, to the user/client system 160 .
  • the user can evaluate the support ticket to determine a further course of action to access the desired endpoint.
  • FIG. 3 is a block diagram illustrating example architecture for a processing system 300 executing one or more modules/applications of the user support system 100 of FIG. 1 .
  • the processing system 300 can include at least one processor 305 (e.g., a central processing unit) coupled to memory elements 310 through a system bus 315 or other suitable circuitry.
  • the processing system 300 can store program code within the memory elements 310 .
  • the processor 305 can execute the program code accessed from the memory elements 310 via the system bus 315 .
  • the processing system 300 can be implemented in the form of any system including a processor and memory that is capable of performing the functions and/or operations described within this specification.
  • the processing system 300 can be implemented as a server.
  • the memory elements 310 can include one or more physical memory devices such as, for example, local memory 320 and one or more bulk storage devices 325 .
  • Local memory 320 refers to random access memory (RAM) or other non-persistent memory device(s) generally used during actual execution of the program code.
  • the bulk storage device(s) 325 can be implemented as a hard disk drive (HDD), solid state drive (SSD), or other persistent data storage device.
  • the processing system 300 also can include one or more cache memories (not shown) that provide temporary storage of at least some program code in order to reduce the number of times program code must be retrieved from the bulk storage device 325 during execution.
  • One or more network adapters 330 also can be coupled to processing system 300 to enable processing system 300 to become coupled to other systems, computer systems, remote printers, and/or remote storage devices through intervening private or public networks.
  • Modems, cable modems, transceivers, and Ethernet cards are examples of different types of network adapters 330 that can be used with the processing system 300 .
  • the memory elements 310 can store the components of the system 100 of FIG. 1 , namely the requirements management tool 110 , the quality management tool 120 , the path search engine 130 and the tended support system 150 .
  • the memory elements also can store the automated support system 250 of FIG. 2 . Being implemented in the form of executable program code, these components of the processing system 300 (or system 200 ) can be executed by the processing system 300 and, as such, can be considered part of the processing system 300 .
  • the requirements management tool 110 , the quality management tool 120 , the path search engine 130 and the support system(s) 150 , 250 including any parameters, data and/or attributes utilized by such components, are functional data structures that impart functionality when employed as part of the processing system 300 of FIG. 3 .
  • the requirements management tool 110 the quality management tool 120 , the path search engine 130 and the support system(s) 150 , 250 each be executed on the same processing system 300 .
  • the processing system 300 can execute one or more of these components 110 , 120 , 130 , 150 , 250 , and one or more other processing systems can execute other components.
  • FIG. 4 is a block diagram illustrating example architecture for a client system 160 .
  • the client system 160 can include at least one processor 405 (e.g., a central processing unit) coupled to memory elements 410 through a system bus 415 or other suitable circuitry.
  • the client system 160 can store program code within the memory elements 410 .
  • the processor 405 can execute the program code accessed from the memory elements 410 via the system bus 415 .
  • the client system 160 can be implemented in the form of any system including a processor and memory that is capable of performing the functions and/or operations described within this specification.
  • the client system 160 can be implemented as a computer, a workstation, a mobile computer, a laptop computer, a tablet computer, a smart phone, a personal digital assistant, a gaming device, an appliance, and so on.
  • the memory elements 410 can include one or more physical memory devices such as, for example, local memory 420 and one or more bulk storage devices 425 .
  • the client system 160 also can include one or more cache memories (not shown) that provide temporary storage of at least some program code in order to reduce the number of times program code must be retrieved from the bulk storage device 425 during execution.
  • I/O devices such as a display 430 , a pointing device 435 and, optionally, a keyboard 440 can be coupled to the client system 160 .
  • the I/O devices can be coupled to the client system 160 either directly or through intervening I/O controllers.
  • the display 430 can be coupled to the client system 160 via a graphics processing unit (GPU), which may be a component of the processor 405 or a discrete device.
  • graphics processing unit GPU
  • One or more network adapters 445 also can be coupled to client system 160 to enable client system 160 to become coupled to other systems, computer systems, remote printers, and/or remote storage devices through intervening private or public networks. Modems, cable modems, transceivers, and Ethernet cards are examples of different types of network adapters 445 that can be used with the client system 160 .
  • the memory elements 410 can store the computer program 140 (e.g., an instance of the computer program 140 being used by the client system 160 ).
  • the memory elements 410 can store a web browser or other suitable application configured to access the computer program 140 from a remote system.
  • the computer program 140 can be a web application accessed by the client system 160 .
  • these components of the client system 160 can be executed by the client system 160 and, as such, can be considered part of the client system 160 .
  • the signature log 162 generated by the client system 160 is a functional data structure that imparts functionality when employed as part of the systems 100 , 200 of FIGS. 1 and 2 .
  • FIG. 5 is a flow chart illustrating an example of a method 500 of selecting a predicted path corresponding to a predicted endpoint in a computer program.
  • a first signature generated by a first processing system can be received.
  • the first signature log is a computer readable data structure and includes a first listing of at least a recorded series of user inputs received by a computer program.
  • a path search engine executed using a processor can compare the recorded series of user inputs to at least one historical log indicating at least one historical path.
  • Each historical path includes at least second listing of a series of historical user inputs that corresponds to a historical endpoint in the computer program.
  • At step 515 responsive to comparing the first listing of the recorded series of user inputs to the at least one historical log, at least one historical path to which the recorded series of user inputs at least partially corresponds can be identified.
  • the least one historical endpoint can be identified as a predicted endpoint in the computer program.
  • a predicted path corresponding to the predicted endpoint in the computer program can be selected based on the predicted endpoint.
  • the predicted path can be output. For instance, the predicted path can be output for presentation to a user.
  • the present invention may be a system, a method, and/or a computer program product.
  • the computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
  • the computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device.
  • the computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
  • a non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or Flash memory erasable programmable read-only memory
  • SRAM static random access memory
  • CD-ROM compact disc read-only memory
  • DVD digital versatile disk
  • memory stick a floppy disk
  • a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon
  • a computer readable storage medium is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
  • Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network.
  • the network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
  • Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
  • the computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the figures.
  • two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • the term “plurality,” as used herein, is defined as two or more than two.
  • the term “another,” as used herein, is defined as at least a second or more.
  • the term “coupled,” as used herein, is defined as connected, whether directly without any intervening elements or indirectly with one or more intervening elements, unless otherwise indicated. Two elements also can be coupled mechanically, electrically, or communicatively linked through a communication channel, pathway, network, or system.
  • the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will also be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms, as these terms are only used to distinguish one element from another unless stated otherwise or the context indicates otherwise.
  • if may be construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context.
  • phrase “if it is determined” or “if [a stated condition or event] is detected” may be construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.

Abstract

A first signature log generated by a first processing system is received. A first listing of the recorded series of user inputs included in the signature log is compared to at least one historical log indicating at least one historical path, each historical path including at least second listing of a series of historical user inputs that corresponds to a historical endpoint in the computer program. Responsive to comparing the first listing of the recorded series of user inputs to the at least one historical log, the historical path to which the recorded series of user inputs at least partially corresponds is identified and the at least one historical endpoint is identified as a predicted endpoint in the computer program. Based on the predicted endpoint, a predicted path corresponding to the predicted endpoint in the computer program is selected and output.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a Continuation of U.S. application Ser. No. 14/456,105, filed on Aug. 11, 2014, the entirety of which is incorporated herein by reference.
  • BACKGROUND
  • The present invention relates to user support systems, and more specifically, to support systems that help users to use computer programs.
  • Computer programs, such as applications, operating systems, and the like, oftentimes are very complex. Users who are new to the products typically lack knowledge required to access certain features of the products. Help menus commonly are provided, but sometimes the help menus themselves can be difficult to navigate. Moreover, help menus sometimes only cover basic features provided computer programs and lack instructions for implementing more advanced features. Sometimes a telephone number is provided which a user can call to request further assistance, either from an automated system or from a person manning a help desk. The solution to the user's inquiry, however, is not always easily obtained. Indeed, an automated system may not even be programmed to cover all potential feature implementations, and a person manning the help desk also may lack knowledge necessary to implement certain features in the manner in which the user wishes to use such features.
  • SUMMARY
  • A method includes receiving a first signature log generated by a first processing system, the first signature log being a computer readable data structure and including a first listing of at least a recorded series of user inputs received by a computer program. The method also includes comparing, by a path search engine executing using a processor, the first listing of the recorded series of user inputs to at least one historical log indicating at least one historical path, each historical path including at least second listing of a series of historical user inputs that corresponds to a historical endpoint in the computer program. The method also includes, responsive to comparing the first listing of the recorded series of user inputs to the at least one historical log, identifying the at least one historical path to which the recorded series of user inputs at least partially corresponds and identifying the at least one historical endpoint as a predicted endpoint in the computer program. The method also includes, selecting, based on the predicted endpoint, a predicted path corresponding to the predicted endpoint in the computer program, and outputting the predicted path.
  • BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
  • FIG. 1 is a block diagram illustrating an example of a user support system.
  • FIG. 2 is a block diagram illustrating another example of a user support system.
  • FIG. 3 is a block diagram illustrating example architecture for a processing system executing one or more modules/applications of the user support system of FIG. 1.
  • FIG. 4 is a block diagram illustrating example architecture for a client system.
  • FIG. 5 is a flow chart illustrating an example of a method of selecting a predicted path corresponding to a predicted endpoint in a computer program.
  • DETAILED DESCRIPTION
  • While the disclosure concludes with claims defining novel features, it is believed that the various features described herein will be better understood from a consideration of the description in conjunction with the drawings. The process(es), machine(s), manufacture(s) and any variations thereof described within this disclosure are provided for purposes of illustration. Any specific structural and functional details described are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the features described in virtually any appropriately detailed structure. Further, the terms and phrases used within this disclosure are not intended to be limiting, but rather to provide an understandable description of the features described.
  • This disclosure relates to user support systems, and more specifically, to support systems that help users to use computer programs. In accordance with arrangements described herein, a user of a computer program can provide a series of user inputs to the computer program attempting to access a desired task, function or process (hereinafter “endpoint”) initiated by a computer program. The user inputs can be recorded by the computer program, or another application or service, in a log file. Further, triggered events (e.g., presentation of menus, etc.), calls exchanged between modules of a computer program, between a computer program and another computer program (e.g., calls between a web browser and a web application), and the like also can be recorded in the log file. The data recorded in the log file is referred to herein as a “signature.” The series of user inputs provided by the user, however, may not result in the endpoint being initiated. For example, the signature may not lead to the desired endpoint. The user then may initiate a help function of the computer program or contact a support system to request help in reaching the desired endpoint.
  • The help function or support system can compare the present signature to a historical log containing one or more historical paths. Each historical path can include a listing of a series of historical user inputs that correspond to a historical endpoint in the computer program. Each path also can list events triggered by the user inputs, calls, and the like. In this regard, each historical path can be a signature previously recorded when a historical endpoint was accessed, for example during testing or debugging of the computer program, while a support engineer was helping another user, etc.
  • Responsive to comparing the present signature to the historical log, one or more historical paths to which the present signature corresponds, at least in part, can be identified and one or more historical endpoints corresponding to the identified historical paths can be identified. Further, an identifier for a predicted endpoint in the computer program can be generated. For example, based on the present signature, and its determined correspondence to a plurality of historical paths, one of the corresponding historical paths can be identified as being most relevant to the signature. The historical endpoint of that historical path can be identified, and a corresponding identifier can be generated indicating that historical endpoints as a predicted endpoint. Based on the predicted endpoint, a predicted path corresponding to the predicted endpoint can be selected, and the predicted path can be output. For example, the predicted path can be presented to the user or a support person helping the user.
  • Several definitions that apply throughout this document now will be presented.
  • As defined herein, the term processing system means a system that includes at least one processor. Examples of a processing system include, but are not limited to, a server, a workstation, a desktop computer, a mobile computer, a laptop computer, a netbook computer, a tablet computer, a smart phone, a set top box, a gaming system and an internet appliance.
  • As defined herein, the term “processor” means at least one hardware circuit (e.g., an integrated circuit) configured to carry out instructions contained in program code. Examples of a processor include, but are not limited to, a central processing unit (CPU), an array processor, a vector processor, a digital signal processor (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA), an application specific integrated circuit (ASIC), programmable logic circuitry, and a controller.
  • As defined herein, the term “signature” means a listing of a series of events detected by, or initiated by, a computer program. For example, a signature can include a listing of a series of user inputs received by a computer program, the series of user inputs entered by a user with an intent to access a desired endpoint. Such signature also can include a listing of events, for example presentation of menu items, initiated by the computer program responsive to user inputs. The signature further can include a listing of calls between modules of the computer program, a listing of calls between the computer program and another computer program, and the like, initiated by the computer program responsive to user inputs. A signature may be stored in a log.
  • As defined herein, the term “path” means a signature that actually leads to a desired endpoint.
  • As defined herein, the term “historical path” means a path stored on a computer readable storage medium which is configured to be accessed for future processing. For example, a historical path may be contained in a historical log and may be accessed for comparison to received signature.
  • As defined herein, the term “user input” means an input by a user into a computer program. Examples of a user input include, but are not limited to, a user selection of one or more keys of a keyboard or keypad, a user selection of a button, a user selection of an icon, key, button, field or the like presented by a graphical user interface, a user control of a mouse, touchpad, or the like, a user selection of a menu item presented by a user interface, a user entry of information into a field presented by a user interface, and detection of a user gesture (e.g., by a sensor or touch screen).
  • As defined herein, the term “log” means a computer readable data structure, formatted for interpretation by a processor, in which user inputs are recorded. A log also can include a listing of events, for example presentation of menu items, initiated by a computer program responsive to the user inputs.
  • As defined herein, the term “historical log” means a log stored on a computer readable storage medium which is configured to be accessed for future processing.
  • As defined herein, the term “endpoint” means a task, function or process initiated by a computer program in response to at least one user input. In illustration, a user may enter a series of user inputs into a computer program with the intent to access a task, function or process.
  • As defined herein, the term “historical endpoint” means an endpoint led to by a historical path.
  • As defined herein, the term “predicted endpoint” means an endpoint predicted by a processing system as corresponding to a desired endpoint based on a series of user inputs received by a computer program.
  • As defined herein, the term “predicted path” means a path selected by a processing system that leads to a predicted endpoint.
  • As defined herein, the term “use case” means a set of conditions or variables used to determine whether a computer program, or a feature of the computer program, is working as intended. A use case can be, for example, a test case.
  • As defined herein, the term “responsive to” means responding or reacting readily to an action or event. Thus, if a second action is performed “responsive to” a first action, there is a causal relationship between an occurrence of the first action and an occurrence of the second action, and the term “responsive to” indicates such causal relationship.
  • As defined herein, the term “computer readable storage medium” means a storage medium that contains or stores program code for use by or in connection with an instruction execution system, apparatus, or device. As defined herein, a “computer readable storage medium” is not a transitory, propagating signal per se.
  • As defined herein, the term “substantially” means largely but not wholly. For example, if a signature log substantially matches a historical log, a large portion of events listed in the signature log may match events listed in the historical log, though there may not be a match for all events. Similarly, if a signature log substantially matches a historical log, each event listed in the signature log may match a corresponding event in the historical log, but the historical log also may lists additional events not listed in the signature log.
  • As defined herein, the term “output” means storing in memory elements, writing to display or other peripheral output device, sending or transmitting to another system, exporting, or the like.
  • As defined herein, the term “real time” means a level of processing responsiveness that a user or system senses as sufficiently immediate for a particular process or determination to be made, or that enables the processor to keep up with some external process.
  • As defined herein, the term “automatically” means without user intervention.
  • As defined herein, the term “user” means a person (i.e., a human being).
  • FIG. 1 is a block diagram illustrating an example of a user support system (hereinafter “system”) 100. The system 100 can include a requirements management tool 110 and a quality management tool 120 and a path search engine 130. The requirements management tool 110, quality management tool 120 and path search engine 130 can be software modules/applications executed by a single processing system or executed among a plurality of processing systems communicatively linked via at least one network. The network is the medium used to provide communications links between various devices and data processing systems connected together within system 100. The network may include connections, such as wire, wireless communication links, or fiber optic cables. The network can be implemented as, or include, any of a variety of different communication technologies such as a wide area network (WAN), a local area network (LAN), a wireless network, a mobile network, a Virtual Private Network (VPN), the Internet, the Public Switched Telephone Network (PSTN), or the like.
  • The requirements management tool 110 can receive computer program requirements 112 for a computer program 140. The computer program requirements 112 can specify functionality expected of the computer program 140, including stated requirements the computer program 140 is to achieve. The computer program requirements 112 can be communicated to a quality management tool 120. In addition, use cases 122 (e.g., test cases) based on the computer program requirements 112 can be generated and communicated to the quality management tool 120. By way of example, one or more quality engineers can read the computer program requirements 112 and generate the use cases 122. One or more links between the computer program requirements 112 and the generated the use cases 122 can be established. Such links can indicate, for example, the status of the computer program requirements 112 with regard to the use cases 122, how many use cases 122 have been created for each computer program requirement 112, etc.
  • The quality management tool 120, or another application/service to which the quality management tool 120 is communicatively linked, can be accessed by one or more quality engineers to execute the use cases 122 with the computer program 140. While executing each of the use cases 122, the quality engineers can enter one or more user inputs with the goal of reaching a particular endpoint. The user inputs entered can be tracked and entered into a historical log 124 as a historical path. In addition, events triggered by the user inputs, calls, and the like can be tracked and entered into the historical log 124. In one arrangement, the computer program 140 can be instrumented with program code that generates identifiers corresponding to the user inputs, events, calls, etc., and these identifiers can be stored in the historical log. Regardless, the historical log 124 can maintain a historical signature corresponding to the testing implemented using the use case, and the historical signature can be associated with the use case in a suitable manner. For example, and identifier indicating the use case can be included in the historical log 124. Further, the endpoint that is reached by each particular set of user inputs can be indicted in the historical log 124 as a historical endpoint. The historical log 124 generated for each use case can be stored in a suitable data structure, for example in a database, data table, or the like.
  • The path search engine 130 can be configured to receive signatures recorded by client systems while the computer program 140 is used, and search the historical logs 124 to find historical signatures that, at least in part, match the received signatures. For example, the path search engine 130 can interface with the quality management tool 120 to access the historical logs 124, or the path search engine 130 can access the historical logs 124 directly from the data structure in which they are stored.
  • In illustration, a client system 160 can execute the computer program 140, or the client system 160 can access the computer program 140 via a network (e.g., if the computer program 140 is a web application or other computer program hosted remote to the client system 160). A user of the client system 160 can contact the tended support system 150 to request assistance accessing a certain feature (endpoint) of the client system 160. The tended support system 150 can be a software module/application executing on a processing system that executes the path search engine 130, or can be executed on a processing system communicatively linked to the processing system executing the path search engine 130, for example via the network. Further, the tended support system 150 can be communicatively linked to other components of the system 100, such as the quality management tool 120 and the path search engine 130, via the network.
  • The user can contact the tended support system 150 via e-mail, text messaging or the like implemented via the client system 160, or the user can place a telephone or video call to the tended support system 150. In this regard, the client system 160 can be communicatively linked to the tended support system 150 via a suitable network, for example network previously described. In any case, a support engineer can respond to the user's inquiry. In one arrangement, the support engineer can request that the user provide access to the computer program 140 to retrieve a signature log 162 generated in response to user inputs by the user into the computer program 140 attempting to access the feature. The user can provide the requested access and the support engineer can access the signature log 162. In another arrangement, the support engineer can instruct the user on how to send the signature log 162, and the user can send the signature log 162 to the support engineer accordingly.
  • The signature log 162 can be a rolling log that is continuously updated each time a user enters a user input, triggers an event/action, etc. For example, the signature log 162 can list user inputs and corresponding events/actions. For example, the signature log 162 can list a user input that triggers presentation of a menu, list user inputs selecting one or more menu items from the menu, list user inputs that initiate other events/actions in the computer program, etc. The signature log 162 can be arranged so that the user inputs and initiated events/actions are listed sequentially. The signature log 162 also can indicate a computing environment in which the computer program 140 is being used by the client system 160. For example, the signature log can indicate the operating system being used, hardware/software resources available and/or being used to execute the computer program 140, etc. In the case that the computer program 140 is a web application, the web browser executing on the client system 160 to access the computer program 140, plugins, and the like, also can be indicated in the signature log 162. Accordingly, the signature log 162 can be readily compared to historical paths to determine which historical path(s) correspond to the computing environment in which the computer program 140 is being used, and the endpoint the user desires to access.
  • In one aspect, the tended support system 150 or support engineer can parse from the signature log 162 the most recent user inputs, actions/events, etc. and include only the parsed items in the version of the signature log 162 communicated to the path search engine 130. For example, the parsed items can be those user inputs, actions/events, etc. beginning with a user selection of a primary menu item in the computer program 140, for instance a menu item presented by a main menu of the computer program 140.
  • Via the tended support system 150, the engineer can open a support ticket with the system 100, for example with the quality management tool 120, and communicate the signature log 162 to the path search engine 130. The signature log 162 can be associated with the support ticket in a suitable manner. For example, when sending the signature log 162 to the path search engine 130, the tended support system 150 can append to the signature log 162 an identifier corresponding to the support ticket.
  • The path search engine 130 can automatically compare the signature log 162 to historical logs 124 to identify one or more historical logs 124 that match, at least in part, the signature log 162. In this regard, because the user was not able to access the desired feature (endpoint), it may be the case that the signature log 162 does not precisely match any of the historical logs 124, or if the signature log 162 does precisely match a particular historical log 124, the endpoint associated with the historical log 124 may not be the user's desired endpoint. Moreover, a user may have started down the appropriate path to reach the desired endpoint, but may be unsure as to a next user input/selection that is required to continue along that path to reach the desired endpoint. Thus, even if the signature log 162 does precisely match a particular historical log 124, the path search engine 130 can identify not only that particular historical log 124, but also one or more other historical logs 124 which at least partially match the signature log 162. For instance, the path search engine 130 can identify one or more other historical logs 124 that match, at least in part, the signature log 162.
  • In illustration, if a historical log 124 includes a path of seven user inputs that access a particular endpoint, and the signature log 162 lists the first five of those user inputs as recently being entered by the user, that historical log 124 can be selected as potentially corresponding to the user's desired endpoint. Similarly, if all but a small number of the user inputs recently entered by the user match the path of the historical log 124, that historical log 124 can be selected as potentially corresponding to the user's desired endpoint. For example, the user may have entered a number of appropriate user selections, but inadvertently selected an incorrect menu item along the way.
  • The path search engine 130 can, in real time, identify the use cases 122 corresponding to the identified historical log(s) 124, and communicate the identified historical logs 164 and corresponding use cases to the tended support system 150. If any of the identified historical logs 164 indicate corresponding support tickets (e.g., support tickets corresponding to use cases associated with the historical logs 164), those support tickets also can be communicated to the tended support system 150 for presentation to the support engineer. Based on interactions with the user, the support engineer can determine what feature (endpoint) of the computer program 140 the user is attempting to access. For example, the support engineer can ask the user “what are you trying to accomplish?” The support engineer can review the use cases and support tickets, if any, to determine whether any of the use cases actually reach the endpoint the user is trying to reach. If so, the support engineer can review the corresponding historical log and explain to the user how to reach that endpoint, or initiate communication, from the tended support system 150 to the client system 160, a predicted path 166 the user can follow to reach the desired endpoint.
  • In one arrangement, for each identified historical log 164, the path search engine 130 can identify a deviation between the signature log 162 and the historical log 164. Such deviation can be, for example, user inputs listed in the historical log 164 that are not listed in the signature log 162, user inputs listed in the signature log 162 that are not listed in the historical log 164, and the like. The deviation can help the support engineer to identify incorrect or missing user inputs preventing the user from accessing the desired endpoint. They support engineer can convey such information to the user.
  • In some cases, there may not be a use case 122 which arrives at the desired endpoint. Nonetheless, based on the use cases that are identified, the support engineer can attempt to determine an appropriate path to arrive at the desired endpoint. If the support engineer is able to determine an appropriate path, the support engineer can explain the path to the user. The support engineer also can initiate, via the tended support system 150, recording of user inputs by the support engineer into the computer program 140, as well as other events corresponding to the user inputs. When the support engineer has arrived at the desired endpoint, the support engineer can stop the recording. The recording can be processed by the tended support system 150 to determine the appropriate path (new path), for reaching the desired endpoint, and the support engineer can initiate communication of such path to the user, or instruct the user how to follow the new path.
  • Further, the new path and corresponding endpoint can be communicated from the tended support system 150 to the quality management tool 120, for example in a new signature log. A corresponding support ticket also can be communicated to the quality management tool 120. The quality management tool 120 can generate a new historical log including the new path, as a historical path, leading to the desired endpoint, and store the new historical log with the other historical logs 124 for future reference. An identifier can be added to the new historical log 124 to indicate an association (e.g., a link) between the new path and the corresponding (desired) endpoint. An identifier also can be added to the newly generated historical log 124 to indicate an association (e.g., a link) between the new path and the support ticket generated for the present help session. Thus, if the historical log 124, or the new use case, is accessed as some future point in time to help another user, the support ticket can be presented to the support engineer or the user. The support ticket can provide specific information regarding the first user's issue, and may include statements by the first user as to what issue the first user encountered.
  • Moreover, a corresponding use case can be automatically generated and stored with the use cases 122. The use case can, for example, identify the corresponding endpoint and indicate the functionality provided by the endpoint. The use case also can provide instructions on how to follow the intended path. Thus, if other users contact the support system 150, and their signature logs match, at least in part (e.g., substantially), the generated historical path, the corresponding use case can be included with the use cases identified by the path search engine 130. In this regard, the present operations can create a linkage between support tickets and use cases 122, as well as requirements upon which use cases 122 are generated. Accordingly, support engineers and/or users can retrieve use cases 122, as well as associated requirements, corresponding to support tickets, and support engineers and/or users can retrieve support tickets corresponding to use cases 122. This linkage can greatly enhance operation of the system 100, improving support provided to users.
  • In one arrangement, the signature log 162 can indicate user inputs, actions/events, etc. that define a path that should lead to the desired endpoint, but does not due to some defect (e.g., bug) in the computer program 140. The path/point information 168 communicated to the quality management tool 120 can indicate such defect. Based on such indication, the quality management tool 120 can automatically generate a defect notification and communicate that notification to a system (not shown) that tracks software defects, and a corrective action notification can be generated. Further, the support engineer can work with the user to find an alternate path to the desired endpoint. If such alternate path is found, the path/endpoint 168 information for that path also can be communicated to the quality management tool 120. Further, the corresponding support ticket generated for the present issue can include notes and/or statements by the user and/or support engineer regarding the issue being resolved, including what user inputs, events/actions, etc. were tried, specific problems/error messages encountered, etc.
  • FIG. 2 is a block diagram illustrating another example of a user support system 200. In FIG. 2, rather than the client system 160 or user contacting the tended support system 150 of FIG. 1, the user and/or client system 160 can contact an automated support system 250. Again, the automated support system 250 can be a software module/application executing on a processing system that executes the path search engine 130, or can be executed on a processing system communicatively linked to the processing system executing the path search engine 130, for example via the network. Further, the automated support system 250 can be communicatively linked to other components of the system 200, such as the quality management tool 120 and the path search engine 130, via the network. Also, the client system 160 can be communicatively linked to the automated support system 250 a suitable network, such as that previously described.
  • In operation, the user/client system 160 can contact the automated support system 250 via a help menu presented by the computer program 140, via a web page presented by the automated support system 250 accessed by the user/client system 160, or the user/client system 160 can contact the automated support system 250 in any other suitable manner. The system 200 can implement the functions/processes previously described for FIG. 1, though the automated support system 250 can automatically implement functions previously described. In one arrangement, the automated support system 250 can prompt the user/client system 160 to communicate the signature log 162 to the automated support system 250. In another arrangement, the computer program 140, or another application or service, can communicate the signature log 162 to the automated support system 250.
  • In one aspect, when a plurality of logs/use cases 164 are identified by the path search engine 130 responsive to processing the signature log 162, the path search engine 130 can communicate to the automated support system 250 the identified historical logs/use cases 164. Each historical log can identify a historical endpoint to which the use case corresponds. From among the identified historical logs/use cases 164, the automated support system 250 can select one of the historical logs 164 that most closely matches the signature log 162. The automated support system 250 then can communicate with the client system 160 to present a message to a user, for example via the user interface of the client system 160, indicating the corresponding use case and prompting the user to enter a user input indicating whether that use case corresponds to the user's desired endpoint. The historical endpoint corresponding to the historical log 124/use case can be identified as a predicted endpoint since that endpoint is identified by comparing the signature log 162 to the historical logs 124.
  • By way example, if the use case corresponding to the historical log is configured to set up a new project team in a repository, the message can state “Based on your recent actions you may be trying to setup a new project team in the repository. Is that correct?” Buttons or icons corresponding to “Yes” and “No” also can be presented with the message. If the user selects the “Yes” button, the automated support system 250 can identify the corresponding predicted endpoint and select the predicted path 166 that is followed to arrive at the predicted endpoint. The automated support system 250 can communicate to the client. In this regard, the predicted path 166 can include instructions (e.g., guidance) for accessing the predicted endpoint. For example, the predicted path 166 can include a statement “You need to establish a connection to the database before you can take this action.” Optionally, the predicted path 166 can include, or provide a link to, instructions that explain how to make the connection to the database. In another aspect, the automated support system 250 can access user permissions corresponding to the user of the client system 160 and, based on the user permissions, determine whether the user has the necessary privileges to implement the actions/events indicted by the predicted path 166. For instance, if a connection to a database is required, the automated support system 250 can determine whether the user is assigned the privileges necessary to establish the connection to the database. If not, the message presented to the user can state, for example, “You do not have the required permissions to do this, you need Admin privilege on the project area.”
  • If the user selects the “No” button, the automated support system 250 can select a historical log 164 that next closely matches the signature log 162. The automated support system 250 can again present, via the client system 160, a corresponding message to the user asking the user whether the use case corresponding to that historical log 164 corresponds to the user's desired endpoint, and prompting the user for a response. Again, based on the user's input, a next course of action can be implemented. This process can continue until the user selects “Yes” for a particular use case, or all use cases corresponding to the identified historical logs 164 have been presented to the user. In another arrangement, each of the use cases can be presented to the user in a message, and the user can be prompted to select one of the use cases or select a button or icon indicating that none of the use cases correspond to the desired endpoint. Again, if the user selects a particular use case, the corresponding historical endpoint can be identified as a predicted endpoint, and the predicted path 166 to arrive at the predicted endpoint can be selected and communicated to the user/client system 160.
  • If the user has indicted that none of such use cases corresponds to the desired endpoint, the automated support system 250 can escalate the user's inquiry. For example, the automated support system 250 can transfer the inquiry to the tended support system 150 of FIG. 1, and a support engineer can interact with the user to attempt to guide the user to the desired endpoint. Again, if the support engineer finds a suitable path to the endpoint, that path/endpoint 168 (FIG. 1) can be communicated to the quality management tool 120, as previously described.
  • In one arrangement, the signature log 162 can indicate a path that should be valid, but is not valid due to a defect in the computer program 140. Based on the historical logs 124, the path search engine 130 can identify the endpoint that should correspond to the signature log 162, and select another path/use case that arrives at the same endpoint. The path search engine 130 can communicate the other path/use case to the automated support system 250. Based on the other path/use case, the automated support system 250 can communicate the predicted path 166 to the user/client system 160 as an alternate path the user should use to reach the desired endpoint. Moreover, the historical log 124 that corresponds to the signature log 162 can identify a support ticket corresponding to an instance when it was discovered that the path that should be valid was discovered to be invalid due to the software defect. The path search engine 130 can communicate that support ticket to the automated support system 250, which can communicate the support ticket, or a portion thereof, to the user/client system 160. The user can evaluate the support ticket to determine a further course of action to access the desired endpoint.
  • FIG. 3 is a block diagram illustrating example architecture for a processing system 300 executing one or more modules/applications of the user support system 100 of FIG. 1. The processing system 300 can include at least one processor 305 (e.g., a central processing unit) coupled to memory elements 310 through a system bus 315 or other suitable circuitry. As such, the processing system 300 can store program code within the memory elements 310. The processor 305 can execute the program code accessed from the memory elements 310 via the system bus 315. It should be appreciated that the processing system 300 can be implemented in the form of any system including a processor and memory that is capable of performing the functions and/or operations described within this specification. For example, the processing system 300 can be implemented as a server.
  • The memory elements 310 can include one or more physical memory devices such as, for example, local memory 320 and one or more bulk storage devices 325. Local memory 320 refers to random access memory (RAM) or other non-persistent memory device(s) generally used during actual execution of the program code. The bulk storage device(s) 325 can be implemented as a hard disk drive (HDD), solid state drive (SSD), or other persistent data storage device. The processing system 300 also can include one or more cache memories (not shown) that provide temporary storage of at least some program code in order to reduce the number of times program code must be retrieved from the bulk storage device 325 during execution.
  • One or more network adapters 330 also can be coupled to processing system 300 to enable processing system 300 to become coupled to other systems, computer systems, remote printers, and/or remote storage devices through intervening private or public networks. Modems, cable modems, transceivers, and Ethernet cards are examples of different types of network adapters 330 that can be used with the processing system 300.
  • As pictured in FIG. 3, the memory elements 310 can store the components of the system 100 of FIG. 1, namely the requirements management tool 110, the quality management tool 120, the path search engine 130 and the tended support system 150. The memory elements also can store the automated support system 250 of FIG. 2. Being implemented in the form of executable program code, these components of the processing system 300 (or system 200) can be executed by the processing system 300 and, as such, can be considered part of the processing system 300. Moreover, the requirements management tool 110, the quality management tool 120, the path search engine 130 and the support system(s) 150, 250, including any parameters, data and/or attributes utilized by such components, are functional data structures that impart functionality when employed as part of the processing system 300 of FIG. 3.
  • As noted, however, it is not necessary that the requirements management tool 110, the quality management tool 120, the path search engine 130 and the support system(s) 150, 250 each be executed on the same processing system 300. In this regard, the processing system 300 can execute one or more of these components 110, 120, 130, 150, 250, and one or more other processing systems can execute other components.
  • FIG. 4 is a block diagram illustrating example architecture for a client system 160. The client system 160 can include at least one processor 405 (e.g., a central processing unit) coupled to memory elements 410 through a system bus 415 or other suitable circuitry. As such, the client system 160 can store program code within the memory elements 410. The processor 405 can execute the program code accessed from the memory elements 410 via the system bus 415. It should be appreciated that the client system 160 can be implemented in the form of any system including a processor and memory that is capable of performing the functions and/or operations described within this specification. For example, the client system 160 can be implemented as a computer, a workstation, a mobile computer, a laptop computer, a tablet computer, a smart phone, a personal digital assistant, a gaming device, an appliance, and so on.
  • The memory elements 410 can include one or more physical memory devices such as, for example, local memory 420 and one or more bulk storage devices 425. The client system 160 also can include one or more cache memories (not shown) that provide temporary storage of at least some program code in order to reduce the number of times program code must be retrieved from the bulk storage device 425 during execution.
  • Input/output (I/O) devices such as a display 430, a pointing device 435 and, optionally, a keyboard 440 can be coupled to the client system 160. The I/O devices can be coupled to the client system 160 either directly or through intervening I/O controllers. For example, the display 430 can be coupled to the client system 160 via a graphics processing unit (GPU), which may be a component of the processor 405 or a discrete device. One or more network adapters 445 also can be coupled to client system 160 to enable client system 160 to become coupled to other systems, computer systems, remote printers, and/or remote storage devices through intervening private or public networks. Modems, cable modems, transceivers, and Ethernet cards are examples of different types of network adapters 445 that can be used with the client system 160.
  • As pictured in FIG. 4, the memory elements 410 can store the computer program 140 (e.g., an instance of the computer program 140 being used by the client system 160). In another arrangement, rather than storing the computer program 140, the memory elements 410 can store a web browser or other suitable application configured to access the computer program 140 from a remote system. For example, the computer program 140 can be a web application accessed by the client system 160. Being implemented in the form of executable program code, these components of the client system 160 can be executed by the client system 160 and, as such, can be considered part of the client system 160. Moreover, the signature log 162 generated by the client system 160 is a functional data structure that imparts functionality when employed as part of the systems 100, 200 of FIGS. 1 and 2.
  • FIG. 5 is a flow chart illustrating an example of a method 500 of selecting a predicted path corresponding to a predicted endpoint in a computer program. At step 505, a first signature generated by a first processing system can be received. The first signature log is a computer readable data structure and includes a first listing of at least a recorded series of user inputs received by a computer program. At step 510, a path search engine executed using a processor can compare the recorded series of user inputs to at least one historical log indicating at least one historical path. Each historical path includes at least second listing of a series of historical user inputs that corresponds to a historical endpoint in the computer program. At step 515, responsive to comparing the first listing of the recorded series of user inputs to the at least one historical log, at least one historical path to which the recorded series of user inputs at least partially corresponds can be identified. The least one historical endpoint can be identified as a predicted endpoint in the computer program. At step 520, a predicted path corresponding to the predicted endpoint in the computer program can be selected based on the predicted endpoint. The predicted path can be output. For instance, the predicted path can be output for presentation to a user.
  • For purposes of simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numbers are repeated among the figures to indicate corresponding, analogous, or like features.
  • The present invention may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
  • The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
  • Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
  • Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
  • Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
  • The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
  • The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this disclosure, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
  • Reference throughout this disclosure to “one embodiment,” “an embodiment,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment described within this disclosure. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” and similar language throughout this disclosure may, but do not necessarily, all refer to the same embodiment.
  • The term “plurality,” as used herein, is defined as two or more than two. The term “another,” as used herein, is defined as at least a second or more. The term “coupled,” as used herein, is defined as connected, whether directly without any intervening elements or indirectly with one or more intervening elements, unless otherwise indicated. Two elements also can be coupled mechanically, electrically, or communicatively linked through a communication channel, pathway, network, or system. The term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will also be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms, as these terms are only used to distinguish one element from another unless stated otherwise or the context indicates otherwise.
  • The term “if” may be construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” may be construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
  • The descriptions of the various embodiments of the present invention have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (8)

1. A method, comprising:
receiving a first signature log generated by a first processing system, the first signature log being a computer readable data structure and comprising a first listing of at least a recorded series of user inputs received by a computer program;
comparing, by a path search engine executing using a processor, the first listing of the recorded series of user inputs to at least one historical log indicating at least one historical path, each historical path comprising at least second listing of a series of historical user inputs that corresponds to a historical endpoint in the computer program;
responsive to comparing the first listing of the recorded series of user inputs to the at least one historical log, identifying the at least one historical path to which the recorded series of user inputs at least partially corresponds and identifying the at least one historical endpoint as a predicted endpoint in the computer program; and
selecting, based on the predicted endpoint, a predicted path corresponding to the predicted endpoint in the computer program, and outputting the predicted path.
2. The method of claim 1, further comprising:
presenting to a user a plurality of use cases, each use case corresponding to a corresponding identified historical path;
receiving from the user a selection of one of the plurality of use cases; and
responsive to receiving from the user the selection of one of the plurality of use cases, identifying the historical endpoint corresponding to the selected use case as the predicted endpoint in the computer program.
3. The method of claim 1, further comprising:
identifying requirements the computer program is to satisfy;
receiving at least a portion of the plurality of use cases generated based on the requirements the computer program is to satisfy; and
generating a plurality of historical logs, each of the plurality of historical logs based on a respective one of the generated plurality of use cases.
4. The method of claim 3, further comprising:
generating a support ticket associated with the first signature log; and
creating, in at least one of the historical logs, an association between the support ticket and the respective one of the generated plurality of use cases;
wherein, based on the created association, the support ticket is presented to a user or a support engineer accessing the historical log or the respective use case.
5. The method of claim 3, further comprising:
generating a support ticket associated with the first signature log; and
creating, in at least one of the historical logs, an association between the support ticket and the respective one of the generated plurality of use cases;
wherein, based on the created association, the historical log, including the respective use case, is presented to a user or a support engineer accessing the support ticket.
6. The method of claim 1, further comprising:
responsive to a determination that the predicted endpoint does not correspond to a desired endpoint, receiving a new signature log comprising a new path corresponding to the desired endpoint;
generating a new historical log indicating the new path and the desired endpoint; and
storing the new historical log as a computer readable data structure.
7. The method of claim 6, further comprising:
generating a support ticket associated with the first signature log;
automatically generating a new use case based on the new path and the desired endpoint; and
creating, in the new historical log, an association between the support ticket and the new use case;
wherein, based on the created association, the support ticket is presented to a user or a support engineer accessing the new historical log or the new use case.
8-20. (canceled)
US14/723,698 2014-08-11 2015-05-28 Mapping user actions to historical paths to determine a predicted endpoint Pending US20160042358A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/723,698 US20160042358A1 (en) 2014-08-11 2015-05-28 Mapping user actions to historical paths to determine a predicted endpoint

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/456,105 US9934507B2 (en) 2014-08-11 2014-08-11 Mapping user actions to historical paths to determine a predicted endpoint
US14/723,698 US20160042358A1 (en) 2014-08-11 2015-05-28 Mapping user actions to historical paths to determine a predicted endpoint

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/456,105 Continuation US9934507B2 (en) 2014-08-11 2014-08-11 Mapping user actions to historical paths to determine a predicted endpoint

Publications (1)

Publication Number Publication Date
US20160042358A1 true US20160042358A1 (en) 2016-02-11

Family

ID=55267667

Family Applications (3)

Application Number Title Priority Date Filing Date
US14/456,105 Active 2036-10-02 US9934507B2 (en) 2014-08-11 2014-08-11 Mapping user actions to historical paths to determine a predicted endpoint
US14/723,698 Pending US20160042358A1 (en) 2014-08-11 2015-05-28 Mapping user actions to historical paths to determine a predicted endpoint
US15/898,171 Active 2034-12-16 US10832254B2 (en) 2014-08-11 2018-02-15 Mapping user actions to historical paths to determine a predicted endpoint

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/456,105 Active 2036-10-02 US9934507B2 (en) 2014-08-11 2014-08-11 Mapping user actions to historical paths to determine a predicted endpoint

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/898,171 Active 2034-12-16 US10832254B2 (en) 2014-08-11 2018-02-15 Mapping user actions to historical paths to determine a predicted endpoint

Country Status (1)

Country Link
US (3) US9934507B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10740257B2 (en) * 2018-07-02 2020-08-11 International Business Machines Corporation Managing accelerators in application-specific integrated circuits
US10832254B2 (en) 2014-08-11 2020-11-10 International Business Machines Corporation Mapping user actions to historical paths to determine a predicted endpoint

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10965573B1 (en) * 2014-09-09 2021-03-30 Wells Fargo Bank, N.A. Systems and methods for online user path analysis
US10387882B2 (en) 2015-07-01 2019-08-20 Klarna Ab Method for using supervised model with physical store
US9904916B2 (en) 2015-07-01 2018-02-27 Klarna Ab Incremental login and authentication to user portal without username/password
US20170212651A1 (en) * 2016-01-27 2017-07-27 Amadeus S.A.S. Short cut links in a graphical user interface
US10440096B2 (en) * 2016-12-28 2019-10-08 Intel IP Corporation Application computation offloading for mobile edge computing
EP3669334B1 (en) * 2017-08-18 2023-09-27 Carrier Corporation Method to create a building path for building occupants based on historic information
US11102219B2 (en) 2017-08-24 2021-08-24 At&T Intellectual Property I, L.P. Systems and methods for dynamic analysis and resolution of network anomalies
US11075925B2 (en) 2018-01-31 2021-07-27 EMC IP Holding Company LLC System and method to enable component inventory and compliance in the platform
US10693722B2 (en) 2018-03-28 2020-06-23 Dell Products L.P. Agentless method to bring solution and cluster awareness into infrastructure and support management portals
US10754708B2 (en) 2018-03-28 2020-08-25 EMC IP Holding Company LLC Orchestrator and console agnostic method to deploy infrastructure through self-describing deployment templates
US10795756B2 (en) 2018-04-24 2020-10-06 EMC IP Holding Company LLC System and method to predictively service and support the solution
US11086738B2 (en) * 2018-04-24 2021-08-10 EMC IP Holding Company LLC System and method to automate solution level contextual support
US11599422B2 (en) 2018-10-16 2023-03-07 EMC IP Holding Company LLC System and method for device independent backup in distributed system
US10862761B2 (en) 2019-04-29 2020-12-08 EMC IP Holding Company LLC System and method for management of distributed systems
US11301557B2 (en) 2019-07-19 2022-04-12 Dell Products L.P. System and method for data processing device management
US11409590B2 (en) * 2020-04-01 2022-08-09 Paypal, Inc. Proactive outreach platform for error resolution based on user intent in server-driven communication channels

Citations (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4964077A (en) * 1987-10-06 1990-10-16 International Business Machines Corporation Method for automatically adjusting help information displayed in an online interactive system
US5239617A (en) * 1990-01-05 1993-08-24 International Business Machines Corporation Method and apparatus providing an intelligent help explanation paradigm paralleling computer user activity
US5255386A (en) * 1990-02-08 1993-10-19 International Business Machines Corporation Method and apparatus for intelligent help that matches the semantic similarity of the inferred intent of query or command to a best-fit predefined command intent
US5388198A (en) * 1992-04-16 1995-02-07 Symantec Corporation Proactive presentation of automating features to a computer user
US5471631A (en) * 1992-10-19 1995-11-28 International Business Machines Corporation Using time stamps to correlate data processing event times in connected data processing units
US5485544A (en) * 1989-02-17 1996-01-16 Hitachi, Ltd. History sensitive help control method and system
US5546521A (en) * 1991-10-15 1996-08-13 International Business Machines Corporation Dynamic presentation of contextual help and status information
US6021437A (en) * 1996-07-17 2000-02-01 Bull S.A. Process and system for real-time monitoring of a data processing system for its administration and maintenance support in the operating phase
US6021403A (en) * 1996-07-19 2000-02-01 Microsoft Corporation Intelligent user assistance facility
US6340977B1 (en) * 1999-05-07 2002-01-22 Philip Lui System and method for dynamic assistance in software applications using behavior and host application models
US20020087949A1 (en) * 2000-03-03 2002-07-04 Valery Golender System and method for software diagnostics using a combination of visual and dynamic tracing
US20030204565A1 (en) * 2002-04-29 2003-10-30 Guo Katherine H. Method and apparatus for supporting real-time multi-user distributed applications
US20040130572A1 (en) * 2003-01-07 2004-07-08 Aravind Bala Active content wizard: execution of tasks and structured content
US20050193004A1 (en) * 2004-02-03 2005-09-01 Cafeo John A. Building a case base from log entries
US20050268234A1 (en) * 2004-05-28 2005-12-01 Microsoft Corporation Strategies for providing just-in-time user assistance
US20060036991A1 (en) * 2004-08-12 2006-02-16 International Business Machines Corporation Predictive help method, system and program product for software systems
US20060126801A1 (en) * 2004-12-14 2006-06-15 Sbc Knowledge Ventures, L.P. Trouble ticket monitoring system having internet enabled and web-based graphical user interface to trouble ticket workload management systems
US20060155398A1 (en) * 1991-12-23 2006-07-13 Steven Hoffberg Adaptive pattern recognition based control system and method
US7225139B1 (en) * 2000-06-27 2007-05-29 Bellsouth Intellectual Property Corp Trouble tracking system and method
US20070136667A1 (en) * 2005-12-14 2007-06-14 Honeywell International Inc. System and method for providing context sensitive help information
US20070162256A1 (en) * 2006-01-06 2007-07-12 Verma Dinesh C Method and system for quantitative determination of software ease of use
US20070162259A1 (en) * 2006-01-10 2007-07-12 Garrett Tricia Y Method for converting a log of user manipulations of a computer program into task documentation
US20070174731A1 (en) * 2005-12-30 2007-07-26 Tilmann Haeberle Contextual enterprise software support tools
US20070203712A1 (en) * 2002-03-29 2007-08-30 Mark Sunday Screening electronic service requests
US7366731B2 (en) * 2003-12-12 2008-04-29 At&T Delaware Intellectual Property, Inc. Trouble ticket assignment
US20080162688A1 (en) * 2007-01-03 2008-07-03 International Business Machines Corporation Proactive problem resolution system, method of proactive problem resolution and program product therefor
US20080250316A1 (en) * 2007-04-04 2008-10-09 Honeywell International Inc. Mechanism to improve a user's interaction with a computer system
US7539654B2 (en) * 2005-01-21 2009-05-26 International Business Machines Corporation User interaction management using an ongoing estimate of user interaction skills
US20100115348A1 (en) * 2008-07-29 2010-05-06 Frank Van Gilluwe Alternate procedures assisting computer users in solving problems related to error and informational messages
US7757124B1 (en) * 2007-07-16 2010-07-13 Oracle America, Inc. Method and system for automatic correlation of asynchronous errors and stimuli
US7979733B2 (en) * 2005-12-30 2011-07-12 Sap Ag Health check monitoring process
US20120066547A1 (en) * 2010-09-13 2012-03-15 International Business Machines Corporation Problem Record Signature Generation, Classification and Search in Problem Determination
US8438479B2 (en) * 2008-11-25 2013-05-07 Panasonic Corporation Operation support apparatus and method of the same
US8694355B2 (en) * 2008-05-30 2014-04-08 Sri International Method and apparatus for automated assistance with task management
US20140123228A1 (en) * 2012-10-25 2014-05-01 Jacob Andrew Brill Event Reporting and Handling
US20140317502A1 (en) * 2013-04-18 2014-10-23 Next It Corporation Virtual assistant focused user interfaces
US20150046578A1 (en) * 2013-08-06 2015-02-12 Cellco Partnership D/B/A Verizon Wireless Mobile trouble ticket
US8965949B2 (en) * 2005-04-29 2015-02-24 Xerox Corporation System and method for applying computational knowledge to device data
US20150169336A1 (en) * 2013-12-16 2015-06-18 Nuance Communications, Inc. Systems and methods for providing a virtual assistant
US9135642B1 (en) * 2004-01-29 2015-09-15 NetCracker Technology Solutions, Inc. System and method for device-based eCare
US20160210033A1 (en) * 2013-10-09 2016-07-21 Hewlett-Packard Development Company, L.P. Remote Support of a Device
US20160269553A1 (en) * 2012-12-05 2016-09-15 Future Dial, Inc. Using automatically collected device problem information to route and guide users' requests

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7240297B1 (en) 2000-06-12 2007-07-03 International Business Machines Corporation User assistance system
US7003090B2 (en) 2001-08-28 2006-02-21 International Business Machines Corporation Method of establishing a communication channel to intelligent support for ebusiness applications
US10157368B2 (en) * 2006-09-25 2018-12-18 International Business Machines Corporation Rapid access to data oriented workflows
US8271950B2 (en) 2009-07-06 2012-09-18 Microsoft Corporation Test generation from captured user interface status
US9529842B2 (en) * 2009-12-28 2016-12-27 International Business Machines Corporation Dynamically creating queries to find related records in a database
US9251499B2 (en) * 2010-04-01 2016-02-02 International Business Machines Corporation System, method, and apparatus for preservation of accessibility and serviceability information
US8719239B2 (en) * 2010-07-16 2014-05-06 International Business Machines Corporation Displaying changes to versioned files
US8561011B2 (en) * 2011-06-10 2013-10-15 International Business Machines Corporation Task management for changes to shared artifacts
US8621278B2 (en) 2011-06-28 2013-12-31 Kaspersky Lab, Zao System and method for automated solution of functionality problems in computer systems
US9009609B2 (en) * 2011-09-15 2015-04-14 International Business Machines Corporation Interaction with a visualized state transition model
US8756566B2 (en) * 2011-11-02 2014-06-17 International Business Machines Corporation Parallel development of a software system
US9117187B2 (en) * 2013-03-12 2015-08-25 International Business Machines Corporation Presenting a filtered list of work items
US9652507B2 (en) * 2014-01-24 2017-05-16 International Business Machines Corporation Dynamic interest-based notifications
US9262134B2 (en) * 2014-03-21 2016-02-16 International Business Machines Corporation Analysis of source code changes
US9934507B2 (en) 2014-08-11 2018-04-03 International Business Machines Corporation Mapping user actions to historical paths to determine a predicted endpoint
US9940370B2 (en) * 2015-01-02 2018-04-10 International Business Machines Corporation Corpus augmentation system
US10447646B2 (en) * 2015-06-15 2019-10-15 International Business Machines Corporation Online communication modeling and analysis
US10152534B2 (en) * 2015-07-02 2018-12-11 International Business Machines Corporation Monitoring a corpus for changes to previously provided answers to questions
US9955428B1 (en) * 2016-10-24 2018-04-24 International Business Machines Corporation Optimizing scheduled charging of battery enabled devices based on a predicted battery consumption factor for an area
US9955313B1 (en) * 2016-10-24 2018-04-24 International Business Machines Corporation Scheduling optimized charging of battery enabled devices based on power usage impact data received from multiple sources
US9955314B1 (en) * 2016-10-24 2018-04-24 International Business Machines Corporation Specifying a map of available locations for recharging battery enabled devices based on a schedule of predicted locations for a user

Patent Citations (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4964077A (en) * 1987-10-06 1990-10-16 International Business Machines Corporation Method for automatically adjusting help information displayed in an online interactive system
US5485544A (en) * 1989-02-17 1996-01-16 Hitachi, Ltd. History sensitive help control method and system
US5239617A (en) * 1990-01-05 1993-08-24 International Business Machines Corporation Method and apparatus providing an intelligent help explanation paradigm paralleling computer user activity
US5255386A (en) * 1990-02-08 1993-10-19 International Business Machines Corporation Method and apparatus for intelligent help that matches the semantic similarity of the inferred intent of query or command to a best-fit predefined command intent
US5546521A (en) * 1991-10-15 1996-08-13 International Business Machines Corporation Dynamic presentation of contextual help and status information
US20060155398A1 (en) * 1991-12-23 2006-07-13 Steven Hoffberg Adaptive pattern recognition based control system and method
US5388198A (en) * 1992-04-16 1995-02-07 Symantec Corporation Proactive presentation of automating features to a computer user
US5471631A (en) * 1992-10-19 1995-11-28 International Business Machines Corporation Using time stamps to correlate data processing event times in connected data processing units
US6021437A (en) * 1996-07-17 2000-02-01 Bull S.A. Process and system for real-time monitoring of a data processing system for its administration and maintenance support in the operating phase
US6021403A (en) * 1996-07-19 2000-02-01 Microsoft Corporation Intelligent user assistance facility
US6340977B1 (en) * 1999-05-07 2002-01-22 Philip Lui System and method for dynamic assistance in software applications using behavior and host application models
US20020087949A1 (en) * 2000-03-03 2002-07-04 Valery Golender System and method for software diagnostics using a combination of visual and dynamic tracing
US7225139B1 (en) * 2000-06-27 2007-05-29 Bellsouth Intellectual Property Corp Trouble tracking system and method
US20070203712A1 (en) * 2002-03-29 2007-08-30 Mark Sunday Screening electronic service requests
US20030204565A1 (en) * 2002-04-29 2003-10-30 Guo Katherine H. Method and apparatus for supporting real-time multi-user distributed applications
US20040130572A1 (en) * 2003-01-07 2004-07-08 Aravind Bala Active content wizard: execution of tasks and structured content
US7366731B2 (en) * 2003-12-12 2008-04-29 At&T Delaware Intellectual Property, Inc. Trouble ticket assignment
US9135642B1 (en) * 2004-01-29 2015-09-15 NetCracker Technology Solutions, Inc. System and method for device-based eCare
US20050193004A1 (en) * 2004-02-03 2005-09-01 Cafeo John A. Building a case base from log entries
US20050268234A1 (en) * 2004-05-28 2005-12-01 Microsoft Corporation Strategies for providing just-in-time user assistance
US20060036991A1 (en) * 2004-08-12 2006-02-16 International Business Machines Corporation Predictive help method, system and program product for software systems
US20060126801A1 (en) * 2004-12-14 2006-06-15 Sbc Knowledge Ventures, L.P. Trouble ticket monitoring system having internet enabled and web-based graphical user interface to trouble ticket workload management systems
US7539654B2 (en) * 2005-01-21 2009-05-26 International Business Machines Corporation User interaction management using an ongoing estimate of user interaction skills
US8965949B2 (en) * 2005-04-29 2015-02-24 Xerox Corporation System and method for applying computational knowledge to device data
US20070136667A1 (en) * 2005-12-14 2007-06-14 Honeywell International Inc. System and method for providing context sensitive help information
US7979733B2 (en) * 2005-12-30 2011-07-12 Sap Ag Health check monitoring process
US20070174731A1 (en) * 2005-12-30 2007-07-26 Tilmann Haeberle Contextual enterprise software support tools
US20070162256A1 (en) * 2006-01-06 2007-07-12 Verma Dinesh C Method and system for quantitative determination of software ease of use
US20070162259A1 (en) * 2006-01-10 2007-07-12 Garrett Tricia Y Method for converting a log of user manipulations of a computer program into task documentation
US20080162688A1 (en) * 2007-01-03 2008-07-03 International Business Machines Corporation Proactive problem resolution system, method of proactive problem resolution and program product therefor
US20080250316A1 (en) * 2007-04-04 2008-10-09 Honeywell International Inc. Mechanism to improve a user's interaction with a computer system
US7757124B1 (en) * 2007-07-16 2010-07-13 Oracle America, Inc. Method and system for automatic correlation of asynchronous errors and stimuli
US8694355B2 (en) * 2008-05-30 2014-04-08 Sri International Method and apparatus for automated assistance with task management
US20100115348A1 (en) * 2008-07-29 2010-05-06 Frank Van Gilluwe Alternate procedures assisting computer users in solving problems related to error and informational messages
US8438479B2 (en) * 2008-11-25 2013-05-07 Panasonic Corporation Operation support apparatus and method of the same
US20120066547A1 (en) * 2010-09-13 2012-03-15 International Business Machines Corporation Problem Record Signature Generation, Classification and Search in Problem Determination
US20140123228A1 (en) * 2012-10-25 2014-05-01 Jacob Andrew Brill Event Reporting and Handling
US20160269553A1 (en) * 2012-12-05 2016-09-15 Future Dial, Inc. Using automatically collected device problem information to route and guide users' requests
US20140317502A1 (en) * 2013-04-18 2014-10-23 Next It Corporation Virtual assistant focused user interfaces
US20150046578A1 (en) * 2013-08-06 2015-02-12 Cellco Partnership D/B/A Verizon Wireless Mobile trouble ticket
US20160210033A1 (en) * 2013-10-09 2016-07-21 Hewlett-Packard Development Company, L.P. Remote Support of a Device
US20150169336A1 (en) * 2013-12-16 2015-06-18 Nuance Communications, Inc. Systems and methods for providing a virtual assistant

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Kriegsman, Mark and Ralph Barletta. "Building a Case-Based Help Desk Application" 1993 [ONLINE] Downloaded 12/28/2017 http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=248349 *
The development and utilization of the case-based help-desk support system HOMER, by Goker, 1999 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10832254B2 (en) 2014-08-11 2020-11-10 International Business Machines Corporation Mapping user actions to historical paths to determine a predicted endpoint
US10740257B2 (en) * 2018-07-02 2020-08-11 International Business Machines Corporation Managing accelerators in application-specific integrated circuits

Also Published As

Publication number Publication date
US10832254B2 (en) 2020-11-10
US20160042288A1 (en) 2016-02-11
US20180174155A1 (en) 2018-06-21
US9934507B2 (en) 2018-04-03

Similar Documents

Publication Publication Date Title
US10832254B2 (en) Mapping user actions to historical paths to determine a predicted endpoint
US11651033B2 (en) Insights into performance of a bot system
EP4028903A1 (en) Chatbot for defining a machine learning (ml) solution
EP4028875A1 (en) Machine learning (ml) infrastructure techniques
US9280451B2 (en) Testing device
US11159554B2 (en) Correlating threat information across sources of distributed computing systems
WO2021051031A1 (en) Techniques for adaptive and context-aware automated service composition for machine learning (ml)
US10656812B2 (en) Controlling an application instance using a graphical user interface
US9939997B2 (en) Transitioning browser tabs from one environment context to another
US20160292164A1 (en) Efficient database management
US10178119B1 (en) Correlating threat information across multiple levels of distributed computing systems
US20200050540A1 (en) Interactive automation test
US11709768B1 (en) Self-healing hybrid element identification logic
US10095608B2 (en) Application test automation transmitting data via phone/voice calls
US20150067139A1 (en) Agentless monitoring of computer systems
US11068617B2 (en) Secure access to multi-tenant relational data
US10021012B2 (en) Notifying original state listeners of events in a domain model
US20180267795A1 (en) Smart reviews for applications in application stores
CN113010365A (en) System running state monitoring method, system running state detection device, electronic equipment and storage medium
US20180232699A1 (en) Prioritization of e-mail files for migration
US20130166582A1 (en) Operation of a user interface
US11403577B2 (en) Assisting and automating workflows using structured log events
US20240037243A1 (en) Artificial intelligence based security requirements identification and testing
US11514094B2 (en) Search and navigation of hidden elements of a web page
CN114140006A (en) Risk management and control method, device, electronic equipment and program product

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:COHEN, AARON M.;KOMAR, PAUL;RUSKE, SHAUN;AND OTHERS;SIGNING DATES FROM 20140730 TO 20140811;REEL/FRAME:035730/0903

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCV Information on status: appeal procedure

Free format text: NOTICE OF APPEAL FILED

STCV Information on status: appeal procedure

Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER

STCV Information on status: appeal procedure

Free format text: NOTICE OF APPEAL FILED

STCV Information on status: appeal procedure

Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER

STCV Information on status: appeal procedure

Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS

STPP Information on status: patent application and granting procedure in general

Free format text: AMENDMENT / ARGUMENT AFTER BOARD OF APPEALS DECISION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED