ONLINE SIMULTANEOUS/ALTERNATING - AUDIO/VIDEO/VOICE DATA BASED SERVICE AND SUPPORT FOR COMPUTER SYSTEMS
FIELD OF THE INVENTION
This invention relates generally to online support services for computer users and specifically to an online support service using integrated audio, image and other data to provide service and support functions.
BACKGROUND OF THE INVENTION
The popularity of personal computers has made service and support for such computers critical to insure consumers' efficient use of the computers Further, because computer designs are so similar, service and support programs also serve to differentiate different manufacturers of the computers A superior service and support program may well be the difference between mediocre and superior personal computer sales
However, even though a good service and support system is important to a computer manufacturer, such a program is difficult and expensive to maintain because of the complexity of today's computer systems and related components, the lack of technical expertise at the user end and the difficulty of solving technical computer problems from a remote location
Part of the difficulty also arises from the "open architecture" of a typical personal computer Such an open architecture allows many different manufacturers to produce hardware components and software applications for a consumer's personal computer. The combination of specific hardware and software residing on, or operating within, a computer system is referred to as the particular "configuration" of that computer system. Because several different hardware and software manufacturers contribute to any particular configuration it is difficult for a single manufacturer to provide adequate support for all of the components in the configuration Also, a given configuration will likely change every few months, or so, as the user purchases new or upgraded hardware and software components Despite the difficulty in providing a single source of support for a user's configuration, the user has a very strong expectation of being able to go to the original equipment manufacturer (known as an "OEM," i e., the manufacturer or assembler of the basic computer
components initially shipped together as a "system," typically including the motherboard and housing, hard disk, monitor, operating system software and bundled applications) for solutions to any problems that the user expeπences with their configuration and is disappointed if such a service is not provided Today's typical support programs allow a user to contact a customer service center staffed and run by the OEM of the user's computer The contact is usually by telephone Often the user can use the Internet, modem or other means to obtain digital information or components such as an updated "patch" to fix a software problem, or instructional text on how to solve a problem However, these methods of communication and information access provided by a typical support program do not provide adequate help to the user for various reasons
One reason that traditional support methods fall short is that in order to properly diagnose a user's computer system problems a customer service representative in a remote location needs to obtain detailed and accurate information about the user's configuration Often this is complicated because of nonstandard provision of information by each of the hardware or software component manufacturers as to identifying their product, and as to describing and implementing the way their product interfaces into the overall computer system
Also, a personal computer user is generally not a technical person In this respect, it is difficult for a customer service representative at a remote location to obtain the proper information from the user, or to get the user to perform tasks on the computer system that are necessary in order to fix a problem with the computer Even if the user is technically trained, it is often difficult to communicate adequately with the user over standard communication devices such as the telephone, fax machine, mail correspondence, etc Yet other problems exist with typical online service and support practices today For example, companies will often provide "patches" on the Internet or World Wide Web ("WWW" or "WEB") which the user must download and install in order to proceed with fixing problems on their computer This process is often time consuming and is usually handled by having the user end the conversation with the customer service representative ("customer service rep"), perform the download, install the patch, test out the software, and call the customer rep back, if necessary Since customer service centers are notoriously overloaded, the act of obtaining another session with a customer rep is frustrating and requires a considerable amount of time
Thus, it is desirable to provide an online service and support system for improved support, diagnosis and servicing of remotely located personal computers.
SUMMARY OF THE INVENTION
The present invention connects a remotely located customer service and support center with a user's personal computer.
One embodiment of the invention is an online computer support system including a user computer coupled to a communication line. The online computer support system also includes a customer service center including a customer representative and electronic equipment coupled to the communication line. The user computer and the electronic equipment each include means for transferring audio information over the communication line; means for transferring image (including video) information over the communication line; and means for transferring digital data over the communication line. The transfer protocol can allow for either simultaneous or alternating transmission of the different data types.
Another embodiment of the invention provides an online computer support system including a user computer coupled to a communication line; hardware components coupled to the user computer; a customer service center including a customer representation and electronic equipment coupled to the communication line; means, coupled to the user computer and to the electronic equipment, for transferring digital data over the communication line; and means for transferring information about the hardware from the user computer to the customer service center over the communication line.
Since another embodiment of the invention provides an online computer support system including a user computer coupled to a communication line, software residing in the user computer; a customer service center including a customer representation and electronic equipment coupled to the communication line; means, coupled to the user computer and to the electronic equipment, for transferring digital data over the communication line; and means for transferring information about the software from the user computer to the customer service center over the communication line.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a system-level illustration of the online customer service system of the present invention;
Fig. 2 shows a typical computer system suitable for use with the present invention,
Fig. 3 shows basic subsystems in a typical computer system; Fig. 4 shows a dialog box of the user interface in the present invention;
Fig. 5 shows a screen image of the VAIO Space navigator along with an SOS icon for launching the online support system of the present invention;
Fig. 6 shows an initial window presented to the user after a connection with the customer service center is made; Fig. 7 is a first screen display of a window viewed by the customer service representative during a session with a user;
Fig 8 shows a second screen display viewed by the customer service representative; and
Fig. 9 is a diagram of interrogation software in a user computer
DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT
Fig. 1 is a system-level illustration of the online customer service system 100 of the present invention. In Fig. 1, customer service center 102 includes electronic equipment such as multimedia server 108, external storage devices 104 and 106, computer stations 1 10 and 1 12, and customer service reps 1 14 and 1 16. Fig. 1 shows multimedia server 108 in communication with customer site 120 via a communication link 122. In a preferred embodiment, voice, image and other digital data information are transferred over a so-called "plain old telephone system" (POTS) line. Other communication lines may be used such as an Integrated Services Digital Network (ISDN) line, TI line, coaxial cable, fiber optic cable, satellite transmission, cellular telephone network, or other connection. Simultaneous transfer of voice and digital data (including images, video, text, etc.) is achieved with a protocol such as Digital Simultaneous Voice/Data (DSVD) Alternating transmission of different data types can be achieved by using, for example, the Asynchronous Voice/Data (AVD) protocol The preferred embodiment uses both of these protocols. Other protocols may be used
In Fig. 1, other customer sites (not shown) may be simultaneously supported Naturally, additional computers, computer peripherals, customer service reps and electronic equipment may be included at the customer service center. For example, a video server, teleconferencing capability, etc. may reside at the customer service center and be coupled to the communication link via multimedia server 108 Other manner of communicating with customer site 120 over a communication link may be possible, such as by directly linking a computer, such as computer 110 at customer service center 102, to customer site 120
At customer site 120 are the user computer 130 and user 132 Various types of information can be captured and digitized at customer service center 102 for transfer to a customer site, such as customer site 120, over the communication line. In Fig 1 , customer service reps are shown with audio head sets for digitizing voice via a microphone such as microphone 160 and for playing back sound through earpiece 162 Video camera 152 is used to capture images The images are then digitized. The overall image and audio data can be synchronized into a presentation, or video program, for playback at the customer site Other types of information may be exchanged with the user as described below.
At customer site 120 the user's computer 130 is, preferably, a multimedia computer That is, it is preferable for the user to have speakers such as speaker 164, and a microphone such as microphone 166 connected to user computer 130 to provide for the transmission and playback of audio information As computers are becoming more popular for educational, entertainment and other home uses, they are increasingly being provided with peripherals such as speakers and microphones as standard equipment to allow playback and capture of audio information Additionally, it is likely that the use of digitizing cameras will gain in popularity as the cost for such cameras and digitizing hardware decreases If the user is equipped with a way to capture and transfer image information back to customer service center 102 a future embodiment of the invention will make use of such added capability
An alternative way for the user to transfer audio information with customer service center 102 is by using a standard telephone handset 168 shown at customer site 120 in Fig. 1 The preferred embodiment uses a personal computer manufactured by Sony Corporation which is provided with a jack that is compatible with the standard telephone line. Thus, the user may plug their standard telephone into the provided jack and establish voice communication with customer service center 102 by using the telephone The preferred embodiment uses a standard
telephone line for simultaneous transfer of image, audio, and other digital data with a standard modem at 28 8 kbps The data format is Digital Simultaneous Voice/Data (DSVD) protocol developed by, among others, Intel Corporation
Simultaneous transfer of data using DSVD has the advantage that data can be exchanged during a telephone conversation so that, for example, an image frame, which consists of a large amount of data, can be sent over the line while the customer service rep and the user are having a conversation At other times it may be more advantageous to use the line exclusively for voice or data transfer as in the case where a large amount of image data must be sent before the support session can continue In this latter case, an Asynchronous Voice/Data (AVD) implementation may be used The preferred embodiment uses a protocol implementation called
VOICEVIEW, developed by Radish Corporation This allows the customer service rep and the user to switch back and forth between voice and data transfers as often as necessary
Fig 2 shows a typical computer system 180 Such a computer system is representative of the type that may be encountered at a customer site, for example, as computer 130 of Fig 1 Also, such a computer is typical of the type that can be used at customer service center 102 (of Fig 1) as workstation computers for customer reps, such as computers 110 and
1 12
In Fig 2, computer system 180 includes monitor 182 having display screen 184 and housing 186 Housing 186 typically includes standard computer components such as a hard disk drive, random access memory (RAM), processor, and additional hardware components (not shown) Computer system 180 also includes user input devices such as keyboard 188 and mouse
190 Mouse 190 has one or more buttons such as those shown at 192
Fig 3 shows basic subsystems in a typical computer system such as the computer system of Fig 2 Fig 3 shows system bus 200 used to allow transfer of information between subsystems, or components, connected to the bus For example, central processor 206 executes programs residing in system memory 204 or on fixed disk 218 Also, information can be transferred to devices such as printer 208, serial port 214, I/O controller 202 or external interface 220 Visual information is sent to display adapter 210 for display on monitor 212 Data generated by a human user of the computer is received through input devices such as keyboard
216 or a mouse pointer device (not shown) Other devices may be connected to the system bus
through I/O controller 202 or serial port 214. For example, I/O controller 202 can be a Small Computer Systems Interconnect (SCSI) controller or an IEEE 1394 standard bus interface Many standard devices such as disk drives, video capture cards and consumer electronic devices may be connected to these types of interfaces. Serial port 214 can be used to connect the computer to a telephone line or other communication link, printer, mouse or other peripheral.
Fig. 3 is merely illustrative of some typical subsystems, or components, found in a computer system The configuration of any given computer system may vary greatly from that shown in Fig. 3 For example, some computer systems will not have a printer or external interface adapter Other devices that are common to computers, such as a sound card, are not shown as in Fig 3 Typically, the speakers and microphone at the user computer as shown in Fig 1 communicate with the processor and communication line through a sound card mated directly to the bus, or through an interface controller such as a SCSI controller
In general, subsystems may be added to, or taken away from, those shown in Fig 3 without departing from the scope of the present invention
Using Audio. Image And Other Data Over A Single Communication Line To Provide Improved Support
The present invention provides a user, or customer, with both audio and image information, along with other types of information, to improve customer service, product registration, analyzing, repairing and updating hardware and software components of the user's system A simple and immediate benefit of providing audio and image data to the user during a customer service session is that the user can see what the customer service rep looks like This allows the user to relate more easily to the customer service rep and puts the user in a good frame of mind to deal with the technical problems and frustration associated with having the computer malfunction
Fig 4 shows a first screen shot of the user interface used in the customer service system of the present invention This screen appears when the user attempts to connect for a first support session with the customer service center. The user can, alternatively, invoke the session by clicking on an icon that is available from within the application "navigator" provided with each system sent by the manufacturer In the preferred embodiment, the manufacturer is Sony
Corporation, the navigator is referred to as "VAIO Space "
Fig 5 shows a screen image 290 of the VAIO Space navigator in the preferred embodiment along with an SOS icon 292 used to launch the Sony Online Support system of the present invention The VAIO Space navigator per se does not form an essential part of the present application Returning to Fig 4, in the dialog box shown in Fig 4 the user enters their name, phone number and a description of the problem they are having After the information is filled in, "SOS Help" can be invoked by depressing the button to access a local help data base residing on the user's computer Alternatively, the "Call SOS" button can be pressed to dial up the remote customer service center for assistance from a customer service rep Note the instructions under the buttons which direct the user to connect a telephone to the PC if the user does not have speakers and a microphone already attached to their PC After the user presses the "call SOS" button, and after the customer service rep answers the call, the user is presented with new windows shown in Fig 6
Fig 6 shows an initial window presented to the user after a connection with the customer service center is made Additionally, a "dial up" window is shown The dial-up window is used to change the telephone number for the customer service center, if necessary
In Fig 6, the name, phone number, extension, and visual image of the customer service rep who will be helping the user in the current support session is shown The user has options of, e g , saving, printing, or annotating the information shown in the initial window 300 For example, the user can save the text and image information to disk under a chosen file name by depressing "SAVE AS " button 308 Before saving, the user can edit, or annotate, the information by depressing button 310 "SEND" button 302 is used to forward a screen image such as the screen image shown in Fig 6, to another PC user assuming that the other PC user has a DSVD modem and SOS software The user can print the text and image to a printer by depressing the "PRINT" button 306 "COPY" button 304 copies the screen image to the local clipboard of the operating system to allow the image to be transferred to another application The user may close the initial screen by depressing the "CLOSE VIEWER" button 3 12 If the view is closed, image data is no longer displayed However, the user can still be in voice and data contact with the customer service rep The user may return to the SOS dialog box shown in Fig 4 by depressing the
"SOS Screen" button 314
The user may return to the SOS dialog box shown in Fig. 4 by depressing the "SOS Screen" button 314.
In a preferred embodiment of the invention a single-frame picture of the customer rep will be shown in the image area at 316. In future embodiments, as communication line bandwidth increases, the image at 316 can be enlarged to fill the entire window, or display screen, as desired, and can be animated to a full-motion video by having the image updated at several frames per second. Also, synchronized audio will be provided so that the user can see and hear the customer service rep in real time. Not only will this make the support session more human and friendly, but it will also facilitate the exchange of information by, for example, allowing the customer service rep to use hand gestures, hold up different objects or diagrams in front of the video camera, play instructional videos or tutorials, etc. The user may selectively capture screens of the images for future reference or may capture entire segments of the video. Also, the user may annotate the frames of video by depressing the EDIT button and typing in additional informational "notes." In the future, personal computers will be more apt to have video cameras at the user end. Another option will be camcorders connected to a PC by using IEEE 1394 standard serial data buses. This will allow the customer service rep to view the user, and objects or documents the user might have.
Fig. 7 is a first screen shot of a window viewed by the customer service rep during a session with a user. In Fig. 7 a box at the center of the window shows a log of session highlights and basic information relevant to the session. For example, the agent's name is entered into the log as the first entry at the top of the box. The second entry shows that user information has been obtained from the user successfully. That is, the information which the user has entered into the dialog box of Fig. 4 is obtained. As discussed below, additional information is transferred at the initial connection between the user and the customer service rep. Finally, the fact that an acknowledgment has been sent back to the user computer is logged. As discussed below, identification information obtained from the user's computer is used to index a data base at the customer service center to include detailed information about the history of support activity for a specific user. In Fig. 7, the box labeled "notes;" shows information retrieved from the data base.
As can be seen, the data base includes information that this is the second call from this customer.
and that the customer is having a problem with his CD caddy Information such as the information that this is the second call from the customer is generated automatically by the database or other record-keeping features of the customer service center Additional information, such as the information that the customer's problem in a prior session was with the CD caddy, is entered by the customer service rep and maintained in a database at the customer service center
The box to the right of the window shown in Fig. 7 contains a "Macro List" which allows the customer service rep to select an activity, text, etc. with a single mouse click to more quickly provide the user with information or to perform a function The macros in the list can also be selected by using predesignated buttons or hot keys Some of the functions that the customer service rep may select include predefined tests that can be sent to the user's computer and executed at the user computer In a preferred embodiment, the code for these tests already exist at the user computer since it was provided at the time of initial shipment of the user's computer to the user Other common tasks such as getting a directory listing of the user's root directory, getting copies of the autoexec bat and config sys files, getting predesignated user info or obtaining copies of other critical documents or files in the user system may be instantly obtained by using the Macro List In the preferred embodiment transfer of data (e g , files such as the autoexec bat and config.sys files) takes place in the background of the session so that the user and customer service rep can communicate both through audio and image data while a file transfer is going on Fig 8 shows a second screen display viewed by the customer service rep
In Fig 8, the customer service rep has selected viewing of the file USERINFO.FMP Part of the information in USERINFO FMP is provided by the user while other of the information is obtained automatically by software executing at the user's computer For example, in Fig 8 the user's name and phone number appear along with answers to queπes provided by software at the user end that interrogates hardware and software components in the user's system Part of the interrogation automatically provides the customer service rep with information as to the user's hardware and software components and any existing upgrades to these components
In the preferred embodiment, a standard 28 8 kbps modem is used to transfer data over the telephone line Of this bandwidth, approximately 9600 bps is used for voice communications and about 14 4 kbps is used for data transfer, including video and image transfer
The remaining bandwidth is used for communication protocol and overhead. Other dynamic and static allocations of data are possible.
One advantage of the present invention is that it allows a customer service rep to instantly present ready-made instructions such as text or video instructions to the user Thus, when the customer service rep determines that the user's problem is, for example, that the user needs to know how to configure their new peripheral, the customer service rep can send the appropriate text or video tutorial to the user. The selection of the appropriate tutorial can be, for example, a selection on the customer service rep's Macro List. Such tutorials can be stored on a hard disk or Compact Disk - Read Only Memory (CD-ROM) disk or other media. For example, in Fig. 1, a server database including the tutorial can be connected to the network at the customer service center in a manner similar to that for connecting external storage devices 104 or 106
Other advantages are provided by the present invention For example, the customer service rep can "talk" over a ready-made tutorial as the tutorial is presented. Either the customer service rep or the user may stop and start the tutorial, or fast forward and rewind the tutorial similar to a videotape Also, both parties may "point" to items shown on the screen That is, both the user and customer service rep's mouse pointers can appear on each computer screen. This facilitates communication Text that is typed in by one party also appears on the other's screen and can be saved by taking a "snapshot" of the screen at any time or by recording a series of screens, as in a video Drawing, by using a mouse and pointer in a manner similar to standard drawing programs is possible. This allows, for example, the customer service rep to circle or otherwise highlight and indicate objects on the user's screen
A customer service rep can also bring in additional support reps to help in the user's support session For example, customer service rep 1 14 of Fig 1 may transfer the user's session to customer service rep 1 12. Thus, customer service rep 1 12 may take over a session in progress Alternatively, customer service rep 1 12 can "join" in to a session already being handled by customer service rep 1 14 Text and pointer movement for this second customer service rep could appear in a different color on the user computer's screen than the color for the first customer service rep. The voice and image data from customer service rep 112 are provided in a similar manner as discussed above
Reading Hardware and Software Properties
Another aspect of the present invention is the ability to read properties of the hardware and software components in the user computer system. The present invention uses "interrogation software" comprising the Windows Registry Browser (part of the operating system provided by Microsoft Corp.), the Desktop Management Interface (DMI) browser (provided by Intel Corp. with modifications by Sony Corporation) including PC_INFO.EXE, and software developed by Sony Corporation creating executables such as "register.exe" to query and obtain information about hardware and software components in the user computer. Examples of the types of information that the interrogation software can obtain are size of a software data file or program, who created the software module, when the software or hardware component was installed, currently installed Dynamic Link Libraries (DLLs), the version number of the hardware or software component. Interrupt Request (IRQ) levels assigned to a hardware component, device drivers used by a hardware component, status of a component, memory used or allocated, etc. This information forms the heart of most problems that a user can experience
Fig. 9 shows a diagram of interrogation software 342 residing in user computer 340. Interrogation software 342 communicates with the resident operating system, the DMI and hardware components in the user's computer system.
Most of the information that the interrogation software obtains is from the DMI and some operating system data sources, such as the Windows Registry for the Windows 95 operating system. The DMI provides low-level communication with hardware devices to obtain information on properties of the hardware devices, or components. The information obtained is transferred to the Customer Service Center via the communication link as described above
Table I shows the types of information that are transferred from the interrogation software to the Customer Service Center. In Table I, the interrogation software provides the information listed after the line ";LPT - Printer Ports." All information above this line, under the headings ";ComponentID Group" and ";Base System" is provided in non-volatile memory as programmed at the manufacturing factory of the computer system, discussed below in the next section.
Thus, the provision for interrogation software in the present invention provides the customer service rep with timely, complete and accurate information as to the user's configuration of hardware and software. Such information is critical to the efficient solving of a user's computer problems.
Factory-Stored Identifiers
Another feature of the present invention is the use of factory-stored identifiers to provide necessary information to tie-in a particular user's computer to database statistics and other information kept at the Customer Service Center. In the preferred embodiment, the information programmed at the factory includes the information in Table I's first two sections labeled ",ComponentID Group" and ";Base System" For example, the manufacturer ("Sony Corporation" in the preferred embodiment) and serial number are programmed before the computer is shipped to an end-user or to a retailer
This information is transferred to the Customer Service Center by the interrogation software at the start of a support session At the Customer Service Center, information such as the serial number is used to index a local database to retrieve records for the user's particular computer such as a history of support sessions By embedding the information directly into non¬ volatile memory on the motherboard of the computer system, e g , in a read-only memory (ROM) chip, and by transferring the information at the start of each support session, the accuracy of such data and tracking of user problems is ensured.
The information provided by the interrogation software, in conjunction with records kept on the local database, assists the customer service rep in determining copyright protection issues, validating warranties, inventory control, maintaining service and upgrade history and in manufacturing process flow control
Online Agents and Other Features
The architecture of the present invention allows a customer service rep to transfer software "agents" to the user computer system The transfer of an agent is similar to the transfer of other data such as files or tutorials, discussed above An agent has the ability to be executed at the user computer and perform a function such as obtaining additional information from the user computer system and sending the information back to the customer service rep
Additionally, agents can be used for many purposes Some of the functions are re-configuring software, hardware or firmware; upgrading software, hardware or firmware,
preventive maintenance of software, hardware or firmware; fixing a failed component, updating and re-programming access control information
Preventive maintenance is a feature of the present invention's online support system Preventive maintenance allows a routine executing at the user's computer to detect if a component is having sporadic problems and may fail in the near future Another aspect is to monitor a component, such as a hard disk drive, and log the number of hours against the mean time to failure of the component The component can be automatically ordered shipped to the user (if hardware) or automatically downloaded to the user's computer before the component actually fails The present invention allows "remote control" of a user's computer by the customer service rep Remote control allows a customer service rep to take control of a user's computer and control the computer by accessing applications on the user's computer from the customer service rep's computer That is, commands can by typed, buttons and icons selected, etc , on the user's computer by having the signals from the customer service rep's input devices sent to the user's computer The control can be preemptive or shared In a shared mode both the user and customer service rep can control the user's computer Voice and other data communication are possible during remote control
Thus, a system for online computer support has been discussed above Although the invention has been discussed with respect to a specific embodiment, the scope of the invention is to be determined solely by the appended claims