WO2000004478A2 - A system containing a multi-user virtual learning environment - Google Patents

A system containing a multi-user virtual learning environment Download PDF

Info

Publication number
WO2000004478A2
WO2000004478A2 PCT/US1999/016103 US9916103W WO0004478A2 WO 2000004478 A2 WO2000004478 A2 WO 2000004478A2 US 9916103 W US9916103 W US 9916103W WO 0004478 A2 WO0004478 A2 WO 0004478A2
Authority
WO
WIPO (PCT)
Prior art keywords
user systems
virtual environment
facilitator
computer system
user
Prior art date
Application number
PCT/US1999/016103
Other languages
French (fr)
Other versions
WO2000004478A3 (en
Inventor
Arne Jonsson
Sandra Testani
Edward Wagner
Josh Burdick
Original Assignee
The Franklin Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Franklin Institute filed Critical The Franklin Institute
Priority to AU51064/99A priority Critical patent/AU5106499A/en
Publication of WO2000004478A2 publication Critical patent/WO2000004478A2/en
Publication of WO2000004478A3 publication Critical patent/WO2000004478A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/18Book-keeping or economics
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication

Definitions

  • the present invention relates to a multi-user distributed interactive virtual reality environment, and more particularly, to a multi-user interactive virtual environment for collaborative learning through task-based group interaction monitored by a configurable project facilitator.
  • the present invention relates to a virtual environment for solving business- oriented problems by interactive-collaborative learning involving one or more participants that are monitored by a facilitator.
  • a facilitator Upon "entering" the virtual environment, each participant chooses a virtual persona or "avatar" and each participant may navigate through the virtual environment individually or with other participants.
  • the facilitator guides and monitors participants' navigation through the virtual environment and the facilitator may prompt the participants to negotiate complex problems presented by a software application to reach collaborative decisions. Additionally, the facilitator may interact one-to-one with each participant or interact with a selective group of participants or with all of the participants.
  • One feature of the present invention is to provide a virtual environment on a distributed network where participants executing three-dimensional applications on desktop computer systems are connected to each other and a facilitator via the network and the participants may communicate with each other and the facilitator through the network.
  • Another feature of the invention is to provide a configurable facilitator for modifying the virtual environment based on the participants' performance.
  • the facilitator functions may be automated or controlled by 'real-time' human interaction and they may reside on a desktop computer system or a server system.
  • the invention allows the facilitator to administrate interaction among and between each of the participants and to facilitate collaboration and joint decision-making by participants.
  • the facilitator may selectively communicate with one of the participants, with a selected group of the participants and/or with all of the participants. Additionally, the facilitator may selectively control navigation of one or more of the participants through the virtual environment.
  • Another feature of the invention is to provide a virtual environment where a computer system enables assignment of ownership of items by participants such that, the owner of each item may navigate the virtual environment in a particular way not otherwise navigable by other participants. Ownership of the items may be transferred directly between participants or through the facilitator and the facilitator may control acquisition of ownership of items.
  • the computer system keeps track of ownership of each item in the virtual environment.
  • Another feature of the invention is to provide a virtual environment where the facilitator or the computer system controls aspects and/or elapsed time of the virtual environment.
  • the computer system also maintains a state of each of the participants as they navigate through the virtual environment.
  • Each participant's state includes the participant's location in the virtual environment, a list of items owned by the participant and a history of tasks completed by the participant.
  • the facilitator accesses the state to administrate navigation of the corresponding participant.
  • Another feature of the invention is to provide a virtual environment where each participant is associated with an avatar and 'perceives' other avatars associated with other participants.
  • the participants may selectively communicate with each other through the computer system or via the computer system through the Internet.
  • the communication may include voice communication and gesturing.
  • An additional feature of the invention is to provide a virtual environment where the facilitator may selectively view the virtual environment through the perspective of at least one of the participants.
  • Yet another feature of the invention is to provide a virtual environment where the computer system receives information from a desktop computer system, distributes portions of the information to one or more other desktop computers and/or an automated or human facilitator and updates the virtual environment in accordance with the information.
  • the information may include voice message, text message, a position update and request to acquire ownership in an item.
  • the computer system may also receive information from the automated or human facilitator and selectively distribute the information to the desktop computer systems.
  • Yet still another feature of the present invention is to provide a virtual environment where participants, through natural speaking, selectively communicate online by means of electronic voice transmission. Additional features and advantages of the invention will be set forth in part in the description that follows, and in part will be obvious from the description, or may be learned by practice of the invention.
  • the invention comprises a multi-user distributed interactive ⁇ irtual system comprising a computer system for generating and controlling a virtual e ironment; a plurality of user systems, coupled to the computer system, that communicate with one another through the computer system; and a facilitator system, coupled to the computer system, that administrates interaction among each of the plurality of user systems and between each the the plurality of user systems and the plurality of user systems and between each the the plurality of user systems and the virtual environment.
  • Fig. 1 illustrates a computer network in which the inventive multi-user virtual reality environment may be inco ⁇ orated
  • Fig. 2 illustrates an alternate embodiment of a computer network in which the inventive multi-user virtual reality environment may be incorporated;
  • Fig. 3 illustrates interactions between client components and server components on the computer network
  • Fig. 4 illustrates components of the inventive virtual reality system
  • Fig. 5 illustrates a flow chart of an application that utilizes the present invention.
  • participant in the virtual environment solve business problems by interactive collaboration with other participants and they are guided by a facilitator.
  • Each participant utilizes a three dimensional virtual reality application that is executed on a desktop computer system in a distributed network.
  • each participant Upon "entering" the virtual emironment, each participant chooses a virtual persona or "avatar" and the participant may navigate through the virtual environment individually or with other participants.
  • the facilitator monitors the participants as they navigate through the virtual environment and the facilitator may interact one-to-one with each participant or interact with a selective group of participants or with all of the participants.
  • Fig. 1 is an example of a local area network (LAN) 100 that is configured to connect components executing virtual reality programs; such that, users of the LAN components can interact within a shared virtual environment.
  • LAN 100 may include a server 102, one or more desktop computer systems (illustrated as computer systems 104, 106, 108, 110) and peripherals such as printers and/or other devices 112 that may be shared by components on LAN 100.
  • Computer systems 104-110 may serve as clients for server 102 and/or as clients and/or servers for each other and/or for other components connected to LAN 100.
  • Components on LAN 100 may be preferably connected together by cable media, for example copper or fiber-optic cable, and LAN 100 typology may be a token ring topology 114.
  • other media for example wireless media such as optical and radio frequency, may also connect components on LAN 100 and other network topologies such as Ethernet may be used.
  • Routers 120, 122 create an expanded network by connecting LAN 100 to other computer networks, such as, the Internet, other LANs or Wide Area Networks (WAN). Routers are hardware devices that may include a conventional processor, memory, and separate I/O interface for each network to which it connects. Hence, components on the expanded network may share information and services with each other. It should be noted that, computer systems 104-110 may be connected directly to other computer networks through modems or other connection devices. Thus, computer systems 104-110 may share information and services with components on the computer networks.
  • FIG. 2 An alternate embodiment of a computer network 200 in which the present invention may be implemented is illustrated in Fig. 2.
  • the computer network 200 includes multiple Intranets 204 and 2 06 each connecting desktop computer systems 208-218 to an expanded network and desktop computer systems 220-224. Routers connect Intranets 204-206 to the expanded network and desktop computer systems 220- 224 are connected to the Internet 226 through modem 230. It should be noted that other connection means may be utilized.
  • Desktop computer systems 208-218, 220 and 224 each serves as clients to desktop computer system 222 and system 222 serves as a server system to systems 208-218, 220 and 224. Components on the expanded network are connected to each other through physical media. As would be apparent, the client/server arrangement among desktop computer systems 208-224 may be modified.
  • an interactive virtual-reality application resides on clients / desktop computer systems 104-110 or on server 102.
  • Fig. 3 illustrates how components on a particular client 302 in the virtual reality environment interact with components on server 350.
  • client 302 may be connected to a JAVATM based server 352 through a client controller 304.
  • Interactive virtual-reality applications residing on JAVATM based server 352 may be executed by three-dimensional interactive applications on client 302 through JAVATM Remote Method Invocation (RMI).
  • RMI Remote Method Invocation
  • JAVATM RMI enables objects executing on client 302 to invoke methods of objects on server 352. The invoked methods are thereafter executed on the server 352.
  • Each desktop computer system 104- 110 may also include a desktop videoconferencing application and a camera 126-132.
  • Client 302 exchanges non- Virtual Reality Model Languages (VRML) data with JAVA TM based server 352.
  • VRML supports three-dimensional graphics for computerized generation of virtual reality environments.
  • a VRML Browser 306 exchanges VRML data with a VRML community server 354.
  • Non-VRML information transmitted from client 302 may be stored in databases 358, 360 or 362 and community server 354 transmits VRML information stored in VRML databases 364 to VRML client 306.
  • Client 302 additionally includes a voice-sound plug-in 314 for allowing users of the virtual reality environment to verbally communicate with each other.
  • a voice environment sound server 366 may generate special voice propagation to users to simulate the relative positioning of each participant within the virtual environment. It should also be noted that voice compression and other methods for verbal communication between users in the virtual environment might also be used.
  • Browser 308 may be connected to the expanded network through a second user interface 310.
  • the second user interface 310 accesses locally stored VRML information 312 that may be pre-loaded on each desktop system 104-110.
  • JAVATM based server 352 may be connected to a Hyper Text Transfer Protocol (HTTP) web server 356 for access to information on the web.
  • HTTP Hyper Text Transfer Protocol
  • HTTP Hyper Language
  • virtual reality environment 400 Upon a user logging on to a desktop computer system 104-110, client 302 forwards the user authentication information to server 352 for storage in biographical database 358.
  • Biographical database 358 stores, among other things, organized information corresponding to the results of exercises performed by users and users' profiles. All events triggered by the users are stored in databases 360-362 to maintain a complete audit of how the system is used.
  • virtual reality environment 400 is tailored to function as a template for solving business problems.
  • Virtual reality environment 400 includes a facilitator 404 and one or more participants 406. The facilitator 404 guides and monitors the navigation of the participants through virtual reality environment 400 to prompt the participants to negotiate complex problems and reach collaborative decisions.
  • Functions 408 of facilitator 404 include debriefing and/or teaching the participants, adding challenges to the virtual reality environment and/or modifying the environment.
  • facilitator 404 may describe a business problem and an associated exercise to the participant; time how long participants collaborate before a solution to the business function is found; move the participants to other locations in virtual environment 400 and increase or decrease the difficulty of each exercise based on the participants' performance.
  • Functions 408 of facilitator 404 may be automated or controlled by "real-time" human interaction. Participants 406 in environment 400 follow a script and they may monitor each other or be monitored by the facilitator 404 to ensure collaboration in arriving at a solution to a business problem. Additionally participants 406 must collaborate and communicate to solve simulated exercises in virtual environment 400. Skills developed by participants 406 in environment 400 are applicable to solving real-time business problems/issues.
  • Each participant 406 and facilitator 404 in environment 400 chooses his/her own virtual persona or "avatar". To heighten the sense of realism, pictures of the participants' faces may be mapped onto the avatar bodies. Environment 400 is divided into virtual reality scenes 412 where all participants reside. While participants 406 usually reside within the same virtual reality scene, a participant may individually navigate within the same virtual scenes. Facilitator 404 may also move participants within the same scene and/or into and out of scenes individually or as a group.
  • Facilitator 404 may generate commands either through automation or human interaction to move the participants 406 along to subsequent scenes. Participants 406 may also move to subsequent scenes or scenes in environment 400 in response to actions by an individual participant, by the group, or by the facilitator. When the facilitator functions 408 are performed through human interaction, options for modifying environment 400 are continually presented to the facilitator 404. For example, facilitator 404 may increase or decrease the level of difficulty of each exercise based on the performance of participants 406. Facilitator 404 may also 'listen' to dialogue between the participants, and when they are confronted with additional challenges, and facilitator 404 may move the participants 406 to other scenes and/or wait until an event occurs before commencing the next scene.
  • facilitator 404 may selectively communicate with each participant, with a group of participants or with all of the participants. For example, during an exercise, if facilitator 404 determines that a particular participant is having a problem, facilitator 404 may provide one-on-one attention to that participant or instruct other participants or groups of participants on how the help the participant with the problem.
  • the present invention By controlling functions 408 of facilitator 404 through real-time human interaction, the present invention enables dynamic operation flows, i.e., exercises are implemented based on real-time interaction with human.
  • the invention offers an advantage over script operations of three-dimension games where the flows of these games are predetermined by predefined decisions in the script.
  • the flow of exercises in environment 400 is dynamic and subject to input from facilitator 404.
  • the facilitator concept enables the multi-user virtual environment 400 to serve as a learning tool. This concept gives participants 406 partial control to navigate through environment 400 in accordance with facilitator 404.
  • Facilitator 404 has privileged access to control the virtual environment 400 in order to create a learning environment.
  • the facilitator 404 adds a structure to VRML technology that affects collaborative learning between participants and guides participants to achieve team- oriented goals over and above script-operation of three-dimensional games.
  • functions 408 of facilitator 404 and functions associated with events in the business exercise are stored on server 350.
  • functions 408 of facilitator 404 may also be stored on a desktop computer system / client 302.
  • Server 350 maintains the states of each participant 406 as they navigate through the virtual environment.
  • Each participant's state includes the participant's location in the virtual environment, a list of items owned by the participant and a history of tasks completed by the participant.
  • the history of each participant's task is stored in databases 360-362 to maintain a complete audit of how the system is used.
  • the facilitator accesses each participant's state on the server to administrate navigation of the corresponding participant.
  • triggers automatically are set for the next scene.
  • client 302 forwards a request to JAVATM based server 352, which then instructs client 302 to load VRML data (from client 302 hard drive or community server 354). All activities are stored into the event or transaction database 360-368 for later evaluation of the business exercise.
  • FIG. 5 illustrates a flowchart of a virtual reality application that utilizes the present invention.
  • the application revolves around a team of employees from a fictional company. The team is challenged to travel to a bridge site in a distant city where construction of a bridge has stopped because of the differing needs of a variety of neighborhood, political, and business stakeholders. The team must determine what caused the stoppage and present a solution to continue construction of the bridge.
  • Step 510 upon entering the virtual reality environment, each participant avatar enters a virtual three-dimensional lobby where a receptionist "bot", a system generated animated object, plays a prerecorded welcoming message.
  • the receptionist bot 'instructs' the participants to visit different virtual rooms where information about the role-playing exercise and the process of collaborative decision making, conflict management, and methods of negotiating are presented.
  • Step 520 each participant avatar is instructed to roam through some of the virtual scenes to become comfortable with the virtual environment and to later return to the virtual lobby to begin a business exercise.
  • each participant avatar enters into a virtual practice room where a tutorial on how to navigate virtual locations and communicate with other avatars is presented. For example, avatars learn how to take possession of virtual objects and transfer virtual objects to other avatars, drive a virtual automobile, and communicate with other avatars, either through private conversations with another avatars, semi- private conversations with portions of the group, or a group-wide discussion. Users of the system also learn about menu features, such as a help button, a timer, inventory boxes, and a status bar (health, rest and food), that appear on each desktop computer screen.
  • participant avatars are instructed to enter a virtual conference room. When the last avatar enters, the business exercise begins.
  • the users represented by the participant avatar hear a voice that is associated with the facilitator avatar.
  • This speech either electroniccally generated or spoken by a human instructor, introduces the users to the business problem.
  • the facilitator avatar assigns the participant avatars to roles which include a community relations manager, a finance manager, a marketing manager, an operations manager, a human resources manager, and a sales manager.
  • Each role within the fictional corporation entails a variety of inter-company politics to add reality to the business exercise.
  • the facilitator avatar introduces shared responsibilities and items, represented by icons, to the participants' avatars by triggering the system. Examples of icons may include a cell phone icon, a debit card icon, a travel map icon, and an employee manual icon.
  • the cell phone icon may be used to make calls during the journey, the debit card icon may be used to pay for the participants' virtual overnight stay and meals.
  • the travel map icon may be used to guide the participants to the virtual construction site and the employee manual icon may be used to explain the company's policies on personal resources (meals and rest stops), cell phone usage, appropriate usage and balance of the debit card, and the bonus plan at the company.
  • the items may be divided among the participant avatars and the participants are given a certain amount of time to decide which participant is responsible for a particular item.
  • the facilitator monitors communications between the participants, and if they are unsuccessful in this task, the facilitator enters the virtual environment on each desktop computer and assists the user on that computer in negotiating through the task. If necessary, i.e., there is no agreement among the participants, the facilitator may assign items to each participant avatar.
  • Step 570 the facilitator starts a discussion of travel planning issues.
  • the participants must jointly decide, from a list of available choices, on which type of vehicle to rent, insurance coverage to buy and route to travel.
  • the facilitator monitors the participants' collaboration during discussions associated with the travel planning decisions, and is able to interject to assist, provide guidance and or impose a particular solution.
  • the facilitator Upon receiving a call informing them that their virtual car is ready, the facilitator instructs the participants to begin the journey.
  • the journey to the bridge site destination is designed to function as a communication and joint decision-making exercise, monitored by the facilitator.
  • the participants may confront several possible challenges, depending in part upon the facilitator's judgment regarding the prudence of the participants' collective decisions. For example, the participants may be detained by a police officer bot for opting to travel beyond the legal speed limit, which will consume their time and financial resources.
  • the participants may encounter obstacles including flooding conditions, traffic, road construction, hunger and sickness requiring a hospital visit.
  • the participants may also be forced to stop for fuel, rest stops and food at inopportune times.
  • the role of the facilitator is to impose an optimal number of obstacles, according to the skill levels demonstrated by the participants, to provide opportunities for the participants to practice managing business conflicts.
  • each participant must keep track of his/her assigned item, for example, the debit card icon.
  • the server system also keeps track of each object and the resources available therein.
  • the facilitator monitors conversations among the participants to examine the level of information sharing and the facilitator evaluates the quality of the participants' discussions for accessing each participant's progress.
  • Step 590 when the participants successfully reach the work site, a site manager provides background about the issues that relate to the work stoppage. The participants are asked to meet with all parties and devise a solution.
  • Step 600 After the site manager approves the plan, the team moves to the cranes and watches as the virtual bridge is successfully constructed. Upon the conclusion of the project, the participants return to the initial virtual conference room with the facilitator to debrief and discuss the exercise.

Abstract

A virtual environment (400) for solving business-oriented problems by interactive-collaborative learning involving one or more participants (406) that are monitored by a facilitator (404). The virtual environment for facilitating collaborative decision-making is implemented on an interactive distributed network. Upon 'entering' the virtual environment, each participant chooses a virtual persona or 'avatar' and each participant may navigate through the virtual environment individually or with other participants. The facilitator guides and monitors participants' navigation through the virtual environment and the facilitator may prompt the participants to negotiate complex problems presented by a software application to reach collaborative decisions. Additionally, the facilitator may interact one-to-one with each participant or with a selective group of participants or with all of the participants. Each participant utilizes a three-dimensional application that is executed on a client computer system and the facilitator's functions and other functions relating to the virtual environment may be stored on a server computer.

Description

A System Containing A Multi-User Virtual Learning Environment
Field of the Invention
The present invention relates to a multi-user distributed interactive virtual reality environment, and more particularly, to a multi-user interactive virtual environment for collaborative learning through task-based group interaction monitored by a configurable project facilitator.
Background of the Invention Advances in memory storage and processing capabilities for computer hardware, telecommunication networks, and multimedia technology have facilitated the development of distributed real-time virtual reality simulations in which users can interact with each other in a fashion that closely resembles actual reality. Improved Internet browser software supports three-dimensional graphics for computerized generation of "scenes," virtual representations of physical objects or locations. Thus, users of virtual reality programs on computers connected through dedicated networks or through the Internet can interact within a multi-user virtual reality environment. Current network-based virtual reality applications, such as virtual three- dimensional maps for promoting tourism or computer-generated motion video for advertising, have generally been limited to single-user applications. While three- dimensional multi-user virtual reality environments are used in military simulations and animated / action and adventure computer games, there are no current facilitator-led three-dimensional multi-user virtual reality environments to address general and/or specific business needs. Moreover, existing multi-user virtual reality environments do not provide a structure to effect collaborative interaction between participants and to guide participants to achieve team-oriented goals.
Summary of the Invention
The present invention relates to a virtual environment for solving business- oriented problems by interactive-collaborative learning involving one or more participants that are monitored by a facilitator. Upon "entering" the virtual environment, each participant chooses a virtual persona or "avatar" and each participant may navigate through the virtual environment individually or with other participants. The facilitator guides and monitors participants' navigation through the virtual environment and the facilitator may prompt the participants to negotiate complex problems presented by a software application to reach collaborative decisions. Additionally, the facilitator may interact one-to-one with each participant or interact with a selective group of participants or with all of the participants.
One feature of the present invention is to provide a virtual environment on a distributed network where participants executing three-dimensional applications on desktop computer systems are connected to each other and a facilitator via the network and the participants may communicate with each other and the facilitator through the network.
Another feature of the invention is to provide a configurable facilitator for modifying the virtual environment based on the participants' performance. The facilitator functions may be automated or controlled by 'real-time' human interaction and they may reside on a desktop computer system or a server system. The invention allows the facilitator to administrate interaction among and between each of the participants and to facilitate collaboration and joint decision-making by participants. The facilitator may selectively communicate with one of the participants, with a selected group of the participants and/or with all of the participants. Additionally, the facilitator may selectively control navigation of one or more of the participants through the virtual environment. Another feature of the invention is to provide a virtual environment where a computer system enables assignment of ownership of items by participants such that, the owner of each item may navigate the virtual environment in a particular way not otherwise navigable by other participants. Ownership of the items may be transferred directly between participants or through the facilitator and the facilitator may control acquisition of ownership of items. The computer system keeps track of ownership of each item in the virtual environment.
Another feature of the invention is to provide a virtual environment where the facilitator or the computer system controls aspects and/or elapsed time of the virtual environment. The computer system also maintains a state of each of the participants as they navigate through the virtual environment. Each participant's state includes the participant's location in the virtual environment, a list of items owned by the participant and a history of tasks completed by the participant. The facilitator accesses the state to administrate navigation of the corresponding participant.
Another feature of the invention is to provide a virtual environment where each participant is associated with an avatar and 'perceives' other avatars associated with other participants. The participants may selectively communicate with each other through the computer system or via the computer system through the Internet. The communication may include voice communication and gesturing. An additional feature of the invention is to provide a virtual environment where the facilitator may selectively view the virtual environment through the perspective of at least one of the participants.
Yet another feature of the invention is to provide a virtual environment where the computer system receives information from a desktop computer system, distributes portions of the information to one or more other desktop computers and/or an automated or human facilitator and updates the virtual environment in accordance with the information. The information may include voice message, text message, a position update and request to acquire ownership in an item. The computer system may also receive information from the automated or human facilitator and selectively distribute the information to the desktop computer systems.
Yet still another feature of the present invention is to provide a virtual environment where participants, through natural speaking, selectively communicate online by means of electronic voice transmission. Additional features and advantages of the invention will be set forth in part in the description that follows, and in part will be obvious from the description, or may be learned by practice of the invention.
To achieve the features and in accordance with the purpose of the invention, as embodied and broadly described herein, the invention comprises a multi-user distributed interactive \irtual system comprising a computer system for generating and controlling a virtual e ironment; a plurality of user systems, coupled to the computer system, that communicate with one another through the computer system; and a facilitator system, coupled to the computer system, that administrates interaction among each of the plurality of user systems and between each the the plurality of user systems and the plurality of user systems and between each the the plurality of user systems and the virtual environment.
Brief Description of the Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention that together with the description serve to explain the principles of the invention. In the drawings:
Fig. 1 illustrates a computer network in which the inventive multi-user virtual reality environment may be incoφorated;
Fig. 2 illustrates an alternate embodiment of a computer network in which the inventive multi-user virtual reality environment may be incorporated;
Fig. 3 illustrates interactions between client components and server components on the computer network; Fig. 4 illustrates components of the inventive virtual reality system; and
Fig. 5 illustrates a flow chart of an application that utilizes the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
In the present invention, participants in the virtual environment solve business problems by interactive collaboration with other participants and they are guided by a facilitator. Each participant utilizes a three dimensional virtual reality application that is executed on a desktop computer system in a distributed network. Upon "entering" the virtual emironment, each participant chooses a virtual persona or "avatar" and the participant may navigate through the virtual environment individually or with other participants. The facilitator monitors the participants as they navigate through the virtual environment and the facilitator may interact one-to-one with each participant or interact with a selective group of participants or with all of the participants.
Fig. 1 is an example of a local area network (LAN) 100 that is configured to connect components executing virtual reality programs; such that, users of the LAN components can interact within a shared virtual environment. LAN 100 may include a server 102, one or more desktop computer systems (illustrated as computer systems 104, 106, 108, 110) and peripherals such as printers and/or other devices 112 that may be shared by components on LAN 100. Computer systems 104-110 may serve as clients for server 102 and/or as clients and/or servers for each other and/or for other components connected to LAN 100. Components on LAN 100 may be preferably connected together by cable media, for example copper or fiber-optic cable, and LAN 100 typology may be a token ring topology 114. As would be apparent to those of ordinary skill in the art, other media, for example wireless media such as optical and radio frequency, may also connect components on LAN 100 and other network topologies such as Ethernet may be used.
Data may be transferred between components on LAN 100 in packets, i.e., blocks of data that are individually transmitted over LAN 100. Routers 120, 122 create an expanded network by connecting LAN 100 to other computer networks, such as, the Internet, other LANs or Wide Area Networks (WAN). Routers are hardware devices that may include a conventional processor, memory, and separate I/O interface for each network to which it connects. Hence, components on the expanded network may share information and services with each other. It should be noted that, computer systems 104-110 may be connected directly to other computer networks through modems or other connection devices. Thus, computer systems 104-110 may share information and services with components on the computer networks. In order for communications to occur between components of physically connected networks, all components on the expanded network and the routers that connect them must adhere to a standard protocol. Computer networks connected to the Internet and to other networks typically use the TCP/IP Layering Model Protocol. It should be noted that other internetworking protocols may be used.
An alternate embodiment of a computer network 200 in which the present invention may be implemented is illustrated in Fig. 2. The computer network 200 includes multiple Intranets 204 and 2 06 each connecting desktop computer systems 208-218 to an expanded network and desktop computer systems 220-224. Routers connect Intranets 204-206 to the expanded network and desktop computer systems 220- 224 are connected to the Internet 226 through modem 230. It should be noted that other connection means may be utilized. Desktop computer systems 208-218, 220 and 224 each serves as clients to desktop computer system 222 and system 222 serves as a server system to systems 208-218, 220 and 224. Components on the expanded network are connected to each other through physical media. As would be apparent, the client/server arrangement among desktop computer systems 208-224 may be modified. In a preferred embodiment of the present invention, an interactive virtual-reality application resides on clients / desktop computer systems 104-110 or on server 102. Fig. 3 illustrates how components on a particular client 302 in the virtual reality environment interact with components on server 350. As illustrated in Fig. 3, client 302 may be connected to a JAVA™ based server 352 through a client controller 304. Interactive virtual-reality applications residing on JAVA™ based server 352 may be executed by three-dimensional interactive applications on client 302 through JAVA™ Remote Method Invocation (RMI). To perform server-based functions on client 302, JAVA™ RMI enables objects executing on client 302 to invoke methods of objects on server 352. The invoked methods are thereafter executed on the server 352. Each desktop computer system 104- 110 may also include a desktop videoconferencing application and a camera 126-132. Client 302 exchanges non- Virtual Reality Model Languages (VRML) data with JAVA ™ based server 352. VRML supports three-dimensional graphics for computerized generation of virtual reality environments. A VRML Browser 306 exchanges VRML data with a VRML community server 354. Non-VRML information transmitted from client 302 may be stored in databases 358, 360 or 362 and community server 354 transmits VRML information stored in VRML databases 364 to VRML client 306. Client 302 additionally includes a voice-sound plug-in 314 for allowing users of the virtual reality environment to verbally communicate with each other. A voice environment sound server 366 may generate special voice propagation to users to simulate the relative positioning of each participant within the virtual environment. It should also be noted that voice compression and other methods for verbal communication between users in the virtual environment might also be used.
Users on desktop computer systems 104-110 may use Netscape Navigator ™ browser or 308 any other browser to access information on the World Wide Web (Web). Browser 308 may be connected to the expanded network through a second user interface 310. To display virtual environments on a desktop computer system 104-110, the second user interface 310 accesses locally stored VRML information 312 that may be pre-loaded on each desktop system 104-110. JAVA™ based server 352 may be connected to a Hyper Text Transfer Protocol (HTTP) web server 356 for access to information on the web. Browser 308 accesses and displays Hyper Text Markup
Language (HTML) documents on the web through the HTTP web servers.
Upon a user logging on to a desktop computer system 104-110, client 302 forwards the user authentication information to server 352 for storage in biographical database 358. Biographical database 358 stores, among other things, organized information corresponding to the results of exercises performed by users and users' profiles. All events triggered by the users are stored in databases 360-362 to maintain a complete audit of how the system is used. According to the invention, virtual reality environment 400 is tailored to function as a template for solving business problems. Virtual reality environment 400 includes a facilitator 404 and one or more participants 406. The facilitator 404 guides and monitors the navigation of the participants through virtual reality environment 400 to prompt the participants to negotiate complex problems and reach collaborative decisions. Functions 408 of facilitator 404 include debriefing and/or teaching the participants, adding challenges to the virtual reality environment and/or modifying the environment. For example, facilitator 404 may describe a business problem and an associated exercise to the participant; time how long participants collaborate before a solution to the business function is found; move the participants to other locations in virtual environment 400 and increase or decrease the difficulty of each exercise based on the participants' performance. Functions 408 of facilitator 404 may be automated or controlled by "real-time" human interaction. Participants 406 in environment 400 follow a script and they may monitor each other or be monitored by the facilitator 404 to ensure collaboration in arriving at a solution to a business problem. Additionally participants 406 must collaborate and communicate to solve simulated exercises in virtual environment 400. Skills developed by participants 406 in environment 400 are applicable to solving real-time business problems/issues.
Each participant 406 and facilitator 404 in environment 400 chooses his/her own virtual persona or "avatar". To heighten the sense of realism, pictures of the participants' faces may be mapped onto the avatar bodies. Environment 400 is divided into virtual reality scenes 412 where all participants reside. While participants 406 usually reside within the same virtual reality scene, a participant may individually navigate within the same virtual scenes. Facilitator 404 may also move participants within the same scene and/or into and out of scenes individually or as a group.
Facilitator 404 may generate commands either through automation or human interaction to move the participants 406 along to subsequent scenes. Participants 406 may also move to subsequent scenes or scenes in environment 400 in response to actions by an individual participant, by the group, or by the facilitator. When the facilitator functions 408 are performed through human interaction, options for modifying environment 400 are continually presented to the facilitator 404. For example, facilitator 404 may increase or decrease the level of difficulty of each exercise based on the performance of participants 406. Facilitator 404 may also 'listen' to dialogue between the participants, and when they are confronted with additional challenges, and facilitator 404 may move the participants 406 to other scenes and/or wait until an event occurs before commencing the next scene. Upon monitoring interaction among participants, facilitator 404 may selectively communicate with each participant, with a group of participants or with all of the participants. For example, during an exercise, if facilitator 404 determines that a particular participant is having a problem, facilitator 404 may provide one-on-one attention to that participant or instruct other participants or groups of participants on how the help the participant with the problem.
By controlling functions 408 of facilitator 404 through real-time human interaction, the present invention enables dynamic operation flows, i.e., exercises are implemented based on real-time interaction with human. Thus, the invention offers an advantage over script operations of three-dimension games where the flows of these games are predetermined by predefined decisions in the script. Hence, the flow of exercises in environment 400 is dynamic and subject to input from facilitator 404. The facilitator concept enables the multi-user virtual environment 400 to serve as a learning tool. This concept gives participants 406 partial control to navigate through environment 400 in accordance with facilitator 404. Facilitator 404 has privileged access to control the virtual environment 400 in order to create a learning environment. Examples of applications that may lend themselves to this mode of learning include hazardous materials training, precision manufacturing, plant operations, military command and control, military field training, and group engineering and design applications. Thus, the facilitator 404 adds a structure to VRML technology that affects collaborative learning between participants and guides participants to achieve team- oriented goals over and above script-operation of three-dimensional games. According to the invention, functions 408 of facilitator 404 and functions associated with events in the business exercise are stored on server 350. It should be noted that functions 408 of facilitator 404 may also be stored on a desktop computer system / client 302. Server 350 maintains the states of each participant 406 as they navigate through the virtual environment. Each participant's state includes the participant's location in the virtual environment, a list of items owned by the participant and a history of tasks completed by the participant. The history of each participant's task is stored in databases 360-362 to maintain a complete audit of how the system is used. The facilitator accesses each participant's state on the server to administrate navigation of the corresponding participant.
When a new scene 412 is transmitted to each client 302 (loaded into the memory area on each desktop computer 104-110), triggers automatically are set for the next scene. Upon the occurrence of a trigger, client 302 forwards a request to JAVA™ based server 352, which then instructs client 302 to load VRML data (from client 302 hard drive or community server 354). All activities are stored into the event or transaction database 360-368 for later evaluation of the business exercise.
While an example of a virtual reality application is presented below to illustrate features of the inventive system, it should be understood that numerous applications may be applied to this invention and the scope of this invention is not confined to a particular application, scenario or role-playing exercise. Fig. 5 illustrates a flowchart of a virtual reality application that utilizes the present invention. The application revolves around a team of employees from a fictional company. The team is challenged to travel to a bridge site in a distant city where construction of a bridge has stopped because of the differing needs of a variety of neighborhood, political, and business stakeholders. The team must determine what caused the stoppage and present a solution to continue construction of the bridge.
Planning for the project and the journey itself presents a variety of opportunities for the team to exercise communication, listening, and information sharing skills. The team members in this application must share responsibilities, use collaborative decision making and problem solving skills, and build conflict management skills. After a workable solution is found, the team members virtually complete the bridge. To increase the complexity of the challenges presented to the team, as the team moves through the virtual environment, the facilitator may escalate the degree of difficulty in each scene. For example, the facilitator may place a road block on a virtual road to the bridge to test information sharing between team members.
In Step 510, upon entering the virtual reality environment, each participant avatar enters a virtual three-dimensional lobby where a receptionist "bot", a system generated animated object, plays a prerecorded welcoming message. The receptionist bot 'instructs' the participants to visit different virtual rooms where information about the role-playing exercise and the process of collaborative decision making, conflict management, and methods of negotiating are presented. In Step 520, each participant avatar is instructed to roam through some of the virtual scenes to become comfortable with the virtual environment and to later return to the virtual lobby to begin a business exercise.
In Step 530, each participant avatar enters into a virtual practice room where a tutorial on how to navigate virtual locations and communicate with other avatars is presented. For example, avatars learn how to take possession of virtual objects and transfer virtual objects to other avatars, drive a virtual automobile, and communicate with other avatars, either through private conversations with another avatars, semi- private conversations with portions of the group, or a group-wide discussion. Users of the system also learn about menu features, such as a help button, a timer, inventory boxes, and a status bar (health, rest and food), that appear on each desktop computer screen. In Step 540, participant avatars are instructed to enter a virtual conference room. When the last avatar enters, the business exercise begins. At this point, the users represented by the participant avatar hear a voice that is associated with the facilitator avatar. This speech, either electroniccally generated or spoken by a human instructor, introduces the users to the business problem. In Step 550, the facilitator avatar then assigns the participant avatars to roles which include a community relations manager, a finance manager, a marketing manager, an operations manager, a human resources manager, and a sales manager. Each role within the fictional corporation entails a variety of inter-company politics to add reality to the business exercise. In Step 560, the facilitator avatar introduces shared responsibilities and items, represented by icons, to the participants' avatars by triggering the system. Examples of icons may include a cell phone icon, a debit card icon, a travel map icon, and an employee manual icon. The cell phone icon may be used to make calls during the journey, the debit card icon may be used to pay for the participants' virtual overnight stay and meals. The travel map icon may be used to guide the participants to the virtual construction site and the employee manual icon may be used to explain the company's policies on personal resources (meals and rest stops), cell phone usage, appropriate usage and balance of the debit card, and the bonus plan at the company. The items may be divided among the participant avatars and the participants are given a certain amount of time to decide which participant is responsible for a particular item. The facilitator monitors communications between the participants, and if they are unsuccessful in this task, the facilitator enters the virtual environment on each desktop computer and assists the user on that computer in negotiating through the task. If necessary, i.e., there is no agreement among the participants, the facilitator may assign items to each participant avatar.
In Step 570, the facilitator starts a discussion of travel planning issues. The participants must jointly decide, from a list of available choices, on which type of vehicle to rent, insurance coverage to buy and route to travel. Again in Step 580, the facilitator monitors the participants' collaboration during discussions associated with the travel planning decisions, and is able to interject to assist, provide guidance and or impose a particular solution.
Upon receiving a call informing them that their virtual car is ready, the facilitator instructs the participants to begin the journey. The journey to the bridge site destination is designed to function as a communication and joint decision-making exercise, monitored by the facilitator. The participants may confront several possible challenges, depending in part upon the facilitator's judgment regarding the prudence of the participants' collective decisions. For example, the participants may be detained by a police officer bot for opting to travel beyond the legal speed limit, which will consume their time and financial resources. Along the journey, the participants may encounter obstacles including flooding conditions, traffic, road construction, hunger and sickness requiring a hospital visit. The participants may also be forced to stop for fuel, rest stops and food at inopportune times. The role of the facilitator is to impose an optimal number of obstacles, according to the skill levels demonstrated by the participants, to provide opportunities for the participants to practice managing business conflicts. As the participant avatars navigate through the virtual environment, each participant must keep track of his/her assigned item, for example, the debit card icon. The server system also keeps track of each object and the resources available therein. The facilitator monitors conversations among the participants to examine the level of information sharing and the facilitator evaluates the quality of the participants' discussions for accessing each participant's progress. In Step 590, when the participants successfully reach the work site, a site manager provides background about the issues that relate to the work stoppage. The participants are asked to meet with all parties and devise a solution. Locations at the work site, for example, virtual trailers, are provided for the participants to hold discussions with the opposing groups. After hearing each of the issues, the team gathers in another location and decides upon a course of action. Again, the facilitator monitors this discussion for later evaluation. In Step 600, after the site manager approves the plan, the team moves to the cranes and watches as the virtual bridge is successfully constructed. Upon the conclusion of the project, the participants return to the initial virtual conference room with the facilitator to debrief and discuss the exercise.
The foregoing description has been directed to specific embodiments of this invention. It will be apparent, however, that other variations and modifications may be made to the described embodiments, with the attainment of some or all of their advantages. Therefore, it is the object of the appended claims to cover all such variations and modifications as come within the true spirit and scope of the invention.

Claims

Claims:
1. A multi-user, distributed, interactive, virtual reality system comprising: a computer system for generating and controlling a virtual environment; a plurality of user systems, coupled to said computer system, that communicate with one another through the computer system; and a facilitator system, coupled to said computer system, that administrates interaction among each of said plurality of user systems and between each of said plurality of user systems and the virtual environment.
2. The system of claim 1, wherein said facilitator system selectively communicates with one of said plurality of user systems.
3. The system of claim 1, wherein said facilitator system selectively communicates with a portion of said plurality of user systems.
4. The system of claim 1, wherein said facilitator system selectively communicates with all of said plurality of user systems.
5. The system of claim 1 , wherein said facilitator system selectively controls navigation of one of said plurality of user systems through the virtual environment.
6. The system of claim 1, wherein said facilitator system selectively controls navigation of said plurality of users systems through the virtual environment.
7. The system of claim 1, wherein said facilitator system controls aspects of the virtual environment.
8. The system of claim 1, wherein said computer system controls aspects of the virtual environment.
9. The system of claim 7, wherein said facilitator system controls an elapsed time in the virtual environment.
10. The system of claim 1 , wherein each of said plurality of user systems navigates in the virtual environment from a particular perspective.
11. The system of claim 10, wherein each of said plurality of user systems is represented as an avatar in the virtual environment.
12. The system of claim 11, wherein one of said plurality of user systems perceives an avatar associated with another one of said plurality of user systems.
13. The system of claim 10, wherein said facilitator system selectively views a particular perspective of at least one of said plurality of user systems.
14. A method in a multi-user, distributed, interactive, virtual reality system comprising a computer system, a plurality of user systems, coupled to said computer system and a facilitator system, coupled to said computer system, said method comprising the steps of : generating and controlling a virtual environment by said computer system; communicating between said plurality of user systems through said computer system; and administrating through said facilitator system interaction among each of said plurality of user systems and between each of said plurality of user systems and the virtual environment.
15. The method of claim 14 further comprising the step of selectively communicating between said facilitator system and one of said plurality of user systems.
16. The method of claim 14 further comprising the step of selectively communicating between said facilitator system and a portion of said plurality of user systems.
17. The method of claim 14 further comprising the step of selectively communicating between said facilitator system and all of said plurality of user systems.
18. The method of claim 14 further comprising the step of selectively controlling through said facilitator system navigation of one of said plurality of user systems through the virtual environment.
19. The method of claim 14 further comprising the step of selectively controlling through said facilitator system navigation of said plurality of users systems through the virtual environment.
20. The method of claim 14 further comprising the step of controlling through said facilitator system aspects of the virtual environment.
21. The method of claim 14 further comprising the step of controlling through said computer system aspects of the virtual environment.
22. The method of claim 20 further comprising the step of controlling through said facilitator system an elapsed time in the virtual environment.
23. The method of claim 14 further comprising the step of navigating by each of said plurahty of user systems through the virtual environment.
24. The method of claim 23 further comprising the step of representing each of said plurality of user systems as an avatar in the virtual environment.
25. The method of claim 24 further comprising the step of perceiving by one of said plurality of user systems an avatar associated with another one of said plurality of user systems.
26. The method of claim 23 further comprising the step of selectively viewing through said facilitator system a particular perspective of at least one of said plurality of user systems.
27. A multi-user, distributed, interactive, virtual reality system comprising: a computer system for generating and controlling a virtual environment; an item in the virtual environment having characteristics associated with ownership; and a plurality of user systems, coupled to said computer system, that are capable of owning said item.
28. The system of claim 27, wherein an owning one of said plurality of user systems acquires ownership of said item.
29. The system of claim 28, wherein ownership of said item permits said owning one of said plurality of user systems to navigate the virtual environment in a particular way not otherwise navigable by any other of said plurality of user systems.
30. The system of claim 28, further comprising a facilitator system, coupled to said computer system, that grants one of said plurality of user systems ownership of said item.
31. The system of claim 28, further comprising a facilitator system, coupled to one of said plurality of user systems, that grants one of said plurality of user systems ownership of said item.
32. The system of claim 28, wherein ownership of said item is transferred directly to another one of said plurality of user systems.
33. The system of claim 28, wherein ownership of said item is transferred directly to another one of said plurality of users systems by said owning one of said plurality of said user systems.
34. The system of claim 28, further comprising a facilitator system, coupled to said computer system, that transfers ownership of said item directly from said owning one of said plurahty of user systems to another one of said plurality of user systems.
35. The system of claim 28, further comprising a facilitator system, coupled to one of said plurality of user systems, that transfers ownership of said item directly from said owning one of said plurality of user systems to another one of said plurality of user systems.
36. The system of claim 28, further comprising a facilitator system, coupled to said computer system, that controls acquisition of ownership of said item by said owning one of said plurality of user systems.
37. The system of claim 28, further comprising a facilitator system, coupled to one of said plurality of user systems, that controls acquisition of ownership of said item by said owning one of said plurality of user systems.
38. The system of claim 28, wherein said computer system tracks ownership of said item in the virtual environment.
39. The system of claim 27, wherein examples of icons of said items include one of a key, a payment instrument, a telecommunications device, and a map.
40. An owning method in a multi-user, distributed, interactive, virtual reality system comprising a computer system, a plurality of items representing physical objects and a plurality of user systems coupled to said computer system, said method comprising the steps of: generating and controlling said virtual environment through said computer system; and associating ownership of said plurality of items in said virtual environment with said plurahty of system users.
41. The method of claim 40, further comprising the step of acquiring ownership of one of said plurality of items by an owning one of said plurality of user systems.
42. The method of claim 40, further comprising the step of permitting said owning one of said plurality of user systems to navigate the virtual environment in a particular way not otherwise navigable by any other of said plurality of user systems.
43. The method of claim 40, further comprising the step of granting one of said plurality of user systems ownership of said item by a facilitator system, coupled to said computer system,.
44. The method of claim 40, further comprising the step of granting one of said plurality of user systems ownership of said item by a facilitator system, coupled to said one of said plurality of user systems.
45. The method of claim 40, further comprising the step of transferring ownership of said item directly to another one of said plurality of user systems.
46. The method of claim 45, further comprising the step of transferring ownership of said item directly to another one of said plurality of users systems by said owning one of said plurality of said user systems.
47. The method of claim 40, further comprising the step of transferring ownership of said item directly from said owning one of said plurality of user systems to another one of said plurality of user systems by facilitator system, coupled to said computer system.
48. The method of claim 40, further comprising the step of transferring ownership of said item directly from said owning one of said plurality of user systems to another one of said plurahty of user systems by facilitator system, coupled to one of said plurality of user systems.
49. The method of claim 40, further comprising the step of controlling through a facilitator system, coupled to said computer system, acquisition of ownership of said item by said owning one of said plurality of user systems.
50 The method of claim 40, further comprising the step of controlling through a facilitator system, coupled to one of said plurality of user systems, acquisition of ownership of said item by said owning one of said plurality of user systems.
51. The method of claim 40, further comprising the step of tracking ownership of said item in said virtual environment through said computer system.
52. A multi-user, distributed, interactive, virtual reality system comprising: a computer system for generating and controlling a virtual environment; and a plurality of user systems, coupled to said computer system, that navigate through the virtual environment and that selectively communicate with one another via said computer system.
53. The system of claim 52, wherein said communication occurs between at least two of said plurality of user systems via said computer system through the Internet.
54. The system of claim 52, wherein said communication includes voice communication.
55. The system of claim 53, wherein said communication includes voice communication.
56. The system of claim 52, wherein said communication includes gesturing.
57. The system of claim 53, wherein said communication includes gesturing.
58. The system of claim 52, wherein at least two of said plurality of user systems communicate with one another via computer system without communicating to at least one other of said plurality of user systems.
59. A selective communication method in multi-user, distributed, interactive, virtual reality system comprising a computer system and a plurality of user systems, coupled to said computer system, that navigate through said virtual environment, said method comprising the steps of: generating and controlling said virtual environment through said computer system; and selectively communicating among said plurality of user systems via said computer system.
60. The method of claim 59 further comprising the step of communicating between at least two of said plurality of user systems via said computer system through the Internet.
61. The method of claim 59 further comprising voice communicating means.
62. The method of claim 60 further comprising voice communicating means.
63. The method of claim 59 further comprising gesturing communicating means.
64. The method of claim 60 further comprising gesturing communicating means.
65. The method of claim 59 further comprising the step of means of communicating between at least two of said plurality of user systems via said computer system without communicating with at least one other of said plurality of user systems.
66. A multi-user, distributed, interactive, virtual reality system comprising: a plurality of user systems that navigate through a virtual environment and that interact with one in the virtual environment; and a computer system, coupled to each of said plurality of user systems, that maintains a state of each of said plurality of user systems as they navigate through the virtual environment.
67. The system of claim 66, wherein said computer system is coupled to each of said plurality of user systems via the Internet.
68. The system of claim 66, wherein said state includes a location in the virtual environment of its corresponding user system.
69. The system of claim 66, wherein said state includes a list of items that are owned by its corresponding user system in the virtual environment.
70. The system of claim 66, wherein said state includes a representation of its corresponding user system in the virtual environment.
71. The system of claim 66, wherein said state includes a history of tasks completed by its corresponding user system in the virtual environment.
72. The system of claim 66, further comprising a facilitator system, coupled to said computer system, that accesses said state to administrate navigation of its corresponding user system in the virtual environment.
73. The system of claim 66, further comprising a facilitator system, coupled to one of said plurahty of user systems, that accesses said state to administrate navigation of its corcesponding user system in the virtual environment.
74. A method for maintaining the state of a plurality of user systems that navigate through and interact with one another in a virtual environment residing on a multi-user, distributed, interactive, virtual reality system comprising a computer system, coupled to each of said plurality of user systems, said method comprising the step of maintaining a state of each of said plurality of user systems as they navigate through the virtual environment.
75. The method of claim 74 further comprising the step of coupling said computer system to each of said plurality of user systems via the Internet.
76. The method of claim 74 further comprising the step of including in said state a location in the virtual environment of a corresponding user system.
77. The method of claim 74 further comprising the step of including in said state a list of items that are owned by a corresponding user system in the virtual environment.
78. The method of claim 74 further comprising the step of including in said state a representation of a corresponding user system in the virtual environment.
79. The method of claim 74 further comprising the step of including in said state a history of tasks completed by a corresponding user system in the virtual environment.
80. The method of claim 74 further comprising the step of accessing said state by a facilitator system, coupled to said computer system, to administrate navigation of a corresponding user system in the virtual environment.
81. The method of claim 74 further comprising the step of accessing said state by a facilitator system, coupled to one of said plurality of user systems, to administrate navigation of its corresponding user system in the virtual environment.
82. A multi-user, distributed, interactive, virtual reality system comprising: a plurality of user systems, coupled to a computer system, that navigate in a virtual environment; a facilitator system, coupled to said computer system, that administrates and monitors navigation of said plurality of user systems in the virtual environment; and said computer system that generates the virtual environment, that receives information from at least one of said plurality of user systems, that communicates at least a portion of said information to at least one other of said plurality of user systems, and that updates the virtual environment in accordance with said information.
83. The system of claim 82, wherein said computer system communicates at least a portion of said information to said facilitator system.
84. The system of claim 82, wherein said information includes a voice message from said one of said plurality of user systems.
85. The system of claim 82, wherein said information includes a text message from said one of said plurality of user systems.
86. The system of claim 82, wherein said information includes a position update from said one of said plurality of user systems.
87. The system of claim 82, wherein said information includes a request to acquire ownership in an item in the virtual environment.
88. The system of claim 82, wherein said computer system maintains a state of each of said plurality of user systems in the virtual environment.
89. The system of claim 88, wherein said server system determines which representations of said plurality of user systems a particular one of said plurality of user systems perceives in the virtual environment.
90. The system of claim 82, wherein said computer system receives information from one of said plurality of user systems and distributes the information to each of said plurality of user systems.
91. The system of claim 82, wherein said computer system receives information from one of said plurality of user systems and distributes the information to a portion of said plurality of user systems.
92. The system of claim 82, wherein said computer system receives information from said facilitator system and distributes the information to each of said plurality of user systems.
93. The system of claim 82, wherein said computer system receives information from said facilitator system and distributes the information to a portion of said plurality of user systems.
94. The system of claim 82, wherein said computer system receives information from said facilitator system and said facilitator inhibits the distribution of the information to at least a portion of said plurality of user systems.
95. The system of claim 82, wherein said computer system provides a scene change to all of said plurality of users systems.
96. The system of claim 94, wherein said particular scene is provided as directed by said facilitator system.
97. The system of claim 94, wherein said computer system maintains a state of each of said plurahty of user systems through said scene change.
98. The method of interaction in a multi-user, distributed, interactive, virtual reality system comprising a plurality of user systems, coupled to a computer system, a facilitator system, coupled to said computer system and said computer system, said method comprising the steps of: generating the virtual environment by said computer system; navigating in a virtual environment by said plurality of user systems; administrating and monitoring by said facilitator system navigation of said plurality of user systems in the virtual environment; receiving information from at least one of said plurality of user systems; communicating at least a portion of said information to at least one other of said plurality of user systems; and updating the virtual environment in accordance with said information.
99. The method of claim 97 further comprising the step of communicating by said computer system, at least a portion of said information to said facilitator system.
100. The method of claim 97 further comprising the step of including is said information a voice message from said one of said plurality of user systems.
101. The method of claim 97 further comprising the step of including is said information a text message from said one of said plurality of user systems.
102. The method of claim 97 further comprising the step of including is said information a position update from said one of said plurality of user systems.
103. The method of claim 97 further comprising the step of including is said information a request to acquire ownership in an item in the virtual environment.
104. The method of claim 97 further comprising the step of maintaining a state of each of said plurality of user systems in the virtual environment on said computer system.
105. The method of claim 103 further comprising the step of determining on said server system which representations of said plurality of user systems a particular one of said plurality of user systems perceives in the virtual environment.
106. The method of claim 97 further comprising the step of receiving information on said computer system from one of said plurality of user systems and distributing the information to each of said plurality of user systems.
107. The method of claim 97 further comprising the step of receiving information on said computer system from one of said plurality of user systems and distributing the information to a portion of said plurality of user systems.
108. The method of claim 97 further comprising the step of receiving information on said computer system from said facilitator system and distributing the information to each of said plurality of user systems.
109. The method of claim 97 further comprising the step of receiving information on said computer system from said facilitator system and distributing the information to a portion of said plurality of user systems.
110. The method of claim 97 further comprising the step of receiving information on said computer system from said facilitator system and inhibiting by said facilitator system the distribution of the information to at least a portion of said plurality of user systems.
111. The method of claim 97 further comprising the step of providing on said computer system a scene change to all of said plurality of users systems.
112. The method of claim 110 further comprising the step of providing said particular scene as directed by said facilitator system.
113. The method of claim 97 further comprising the step of maintaining a state of each of said plurality of user systems through said scene change.
PCT/US1999/016103 1998-07-17 1999-07-16 A system containing a multi-user virtual learning environment WO2000004478A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU51064/99A AU5106499A (en) 1998-07-17 1999-07-16 A system containing a multi-user virtual learning environment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US9329898P 1998-07-17 1998-07-17
US60/093,298 1998-07-17

Publications (2)

Publication Number Publication Date
WO2000004478A2 true WO2000004478A2 (en) 2000-01-27
WO2000004478A3 WO2000004478A3 (en) 2000-11-16

Family

ID=22238189

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/016103 WO2000004478A2 (en) 1998-07-17 1999-07-16 A system containing a multi-user virtual learning environment

Country Status (2)

Country Link
AU (1) AU5106499A (en)
WO (1) WO2000004478A2 (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000067227A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System method and article of manufacture for creating collaborative application sharing
WO2000067230A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System, method and article of manufacture for creating collaborative simulations with multiple roles for a single student
WO2000067232A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System, method and article of manufacture for creating chat rooms with multiple roles for multiple participants
WO2002009066A2 (en) * 2000-07-21 2002-01-31 Englishtown, Inc. A learning activity platform and method for teaching a foreign language over a network
WO2002097616A1 (en) * 2001-05-22 2002-12-05 Nanyang University Collaborative virtual enivonment system and method
US6493690B2 (en) 1998-12-22 2002-12-10 Accenture Goal based educational system with personalized coaching
US6535861B1 (en) 1998-12-22 2003-03-18 Accenture Properties (2) B.V. Goal based educational system with support for dynamic characteristics tuning using a spread sheet object
US6549893B1 (en) 1998-12-22 2003-04-15 Indeliq, Inc. System, method and article of manufacture for a goal based system utilizing a time based model
US6745170B2 (en) 1999-02-08 2004-06-01 Indeliq, Inc. Goal based educational system with support for dynamic characteristic tuning
GB2406669A (en) * 2003-10-02 2005-04-06 Mark Faulkner Meeting facilitator using virtual character
US6970858B1 (en) 1999-02-08 2005-11-29 Accenture, Llp Goal based system utilizing an activity table
US6993513B2 (en) 1999-05-05 2006-01-31 Indeliq, Inc. Interactive simulations utilizing a remote knowledge base
US7031651B2 (en) 2000-07-21 2006-04-18 Englishtown, Inc. System and method of matching teachers with students to facilitate conducting online private instruction over a global network
US7054848B1 (en) 1999-02-08 2006-05-30 Accenture, Llp Goal based system utilizing a time based model
US7065513B1 (en) 1999-02-08 2006-06-20 Accenture, Llp Simulation enabled feedback system
US7065512B1 (en) 1999-02-08 2006-06-20 Accenture, Llp Dynamic toolbar in a tutorial system
US7089222B1 (en) 1999-02-08 2006-08-08 Accenture, Llp Goal based system tailored to the characteristics of a particular user
US7117189B1 (en) 1998-12-22 2006-10-03 Accenture, Llp Simulation system for a simulation engine with a help website and processing engine
US7152092B2 (en) 1999-05-05 2006-12-19 Indeliq, Inc. Creating chat rooms with multiple roles for multiple participants
US7156665B1 (en) 1999-02-08 2007-01-02 Accenture, Llp Goal based educational system with support for dynamic tailored feedback
US7316000B2 (en) 2001-08-27 2008-01-01 International Business Machines Corporation Interactive agent for a topological multi-tier business application composer
US7386524B2 (en) 1999-02-08 2008-06-10 Accenture Global Services Gmbh Simulation enabled focused feedback tutorial system
US7428518B1 (en) 1998-12-22 2008-09-23 Accenture Global Services Gmbh Simulation enabled accounting tutorial system
US7433852B1 (en) 1998-12-22 2008-10-07 Accenture Global Services Gmbh Runtime program regression analysis tool for a simulation engine
US7536363B1 (en) 1998-12-22 2009-05-19 Accenture Global Services Gmbh Goal based system, utilizing a table based architecture
US7621748B2 (en) 1999-08-31 2009-11-24 Accenture Global Services Gmbh Computer enabled training of a user to validate assumptions
US7660778B1 (en) 1998-12-22 2010-02-09 Accenture Global Services Gmbh Runtime program analysis tool for a simulation engine
US7716284B2 (en) 2006-02-28 2010-05-11 Microsoft Corporation Subsystem-scoping architecture for breakout rooms in a virtual space
US7856410B2 (en) 1998-12-22 2010-12-21 Accenture Global Services Limited Simulation enabled retail management tutorial system
WO2011014718A1 (en) * 2009-07-31 2011-02-03 Siemens Corporation Virtual world building operations center
US8176421B2 (en) 2008-09-26 2012-05-08 International Business Machines Corporation Virtual universe supervisory presence
CN107591047A (en) * 2017-09-16 2018-01-16 深圳市赛亿科技开发有限公司 A kind of tutoring system of virtual reality
CN110827595A (en) * 2019-12-12 2020-02-21 广州三人行壹佰教育科技有限公司 Interaction method and device in virtual teaching and computer storage medium
US11277203B1 (en) 2020-01-22 2022-03-15 Architecture Technology Corporation Hybrid communications based upon aerial networks
US11474596B1 (en) 2020-06-04 2022-10-18 Architecture Technology Corporation Systems and methods for multi-user virtual training
US11508253B1 (en) 2020-02-12 2022-11-22 Architecture Technology Corporation Systems and methods for networked virtual reality training

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9159151B2 (en) 2009-07-13 2015-10-13 Microsoft Technology Licensing, Llc Bringing a visual representation to life via learned input from the user

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0753834A2 (en) * 1995-07-11 1997-01-15 Sony Corporation A three-dimensional virtual reality space sharing method and system
US5727950A (en) * 1996-05-22 1998-03-17 Netsage Corporation Agent based instruction system and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0753834A2 (en) * 1995-07-11 1997-01-15 Sony Corporation A three-dimensional virtual reality space sharing method and system
US5727950A (en) * 1996-05-22 1998-03-17 Netsage Corporation Agent based instruction system and method

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
JACOBSTEIN N ET AL: "A multi-agent associate system guide for a virtual collaboration center" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 215-220, XP002142554 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *
JOHNSON W L ET AL: "Pedagogical agents in virtual team training" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 72-77, XP002142553 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *
KIRSH D: "Virtual collaboration and adaptive rooms" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 10-15, XP002142555 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *
LANDAUER C ET AL: "What is cyberspace?" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 16-21, XP002142552 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *
MCKAY D P ET AL: "An architecture for a training virtual world environment" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 125-130, XP002124035 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *
TAYLOR S L ET AL: "Virtual communities of interest for education and training" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 172-177, XP002124036 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *
TESTANI S ET AL: "CIMBLE: experiential training in a VRML environment" PROCEEDINGS OF THE VIRTUAL WORLDS AND SIMULATION CONFERENCE (VMSIM'98), PROCEEDINGS OF VIRTUAL WORLDS AND SIMULATION CONFERENCE (VWSIM'98), SAN DIEGO, CA, USA, 11-14 JAN. 1998, pages 67-71, XP002124034 1998, San Diego, CA, USA, Society for Computer Simulation International, USA *

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6658398B1 (en) 1998-12-22 2003-12-02 Indeliq, Inc. Goal based educational system utilizing a remediation object
US7117189B1 (en) 1998-12-22 2006-10-03 Accenture, Llp Simulation system for a simulation engine with a help website and processing engine
US7428518B1 (en) 1998-12-22 2008-09-23 Accenture Global Services Gmbh Simulation enabled accounting tutorial system
US7856410B2 (en) 1998-12-22 2010-12-21 Accenture Global Services Limited Simulation enabled retail management tutorial system
US7660778B1 (en) 1998-12-22 2010-02-09 Accenture Global Services Gmbh Runtime program analysis tool for a simulation engine
US6493690B2 (en) 1998-12-22 2002-12-10 Accenture Goal based educational system with personalized coaching
US7433852B1 (en) 1998-12-22 2008-10-07 Accenture Global Services Gmbh Runtime program regression analysis tool for a simulation engine
US6535861B1 (en) 1998-12-22 2003-03-18 Accenture Properties (2) B.V. Goal based educational system with support for dynamic characteristics tuning using a spread sheet object
US6549893B1 (en) 1998-12-22 2003-04-15 Indeliq, Inc. System, method and article of manufacture for a goal based system utilizing a time based model
US7536363B1 (en) 1998-12-22 2009-05-19 Accenture Global Services Gmbh Goal based system, utilizing a table based architecture
US6745170B2 (en) 1999-02-08 2004-06-01 Indeliq, Inc. Goal based educational system with support for dynamic characteristic tuning
US7054848B1 (en) 1999-02-08 2006-05-30 Accenture, Llp Goal based system utilizing a time based model
US7386524B2 (en) 1999-02-08 2008-06-10 Accenture Global Services Gmbh Simulation enabled focused feedback tutorial system
US7156665B1 (en) 1999-02-08 2007-01-02 Accenture, Llp Goal based educational system with support for dynamic tailored feedback
US6970858B1 (en) 1999-02-08 2005-11-29 Accenture, Llp Goal based system utilizing an activity table
US7089222B1 (en) 1999-02-08 2006-08-08 Accenture, Llp Goal based system tailored to the characteristics of a particular user
US7065512B1 (en) 1999-02-08 2006-06-20 Accenture, Llp Dynamic toolbar in a tutorial system
US7065513B1 (en) 1999-02-08 2006-06-20 Accenture, Llp Simulation enabled feedback system
WO2000067232A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System, method and article of manufacture for creating chat rooms with multiple roles for multiple participants
WO2000067227A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System method and article of manufacture for creating collaborative application sharing
US6993513B2 (en) 1999-05-05 2006-01-31 Indeliq, Inc. Interactive simulations utilizing a remote knowledge base
WO2000067230A1 (en) * 1999-05-05 2000-11-09 Accenture Properties (2) B.V. System, method and article of manufacture for creating collaborative simulations with multiple roles for a single student
US7152092B2 (en) 1999-05-05 2006-12-19 Indeliq, Inc. Creating chat rooms with multiple roles for multiple participants
US6611822B1 (en) 1999-05-05 2003-08-26 Ac Properties B.V. System method and article of manufacture for creating collaborative application sharing
US7280991B1 (en) 1999-05-05 2007-10-09 Indeliq, Inc. Creating collaborative simulations for creating collaborative simulations with multiple roles for a single student
US7621748B2 (en) 1999-08-31 2009-11-24 Accenture Global Services Gmbh Computer enabled training of a user to validate assumptions
US6741833B2 (en) 2000-07-21 2004-05-25 Englishtown, Inc. Learning activity platform and method for teaching a foreign language over a network
US7058354B2 (en) 2000-07-21 2006-06-06 Mccormick Christopher Learning activity platform and method for teaching a foreign language over a network
US7031651B2 (en) 2000-07-21 2006-04-18 Englishtown, Inc. System and method of matching teachers with students to facilitate conducting online private instruction over a global network
WO2002009066A3 (en) * 2000-07-21 2003-01-03 Englishtown Inc A learning activity platform and method for teaching a foreign language over a network
WO2002009066A2 (en) * 2000-07-21 2002-01-31 Englishtown, Inc. A learning activity platform and method for teaching a foreign language over a network
WO2002097616A1 (en) * 2001-05-22 2002-12-05 Nanyang University Collaborative virtual enivonment system and method
US7316000B2 (en) 2001-08-27 2008-01-01 International Business Machines Corporation Interactive agent for a topological multi-tier business application composer
GB2406669A (en) * 2003-10-02 2005-04-06 Mark Faulkner Meeting facilitator using virtual character
US7716284B2 (en) 2006-02-28 2010-05-11 Microsoft Corporation Subsystem-scoping architecture for breakout rooms in a virtual space
US8176421B2 (en) 2008-09-26 2012-05-08 International Business Machines Corporation Virtual universe supervisory presence
WO2011014718A1 (en) * 2009-07-31 2011-02-03 Siemens Corporation Virtual world building operations center
US8473852B2 (en) 2009-07-31 2013-06-25 Siemens Corporation Virtual world building operations center
CN107591047A (en) * 2017-09-16 2018-01-16 深圳市赛亿科技开发有限公司 A kind of tutoring system of virtual reality
CN110827595A (en) * 2019-12-12 2020-02-21 广州三人行壹佰教育科技有限公司 Interaction method and device in virtual teaching and computer storage medium
US11277203B1 (en) 2020-01-22 2022-03-15 Architecture Technology Corporation Hybrid communications based upon aerial networks
US11563488B1 (en) 2020-01-22 2023-01-24 Architecture Technology Corporation Hybrid communications based upon aerial networks
US11508253B1 (en) 2020-02-12 2022-11-22 Architecture Technology Corporation Systems and methods for networked virtual reality training
US11474596B1 (en) 2020-06-04 2022-10-18 Architecture Technology Corporation Systems and methods for multi-user virtual training
US11868519B2 (en) 2020-06-04 2024-01-09 Architecture Technology Corporation Systems and methods for virtual training within three-dimensional adaptive learning environments

Also Published As

Publication number Publication date
WO2000004478A3 (en) 2000-11-16
AU5106499A (en) 2000-02-07

Similar Documents

Publication Publication Date Title
WO2000004478A2 (en) A system containing a multi-user virtual learning environment
US20210275927A1 (en) Guest management in an online multi-player virtual reality game
US8539085B2 (en) Networked computer system for communicating and operating in a virtual reality environment
Chang Participant systems for cooperative work
Sharda et al. Foundation for the study of computer-supported collaborative learning requiring immersive presence
Tromp et al. Small group behaviour experiments in the coven project
Peña-Mora et al. CAIRO: a concurrent engineering meeting environment for virtual design teams
US9724610B2 (en) Creation and prioritization of multiple virtual universe teleports in response to an event
Xu et al. A flexible context architecture for a multi-user GUI
Van Oijen et al. Goal-based communication using bdi agents as virtual humans in training: An ontology driven dialogue system
Angehrn et al. Leveraging emerging technologies in management education: research and experiences
Nagendran et al. Symmetric telepresence using robotic humanoid surrogates
Kirchner et al. A conference goes virtual: Lessons from creating a social event in the virtual reality
Sharma et al. Workplace collaboration in a 3d virtual office
Morgado et al. A bot spooler architecture to integrate virtual worlds with e-learning management systems for corporate training
Wadley Voice in virtual worlds
Brown et al. Games One: Two: Three A triangle of virtual game scenarios for architectural collaboration
Noll et al. Autonomous agents in collaborative virtual environments
Seidel et al. CIMBLE: Distributed team training via HLA
Huang A collaborative virtual reality system on the Web
Fh et al. Coordinating collaborativework with RECOLLVE
Habib Distributed teleoperation and collaborative environment for robotics e-learning and cooperation
Juazeiro et al. Coordinating Collaborative Work with RECOLLVE
dos Santos Filho et al. The Agent-Based Architecture of RECOLLVE
Lamotte et al. Large‐scale networked virtual environments: architecture and applications

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase