US20010001303A1 - Physical exercise system having a virtual reality environment controlled by a users movement - Google Patents
Physical exercise system having a virtual reality environment controlled by a users movement Download PDFInfo
- Publication number
- US20010001303A1 US20010001303A1 US09/730,833 US73083300A US2001001303A1 US 20010001303 A1 US20010001303 A1 US 20010001303A1 US 73083300 A US73083300 A US 73083300A US 2001001303 A1 US2001001303 A1 US 2001001303A1
- Authority
- US
- United States
- Prior art keywords
- user
- virtual reality
- reality environment
- providing
- load
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
-
- A63F13/10—
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/45—Controlling the progress of the video game
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/816—Athletics, e.g. track-and-field sports
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
- A63B2071/0638—Displaying moving images of recorded environment, e.g. virtual environment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
- A63B71/0622—Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
- A63B2071/0638—Displaying moving images of recorded environment, e.g. virtual environment
- A63B2071/0644—Displaying moving images of recorded environment, e.g. virtual environment with display speed of moving landscape controlled by the user's performance
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2208/00—Characteristics or parameters related to the user or player
- A63B2208/12—Characteristics or parameters related to the user or player specially adapted for children
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2213/00—Exercising combined with therapy
- A63B2213/004—Exercising combined with therapy with electrotherapy
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/30—Speed
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/50—Force related parameters
- A63B2220/54—Torque
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/70—Measuring or simulating ambient conditions, e.g. weather, terrain or surface conditions
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
- A63B2225/20—Miscellaneous features of sport apparatus, devices or equipment with means for remote communication, e.g. internet or the like
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2230/00—Measuring physiological parameters of the user
- A63B2230/60—Measuring physiological parameters of the user muscle strain, i.e. measured on the user
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
- A63F2300/302—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device specially adapted for receiving control signals not targeted to a display device or game input means, e.g. vibrating driver's seat, scent dispenser
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8005—Athletics
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8017—Driving on land or water; Flying
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S482/00—Exercise devices
- Y10S482/901—Exercise devices having computer circuitry
- Y10S482/902—Employing specific graphic or video display
Definitions
- the present invention relates to a wellness system which can provide a user with artificial reality which involves a plurality of human senses integrated, i.e., a virtual reality environment which causes user's plural human senses such as the sense of sight, hearing, touch, and smell to work.
- the present invention relates to a wellness system which can provide a user with a virtual reality environment which can add a sense of sophisticated realism and the contents of a physical exercise which varies according to the virtual reality environment, by acquiring information about a movement and a physiological condition of the user who is doing a physical exercise and then providing feedback of the information to the wellness system, also provide a user who is isolated from a real world with a contact with the real world by providing a virtual reality environment for the user, and support communication between the user and another user, or between the user and a medical authorized person or a helper.
- FIG. 15 there is illustrated a schematic view of such a prior art artificial-experience giving device equipped with a display as disclosed in Japanese Patent Application Laying Open (KOKAI) No. 7-80096.
- KKAI Japanese Patent Application Laying Open
- reference numeral 1 denotes a bicycle training machine
- 2 denotes a pedal of the machine
- 3 denotes a saddle of the machine
- 4 denotes a projector which projects an image of an artificial scene
- 5 denotes a screen shaped like a half-spherical dome, on which an image from the projector 4 is displayed
- 6 denotes a blowing outlet out of which an artificial wind is blowing
- 7 denotes a blowing box which produces the artificial wind
- 8 denotes a fragrant substance adding unit for adding a fragrant substance to the artificial wind.
- the projector 4 projects an image on the screen 5 shaped like a half-spherical dome and located at the front of the bicycle training machine 1 .
- the image displayed on the screen is concerned with an artificial scene in the vicinity of an artificial road on which the bicycle is moving, and the image is controlled so that the artificial scene is varied according to the speed at which the user pushes the pedals 2 around, that is, the scene moves at a high speed when the user pedals fast and the scene moves at a low speed when the user pedals slowly.
- a wind from the blowing outlet 6 located at the front of the user is blowing toward the user.
- the velocity of the wind is controlled according to the speed at which the user pushes the pedals around, similarly to the speed of a variation in the image projected on the screen.
- the prior art artificial-experience giving device equipped with a display is adapted to control the load of a physical exercise imposed on the user and select a fragrant substance to be added to the artificial wind according to the contents of the image displayed on the screen so as to provide the user with a sense of realism, for example, increase the load of the bicycle training when an image of an upward slope is displayed on the screen, decrease the load of the bicycle training when an image of an downward slope is displayed on the screen, or add a fragrant substance including phytoncide as a major constituent to the artificial wind blowing out of the blowing outlet 6 by means of the fragrant substance adding unit 8 in a situation wherein the user is going on a bicycle trip in a wood.
- the prior art wellness system which is so constructed as mentioned above is intended for persons of health or patients who are almost restored in health, but not for early rehabilitation carried out for patients who have no alternative but to be confined to bed, in the presence of a doctor, or according to instructions of a doctor, to prompt early rising and prevent the user from atrophying with disuse. While the prior art wellness system has a measure to display an image in order to cause the user to motivate himself or herself to do rehabilitation, it cannot add a sense of realism to a sufficient degree. Furthermore, the prior art wellness system cannot be intended for patients who are not restored in health; the prior art wellness system cannot provide a load of a physical exercise suitable for the user. In addition, another problem with the prior art wellness system is that since it does not include a means for acquiring information about the user and a real environment in real time and a communications function, the user is not allowed to make contact with a real environment and communicate with another person.
- the present invention is made in order to overcome the above problems. It is therefore an object of the present invention is to provide a wellness system which can provide virtual reality which involves a plurality of human senses integrated for a user, and provide the user with a sense of sophisticated realism and the contents of a physical exercise which the user is to do, and which varies according to the realism, by acquiring information about a movement and a physiological condition of the user who is doing a physical exercise and then providing feedback of the information to the wellness system, thereby giving the user an opportunity of relaxation and refreshment, and causing the user to motivate himself or herself for rehabilitation, which usually bores the user, more effectively, so that a patient who stays in hospital can be helped to do early rising after an operation, and a patient who has been receiving medical treatment for a long time can be prevented from atrophying with disuse.
- It is another object to provide a wellness system which can provide a user who is isolated from a real world with a contact with the real world by providing a virtual reality environment for the user, and support communication between the user and another user which is using another wellness system, or between the user and a medical authorized person or a helper, thereby giving the user an opportunity of participating in society, and offering the care of the mental health of the user.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of a user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit. Furthermore, when providing the virtual reality environment, the virtual reality environment providing unit displays an image which produces the virtual reality environment by setting its angle of view to be larger than a corresponding angle of view of a corresponding object or scene which was shot.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a physiological and psychological condition evaluating unit for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and a control unit for controlling the load of the physical exercise which the user is doing according to the physiological condition of the user evaluated by the physiological and psychological condition evaluating unit, and for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's psychological condition evaluated by the physiological and psychological condition evaluating unit. Furthermore, when providing the virtual reality environment, the virtual reality environment providing unit displays an image which produces the virtual reality environment by setting its angle of view to be larger than a corresponding angle of view of a corresponding object or scene which was shot.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit.
- the virtual reality environment providing unit can store a plurality of dynamic image cuts which were taken at a plurality of places of a real environment which is a source of the virtual reality environment, and can replay them cut by cut according to the user's movement measured by the exercise load providing unit.
- the virtual reality environment providing unit can provide the user with a sound, a wind, and fragrance which are associated with each of the plurality of dynamic image cuts, in synchronization with the replay of each of the plurality of dynamic image cuts.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the load of the physical exercise provided by the exercise load providing unit.
- the virtual reality environment providing unit can provide a negative load of a physical exercise to help the user to do the physical exercise.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the load of the physical exercise provided by the exercise load providing unit according to a data which defines a pattern of the physical exercise which the user is to do.
- the exercise load providing unit includes a load providing unit for directly providing the load of the physical exercise for the user, a position detecting sensor for detecting a position of the load providing unit, and a speed detecting sensor for detecting a moving speed of the load providing unit. Furthermore, the exercise load providing unit can use outputs from the position detecting sensor and the speed detecting sensor as the data which defines the pattern of the physical exercise which the user is to do.
- the wellness system further comprises an exercise load data input unit through which the data which defines the physical exercise pattern can be input when the user starts physical training using the wellness system.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a physiological and psychological condition evaluating unit for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and a control unit for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by the physiological and psychological condition evaluating unit.
- the physiological and psychological condition evaluating unit is provided with an electromyogram measuring unit for measuring an electromyogram of a muscle on which the load of the physical exercise is imposed, a muscle active mass estimating unit for estimating an active mass of the muscle from the electromyogram measured by the electromyograph measuring unit.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a physiological and psychological condition evaluating unit for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and a control unit for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by the physiological and psychological condition evaluating unit.
- the physiological and psychological condition evaluating unit is provided with an electromyograph unit for measuring or obtaining an electromyogram of a muscle of a diseased part in cast of the user by means of electrodes attached to the diseased part in cast, a muscle active mass estimating unit for estimating an active mass of the muscle from the electromyogram obtained by the electromyograph unit.
- the exercise load providing unit is provided with an electric shock applying unit for applying an electric shock to the user's muscle through other electrodes attached to the diseased part in cast, and an electric shock control unit for controlling the electric shock applying unit according to the active mass of the muscle estimated by the muscle active mass estimating unit, thereby providing a pseudo load of a physical exercise for the user by using electric shocks.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a gesture identifying unit for detecting the shape of a part of the user 5 body which makes a gesture and then identifying the gesture; and a control unit for activating or deactivating the wellness system, controlling the virtual reality environment providing unit, and controlling the exercise load providing unit, according to the user's gesture identified by the gesture identifying unit.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit.
- the virtual reality environment providing unit is provided with a unit for taking and capturing an image of at least a part of the user's body, and a unit for superimposing the image captured on an image of the virtual reality environment to be provided to display the composite image when providing the virtual reality environment.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment providing unit for providing the user with a virtual reality environment; a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according tot he user's movement measured by the exercise load providing unit; a transmission information acquiring unit and information about a position of the user in the virtual reality environment, which is furnished by the control unit, into communications data in predetermined communications format so as to produce the communications data to be transmitted by way of a communications network; and a received data transforming unit for transforming communications data transmitted to the wellness system by way of the communications network into data required for the virtual reality environment providing unit to construct the virtual reality environment.
- a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; an image information acquiring unit movably disposed for acquiring information about an image of a real environment that is apart from the user; a sound information acquiring unit movably disposed for acquiring information about sounds made in the real environment that is apart from the user; an environment information acquiring unit movably disposed for acquiring information about the real environment that is apart from the user; and a control unit for moving the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit according to the user's movement measured by the exercise load providing unit, and for controlling the virtual reality environment provided by the virtual reality environment providing unit using the information acquired by the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring
- the wellness system further comprises a user's image information acquiring unit for acquiring information about an image of at least a part of the user's body, a user's sound information acquiring unit for acquiring information about a sound that the user makes, an image information providing unit for providing the image information acquired by the user's image information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment, and an image information providing unit for providing the sound information acquired by the user's sound information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment.
- FIG. 1 is a block diagram of a wellness system according to a first embodiment of the present invention
- FIG. 2 a is a view showing the angle of view of an object when taking an image of the object which is a source of a virtual reality environment to be provided by the wellness system of the first embodiment;
- FIG. 2 b is a view showing the angle of view of the image of the above object, which produces a virtual reality environment, to be displayed on the screen of the wellness system of the first embodiment;
- FIG. 3 is a view showing an example of a method of making image data for a wellness system of a second embodiment of the present invention
- FIG. 4 is a view showing an example of a path on which the user will move in a virtual space provided by the wellness system of the second embodiment of the present invention
- FIG. 5 is a view showing an exercise load providing unit of a wellness system of a third embodiment of the present invention.
- FIG. 6 is a view showing torques and positions of both pedals of a load providing unit of the exercise load providing unit shown in FIG. 5;
- FIG. 7 is a block diagram of a wellness system according to a fourth embodiment of the present invention.
- FIG. 8 is a block diagram of a wellness system according to a fifth embodiment of the present invention.
- FIG. 9 is a block diagram of a wellness system according to a sixth embodiment of the present invention.
- FIG. 10 is a block diagram of a wellness system according to a seventh embodiment of the present invention.
- FIG. 11 is a block diagram of a wellness system according to an eighth embodiment of the present invention.
- FIG. 12 is a block diagram of a wellness system according to a ninth embodiment of the present invention.
- FIG. 13 is a block diagram of a wellness system according to a tenth embodiment of the present invention.
- FIG. 14 is a block diagram of a wellness system according to an eleventh embodiment of the present invention.
- FIG. 15 is a schematic diagram of a prior art wellness system.
- FIG. 1 there is illustrated a block diagram of a wellness system according to a first embodiment of the present invention.
- reference numeral 10 denotes a general control unit for controlling the whole of the wellness system
- 11 denotes a control computer disposed in the general control unit 10 for actually carrying out control of the wellness system
- 12 denotes a first data base used for controlling a virtual reality environment according to a movement of a user (e.g., a patient or a senior citizen) who is doing a physical exercise
- 13 denotes a second data base used for controlling the load of the physical exercise according to a user's physiological condition
- 14 denotes a third data base used for controlling the virtual reality environment according to a user's psychological condition.
- reference numeral 20 denotes a virtual reality providing unit which is controlled by the control computer 11 of the general control unit 10 , for providing the user with a virtual reality environment according to the contents of the virtual reality environment
- 21 denotes an image display unit comprised of an image data storing unit 21 a for storing image data about the virtual reality environment, a display 21 b on which an image of the virtual reality environment is displayed, and an image control unit 21 c for controlling the image data storing unit 21 a and display 21 b
- 22 denotes a sound providing unit comprised of a sound data storing unit 22 a for storing sound data about the virtual reality environment, a sound output unit 22 b for providing a sound for the virtual reality environment, and a sound control unit 22 c for controlling the sound data storing unit 22 a and sound output unit 22 b
- 23 denotes a wind and fragrance generating unit comprised of a fragrance generating unit 23 a for emitting fragrance which constructs a part of the virtual reality environment, a wind generating unit 23
- Reference numeral 30 denotes an exercise load providing unit which is controlled by the control computer 11 of the general control unit 10 , for imposing an appropriate exercise load on the user and measuring a movement of the user who is doing the physical exercise.
- the exercise load providing unit 30 is provided with a load providing unit 31 for imposing an appropriate exercise load on the user, a driving unit 32 for driving the load providing unit 31 , a control unit 33 for controlling the driving unit 32 , an exercise load detection and control unit 34 for furnishing an instruction from the control computer 11 of the general control unit 10 to the control unit 33 and for detecting a movement of the user who is doing the physical exercise and then informing the control computer 11 of the detected result.
- reference numeral 40 denotes a physiological and psychological condition measurement unit which is controlled by the control computer 11 of the general control unit 10 , for measuring information about user's physiological and psychological conditions so as to determine the user's physiological and psychological conditions.
- the physiological and psychological condition measurement unit 40 is provided with a physiological and psychological information acquiring unit 41 for acquiring information about user's physiological and psychological conditions, a physiological and psychological information analyzing unit 42 for analyzing the information about the user's physiological and psychological conditions acquired by the physiological and psychological information acquiring unit 41 so as to evaluate the user's physiological and psychological conditions, and an interface unit 43 which interfaces between the physiological and psychological information acquiring unit 41 and the physiological and psychological information analyzing unit 42 .
- the general control unit 10 controls each of the image display unit 21 , sound providing unit 22 , and wind and fragrance generating unit 23 by means of the control computer 11 so that they are synchronized with each other so as to generate a virtual reality environment that provides a user with a sense of realism, according to the contents of the virtual reality environment.
- the first data base 12 is used.
- the third data base 14 is used.
- the exercise load detection and control unit 34 of the exercise load providing unit 30 measures a movement of the user who is doing the physical exercise, such as a walking motion of the user, and then varies the image of the virtual reality environment displayed by the image display unit 21 according to the measured walking speed of the user and simultaneously varies the sound to be emitted by the sound providing unit 22 and the wind and fragrance to be provided by the wind and fragrance generating unit 23 .
- the general control unit 10 can vary an image of the wood to be displayed on the display 21 b by the image display unit 21 as the user walks in the virtual reality environment, and simultaneously vary sounds generated within the wood, such as a bird's twittering and rustling of trees, emitted by the sound output unit 22 b of the sound providing unit 22 , and a wind generated by the wind generating unit 23 b of the wind and fragrance generating unit 23 and fragrance, such as a smell of a needle-leaf tree or a smell of a flower, generated by the fragrance generating unit 23 a of the wind and fragrance generating unit 23 . Accordingly, the user can enjoy virtual forest bathing while doing such a rehabilitation exercise.
- the wellness system of this embodiment can store environment data about a scene that can relax the user such as an amusement park in the third data base 14 in order to control the virtual reality environment according to a user's psychological condition.
- the physiological and psychological condition measurement unit 40 determines that the user is strung up, the general control unit 10 provides a virtual scene of such an amusement park so as to relax the user by means of the image display unit 21 , sound providing unit 22 , and wind and fragrance generating unit 23 of the virtual reality environment providing unit 20 .
- the wellness system can control the load of the physical exercise imposed on the user with reference to the second data base 13 which was prepared in advance, when controlling the exercise load according to the physiological condition of the user.
- the wellness system can provide the user with a physical exercise to make the user feel good with safety while avoiding danger due to an overload to the user, by adjusting the load of the physical exercise in such a manner that it prevents an overload and a light load of the physical exercise from being imposed on the user.
- the wellness system according to this embodiment capable of controlling the virtual reality environment and the load of a physical exercise which the user is doing can be applied to the rehabilitation of a patient who has no alternative but to be confined to bed with illness, a patient who is on the road to recovery, and a person of health.
- FIGS. 2 a and 2 b there are illustrated views showing the angle of view in the wellness system of the first embodiment when taking an image of a scene and displaying an image on the screen thereof.
- FIG. 2 a shows the angle of view when taking an image of a scene.
- FIG. 2 b shows the angle of view when displaying the image on the screen.
- a dynamic image of a scene is taken with an angle of view of ⁇ 0 by a video camera or the like.
- the image data taken by the video camera is stored in the image storing unit 21 a of the image display unit 21 .
- the image control unit 21 c of the image display unit 21 reads the image data stored in the image storing unit 21 a in response to a control signal furnished by the control computer 11 of the general control unit 10 , and displays the image on the display 21 b with a larger angle of view of ⁇ 1 as shown in FIG. 2 b.
- the display 21 b which displays an image on the screen thereof with a large angle of view can be implemented via an image display device comprising a display board for displaying an image having a barrel-shaped distortion and an optical system for making a distortion correction to the image, or a head-mount type image display device.
- an image display device comprising a display board for displaying an image having a barrel-shaped distortion and an optical system for making a distortion correction to the image, or a head-mount type image display device.
- the image display unit of the wellness system of this embodiment displays an image with the angle of view of ⁇ 1 which is larger than the angle of view of ⁇ 0 when making a video film of a corresponding scene, it causes the user to feel as if the user enters the scene displayed on the screen and hence to get himself or herself absorbed in the virtual reality environment.
- CG computer graphics
- FIG. 3 there is illustrated a view showing an example of a method of making image data which is used for a wellness system of a second embodiment of the present invention.
- the wellness system of the second embodiment is structured similarly to that of the above-mentioned first embodiment shown in FIG. 1, except that the preparation of image data stored in the image storing unit 21 a of the image display unit 21 disposed within the virtual reality environment providing unit 20 and control data stored in the first data base 12 of the general control unit 10 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise are carried out by following a step dynamic image method.
- the step dynamic image method is comprised of steps of storing a plurality of dynamic image cuts which were taken at a plurality of places in a path through which the user will walk or run in the virtual reality environment to be provided by the wellness system in the virtual reality environment providing unit 20 , and replaying the plurality of dynamic image cuts cut by cut according to a physical exercise that the user does and producing a corresponding sound, wind, and fragrance in synchronization with each of the plurality of dynamic image cuts replayed by means of the virtual reality environment providing unit 20 .
- each dynamic image cut is being made at each of the places arranged as mentioned above for a predetermined time, e.g., tens of seconds with a video camera held in a horizontal state, while positioning the video camera at eye level of an average man and pointing the video camera to the direction which the user is to be headed in the virtual reality environment, for example, the direction of the tangent line of a road on which the user will walk in the virtual reality environment.
- a predetermined time e.g., tens of seconds
- a video camera held in a horizontal state
- the video camera at eye level of an average man and pointing the video camera to the direction which the user is to be headed in the virtual reality environment, for example, the direction of the tangent line of a road on which the user will walk in the virtual reality environment.
- a fork of the path one dynamic image cut of a scene showing how many streets the path is divided to is taken with the video camera.
- a plurality of dynamic image cuts thus taken are compressed with an image compressing and coding method such as the Moving Picture Experts Group (MPEG) compressing and coding method defined by International Standards Organization (ISO), and then the compressed and coded data are stored in the image storing unit 21 a of the image display unit 21 .
- MPEG Moving Picture Experts Group
- ISO International Standards Organization
- each of the plural places where each of the plurality of dynamic image cuts is taken information about sounds is recorded at the same time.
- sounds from different directions must be recorded separately by using a good-directional microphone.
- sound data which correspond to each of the plural dynamic image cuts to be displayed on the screen are generated and recorded in the sound data storing unit 22 a.
- information about a plurality of sound sources and their positions can be generated and stored in the sound data storing unit 22 a in order to offer a stereophonic sound.
- the position of the small bird, the dimensions of the vicinity of the bird which can reflect a sound which the bird makes such as the bird's twittering and which a human being can hear, the reflectivity of sound against the vicinity of the bird, and the timing of the twittering are stored as sound data which correspond to one dynamic image cut to be displayed on the screen as well as the phrase of the twittering of the small bird.
- Control information showing a correspondence between the plurality of dynamic image cuts and sound data is stored in the first data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise.
- a set of the timing data showing the timing of blowing a wind and generating fragrance and parameters required for generating the wind and fragrance is stored as the control information, similarly to the case of sound data.
- the inclination of land and condition of land such as its hardness and construction materials are measured and corresponding control parameters are stored in the first data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise.
- the control computer 11 of the general control unit 10 selects one of the plural dynamic image cuts to be replayed next according to information stored in the first data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise, and then furnished the selected cut to the image display unit 21 .
- the control computer 11 delivers an instruction to start the replay of the next dynamic image cut to the image control unit 21 c of the image display unit 21 in synchronization when the exercise load detection and control unit 34 of the exercise load providing unit 30 detects a stepping motion of the user, that is, every time the user makes one step.
- the control unit can project an image including at least a part of the human body of the user who can show the direction in which the user is headed with a gesture on the screen, as described below in a seventh embodiment of the present invention, so as to cause the user to select a path through which the user wants to move by making a gesture, the meaning of which can be identified by the wellness system.
- control computer 11 of the general control unit 10 reads control information about sounds, a wind and fragrance which correspond to the next dynamic image cut to be displayed and control information about the load of a physical exercise which the user will do, and furnishes the control information to the sound providing unit 22 , the wind and fragrance unit 23 , and the exercise load providing unit 30 .
- the image control unit 21 c of the image display unit 21 receives an instruction to start the replay of a next dynamic image cut, it reads image information about the next cut from the image storing unit 21 a and decompresses the image information which was compressed using the MPEG compression method by means of an image expanding circuit board not shown in FIG. 1. Then, the image control unit 21 c of the image display unit 21 furnishes the expanded image information to the display 21 b so as to provide the user with the next dynamic image cut.
- the image control unit 21 c of the image display unit 21 does not receive the instruction to start the replay of a next cut even though the replay of the preceding dynamic image cut has been completed, that is, when the movement of user is very slow or the user stops, the image control unit returns to the first frame of the same dynamic image cut and repeats the replay of the same dynamic image cut.
- the scene on-screen such as a park changes to the next dynamic image cut which was taken at a one-step forward place
- the sound control unit 22 c of the sound providing unit 22 provides a stereophonic sound such as a bird's twittering, or rustling of leaves of trees which corresponds to the on-screen image according to sound data stored in the sound data storing unit 22 a by means of the sound output unit 22 b
- the wind and fragrance control unit 23 c of the wind and fragrance generating unit 23 controls the wind generating unit 23 b and the fragrance generating unit 23 a under control of the control computer 11 of the general control unit 10 so as to provide a wind and fragrance such as a smell of a flower which correspond to the image on-screen.
- the load providing unit 31 of the exercise load providing unit 30 which is controlled by the control computer 11 of the general control unit 10 provides a load of a physical exercise according to the image of a scene displayed on the screen. Accordingly, the user can feel as if the user walk in a real-life place which is the source of the virtual reality environment on-screen. For example, the user can feel a difference of conditions of the road surface on which the user steps, or the angle between the user's legs and a slope.
- the wellness system can generate image data and control data by means of the step dynamic image method, the wellness system can cause the user to have a sense that the user moves in a real-life space without causing the user to do a physical exercise to excess according to the image on-screen.
- each of the plural dynamic image cuts so that the image of the first frame of each of the plural dynamic image cuts is similar to that of the last frame of each of the plural dynamic image cuts.
- sound data mainly including data about a sound which does not vary rapidly or a series of similar sounds can be incorporated into the dynamic image together with data about a sound which does not provide the user with an unnatural feeling even though the replay of the sound is terminated in the middle of the replay, such as a bird's twittering or an insect's chirping.
- FIG. 4 there is illustrated a view showing an example of a path through which the user walks in a virtual space.
- the path is comprised of a main path shaped like a loop and a plurality of branches each including branch paths all of which are connected to the main path.
- the path is a one-way road. Accordingly, explosive increases in the number of nodes and the number of needed dynamic image cuts which are caused by the branches as shown in FIG. 4 can be prevented.
- both of the image display unit 21 and sound providing unit 22 can be formed in one piece which can compress image and sound which are synchronized with each other and store them therein.
- the wellness system of this second embodiment can offer a virtual reality environment in which the user can work at oars by hand.
- the wellness system can cause the user to feel as if the user become a child or another creature that is completely different from a human being.
- the wellness system of this embodiment can provide a person who usually view a real world while sitting on a wheelchair with a feeling of a person who is walking.
- the wellness system of this embodiment can also provide a person who can walk normally with a feeling of a person who usually view a real world while sitting on a wheelchair.
- FIG. 5 there is illustrated a schematic diagram of the exercise load providing unit 30 of a wellness system of a third embodiment of the present invention.
- the exercise load providing unit 30 of this third embodiment is adapted to provide the user with a negative load of a physical exercise for helping the user to do a physical exercise.
- the structure of the wellness system of the third embodiment of the present invention is the same as that of the first embodiment shown in FIG. 1, and the same components as those shown in FIG. 1 are designated by the same reference numerals. Therefore, the description about the structure of the wellness system of this embodiment will be omitted hereinafter.
- the exercise load detection and control unit 34 of the exercise load providing unit 30 furnishes an instruction to offer a negative load of a physical exercise to the control unit 33 according to an instruction from the control computer 11 of the general control unit 10 .
- the provision of the negative load of a physical exercise means that the wellness system helps the user to do a physical exercise by exerting forces on the user's legs, for example.
- the load providing unit 31 of this embodiment is provided with left and right pedals for securing the user's left and right feet to the pedals, respectively, so that both of the user's feet are not separate from the pedals, so as to exert forces from the driving unit 32 on the pedals and hence the user's feet and legs.
- the negative load of a physical exercise imposed on the user causes the user to bend and stretch the user's knees alternately.
- the control unit 33 controls the driving unit 32 so that the driving unit 32 sets the forces, i.e., torques and positions of both of the pedals of the load providing unit 31 , as shown in FIG. 6.
- the driving unit 32 moves the positions of the right and left pedals in such a manner that they have opposite phases, and the driving unit 32 also sets the forces provided by the right and left pedals in such a manner that they have opposite phases.
- a specialist such as a doctor or a rehabilitation doctor sets the magnitude of the forces to be exerted on the load providing unit 31 and hence the user according to recovery of the user, to the general control unit 10 . More specifically, a method as described in a fourth embodiment of the present invention can be applied.
- both of the pedals for securing the user's feet to the load providing unit 31 are adapted to automatically release the user's feet when too big a force is exerted on at least one of the pedals, and there is provided an emergency switch for releasing the user's feet from the pedals.
- the user who cannot move the user's legs by himself or herself can do a passive rehabilitation exercise which is usually provided by a rehabilitation doctor by using the wellness system of this embodiment.
- the user can easily do a physical exercise which lasts a short time over and over again a day. It is thus expected that the user's stiff muscle or joint become movable and then the user can move his or her muscle and joint by himself or herself.
- the wellness system can provide the user who cannot move with a feeling of moving in a virtual reality environment by virtue of a passive physical exercise. For example, when the user pedals as shown in FIG. 5, the wellness system offers a feeling of walking. Therefore, the user can temporarily get rid of the stress of being confined to a bed and therefore mentally refresh himself or herself.
- the wellness system can help the user who cannot do a physical exercise without any efforts to do an exercise when the user starts to be trained, the user can easily face the training.
- the wellness system of this embodiment can prevent muscles or the like of the user from atrophying with disuse.
- a knee bending exercise is explained as an example.
- the wellness system of this embodiment can also be applied to a physical exercise of an ankle, an arm, or a wrist.
- FIG. 7 there is illustrated a block diagram showing the structure of a wellness system of a fourth embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the fourth embodiment is adapted to provide a load of a physical exercise suitable for the user according to an exercise pattern such as a movable range of the user, and an acceptable walking or pedaling speed, which have been input by a doctor or a rehabilitation doctor when the user starts to be trained. Furthermore, the wellness system can learn, i.e., store the exercise pattern which has been input.
- an exercise pattern such as a movable range of the user
- an acceptable walking or pedaling speed which have been input by a doctor or a rehabilitation doctor when the user starts to be trained.
- reference numeral 35 denotes a position detecting sensor disposed in the exercise load providing unit 30 , for detecting the position of the load providing unit 31 and then furnishing the detected result to the control computer 11 of the general control unit 10
- 36 denotes a speed detecting sensor disposed in the exercise load providing unit 30 , for detecting the moving speed of the load providing unit 31 and then furnishing the detected result to the control computer 11 of the general control unit 10
- 50 denotes an exercise load data input unit through which a doctor or a rehabilitation doctor inputs a setting data which defines the exercise pattern such as a movable range of the user, and an acceptable walking or pedaling speed, which depend on the contents of a rehabilitation physical exercise which the user is to do.
- a doctor or a rehabilitation doctor adjusts the load providing unit 31 of the exercise load providing unit 30 manually according to an exercise pattern suitable for the rehabilitation physical exercise which the user will do.
- the position detecting sensor 35 and speed detecting sensor 36 of the exercise load providing unit 30 measure the position and moving speed of the load providing unit which are determined by the exercise pattern set by a doctor or a rehabilitation doctor and then furnish the position and moving speed data measured to the general control unit 10 .
- the control computer 11 of the general control unit 10 stores the data furnished to the control unit in the first data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise.
- the control computer 11 furnishes the above-mentioned data stored in the first data base 12 to the exercise load detection and control unit 34 of the exercise load providing unit 30 .
- the driving unit 32 controlled by the control unit 33 drives the load providing unit 31 according to the data to offer the exercise pattern suitable for the user, which was manually set by a doctor or a rehabilitation doctor.
- a doctor or a rehabilitation doctor can directly input a setting numerical data which defines the exercise pattern, such as the track of the load providing unit 31 moving, e.g., the track of moving pedals of the load providing unit, a pattern of changes in the speed of the load providing unit which occur during the travel of the load providing unit, the maximum value of the load of a physical exercise provided by the load providing unit, a movable range of the load providing unit, and an acceptable speed of the load providing unit 31 , by means of the exercise load data input unit 50 .
- the setting numerical data which defines the exercise pattern input through the exercise load data input unit 50 are furnished to the general control unit 10 .
- the control computer 11 of the general control unit 10 stores the data furnished to the control unit in the first data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise.
- the control computer 11 reads and furnishes the above-mentioned data stored in the first data base 12 to the exercise load providing unit 30 .
- the driving unit 32 controlled by the control unit 33 drives the load providing unit 31 according to the data to provide the user with a load of a physical exercise, like the above-mentioned case.
- the wellness system of this embodiment can learn or store a data which defines the exercise pattern, such as the movable range of the user and the acceptable speed, which are set manually or through the exercise load data input unit by a doctor or a rehabilitation doctor when the user starts to be trained, so as to provide a load of a physical exercise for the user according to the exercise pattern. Therefore, the user can repeat a safe rehabilitation physical exercise the contents of which have been set by a rehabilitation doctor or the like. Accordingly, this embodiment can solve a problem that the chance of rehabilitation is reduced due to a short supply of rehabilitation doctors.
- FIG. 8 there is illustrated a block diagram showing the structure of a wellness system of a fifth embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the fifth embodiment is adapted to control a load of a physical exercise which the user is doing according to the active mass of muscles of the user, thereby preventing the user's muscles from atrophying.
- FIG. 8 The wellness system of the fifth embodiment is adapted to control a load of a physical exercise which the user is doing according to the active mass of muscles of the user, thereby preventing the user's muscles from atrophying.
- reference numeral 37 denotes a position detecting sensor which is disposed in the exercise load providing unit 30 , and through which the maximum level of a load of a physical exercise is defined
- 44 denotes an electromyograph unit for measuring or obtaining the electromyogram of a muscle which is the target of rehabilitation or training offered to the user
- 45 denotes a muscle active mass estimating unit for analyzing the electromyogram obtained by the electromyogram detecting unit and then estimating the active mass of the muscle
- 46 denotes a muscle active mass display unit for displaying the active mass of the muscle estimated by the muscle active mass estimating unit in an easy-to-understand form.
- the physiological and psychological condition measurement unit 40 of the fifth embodiment is provided with the electromyograph unit 44 , muscle active mass estimating unit 45 , and muscle active mass display unit 46 .
- the physiological and psychological condition measurement unit 40 obtains the electromyogram of the muscle which is the target of the rehabilitation or training offered to the user by means of the electromyograph unit 44 .
- the acquisition of the electromyogram by the electromyograph unit 44 is carried out by attaching a pair of disposal electrodes on the body of the user where a general electromyogram of the target muscle (a general electromyogram means an electromyogram of the whole of the muscle) can be obtained and by using a differential amplifier which is generally used for bioelectricity phenomenon measurements and the electric characteristic of which is adjusted for the electromyogram measurement, or a differential amplifier intended for electromyogram measurements.
- the muscle active mass estimating unit 45 When the electromyogram obtained is furnished to the muscle active mass estimating unit 45 , it rectifies the waveform of the electromyogram and then performs low-pass filtering on the rectified electromyogram to convert the electromyogram into a signal having a waveform which represents the active mass of the muscle.
- the muscle active mass estimating unit 45 can obtain the envelope of the waveform of the electromyogram from the electromyogram from the electromyograph unit 44 .
- the waveform of the low-pass filtered signal represents the mean active mass of the muscle.
- the envelope of the electromyogram represents the maximum value of the active mass of the muscle which varies with time in one cycle.
- Such the waveform conversion can produce a signal having a voltage which can rise when the activity of the muscle is brisk and descend when the activity of the muscle is not brisk, that is, which can represent the active mass of the muscle.
- the waveform of the signal thus obtained can be used as a substitute for the active mass of the muscle.
- the muscle active mass display unit 46 shows the active mass of the muscle estimated by the muscle active mass estimating unit 45 in an easy-to-understand form for the user, a trainer, and a rehabilitation doctor.
- the muscle active mass display unit 46 can display the maximum value of the active mass of the muscle in real time by using a level meter, or the waveform of the signal which represents the active mass of the muscle by using a residual image oscilloscope or the like.
- the physiological and psychological condition measurement unit 40 furnishes the signal representing the active mass of the muscle to the control computer 11 of the general control unit 10 , and then the control computer 11 furnishes it to the exercise load detection and control unit 34 of the exercise load providing unit 30 .
- the exercise load detection and control unit 34 controls the load providing unit 31 according to the signal through the control unit 33 and driving unit 32 so as to provide the user with a load of a physical exercise.
- Data about loads of a physical exercise predetermined on the basis of mean physical strengths measured according to age and sex are pre-stored in the second data base 13 of the general control unit 10 , which is used for controlling the load of a physical exercise according to the user's physiological condition.
- the exercise load providing unit 30 applies a load of a physical exercise according to the data stored in the third data base.
- the exercise load detection and control unit 34 compares the active mass of the muscle estimated by the active mass estimating unit 45 of the physiological and psychological condition measurement unit 40 with the maximum level of a load of a physical exercise defined by the exercise load setting unit 37 so as to control the load of a physical exercise provided by the load providing unit 31 according to the comparison result. For example, until the estimated active mass of the muscle reaches the defined maximum level of a load of a physical exercise, the exercise load detection and control unit 34 carries out the control of the load of a physical exercise in such a manner that it increases the load of a physical exercise gradually and reduces the load of a physical exercise to zero when the estimated active mass of the muscle exceeds the defined maximum level of the load of a physical exercise.
- the exercise load setting unit 37 can be adapted to change the maximum level of the load of a physical exercise during the provision of the load of a physical exercise according to a manual input by the user, a trainer, or a rehabilitation doctor who has determined the change.
- Another method of controlling the load of a physical exercise can be applied.
- the method includes steps of converting activity of the muscle at a certain level or more into a pulse by means of a comparator or the like, furnishing a signal to the exercise load detection and control unit 34 when the number of counts of pulses reaches a certain value, and stopping the provision of the load of a physical exercise in response to the signal.
- a certain time which was predetermined in advance, elapses after the exercise load detection and control unit 34 receives a first pulse which represents the occurrence of the activity of the muscle at a certain level or more, it can stop the provision of the load of a physical exercise.
- the second data base 13 which is used for controlling the load of the physical exercise according to a user's physiological condition, is adapted to store measured data such as data about the active mass of muscles, which are organized according to the user's identification (ID), age, and sex, every when a user uses the wellness system.
- the wellness system can set the initial value of the load of a physical exercise which the user is to do and the maximum level of the load of a physical exercise according to the physical strength or the degree of recovery of the user, thereby providing an appropriate load of a physical exercise in accordance with training conditions and the progress of rehabilitation.
- the wellness system of this embodiment is adapted to control the image display unit 21 of the virtual reality environment providing unit 20 according to the active mass of a muscle estimated by the active mass estimating unit.
- the wellness system is adapted to vary something in an image on-screen about a game, when the active mass of a user's muscle exceeds a certain value during the image is displayed.
- the wellness system provides a virtual reality environment in which the user can drive a surface-to-air missile launching ramp and aim at an enemy plane, a detection of the active mass of a user's muscle which exceeds a certain value is utilized to trigger the launching of a missile.
- the wellness system can offer the advantage of introducing a feeling of games into training and rehabilitation by means of such the display means, so that the user can motivate himself or herself for rehabilitation.
- FIG. 9 there is illustrated a block diagram showing the structure of a wellness system of a sixth embodiment of the present invention.
- the same components as those shown in FIG. 8 of the wellness system of the fifth embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the sixth embodiment is adapted to apply an electric shock to a muscle of a diseased part in cast of the user to provide a pseudo load of a physical exercise in order to maintain its muscular strength, thereby preventing the user's muscle from atrophying.
- reference numeral 47 denotes a muscle activity evaluating unit for evaluating the activity of a muscle from the active mass of the muscle estimated by the active mass estimating unit 45 .
- the physiological and psychological condition measurement unit 40 of the sixth embodiment is provided with the muscle activity evaluating unit 47 as well as the electromyograph unit 44 and muscle active mass estimating unit 45 .
- reference numeral 38 denotes an electric shock providing unit for applying an electric shock to a specified muscle of the user
- 39 denotes an electric shock control unit for controlling the electric shock providing unit 38 according to the evaluation result by the muscle activity evaluating unit 47 of the physiological and psychological condition measurement unit 40 .
- the exercise load providing unit 30 of the sixth embodiment is provided with the electric shock providing unit 38 and electric shock control unit 39 .
- electrodes of the electric shock providing unit 38 through which an electric shock is applied, and electrodes of the electromyograph unit 44 , through which a muscular electric current is measured, are mounted to a diseased part of the user which is surrounded and fixed by a cast, in advance of providing the user with a pseudo load of a physical exercise. It is needless to say that the user cannot move the muscle of the diseased part in cast at the user's motive and it is difficult for another person to activate the user's muscle of the diseased part in cast.
- the wellness system of the present embodiment can apply a small amount of current to the muscle of the diseased part through the electrodes used for the purpose to shrink the muscle by means of the electric shock dividing unit 38 of the exercise load providing unit 30 .
- the electromyograph unit 44 of the physiological and psychological condition measurement unit 40 acquires an electromyogram of the muscle, and then the muscle active mass estimating unit 45 estimates the activity of the muscle by analyzing the electromyogram measured.
- the muscle activity evaluating unit 47 evaluates the activity of the muscle from the active mass of the muscle estimated by the muscle active mass estimating unit 45 , and furnishes the evaluation result to the control computer 11 of the general control unit 10 .
- the control computer 11 When the control computer 11 receives the evaluation result, it instructs the exercise load providing unit 30 to allow the electric shock control unit 39 to determine the strength of electric shocks, duration of each of the electric shocks, and frequency of the electric shocks from the evaluation result of the muscle activity.
- the electric shock control unit 39 controls the electric shock providing unit 38 according to the strength of the electric shocks, duration of each of the electric shocks, and frequency of the electric shocks, which have been determined by the electric shock control unit. Then, the electric shock providing unit 38 applies electric shocks with the electric shock strength, duration, and frequency to the muscle of the user through the electric shock electrodes attached to the diseased part in cast.
- the electric shock control unit 39 determines the strength of electric shocks to be applied, duration of each of the electric shocks, and frequency of the electric shocks on the basis of the frequency of the activity of the muscle and the number of pulses which correspond to the activity of the muscle at a certain level or more.
- the wellness system can initially set the magnitude of electric shocks to a value which causes the muscle of the user to shrink, but does not cause the user to feel the apply of the electric shock.
- the wellness system can be adapted to store the history of measured data about the user every when the user uses the wellness system, and then vary the pattern of electric shocks to be applied to the diseased part of the user according to the recovery process of the diseased part.
- the wellness system can inform a doctor or a trainer of a state of the muscle activity and the pattern of electric shocks varying with time, so that the electric shock control unit 39 can reflect a doctor's or trainer's judgement so as for the doctor or trainer to operate the wellness system with safety.
- the exercise load providing unit 30 can provide a pseudo load of a physical exercise by applying electric shocks to a muscle of a diseased part in cast of a user. Accordingly, when a load of a physical exercise from outside cannot be applied forcefully to the user, the wellness system can provide a pseudo load of a physical exercise for maintaining the muscular strength of the muscle of the diseased part in cast of the user by applying electric shocks to the muscle to keep a reduction in the muscular strength to a minimum. As a result, the wellness system makes it possible to shorten a period of time required for rehabilitation and hence accelerate recovery of muscular strength.
- FIG. 10 there is illustrated a block diagram showing the structure of a wellness system of a seventh embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the seventh embodiment is adapted to activate and deactivate its operation, and control the provision of a virtual reality environment and a load of a physical exercise, according to a user's gesture.
- FIG. 10 the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the seventh embodiment is adapted to activate and deactivate its operation, and control the provision of a virtual reality environment and a load of a physical exercise, according to a user's gesture.
- reference numeral 60 denotes a gesture input unit for identifying a gesture that a user makes and then furnishing the identifying result to the control computer 10 of the control unit 11
- 61 denotes an imaging unit disposed in the gesture input unit 60 , for taking an image of a part of the body of the user who makes a gesture with the part of the body
- 62 denotes an image processing unit disposed in the gesture input unit 60 , for processing image information taken by the imaging unit 61 SO as to extract image parameters representing the meaning of the gesture, such as the shape and an angle of a user's hand, and the center position of the user's hand
- 63 denotes a gesture identifying unit disposed in the gesture input unit 60 , for identifying the gesture that the user has made on the basis of the image parameters obtained by the image processing unit 62 and furnishing the identifying result to the control computer 11 of the general control unit 10 .
- reference numeral 15 denotes a gesture-based-control data base which is disposed in the general control unit 10 , and which can be referred by the control computer 11 when it activates and deactivates the operation of the wellness system, and control the virtual reality environment providing unit 20 and the exercise load providing unit 30 according to the type of the gesture identified by the gesture identifying unit 63 of the gesture input unit 60 .
- the user can do that by making a predetermined gesture with a part of the user's body such as a hand.
- the imaging unit 61 of the gesture input unit 60 takes an image of the part of the user's body which makes the gesture and then furnishes the image information obtained to the image processing unit 62 .
- the image processing unit 62 performs a predetermined image processing on the image information furnished thereto to calculate image parameters required for identifying the gesture which the user has made and furnish the image parameters to the gesture identifying unit 63 .
- the gesture identifying unit 63 can identify the gesture which the user has made according to an algorithm for obtaining a correspondence between a pattern (e.g., values and variations in values which vary with time) of image parameters pre-registered and types of gestures, and furnish the identifying result to the general control unit 10 .
- a pattern e.g., values and variations in values which vary with time
- the control computer 11 of the general control unit 10 refers to the gesture-based-control data base 15 , which is used for controlling the wellness system according to a user s gesture, according to the identifying result from the gesture input unit 60 , which informs the general control unit 10 of the meaning of the gesture which the user has made, and then the control computer 11 of the general control unit 10 activates or deactivates the wellness system, performs control such as emergency stop, or controls the provision of a virtual reality environment or the load of a physical exercise which the user is doing, according to the contents referred to of the gesture-based-control data base.
- Control of the provision of a virtual reality environment on-screen is carried out as follows. For example, when the user reaches a fork in the virtual reality environment displayed on the screen of the image display unit 21 of the virtual reality environment providing unit 20 and then shows a direction in which the user will head with a direction of moving a user's hand, the gesture identifying unit 63 identifies the direction of moving the user's hand from image parameters obtained by the image processing unit 62 and then the virtual reality environment providing unit 20 causes the image display unit 21 to display an image of a branch path selected by the user on the screen thereof.
- the gesture identifying unit 63 identifies the user s gesture from image parameters obtained by the image processing unit 62 and then the virtual reality environment providing unit 20 varies the virtual reality environment on-screen by referring to the third data base 14 used for controlling the virtual reality environment according to a user's psychological condition.
- Control of the provision of a load of a physical exercise can be carried out as follows. For example, when the user moves up and down a user's hand while pointing the palm upward, the exercise load detection and control unit 34 increases the load of a physical exercise provided for the user.
- the exercise load detection control unit 34 reduces the load of a physical exercise provided for the user.
- the priorities of such the controls using a user's gesture must be assigned in consideration of the priorities of controls performed by the other control means.
- the gesture showing the emergency stop takes precedence over all of the other controls.
- the user can handle the wellness system of this embodiment by himself or herself by making a gesture that is easy to learn, without having to use a special input device such as a remote controller.
- the wellness system can not only allow the user to handle the system, but have a user interaction function of allowing the user to work upon the wellness system autonomously. Such the user interaction encourages the user to face rehabilitation aggressively.
- the user can move around in the virtual reality environment autonomously, the user can refresh himself or herself more effectively.
- FIG. 11 there is illustrated a block diagram showing the structure of a wellness system of an eighth embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the eighth embodiment is adapted to add to the realism by displaying a part of the body of the user on the screen so that the user can see the part of the body in the virtual reality environment on-screen.
- FIG. 11 there is illustrated a block diagram showing the structure of a wellness system of an eighth embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the eighth embodiment is adapted to add to the realism by displaying a part of the body of the user on the screen so that the user can see the part of the body in the virtual reality environment on-screen.
- reference numeral 71 denotes an imaging unit for taking an image of a part of the user's body
- 72 denotes an image processing unit for performing an image processing on the image taken by the imaging unit
- 73 denotes an image trimming unit for trimming the image so as to extract a needed part of the image including the part of the user's body.
- reference numeral 70 denotes a user's image capturing unit comprised of the imaging unit 71 , image processing unit 72 , and image trimming unit 73 , and connected to the image display unit 21 of the virtual reality environment providing unit 20 .
- reference numeral 21 d denotes disposed in the image display unit 21 of the virtual reality environment providing unit 20 , for superimposing the image extracted by the image trimming unit 73 of the user's image capturing unit 70 on the image of a virtual reality environment to be offered to produce and display the composite screen image on the screen of the display 21 b.
- the imaging unit 71 of the user's image capturing unit 70 takes an image of a part of the user s body, e.g., feet or the end of a hand, and then furnishes the image to the image processing unit 72 .
- the image processing unit 72 converts the image furnished by the imaging unit 71 into an image in a form that the wellness system can handle and then furnishes the converted image to the image trimming unit 73 .
- the image trimming unit 73 trims the converted image from the image processing unit 72 to extract a needed part of the image including the part of the user's body by utilizing a contrast and a luminance difference between the background image and the user s body, and then furnishes the extracted image to the image display unit 21 of the virtual reality environment providing unit 20 .
- the image superimposing unit 21 d of the image display unit 21 superimposes the image extracted by the image extracting unit 73 of the user's image capturing unit 70 on the image of the virtual reality environment read out of the image storing unit 21 a to produce and display the composite screen image on the screen of the display 21 b.
- the wellness system can provide the user with a virtual reality environment in which the user walk in the forest, thereby adding to the realism and hence motivating the user to do a rehabilitation physical exercise more strongly.
- the wellness system can cause the user to entertain friendly sentiments toward the place where the user is staying and recognize the place.
- the wellness system can encourage the user to face rehabilitation aggressively. Furthermore, by making an image of a part of the user's body which the user can see while stepping on the wellness system, for example, feet or a hand which can be viewed from the user's eyes with a camera attached to the user's head, and superimposing the image on an image of a virtual reality environment to produce and display the composite screen image on the screen of the display, the wellness system of this embodiment can provide the realism that causes the user to feel as if the user enters the virtual reality environment.
- FIG. 12 there is illustrated a block diagram showing the structure of a wellness system of a ninth embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the ninth embodiment is adapted to communicate with a plurality of other wellness systems so that the user can meet and communicate with other persons who are using the respective other wellness systems.
- FIG. 12 The wellness system of the ninth embodiment is adapted to communicate with a plurality of other wellness systems so that the user can meet and communicate with other persons who are using the respective other wellness systems.
- reference numeral 80 denotes an information acquiring unit for acquiring information about an image and sounds which are associated with the user and are to be transmitted
- 81 denotes an imaging unit for taking an image of at least a part of the user's body
- 82 denotes an image processing unit for performing an image processing on the image made by the imaging unit
- 83 denotes an image trimming unit for trimming the image so as to extract a needed part of the image including the part of the user's body.
- reference numeral 84 denotes a microphone for gathering a sound generated by the user
- 85 denotes a sound recording unit for recording sound information gathered by the microphone 84 .
- the information acquiring unit 80 is provided with the imaging unit 81 , image processing unit 82 , image trimming unit 83 , microphone 84 , and sound recording unit 85 .
- 91 denotes a communications network through which a plurality of wellness systems can communicate with each other
- 92 denotes a transmission data generating unit for converting the image and sound information from the transmission information getting unit 80 , and information about the position of the user in the virtual reality environment from the general control unit 10 , into transmission data in a predetermined transmission format so as to transmit the transmission data by way of the communications network 91 to at least another wellness system
- 93 denotes a received data converting unit for receiving the position information about the user's position in the virtual reality environment and direction information about a direction in which the user is headed in the virtual reality environment or a direction toward which the user faces from the general control unit 10 and converting the transmission data furnished thereto by way of the communications network 91 into data required for constructing a virtual reality environment in which the user can communicate with at least another person, so as to furnish the converted data to the general control unit 10
- 94 denotes a network interface for connecting the transmission data generating unit 92 and received data converting unit 93
- the plurality of wellness systems each provided with the general control unit 10 , virtual reality environment providing unit 20 , exercise load providing unit 30 , physiological and psychological condition measurement unit 40 , transmission information acquiring unit 80 , transmission data generating unit 92 , received data converting unit 93 , and network interface 94 are connected to each other by way of the communications network 91 .
- FIG. 12 shows an example of this embodiment including two wellness systems which are so constructed.
- the imaging unit 81 takes an image of at least a part of the user's body, such as the user's face, or the whole of the user's body, and the image processing unit 82 converts the image into data in a form that can be handled by the system.
- the image trimming unit 83 trims the image so as to extract and furnish a needed part of the image including the part of the user's body to the image display unit 21 of the virtual reality environment providing unit 20 and also the transmission data generating unit 92 in the same wellness system.
- the wellness system acquires a sound that the user makes by means of the microphone 84 and then records the sound as sound data by means of the sound recording unit 85 .
- the sound data is furnished to the transmission data generating unit 92 .
- user's voices and the sound of footsteps, and sounds made in surroundings are acquired with a plurality of good-directional microphones 84 and a plurality of sound recording units 85 such that the user's voices and sound of footsteps are isolated from the sounds made in surroundings.
- the wellness system can acquire a sound which the user actually makes by means of the microphone 84 , while it can directly furnish sound information which is generated and provided by the sound providing unit 22 of the virtual reality environment providing unit 20 to the sound recording unit 85 , as indicated by a dotted line in FIG. 12.
- the general control unit 10 holds information about the user's position in the virtual reality environment, and updates the position information according to information from the exercise load providing unit 30 and then furnishes the updated position information to the transmission data generating unit 92 .
- the transmission data generating unit 92 receives the image and sound information from the transmission information acquiring unit 80 and the position information from the general control unit 10 , it converts them to communications data in a predetermined communications format which complies with a protocol of the communications network 91 so as to furnish the communications data together with a code for identifying the user onto the communications network 91 by way of the network interface 94 .
- the received data converting unit 93 of the wellness system receives a code for identifying another person who is using another wellness system, information about an image and sounds associated with the other user, and information about the position of the other user in a virtual reality environment provided by the other wellness system, which have been transmitted by way of the communications network 91 by the transmission data generating unit 92 of the other wellness system, the received data transforming unit 93 determines a relationship between the user's position in the virtual reality environment and the position of the other person in the other virtual reality environment provided by the other wellness system from the above information received and information about the user's position and direction in which the user is headed in the virtual reality environment from the general control unit 10 of the same wellness system.
- the received data converting unit 93 furnishes the sound information from the other wellness system together with information about a direction from which the sound made in the other wellness system comes, which is calculated from the above relationship, to the general control unit 10 .
- the received data transforming unit 93 searches the image information from the other wellness system and selects a part of the image that can be viewed in the virtual reality environment on the basis of the direction information showing the direction in which the user is headed in the virtual reality environment and the position information about the other person, and then transforms the part into an image that can be viewed from the user's position and furnishes the image to the general control unit 10 .
- the control unit 10 furnishes the image information from the received data converting unit 93 together with a signal for controlling the virtual reality environment to the image display unit 21 of the virtual reality environment providing unit 20 , and also furnishes the sound information to the sound providing unit 22 .
- the image display unit 21 reads information about an image, which produces an original virtual reality environment, stored in the image storing unit according to the signal for controlling the virtual reality environment from the general control unit 10 , and then superimposing the image information associated with the other person, which has been furnished by the general control unit 10 , and the image information associated with the user, which has been furnished by the transmission information acquiring unit 80 , on the above image of the virtual reality environment so as to produce and display the composite screen image on the display of the wellness system.
- the sound providing unit 22 chooses sound information stored in the sound data storing unit according to the signal for controlling the virtual reality environment from the general control unit 10 and then synthesizes the sound information and the information about a sound that the other person has made, which has been furnished by the general control unit 10 , by using the direction information so as to offer the synthesized sound to the user.
- the wellness system of this embodiment can provide a common virtual space in which the user can meet a plurality of other persons, have a conversation with other persons while looking the persons in the faces or seeing how the persons are, and going for a walk with other persons.
- a common virtual space makes it possible to encourage the user to motivate himself or herself when the user does a rehabilitation physical exercise or receives exercise treatment.
- the user can refresh himself or herself by virtue of communication with other persons.
- Various types of communication can be made.
- the user and another patient can exchange information about their progress toward recovery or methods of treatment.
- the user can demand an explanation of the progress toward recovery or consult with a medical authorized person such as a doctor or a rehabilitation doctor by way of the communications network.
- the medical authorized person can also cheer up the user through communication made by way of the communications network.
- the user can have a conversation about everyday life or the user's impressions of the virtual reality with the user's family or a helper.
- the wellness system provides a virtual reality environment that can produce a relaxed atmosphere in which the user can smoothly communicate with other persons.
- the wellness system of this embodiment can cause the user to feel as if the user holds space and time in common with other persons, thereby encouraging the user to create social relationships with other persons.
- FIG. 13 there is illustrated a block diagram showing the structure of a wellness system of a tenth embodiment of the present invention.
- the same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the tenth embodiment is adapted to provide a virtual reality environment through which the user who is apart from a real environment can make contact with the real environment.
- FIG. 13 The wellness system of the tenth embodiment is adapted to provide a virtual reality environment through which the user who is apart from a real environment can make contact with the real environment.
- reference numeral 100 denotes an image information acquiring unit for acquiring information about an image of an object in a real environment which is apart from the user
- 101 denotes a sound information acquiring unit for acquiring information about sounds (or a sound field) made in the real environment
- 102 denotes a temperature and humidity information acquiring unit for acquiring information about the temperature and humidity of the real environment
- 103 denotes a wind direction and speed information acquiring unit for acquiring information about the direction and speed of a wind blowing in the real environment
- 104 denotes a fragrance information acquiring unit for acquiring information about fragrance emitted out of the real environment.
- a moving unit 105 in which the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , and fragrance information acquiring unit 104 are mounted is adapted to carry them.
- An information transmitting and receiving unit 106 mounted in the moving unit 105 transmits the information acquired by the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , and fragrance information acquiring unit 104 to the general control unit 10 , and receives information for controlling movements of the moving unit 105 from the general control unit 10 .
- An information transmitting and receiving unit 16 disposed in the general control unit 10 receives the information acquired by the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , and fragrance information acquiring unit 104 from the information transmitting and receiving unit 106 , and transmits information for controlling movements of the moving unit 105 .
- control computer 11 of the general control unit 10 controls the virtual reality environment providing unit 20 according to the information acquired by the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , and fragrance information acquiring unit 104 , which has been received by the information transmitting and receiving unit 16 , so as to provide the user with a virtual reality environment which originates from a real environment in which the moving unit 105 is placed, by means of the image display unit 21 , sound providing unit 22 , and fragrance and wind generating unit 23 .
- the exercise load providing unit 30 detects a movement of the user who is doing the physical exercise and then furnishes the detected information to the control computer 11 .
- the control computer 11 creates information for controlling movements of the moving unit 105 from the detected information, and then furnishes it to the information transmitting and receiving unit 106 of the moving unit 105 by means of the information transmitting and receiving unit 16 .
- the moving unit 105 operates under the control of the received information for controlling movements of the moving unit, and moves according to the movement of the user who is doing the physical exercise. For example, when the user makes one step, the moving unit moves by the distance of one step. Accordingly, the moving unit 105 carries the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , and fragrance information acquiring unit 104 , which are mounted in the moving unit, according to the physical exercise that the user is doing.
- These information acquiring units acquire information about images, information about sounds, and information about the real environment such as temperature, humidity, the direction of wind, the speed of wind, and fragrance at a number of places, during the interval that the moving unit is moving.
- the acquired information is transmitted to the information transmitting and receiving unit 16 of the general control unit 10 by the transmitting and receiving unit 106 , and is further furnished to the control computer 11 .
- the control computer 11 controls the virtual reality environment providing unit 20 according to the information received and then provides the user with a virtual reality environment showing the real environment to which the moving unit has been moved, by means of the image display unit 21 , sound providing unit 22 , and wind and fragrance unit 23 .
- the moving unit 105 in which the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , and fragrance information acquiring unit 104 are mounted is placed in the park.
- the user can use the wellness system of this embodiment while lying on a bed.
- the moving unit 105 moves according to the user's steps together with the plurality of information acquiring units mounted in the moving unit and transmits the movement information including information about images, sounds, and the real environment to the control computer by way of the information transmitting and receiving units 106 and 16 , which makes the appropriate changes to the on-screen image provided by the virtual reality environment providing unit 20 , and wind, sounds, fragrance, and so on.
- the on-screen image is changed such that flowers in the flower garden move closer to the user gradually and the fragrance of the flowers becomes stronger.
- the kinds of flowers on the on-screen image are varied and the fragrance emitted out of the wellness system is varied according to a variation in the kinds of on-screen flowers.
- the on-screen image and sound provided by the virtual reality environment providing unit are varied in real time according to movements of the child.
- the wellness system of this embodiment can cause the user to feel as if the user enters a real environment even though the user is apart from the real environment. Accordingly, the wellness system offers the advantage of being able to encourage the user to motivate himself or herself to do a rehabilitation physical exercise. Furthermore, the wellness system can provide interaction with a real world for any other purposes other than rehabilitation, thereby releasing the user from the stress of being confined in a room of a hospital or the user's house and hence causing the user to refresh himself or herself.
- FIG. 14 there is illustrated a block diagram showing the structure of a wellness system of an eleventh embodiment of the present invention.
- the same components as those shown in FIG. 13 of the wellness system of the tenth embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the eleventh embodiment is adapted to provide a virtual reality environment through which the user can make interact with other persons who are staying in a real environment which is the source of the virtual reality environment.
- FIG. 14 there is illustrated a block diagram showing the structure of a wellness system of an eleventh embodiment of the present invention.
- the same components as those shown in FIG. 13 of the wellness system of the tenth embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter.
- the wellness system of the eleventh embodiment is adapted to provide a virtual reality environment through which the user can make interact with other persons who are staying in a real environment which is the source of the virtual reality environment.
- reference numeral 21 e denotes a video camera disposed in the image display unit 21 of the virtual reality environment providing unit 20 , for taking an image of at least a part of the user's body or the whole of the user's body so as to acquire image information about the user
- 21 f denotes an image capturing unit for capturing the image information acquired by the video camera 21 e and then furnishing it to the image control unit 21 c
- 51 denotes a microphone for acquiring information about sounds which the user makes and furnishing it to the control computer 11 of the general control unit 10 .
- reference numeral 110 denotes an image information providing unit for receiving the image information about the user, which has been acquired by the video camera 21 e of the image display unit 21 and has been captured by the image capturing unit 21 f , and which has been transmitted to the control computer 11 by the image control unit 21 c , transmitted thereto by way of the information transmitting and receiving units 16 and 106 , so as to provide the image information for other persons staying in the real world which is the source of the virtual reality environment provided for the user
- 111 denotes a sound information providing unit for receiving the sound information about the user, which has been acquired by the microphone 51 and which has been transmitted by the control computer 11 , transmitted thereto by way of the information transmitting and receiving units 16 and 106 , so as to provide the sound information for other persons staying in the real world which is the source of the virtual reality environment provided for the user.
- the image information acquiring unit 100 when the user who stays in hospital uses the wellness system of the eleventh embodiment in order to interact with the user's family that is staying in a sight-seeing resort, the image information acquiring unit 100 , sound information acquiring unit 101 , temperature and humidity information acquiring unit 102 , wind direction and speed information acquiring unit 103 , fragrance information acquiring unit 104 , information transmitting unit 106 , image information providing unit 110 , and sound information providing unit 111 which are mounted in the moving unit 105 are placed in the sight-seeing resort, while the other components of the wellness system are placed in the hospital in which the user stays.
- the wellness system acquires information about an image of parts of the bodies of members of the user's family or the whole of the bodies of all of the members, an image of a piece of scenery in the sight-seeing resort, sounds which the members of the user's family make, and sounds made in surroundings in the sight-seeing resort, by means of the image information acquiring unit 100 and sound information acquiring unit 101 which are placed in the sight-seeing resort.
- the acquired image and sound information is transmitted to the main body of the wellness system place in the hospital by the information transmitting and receiving unit 106 .
- the wellness system receives the information transmitted thereto through the information transmitting and receiving unit 16 , and furnishes it to the control computer 11 of the general control unit 10 .
- the control computer 11 controls the virtual reality environment providing unit 20 on the basis of the information transmitted thereto so as to provide how the members of the user's family staying in the sight-seeing resort are for the user staying in the hospital.
- the wellness system acquires information about an image of a part of the body of the user who is staying in the hospital or the whole of the user's body by means of the video camera 21 e of the image display unit 21 of the virtual reality environment providing unit 20 which is placed in the hospital. Then, the image capturing unit 21 f captures the image taken by the video camera, and the image control unit 21 c transmits the captured image to the control computer 11 .
- the control computer 11 receives the image information transmitted thereto and furnishes it to the information transmitting and receiving unit 106 which is placed in the sight-seeing resort through the information transmitting and receiving unit 16 .
- the image information is further furnished to the image information providing unit 110 and then is provided for the members of the family.
- the wellness system acquires information about sounds such as a sound which the user makes by means of microphone 51 . Then, the acquired sound information is furnished to the control computer 11 .
- the control computer 11 furnishes the sound information to the information transmitting and receiving unit 106 which is placed in the sight-seeing resort through the information transmitting and receiving unit 16 .
- the sound information is further furnished to the sound information providing unit 111 and then is provided for the members of the family.
- the wellness system of this embodiment can provide a situation in which the user feels as if the user stays together with the user's family staying in a real world which is apart from the user, such as a sight-seeing resort. Furthermore, by changing the sight-seeing resort to a schoolroom of a school, and changing the user's family to a teacher and user's friends, the wellness system of this embodiment can provide a virtual reality environment in which the user can feel as if the user goes to school while staying in hospital.
- the wellness system of this embodiment can cause the user to interact with a real world and communicate with persons which stay in the real world for any other purposes other than rehabilitation, thereby releasing the user from the stress of being restrained in a room of a hospital or the user's house and hence causing the user to refresh himself or herself. Furthermore, since the wellness system can give the user an opportunity of participating in society, it is useful for the care of the mental health of the user.
- the present invention offers the following advantages.
- a wellness system which can display an image which produces a virtual reality environment according to a movement of the user who is doing a physical exercise, which has been measured by an exercise load providing unit, while setting its angle of view to be larger than an angle of view of a corresponding object or scene which was shot by using a video camera or the like. Therefore, the wellness system of the embodiment can provide a virtual reality environment that offers and adds realism to cause the user to feel as if the user enters the screen of the virtual reality environment providing unit.
- a wellness system which can display an image which produces a virtual reality environment which is controlled according to a user's psychological condition evaluated by a physiological and psychological condition evaluating unit, while setting the angle of view of the image on-screen to be larger than an angle of view of a corresponding object or scene which was shot. Therefore, the wellness system of the embodiment can provide a virtual reality environment that offers and adds realism according to the evaluated user's psychological condition.
- a wellness system which can replay a plurality of dynamic image cuts, which were taken at a plurality of places of a real environment which is a source of the virtual reality environment, cut by cut according to a user's movement measured by the exercise load providing unit. Therefore, the wellness system can prevent the user from doing a physical exercise to excess according to an image on-screen of the virtual reality environment provided for the user.
- the wellness system can provide the user with a sound, a wind, and fragrance which are associated with each of the plurality of dynamic image cuts, in synchronization with the replay of each of the plurality of dynamic image cuts. Therefore, the embodiment offers the advantage of being able to cause the user to feel as if the user walks actually in a place shown by the virtual reality environment.
- a wellness system which can provide a negative load of a physical exercise to help the user to do a physical exercise. Accordingly, the wellness system of the embodiment can enable and help the user who cannot move by himself or herself to do a physical exercise such as a passive rehabilitation exercise by himself or herself according to his or her capacity for locomotion. Furthermore, since a user who cannot move by himself or herself can move in the virtual reality environment, the user can temporarily get rid of the stress of being confined to a bed and therefore mentally refresh himself or herself.
- a wellness system which can control the load of a physical exercise provided by the exercise load providing unit according to a data which defines a pattern of the physical exercise which the user is to do. Accordingly, this embodiment can provide a load of a physical exercise suitable for the user. Furthermore, the user can repeat a safe rehabilitation exercise, the contents of which can be set manually or through an exercise load data input unit by a doctor or a rehabilitation doctor when the user starts to be trained. Therefore, the wellness system of this embodiment can prevent a reduction in the chance of rehabilitation due to a short supply of rehabilitation doctors.
- the wellness system can comprise a position detecting sensor for detecting a position of a load providing unit of the exercise load providing unit which is manually moved by a doctor or a rehabilitation doctor according to an exercise pattern suitable for rehabilitation when the user starts to be trained, and a speed detecting sensor for simultaneously detecting the moving speed of the load providing unit which is being moved manually.
- the exercise load providing unit can use outputs from the position detecting sensor and the speed detecting sensor as the data which defines the pattern of the physical exercise which the user is to do.
- the wellness system of this embodiment offers the advantage of being able to enable a doctor or a rehabilitation doctor to input a data which defines a pattern of a physical exercise that the user does by manually moving the load providing unit according to the contents of a desired rehabilitation physical exercise.
- the wellness system further comprises an exercise load data input unit through which the data which defines the physical exercise pattern can be input when the user starts physical training using the wellness system. Accordingly, the wellness system offers the advantage of being able to enable the user to do a safe rehabilitation physical exercise, the contents of which has been set by a rehabilitation doctor or the like by inputting numerical data.
- a wellness system which can control the load of a physical exercise which the user is doing according to an active mass of a muscle estimated by a muscle active mass estimating unit from a electromyogram of the muscle measured by an electromyograph unit. Accordingly, the wellness system of this embodiment offers the advantage of being able to provide a user's muscle with a load of a physical exercise according to the active mass of the muscle, thereby preventing the user's muscle from atrophying.
- a wellness system which can apply an electric shock to a user's muscle through electrodes attached to a diseased part in cast according to the active mass of the muscle estimated from an electromyogram of the muscle. Accordingly, the wellness system of this embodiment offers the advantage of being able to provide a pseudo load of a physical exercise for the user in order to maintain the muscular strength, thereby keeping a reduction in the muscular strength to a minimum.
- a wellness system comprising which can activate or deactivate the wellness system, control the virtual reality environment providing unit, and control the exercise load providing unit, according to a user's gesture. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable the user to handle the wellness system of this embodiment by himself or herself by making a gesture that is easy to learn, thereby causing the user to work upon the wellness system autonomously and face rehabilitation aggressively.
- a wellness system provided with a unit for taking and capturing an image of at least a part of the user's body, and a unit for superimposing the image captured on an image of the virtual reality environment to be provided to display the composite image. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable the user to see the movement of the user's body in the virtual reality environment, thereby adding to the realism.
- a wellness system comprising a transmission information acquiring unit for acquiring information about an image and a sound associated with the user, and a transmission data generating unit for converting the information about an image and a sound acquired by the transmission information acquiring unit and information about a position of the user in the virtual reality environment, which is furnished by the control unit, into communications data in predetermined communications format so as to transmit the communications data to another wellness system by way of a communications network.
- the wellness system of this embodiment offers the advantage of being able to enable a plurality of users to meet each other and communicate with each other in the virtual reality environment.
- a wellness system comprising an image information acquiring unit movably disposed for acquiring information about an image of a real environment that is apart from the user, a sound information acquiring unit movably disposed for acquiring information about sounds made in the real environment that is apart from the user, an environment information acquiring unit movably disposed for acquiring information about the real environment that is apart from the user, and a control unit for moving the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit according to a user's movement measured by the exercise load providing unit, and for controlling the virtual reality environment provided by the virtual reality environment providing unit using the information acquired by the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit.
- the wellness system of this embodiment offers the advantage of being able to cause the user who is apart from the real environment to feel as if the user is staying in the real environment.
- the wellness system further comprises a user's image information acquiring unit for acquiring information about an image of at least a part of the user's body, a user's sound information acquiring unit for acquiring information about a sound that the user makes, an image information providing unit for providing the image information acquired by the user's image information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment, and an image information providing unit for providing the sound information acquired by the user's sound information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment.
- the wellness system of this embodiment offers the advantage of being able to enable the user who is apart from the real environment to interact with persons staying in the real environment.
Abstract
A wellness system comprises an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise, a virtual reality environment providing unit for providing the user with a virtual reality environment that can cause user's plural senses such as the sense of sight, hearing, touch, and smell to work, according to the contents of the virtual reality environment, and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit. Furthermore, when providing the virtual reality environment, the virtual reality environment providing unit displays an image which produces the virtual reality environment by setting its angle of view to be larger than an angle of view of a corresponding object or scene which was shot.
Description
- 1. 1. Field of the Invention
- 2. The present invention relates to a wellness system which can provide a user with artificial reality which involves a plurality of human senses integrated, i.e., a virtual reality environment which causes user's plural human senses such as the sense of sight, hearing, touch, and smell to work. More particularly, the present invention relates to a wellness system which can provide a user with a virtual reality environment which can add a sense of sophisticated realism and the contents of a physical exercise which varies according to the virtual reality environment, by acquiring information about a movement and a physiological condition of the user who is doing a physical exercise and then providing feedback of the information to the wellness system, also provide a user who is isolated from a real world with a contact with the real world by providing a virtual reality environment for the user, and support communication between the user and another user, or between the user and a medical authorized person or a helper.
- 3. 2. Description of the Prior Art
- 4. Each of prior art training machines intended for the improvement of a person's health and physical strength have been widely used as a wellness system. An artificial-experience giving device equipped with a display, for providing a user with artificial experience in doing a target physical training exercise while seeing an image displayed on the screen of the display is one of such training machines. Referring now to FIG. 15, there is illustrated a schematic view of such a prior art artificial-experience giving device equipped with a display as disclosed in Japanese Patent Application Laying Open (KOKAI) No. 7-80096. In the figure,
reference numeral 1 denotes a bicycle training machine, 2 denotes a pedal of the machine, 3 denotes a saddle of the machine, 4 denotes a projector which projects an image of an artificial scene, 5 denotes a screen shaped like a half-spherical dome, on which an image from theprojector 4 is displayed, 6 denotes a blowing outlet out of which an artificial wind is blowing, 7 denotes a blowing box which produces the artificial wind, and 8 denotes a fragrant substance adding unit for adding a fragrant substance to the artificial wind. - 5. When a user sits on the
saddle 3 of thebicycle training machine 1 and then starts to pedal the bicycle training machine, theprojector 4 projects an image on thescreen 5 shaped like a half-spherical dome and located at the front of thebicycle training machine 1. In general, the image displayed on the screen is concerned with an artificial scene in the vicinity of an artificial road on which the bicycle is moving, and the image is controlled so that the artificial scene is varied according to the speed at which the user pushes thepedals 2 around, that is, the scene moves at a high speed when the user pedals fast and the scene moves at a low speed when the user pedals slowly. In addition, a wind from the blowingoutlet 6 located at the front of the user is blowing toward the user. The velocity of the wind is controlled according to the speed at which the user pushes the pedals around, similarly to the speed of a variation in the image projected on the screen. Furthermore, the prior art artificial-experience giving device equipped with a display is adapted to control the load of a physical exercise imposed on the user and select a fragrant substance to be added to the artificial wind according to the contents of the image displayed on the screen so as to provide the user with a sense of realism, for example, increase the load of the bicycle training when an image of an upward slope is displayed on the screen, decrease the load of the bicycle training when an image of an downward slope is displayed on the screen, or add a fragrant substance including phytoncide as a major constituent to the artificial wind blowing out of the blowingoutlet 6 by means of the fragrantsubstance adding unit 8 in a situation wherein the user is going on a bicycle trip in a wood. - 6. The prior art wellness system which is so constructed as mentioned above is intended for persons of health or patients who are almost restored in health, but not for early rehabilitation carried out for patients who have no alternative but to be confined to bed, in the presence of a doctor, or according to instructions of a doctor, to prompt early rising and prevent the user from atrophying with disuse. While the prior art wellness system has a measure to display an image in order to cause the user to motivate himself or herself to do rehabilitation, it cannot add a sense of realism to a sufficient degree. Furthermore, the prior art wellness system cannot be intended for patients who are not restored in health; the prior art wellness system cannot provide a load of a physical exercise suitable for the user. In addition, another problem with the prior art wellness system is that since it does not include a means for acquiring information about the user and a real environment in real time and a communications function, the user is not allowed to make contact with a real environment and communicate with another person.
- 7. The present invention is made in order to overcome the above problems. It is therefore an object of the present invention is to provide a wellness system which can provide virtual reality which involves a plurality of human senses integrated for a user, and provide the user with a sense of sophisticated realism and the contents of a physical exercise which the user is to do, and which varies according to the realism, by acquiring information about a movement and a physiological condition of the user who is doing a physical exercise and then providing feedback of the information to the wellness system, thereby giving the user an opportunity of relaxation and refreshment, and causing the user to motivate himself or herself for rehabilitation, which usually bores the user, more effectively, so that a patient who stays in hospital can be helped to do early rising after an operation, and a patient who has been receiving medical treatment for a long time can be prevented from atrophying with disuse.
- 8. It is another object to provide a wellness system which can provide a user who is isolated from a real world with a contact with the real world by providing a virtual reality environment for the user, and support communication between the user and another user which is using another wellness system, or between the user and a medical authorized person or a helper, thereby giving the user an opportunity of participating in society, and offering the care of the mental health of the user.
- 9. In accordance with one aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of a user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit. Furthermore, when providing the virtual reality environment, the virtual reality environment providing unit displays an image which produces the virtual reality environment by setting its angle of view to be larger than a corresponding angle of view of a corresponding object or scene which was shot.
- 10. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a physiological and psychological condition evaluating unit for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and a control unit for controlling the load of the physical exercise which the user is doing according to the physiological condition of the user evaluated by the physiological and psychological condition evaluating unit, and for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's psychological condition evaluated by the physiological and psychological condition evaluating unit. Furthermore, when providing the virtual reality environment, the virtual reality environment providing unit displays an image which produces the virtual reality environment by setting its angle of view to be larger than a corresponding angle of view of a corresponding object or scene which was shot.
- 11. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit. Furthermore, the virtual reality environment providing unit can store a plurality of dynamic image cuts which were taken at a plurality of places of a real environment which is a source of the virtual reality environment, and can replay them cut by cut according to the user's movement measured by the exercise load providing unit.
- 12. In accordance with a preferred embodiment of the present invention, the virtual reality environment providing unit can provide the user with a sound, a wind, and fragrance which are associated with each of the plurality of dynamic image cuts, in synchronization with the replay of each of the plurality of dynamic image cuts.
- 13. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the load of the physical exercise provided by the exercise load providing unit. Furthermore, the virtual reality environment providing unit can provide a negative load of a physical exercise to help the user to do the physical exercise.
- 14. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the load of the physical exercise provided by the exercise load providing unit according to a data which defines a pattern of the physical exercise which the user is to do.
- 15. In accordance with a preferred embodiment of the present invention, the exercise load providing unit includes a load providing unit for directly providing the load of the physical exercise for the user, a position detecting sensor for detecting a position of the load providing unit, and a speed detecting sensor for detecting a moving speed of the load providing unit. Furthermore, the exercise load providing unit can use outputs from the position detecting sensor and the speed detecting sensor as the data which defines the pattern of the physical exercise which the user is to do.
- 16. In accordance with another preferred embodiment of the present invention, the wellness system further comprises an exercise load data input unit through which the data which defines the physical exercise pattern can be input when the user starts physical training using the wellness system.
- 17. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a physiological and psychological condition evaluating unit for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and a control unit for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by the physiological and psychological condition evaluating unit. Furthermore, the physiological and psychological condition evaluating unit is provided with an electromyogram measuring unit for measuring an electromyogram of a muscle on which the load of the physical exercise is imposed, a muscle active mass estimating unit for estimating an active mass of the muscle from the electromyogram measured by the electromyograph measuring unit.
- 18. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a physiological and psychological condition evaluating unit for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and a control unit for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by the physiological and psychological condition evaluating unit. Furthermore, the physiological and psychological condition evaluating unit is provided with an electromyograph unit for measuring or obtaining an electromyogram of a muscle of a diseased part in cast of the user by means of electrodes attached to the diseased part in cast, a muscle active mass estimating unit for estimating an active mass of the muscle from the electromyogram obtained by the electromyograph unit. Furthermore, the exercise load providing unit is provided with an electric shock applying unit for applying an electric shock to the user's muscle through other electrodes attached to the diseased part in cast, and an electric shock control unit for controlling the electric shock applying unit according to the active mass of the muscle estimated by the muscle active mass estimating unit, thereby providing a pseudo load of a physical exercise for the user by using electric shocks.
- 19. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; a gesture identifying unit for detecting the shape of a part of the
user 5 body which makes a gesture and then identifying the gesture; and a control unit for activating or deactivating the wellness system, controlling the virtual reality environment providing unit, and controlling the exercise load providing unit, according to the user's gesture identified by the gesture identifying unit. - 20. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according to the user's movement measured by the exercise load providing unit. Furthermore, the virtual reality environment providing unit is provided with a unit for taking and capturing an image of at least a part of the user's body, and a unit for superimposing the image captured on an image of the virtual reality environment to be provided to display the composite image when providing the virtual reality environment.
- 21. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment providing unit for providing the user with a virtual reality environment; a control unit for controlling the virtual reality environment provided by the virtual reality environment providing unit according tot he user's movement measured by the exercise load providing unit; a transmission information acquiring unit and information about a position of the user in the virtual reality environment, which is furnished by the control unit, into communications data in predetermined communications format so as to produce the communications data to be transmitted by way of a communications network; and a received data transforming unit for transforming communications data transmitted to the wellness system by way of the communications network into data required for the virtual reality environment providing unit to construct the virtual reality environment.
- 22. In accordance with another aspect of the present invention, there is provided a wellness system comprising: an exercise load providing unit for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise; a virtual reality environment providing unit for providing the user with a virtual reality environment according to the contents of the virtual reality environment; an image information acquiring unit movably disposed for acquiring information about an image of a real environment that is apart from the user; a sound information acquiring unit movably disposed for acquiring information about sounds made in the real environment that is apart from the user; an environment information acquiring unit movably disposed for acquiring information about the real environment that is apart from the user; and a control unit for moving the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit according to the user's movement measured by the exercise load providing unit, and for controlling the virtual reality environment provided by the virtual reality environment providing unit using the information acquired by the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit.
- 23. In accordance with a preferred embodiment of the present invention, the wellness system further comprises a user's image information acquiring unit for acquiring information about an image of at least a part of the user's body, a user's sound information acquiring unit for acquiring information about a sound that the user makes, an image information providing unit for providing the image information acquired by the user's image information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment, and an image information providing unit for providing the sound information acquired by the user's sound information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment.
- 24. Further objects and advantages of the present invention will be apparent from the following description of the preferred embodiments of the invention as illustrated in the accompanying drawings.
- 25.FIG. 1 is a block diagram of a wellness system according to a first embodiment of the present invention;
- 26.FIG. 2a is a view showing the angle of view of an object when taking an image of the object which is a source of a virtual reality environment to be provided by the wellness system of the first embodiment;
- 27.FIG. 2b is a view showing the angle of view of the image of the above object, which produces a virtual reality environment, to be displayed on the screen of the wellness system of the first embodiment;
- 28.FIG. 3 is a view showing an example of a method of making image data for a wellness system of a second embodiment of the present invention;
- 29.FIG. 4 is a view showing an example of a path on which the user will move in a virtual space provided by the wellness system of the second embodiment of the present invention;
- 30.FIG. 5 is a view showing an exercise load providing unit of a wellness system of a third embodiment of the present invention;
- 31.FIG. 6 is a view showing torques and positions of both pedals of a load providing unit of the exercise load providing unit shown in FIG. 5;
- 32.FIG. 7 is a block diagram of a wellness system according to a fourth embodiment of the present invention;
- 33.FIG. 8 is a block diagram of a wellness system according to a fifth embodiment of the present invention;
- 34.FIG. 9 is a block diagram of a wellness system according to a sixth embodiment of the present invention;
- 35.FIG. 10 is a block diagram of a wellness system according to a seventh embodiment of the present invention;
- 36.FIG. 11 is a block diagram of a wellness system according to an eighth embodiment of the present invention;
- 37.FIG. 12 is a block diagram of a wellness system according to a ninth embodiment of the present invention;
- 38.FIG. 13 is a block diagram of a wellness system according to a tenth embodiment of the present invention;
- 39.FIG. 14 is a block diagram of a wellness system according to an eleventh embodiment of the present invention; and
- 40.FIG. 15 is a schematic diagram of a prior art wellness system.
- 41. Referring now to FIG. 1, there is illustrated a block diagram of a wellness system according to a first embodiment of the present invention. In the figure,
reference numeral 10 denotes a general control unit for controlling the whole of the wellness system, 11 denotes a control computer disposed in thegeneral control unit 10 for actually carrying out control of the wellness system, 12 denotes a first data base used for controlling a virtual reality environment according to a movement of a user (e.g., a patient or a senior citizen) who is doing a physical exercise, 13 denotes a second data base used for controlling the load of the physical exercise according to a user's physiological condition, and 14 denotes a third data base used for controlling the virtual reality environment according to a user's psychological condition. - 42. Furthermore,
reference numeral 20 denotes a virtual reality providing unit which is controlled by thecontrol computer 11 of thegeneral control unit 10, for providing the user with a virtual reality environment according to the contents of the virtual reality environment, 21 denotes an image display unit comprised of an imagedata storing unit 21 a for storing image data about the virtual reality environment, adisplay 21 b on which an image of the virtual reality environment is displayed, and animage control unit 21 c for controlling the imagedata storing unit 21 a anddisplay data storing unit 22 a for storing sound data about the virtual reality environment, asound output unit 22 b for providing a sound for the virtual reality environment, and asound control unit 22 c for controlling the sounddata storing unit 22 a andsound output unit fragrance generating unit 23 a for emitting fragrance which constructs a part of the virtual reality environment, awind generating unit 23 b for generating a wind which constructs a part of the virtual reality environment, and a wind andfragrance control unit 23 c for controlling thefragrance generating unit 23 a andwind generating unit 23 b. The virtual realityenvironment providing unit 20 is provided with theimage display unit 21, thesound providing unit 22, and the wind andfragrance generating unit 23. - 43.
Reference numeral 30 denotes an exercise load providing unit which is controlled by thecontrol computer 11 of thegeneral control unit 10, for imposing an appropriate exercise load on the user and measuring a movement of the user who is doing the physical exercise. The exerciseload providing unit 30 is provided with aload providing unit 31 for imposing an appropriate exercise load on the user, a drivingunit 32 for driving theload providing unit 31, acontrol unit 33 for controlling the drivingunit 32, an exercise load detection andcontrol unit 34 for furnishing an instruction from thecontrol computer 11 of thegeneral control unit 10 to thecontrol unit 33 and for detecting a movement of the user who is doing the physical exercise and then informing thecontrol computer 11 of the detected result. - 44. In addition,
reference numeral 40 denotes a physiological and psychological condition measurement unit which is controlled by thecontrol computer 11 of thegeneral control unit 10, for measuring information about user's physiological and psychological conditions so as to determine the user's physiological and psychological conditions. The physiological and psychologicalcondition measurement unit 40 is provided with a physiological and psychologicalinformation acquiring unit 41 for acquiring information about user's physiological and psychological conditions, a physiological and psychologicalinformation analyzing unit 42 for analyzing the information about the user's physiological and psychological conditions acquired by the physiological and psychologicalinformation acquiring unit 41 so as to evaluate the user's physiological and psychological conditions, and aninterface unit 43 which interfaces between the physiological and psychologicalinformation acquiring unit 41 and the physiological and psychologicalinformation analyzing unit 42. - 45. In operation, the
general control unit 10 controls each of theimage display unit 21,sound providing unit 22, and wind andfragrance generating unit 23 by means of thecontrol computer 11 so that they are synchronized with each other so as to generate a virtual reality environment that provides a user with a sense of realism, according to the contents of the virtual reality environment. When controlling the virtual reality environment according to the physical exercise which the user is doing, such as a rehabilitation exercise, thefirst data base 12 is used. When controlling the virtual reality environment according to the psychological condition of the user, the third data base 14 is used. - 46. When controlling the virtual reality environment according to the physical exercise which the user is doing, such as a rehabilitation exercise, the exercise load detection and
control unit 34 of the exerciseload providing unit 30 measures a movement of the user who is doing the physical exercise, such as a walking motion of the user, and then varies the image of the virtual reality environment displayed by theimage display unit 21 according to the measured walking speed of the user and simultaneously varies the sound to be emitted by thesound providing unit 22 and the wind and fragrance to be provided by the wind andfragrance generating unit 23. For example, by storing environment data on a wood for providing forest bathing in thefirst data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise, thegeneral control unit 10 can vary an image of the wood to be displayed on thedisplay 21 b by theimage display unit 21 as the user walks in the virtual reality environment, and simultaneously vary sounds generated within the wood, such as a bird's twittering and rustling of trees, emitted by thesound output unit 22 b of thesound providing unit 22, and a wind generated by thewind generating unit 23 b of the wind andfragrance generating unit 23 and fragrance, such as a smell of a needle-leaf tree or a smell of a flower, generated by thefragrance generating unit 23 a of the wind andfragrance generating unit 23. Accordingly, the user can enjoy virtual forest bathing while doing such a rehabilitation exercise. - 47. The wellness system of this embodiment can store environment data about a scene that can relax the user such as an amusement park in the third data base 14 in order to control the virtual reality environment according to a user's psychological condition. When the physiological and psychological
condition measurement unit 40 determines that the user is strung up, thegeneral control unit 10 provides a virtual scene of such an amusement park so as to relax the user by means of theimage display unit 21,sound providing unit 22, and wind andfragrance generating unit 23 of the virtual realityenvironment providing unit 20. - 48. The wellness system can control the load of the physical exercise imposed on the user with reference to the
second data base 13 which was prepared in advance, when controlling the exercise load according to the physiological condition of the user. For example, the wellness system can provide the user with a physical exercise to make the user feel good with safety while avoiding danger due to an overload to the user, by adjusting the load of the physical exercise in such a manner that it prevents an overload and a light load of the physical exercise from being imposed on the user. - 49. The wellness system according to this embodiment capable of controlling the virtual reality environment and the load of a physical exercise which the user is doing can be applied to the rehabilitation of a patient who has no alternative but to be confined to bed with illness, a patient who is on the road to recovery, and a person of health.
- 50. When the wellness system of the first embodiment displays an image of a virtual reality environment on the
image display unit 21 of the virtual realityenvironment providing unit 20, the angle of view of the image projected on the screen is larger than the angle of view of a corresponding object, i.e., a scene which was shot, that is, which is the source of the image projected. Referring next to FIGS. 2a and 2 b, there are illustrated views showing the angle of view in the wellness system of the first embodiment when taking an image of a scene and displaying an image on the screen thereof. FIG. 2a shows the angle of view when taking an image of a scene. FIG. 2b shows the angle of view when displaying the image on the screen. As shown in FIG. 2a, a dynamic image of a scene is taken with an angle of view of θ0 by a video camera or the like. Then, the image data taken by the video camera is stored in theimage storing unit 21 a of theimage display unit 21. When displaying the image on the screen of the image display unit, theimage control unit 21 c of theimage display unit 21 reads the image data stored in theimage storing unit 21 a in response to a control signal furnished by thecontrol computer 11 of thegeneral control unit 10, and displays the image on thedisplay 21 b with a larger angle of view of θ1 as shown in FIG. 2b. Thedisplay 21 b which displays an image on the screen thereof with a large angle of view can be implemented via an image display device comprising a display board for displaying an image having a barrel-shaped distortion and an optical system for making a distortion correction to the image, or a head-mount type image display device. Thus, since the image display unit of the wellness system of this embodiment displays an image with the angle of view of θ1 which is larger than the angle of view of θ0 when making a video film of a corresponding scene, it causes the user to feel as if the user enters the scene displayed on the screen and hence to get himself or herself absorbed in the virtual reality environment. - 51. Instead of a real-life dynamic image which was taken with a video camera, static images, or computer-generated graphic images, i.e., computer graphics (CG) which are not real-life images, can be used as images which produce a virtual reality environment to be provided for a user.
- 52. Referring next to FIG. 3, there is illustrated a view showing an example of a method of making image data which is used for a wellness system of a second embodiment of the present invention. The wellness system of the second embodiment is structured similarly to that of the above-mentioned first embodiment shown in FIG. 1, except that the preparation of image data stored in the
image storing unit 21 a of theimage display unit 21 disposed within the virtual realityenvironment providing unit 20 and control data stored in thefirst data base 12 of thegeneral control unit 10 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise are carried out by following a step dynamic image method. The step dynamic image method is comprised of steps of storing a plurality of dynamic image cuts which were taken at a plurality of places in a path through which the user will walk or run in the virtual reality environment to be provided by the wellness system in the virtual realityenvironment providing unit 20, and replaying the plurality of dynamic image cuts cut by cut according to a physical exercise that the user does and producing a corresponding sound, wind, and fragrance in synchronization with each of the plurality of dynamic image cuts replayed by means of the virtual realityenvironment providing unit 20. - 53. As shown in FIG. 3, when the virtual reality environment provided for the user is concerned about a situation in which the user walk in a park, corresponding dynamic image cuts are made at the park which is to be the stage where the user does the physical exercise in the virtual reality environment. At that time, a plurality of places where a plurality of dynamic image cuts are to be taken respectively are defined so that they are arranged at predetermined intervals of, for example, one foot or a few feet of an average man. Then, each dynamic image cut is being made at each of the places arranged as mentioned above for a predetermined time, e.g., tens of seconds with a video camera held in a horizontal state, while positioning the video camera at eye level of an average man and pointing the video camera to the direction which the user is to be headed in the virtual reality environment, for example, the direction of the tangent line of a road on which the user will walk in the virtual reality environment. Furthermore, at a fork of the path, one dynamic image cut of a scene showing how many streets the path is divided to is taken with the video camera. A plurality of dynamic image cuts thus taken are compressed with an image compressing and coding method such as the Moving Picture Experts Group (MPEG) compressing and coding method defined by International Standards Organization (ISO), and then the compressed and coded data are stored in the
image storing unit 21 a of theimage display unit 21. - 54. At each of the plural places where each of the plurality of dynamic image cuts is taken, information about sounds is recorded at the same time. In order to offer a stereophonic sound in the virtual reality environment, sounds from different directions must be recorded separately by using a good-directional microphone. By adding composite tone and sound data recorded separately to the sounds thus recorded while replaying each of the plural dynamic image cuts taken, sound data which correspond to each of the plural dynamic image cuts to be displayed on the screen are generated and recorded in the sound
data storing unit 22 a. Furthermore, information about a plurality of sound sources and their positions can be generated and stored in the sounddata storing unit 22 a in order to offer a stereophonic sound. For example, in order to offer a virtual reality environment wherein a small bird is flying while twittering, the position of the small bird, the dimensions of the vicinity of the bird which can reflect a sound which the bird makes such as the bird's twittering and which a human being can hear, the reflectivity of sound against the vicinity of the bird, and the timing of the twittering are stored as sound data which correspond to one dynamic image cut to be displayed on the screen as well as the phrase of the twittering of the small bird. Control information showing a correspondence between the plurality of dynamic image cuts and sound data is stored in thefirst data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise. Instead of creating sound data throughout the total time of the plurality of dynamic image cuts, only sound data can be generated for each scene including a sound in each of the plural dynamic image cuts and then the timing data showing the timing of triggering the generation of a sound in replaying each of the plural dynamic image cuts, i.e., the timing data showing the number of a frame of the cut from which the generation of the sound is started is added to the control information. - 55. Similarly, at each of the plural places where each of the plurality of dynamic image cuts is taken, information about the velocity of a wind blowing, and fragrance is acquired at the same time. Preferably, the information about the wind is recorded by using an air speedometer and an anemoscope. Alternatively, a person can record the velocity and direction of a blowing wind that he or she has noticed as the information about the wind. After that, control information about a wind and fragrance which corresponds to each of the plural dynamic image cuts to be displayed on the screen is generated on the basis of the above information recorded while replaying each of the plural dynamic image cuts on the screen, and is stored in the
first data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise. A set of the timing data showing the timing of blowing a wind and generating fragrance and parameters required for generating the wind and fragrance is stored as the control information, similarly to the case of sound data. In addition, at each of the plural places where each of the plurality of dynamic image cuts is taken, the inclination of land and condition of land such as its hardness and construction materials are measured and corresponding control parameters are stored in thefirst data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise. - 56. When offering the virtual reality environment to the user according to the contents of the virtual reality environment, the
control computer 11 of thegeneral control unit 10 selects one of the plural dynamic image cuts to be replayed next according to information stored in thefirst data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise, and then furnished the selected cut to theimage display unit 21. After that, thecontrol computer 11 delivers an instruction to start the replay of the next dynamic image cut to theimage control unit 21 c of theimage display unit 21 in synchronization when the exercise load detection andcontrol unit 34 of the exerciseload providing unit 30 detects a stepping motion of the user, that is, every time the user makes one step. When the user moves along the path in the virtual reality environment and then reaches a fork, the control unit can project an image including at least a part of the human body of the user who can show the direction in which the user is headed with a gesture on the screen, as described below in a seventh embodiment of the present invention, so as to cause the user to select a path through which the user wants to move by making a gesture, the meaning of which can be identified by the wellness system. Furthermore, thecontrol computer 11 of thegeneral control unit 10 reads control information about sounds, a wind and fragrance which correspond to the next dynamic image cut to be displayed and control information about the load of a physical exercise which the user will do, and furnishes the control information to thesound providing unit 22, the wind andfragrance unit 23, and the exerciseload providing unit 30. - 57. When the
image control unit 21 c of theimage display unit 21 receives an instruction to start the replay of a next dynamic image cut, it reads image information about the next cut from theimage storing unit 21 a and decompresses the image information which was compressed using the MPEG compression method by means of an image expanding circuit board not shown in FIG. 1. Then, theimage control unit 21 c of theimage display unit 21 furnishes the expanded image information to thedisplay 21 b so as to provide the user with the next dynamic image cut. When theimage control unit 21 c of theimage display unit 21 does not receive the instruction to start the replay of a next cut even though the replay of the preceding dynamic image cut has been completed, that is, when the movement of user is very slow or the user stops, the image control unit returns to the first frame of the same dynamic image cut and repeats the replay of the same dynamic image cut. Accordingly, when the user makes a step forward, the scene on-screen such as a park changes to the next dynamic image cut which was taken at a one-step forward place, and simultaneously thesound control unit 22 c of thesound providing unit 22 provides a stereophonic sound such as a bird's twittering, or rustling of leaves of trees which corresponds to the on-screen image according to sound data stored in the sounddata storing unit 22 a by means of thesound output unit 22 b, and the wind andfragrance control unit 23 c of the wind andfragrance generating unit 23 controls thewind generating unit 23 b and thefragrance generating unit 23 a under control of thecontrol computer 11 of thegeneral control unit 10 so as to provide a wind and fragrance such as a smell of a flower which correspond to the image on-screen. Furthermore, theload providing unit 31 of the exerciseload providing unit 30 which is controlled by thecontrol computer 11 of thegeneral control unit 10 provides a load of a physical exercise according to the image of a scene displayed on the screen. Accordingly, the user can feel as if the user walk in a real-life place which is the source of the virtual reality environment on-screen. For example, the user can feel a difference of conditions of the road surface on which the user steps, or the angle between the user's legs and a slope. - 58. Thus, since the wellness system according to the second embodiment of the present invention can generate image data and control data by means of the step dynamic image method, the wellness system can cause the user to have a sense that the user moves in a real-life space without causing the user to do a physical exercise to excess according to the image on-screen.
- 59. In order to reduce a feeling of physical disorder (e.g., sickness) due to discontinuity of images which appears when the user's viewpoint changes, i.e., a next dynamic image cut is displayed on the screen, the shooting of a series of plural dynamic image cuts must be carried out for only an object which hardly moves such as trees and grass without taking a picture of persons walking and automobiles in the vicinity of the shooting place. Fractal small movements such as rustling of leaves of trees are desirable because discontinuity between dynamic image cuts is not prominent. Furthermore, in order to reduce discontinuity in replaying the same dynamic image cut again, it is preferable to trim each of the plural dynamic image cuts so that the image of the first frame of each of the plural dynamic image cuts is similar to that of the last frame of each of the plural dynamic image cuts. Similarly, sound data mainly including data about a sound which does not vary rapidly or a series of similar sounds can be incorporated into the dynamic image together with data about a sound which does not provide the user with an unnatural feeling even though the replay of the sound is terminated in the middle of the replay, such as a bird's twittering or an insect's chirping.
- 60. Referring next to FIG. 4, there is illustrated a view showing an example of a path through which the user walks in a virtual space. As shown in FIG. 4, the path is comprised of a main path shaped like a loop and a plurality of branches each including branch paths all of which are connected to the main path. Furthermore, the path is a one-way road. Accordingly, explosive increases in the number of nodes and the number of needed dynamic image cuts which are caused by the branches as shown in FIG. 4 can be prevented. Furthermore, since the user cannot go back on the path, it is desirable to provide the user with an image in which when the user returns to the main path from a branch path, the user cannot see the exit of another branch. The image cannot be necessarily the one which was taken at a real shooting place. It is preferable to reconstruct such the image by using real-life data recorded so that the user does not have an unnatural feeling. Furthermore, measures not to cause the brightness of the screen, the direction of the sun, and the weather to vary discontinuously among successive dynamic image cuts are needed. Modification of the plural dynamic image cuts which is carried out after the image shooting is effective in order to eliminate the discontinuity, too.
- 61. As previously explained, the
image display unit 21 andsound providing unit 22 according to this embodiment are disposed separately, and image data and sound data are stored separately in the respective storing units. If the wellness system does not offer a stereophonic sound, both of theimage display unit 21 andsound providing unit 22 can be formed in one piece which can compress image and sound which are synchronized with each other and store them therein. - 62. Other numerous variants may be made in the exemplary embodiment mentioned above. Instead of creating image data, sound data, and control information on the basis of a plurality of real-life dynamic image cuts, it is preferable to write a scenario which defines the structure of a virtual reality environment to be provided for the user and variations in the virtual reality environment, and create animation image data by using computer graphics, and sound data and control information according to the scenario.
- 63. Furthermore, instead of providing a virtual reality environment in which the user can walk while stepping, the wellness system of this second embodiment can offer a virtual reality environment in which the user can work at oars by hand.
- 64. In addition, by varying the height of the user's eyes, or setting the spacing between two adjacent shooting places to a distance which is different from the stride of an average person, the wellness system can cause the user to feel as if the user become a child or another creature that is completely different from a human being. Thus, the wellness system of this embodiment can provide a person who usually view a real world while sitting on a wheelchair with a feeling of a person who is walking. On the contrary, the wellness system of this embodiment can also provide a person who can walk normally with a feeling of a person who usually view a real world while sitting on a wheelchair.
- 65. Referring next to FIG. 5, there is illustrated a schematic diagram of the exercise
load providing unit 30 of a wellness system of a third embodiment of the present invention. The exerciseload providing unit 30 of this third embodiment is adapted to provide the user with a negative load of a physical exercise for helping the user to do a physical exercise. The structure of the wellness system of the third embodiment of the present invention is the same as that of the first embodiment shown in FIG. 1, and the same components as those shown in FIG. 1 are designated by the same reference numerals. Therefore, the description about the structure of the wellness system of this embodiment will be omitted hereinafter. - 66. In operation, the exercise load detection and
control unit 34 of the exerciseload providing unit 30 furnishes an instruction to offer a negative load of a physical exercise to thecontrol unit 33 according to an instruction from thecontrol computer 11 of thegeneral control unit 10. The provision of the negative load of a physical exercise means that the wellness system helps the user to do a physical exercise by exerting forces on the user's legs, for example. Theload providing unit 31 of this embodiment is provided with left and right pedals for securing the user's left and right feet to the pedals, respectively, so that both of the user's feet are not separate from the pedals, so as to exert forces from the drivingunit 32 on the pedals and hence the user's feet and legs. The negative load of a physical exercise imposed on the user causes the user to bend and stretch the user's knees alternately. Thecontrol unit 33 controls the drivingunit 32 so that the drivingunit 32 sets the forces, i.e., torques and positions of both of the pedals of theload providing unit 31, as shown in FIG. 6. As can be seen from FIG. 6, the drivingunit 32 moves the positions of the right and left pedals in such a manner that they have opposite phases, and the drivingunit 32 also sets the forces provided by the right and left pedals in such a manner that they have opposite phases. It is desirable that a specialist such as a doctor or a rehabilitation doctor sets the magnitude of the forces to be exerted on theload providing unit 31 and hence the user according to recovery of the user, to thegeneral control unit 10. More specifically, a method as described in a fourth embodiment of the present invention can be applied. - 67. In order to assure safety, it is preferable that there is provided an emergency stop switch located in the vicinity of the wellness system for stopping the supply of the load of a physical exercise. In addition, it is preferable that both of the pedals for securing the user's feet to the
load providing unit 31 are adapted to automatically release the user's feet when too big a force is exerted on at least one of the pedals, and there is provided an emergency switch for releasing the user's feet from the pedals. - 68. Accordingly, the user who cannot move the user's legs by himself or herself can do a passive rehabilitation exercise which is usually provided by a rehabilitation doctor by using the wellness system of this embodiment. The user can easily do a physical exercise which lasts a short time over and over again a day. It is thus expected that the user's stiff muscle or joint become movable and then the user can move his or her muscle and joint by himself or herself. Furthermore, the wellness system can provide the user who cannot move with a feeling of moving in a virtual reality environment by virtue of a passive physical exercise. For example, when the user pedals as shown in FIG. 5, the wellness system offers a feeling of walking. Therefore, the user can temporarily get rid of the stress of being confined to a bed and therefore mentally refresh himself or herself. Furthermore, since the wellness system can help the user who cannot do a physical exercise without any efforts to do an exercise when the user starts to be trained, the user can easily face the training. As a result, the wellness system of this embodiment can prevent muscles or the like of the user from atrophying with disuse.
- 69. In the above description, a knee bending exercise is explained as an example. The wellness system of this embodiment can also be applied to a physical exercise of an ankle, an arm, or a wrist.
- 70. Referring next to FIG. 7, there is illustrated a block diagram showing the structure of a wellness system of a fourth embodiment of the present invention. The same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the fourth embodiment is adapted to provide a load of a physical exercise suitable for the user according to an exercise pattern such as a movable range of the user, and an acceptable walking or pedaling speed, which have been input by a doctor or a rehabilitation doctor when the user starts to be trained. Furthermore, the wellness system can learn, i.e., store the exercise pattern which has been input. In FIG. 7,
reference numeral 35 denotes a position detecting sensor disposed in the exerciseload providing unit 30, for detecting the position of theload providing unit 31 and then furnishing the detected result to thecontrol computer 11 of thegeneral control unit load providing unit 30, for detecting the moving speed of theload providing unit 31 and then furnishing the detected result to thecontrol computer 11 of thegeneral control unit - 71. Before starting rehabilitation, a doctor or a rehabilitation doctor adjusts the
load providing unit 31 of the exerciseload providing unit 30 manually according to an exercise pattern suitable for the rehabilitation physical exercise which the user will do. Theposition detecting sensor 35 andspeed detecting sensor 36 of the exerciseload providing unit 30 measure the position and moving speed of the load providing unit which are determined by the exercise pattern set by a doctor or a rehabilitation doctor and then furnish the position and moving speed data measured to thegeneral control unit 10. Thecontrol computer 11 of thegeneral control unit 10 stores the data furnished to the control unit in thefirst data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise. When the user starts to do the rehabilitation physical exercise, thecontrol computer 11 furnishes the above-mentioned data stored in thefirst data base 12 to the exercise load detection andcontrol unit 34 of the exerciseload providing unit 30. As a result, the drivingunit 32 controlled by thecontrol unit 33 drives theload providing unit 31 according to the data to offer the exercise pattern suitable for the user, which was manually set by a doctor or a rehabilitation doctor. - 72. A doctor or a rehabilitation doctor can directly input a setting numerical data which defines the exercise pattern, such as the track of the
load providing unit 31 moving, e.g., the track of moving pedals of the load providing unit, a pattern of changes in the speed of the load providing unit which occur during the travel of the load providing unit, the maximum value of the load of a physical exercise provided by the load providing unit, a movable range of the load providing unit, and an acceptable speed of theload providing unit 31, by means of the exercise loaddata input unit 50. The setting numerical data which defines the exercise pattern input through the exercise loaddata input unit 50 are furnished to thegeneral control unit 10. Thecontrol computer 11 of thegeneral control unit 10 stores the data furnished to the control unit in thefirst data base 12 used for controlling the virtual reality environment according to a movement of the user who is doing the physical exercise. When the user starts to do a rehabilitation physical exercise using the wellness system, thecontrol computer 11 reads and furnishes the above-mentioned data stored in thefirst data base 12 to the exerciseload providing unit 30. As a result, the drivingunit 32 controlled by thecontrol unit 33 drives theload providing unit 31 according to the data to provide the user with a load of a physical exercise, like the above-mentioned case. - 73. Thus, the wellness system of this embodiment can learn or store a data which defines the exercise pattern, such as the movable range of the user and the acceptable speed, which are set manually or through the exercise load data input unit by a doctor or a rehabilitation doctor when the user starts to be trained, so as to provide a load of a physical exercise for the user according to the exercise pattern. Therefore, the user can repeat a safe rehabilitation physical exercise the contents of which have been set by a rehabilitation doctor or the like. Accordingly, this embodiment can solve a problem that the chance of rehabilitation is reduced due to a short supply of rehabilitation doctors.
- 74. Referring next to FIG. 8, there is illustrated a block diagram showing the structure of a wellness system of a fifth embodiment of the present invention. The same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the fifth embodiment is adapted to control a load of a physical exercise which the user is doing according to the active mass of muscles of the user, thereby preventing the user's muscles from atrophying. In FIG. 8,
reference numeral 37 denotes a position detecting sensor which is disposed in the exerciseload providing unit 30, and through which the maximum level of a load of a physical exercise is defined, 44 denotes an electromyograph unit for measuring or obtaining the electromyogram of a muscle which is the target of rehabilitation or training offered to the user, 45 denotes a muscle active mass estimating unit for analyzing the electromyogram obtained by the electromyogram detecting unit and then estimating the active mass of the muscle, and 46 denotes a muscle active mass display unit for displaying the active mass of the muscle estimated by the muscle active mass estimating unit in an easy-to-understand form. The physiological and psychologicalcondition measurement unit 40 of the fifth embodiment is provided with theelectromyograph unit 44, muscle activemass estimating unit 45, and muscle activemass display unit 46. - 75. In operation, the physiological and psychological
condition measurement unit 40 obtains the electromyogram of the muscle which is the target of the rehabilitation or training offered to the user by means of theelectromyograph unit 44. The acquisition of the electromyogram by theelectromyograph unit 44 is carried out by attaching a pair of disposal electrodes on the body of the user where a general electromyogram of the target muscle (a general electromyogram means an electromyogram of the whole of the muscle) can be obtained and by using a differential amplifier which is generally used for bioelectricity phenomenon measurements and the electric characteristic of which is adjusted for the electromyogram measurement, or a differential amplifier intended for electromyogram measurements. When the electromyogram obtained is furnished to the muscle activemass estimating unit 45, it rectifies the waveform of the electromyogram and then performs low-pass filtering on the rectified electromyogram to convert the electromyogram into a signal having a waveform which represents the active mass of the muscle. Alternatively, the muscle activemass estimating unit 45 can obtain the envelope of the waveform of the electromyogram from the electromyogram from theelectromyograph unit 44. The waveform of the low-pass filtered signal represents the mean active mass of the muscle. On the other hand, the envelope of the electromyogram represents the maximum value of the active mass of the muscle which varies with time in one cycle. Such the waveform conversion can produce a signal having a voltage which can rise when the activity of the muscle is brisk and descend when the activity of the muscle is not brisk, that is, which can represent the active mass of the muscle. The waveform of the signal thus obtained can be used as a substitute for the active mass of the muscle. The muscle activemass display unit 46 shows the active mass of the muscle estimated by the muscle activemass estimating unit 45 in an easy-to-understand form for the user, a trainer, and a rehabilitation doctor. For example, the muscle activemass display unit 46 can display the maximum value of the active mass of the muscle in real time by using a level meter, or the waveform of the signal which represents the active mass of the muscle by using a residual image oscilloscope or the like. - 76. On the other hand, the physiological and psychological
condition measurement unit 40 furnishes the signal representing the active mass of the muscle to thecontrol computer 11 of thegeneral control unit 10, and then thecontrol computer 11 furnishes it to the exercise load detection andcontrol unit 34 of the exerciseload providing unit 30. The exercise load detection andcontrol unit 34 controls theload providing unit 31 according to the signal through thecontrol unit 33 and drivingunit 32 so as to provide the user with a load of a physical exercise. Data about loads of a physical exercise predetermined on the basis of mean physical strengths measured according to age and sex are pre-stored in thesecond data base 13 of thegeneral control unit 10, which is used for controlling the load of a physical exercise according to the user's physiological condition. When the user starts to use the wellness system of this embodiment, the exerciseload providing unit 30 applies a load of a physical exercise according to the data stored in the third data base. - 77. The exercise load detection and
control unit 34 compares the active mass of the muscle estimated by the activemass estimating unit 45 of the physiological and psychologicalcondition measurement unit 40 with the maximum level of a load of a physical exercise defined by the exerciseload setting unit 37 so as to control the load of a physical exercise provided by theload providing unit 31 according to the comparison result. For example, until the estimated active mass of the muscle reaches the defined maximum level of a load of a physical exercise, the exercise load detection andcontrol unit 34 carries out the control of the load of a physical exercise in such a manner that it increases the load of a physical exercise gradually and reduces the load of a physical exercise to zero when the estimated active mass of the muscle exceeds the defined maximum level of the load of a physical exercise. It is needless to say that there is an individual difference in physical strength. Therefore, the exerciseload setting unit 37 can be adapted to change the maximum level of the load of a physical exercise during the provision of the load of a physical exercise according to a manual input by the user, a trainer, or a rehabilitation doctor who has determined the change. - 78. Another method of controlling the load of a physical exercise can be applied. The method includes steps of converting activity of the muscle at a certain level or more into a pulse by means of a comparator or the like, furnishing a signal to the exercise load detection and
control unit 34 when the number of counts of pulses reaches a certain value, and stopping the provision of the load of a physical exercise in response to the signal. Alternatively, when a certain time, which was predetermined in advance, elapses after the exercise load detection andcontrol unit 34 receives a first pulse which represents the occurrence of the activity of the muscle at a certain level or more, it can stop the provision of the load of a physical exercise. - 79. Preferably, the
second data base 13, which is used for controlling the load of the physical exercise according to a user's physiological condition, is adapted to store measured data such as data about the active mass of muscles, which are organized according to the user's identification (ID), age, and sex, every when a user uses the wellness system. Accordingly, the wellness system can set the initial value of the load of a physical exercise which the user is to do and the maximum level of the load of a physical exercise according to the physical strength or the degree of recovery of the user, thereby providing an appropriate load of a physical exercise in accordance with training conditions and the progress of rehabilitation. - 80. Preferably, the wellness system of this embodiment is adapted to control the
image display unit 21 of the virtual realityenvironment providing unit 20 according to the active mass of a muscle estimated by the active mass estimating unit. For example, the wellness system is adapted to vary something in an image on-screen about a game, when the active mass of a user's muscle exceeds a certain value during the image is displayed. More specifically, when the wellness system provides a virtual reality environment in which the user can drive a surface-to-air missile launching ramp and aim at an enemy plane, a detection of the active mass of a user's muscle which exceeds a certain value is utilized to trigger the launching of a missile. Accordingly, the wellness system can offer the advantage of introducing a feeling of games into training and rehabilitation by means of such the display means, so that the user can motivate himself or herself for rehabilitation. - 81. Referring next to FIG. 9, there is illustrated a block diagram showing the structure of a wellness system of a sixth embodiment of the present invention. The same components as those shown in FIG. 8 of the wellness system of the fifth embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the sixth embodiment is adapted to apply an electric shock to a muscle of a diseased part in cast of the user to provide a pseudo load of a physical exercise in order to maintain its muscular strength, thereby preventing the user's muscle from atrophying. In FIG. 9,
reference numeral 47 denotes a muscle activity evaluating unit for evaluating the activity of a muscle from the active mass of the muscle estimated by the activemass estimating unit 45. The physiological and psychologicalcondition measurement unit 40 of the sixth embodiment is provided with the muscleactivity evaluating unit 47 as well as theelectromyograph unit 44 and muscle activemass estimating unit 45. Furthermore,reference numeral 38 denotes an electric shock providing unit for applying an electric shock to a specified muscle of the user, and 39 denotes an electric shock control unit for controlling the electricshock providing unit 38 according to the evaluation result by the muscleactivity evaluating unit 47 of the physiological and psychologicalcondition measurement unit 40. The exerciseload providing unit 30 of the sixth embodiment is provided with the electricshock providing unit 38 and electricshock control unit 39. - 82. In operation, electrodes of the electric
shock providing unit 38, through which an electric shock is applied, and electrodes of theelectromyograph unit 44, through which a muscular electric current is measured, are mounted to a diseased part of the user which is surrounded and fixed by a cast, in advance of providing the user with a pseudo load of a physical exercise. It is needless to say that the user cannot move the muscle of the diseased part in cast at the user's motive and it is difficult for another person to activate the user's muscle of the diseased part in cast. The wellness system of the present embodiment can apply a small amount of current to the muscle of the diseased part through the electrodes used for the purpose to shrink the muscle by means of the electricshock dividing unit 38 of the exerciseload providing unit 30. Theelectromyograph unit 44 of the physiological and psychologicalcondition measurement unit 40 acquires an electromyogram of the muscle, and then the muscle activemass estimating unit 45 estimates the activity of the muscle by analyzing the electromyogram measured. The muscleactivity evaluating unit 47 evaluates the activity of the muscle from the active mass of the muscle estimated by the muscle activemass estimating unit 45, and furnishes the evaluation result to thecontrol computer 11 of thegeneral control unit 10. - 83. When the
control computer 11 receives the evaluation result, it instructs the exerciseload providing unit 30 to allow the electricshock control unit 39 to determine the strength of electric shocks, duration of each of the electric shocks, and frequency of the electric shocks from the evaluation result of the muscle activity. The electricshock control unit 39 controls the electricshock providing unit 38 according to the strength of the electric shocks, duration of each of the electric shocks, and frequency of the electric shocks, which have been determined by the electric shock control unit. Then, the electricshock providing unit 38 applies electric shocks with the electric shock strength, duration, and frequency to the muscle of the user through the electric shock electrodes attached to the diseased part in cast. It is preferable to measure the magnitude of an electric shock which causes the muscle of the user to shrink, but does not cause the user to feel the apply of the electric shock, in advance of providing electric shocks for rehabilitation, and to start to use the wellness system by initially setting the magnitude of electric shocks to be applied to the measured magnitude. - 84. As previously explained, the electric
shock control unit 39 determines the strength of electric shocks to be applied, duration of each of the electric shocks, and frequency of the electric shocks on the basis of the frequency of the activity of the muscle and the number of pulses which correspond to the activity of the muscle at a certain level or more. The wellness system can initially set the magnitude of electric shocks to a value which causes the muscle of the user to shrink, but does not cause the user to feel the apply of the electric shock. In addition, the wellness system can be adapted to store the history of measured data about the user every when the user uses the wellness system, and then vary the pattern of electric shocks to be applied to the diseased part of the user according to the recovery process of the diseased part. Furthermore, the wellness system can inform a doctor or a trainer of a state of the muscle activity and the pattern of electric shocks varying with time, so that the electricshock control unit 39 can reflect a doctor's or trainer's judgement so as for the doctor or trainer to operate the wellness system with safety. - 85. As previously explained, the exercise
load providing unit 30 according to the sixth embodiment can provide a pseudo load of a physical exercise by applying electric shocks to a muscle of a diseased part in cast of a user. Accordingly, when a load of a physical exercise from outside cannot be applied forcefully to the user, the wellness system can provide a pseudo load of a physical exercise for maintaining the muscular strength of the muscle of the diseased part in cast of the user by applying electric shocks to the muscle to keep a reduction in the muscular strength to a minimum. As a result, the wellness system makes it possible to shorten a period of time required for rehabilitation and hence accelerate recovery of muscular strength. - 86. Referring next to FIG. 10, there is illustrated a block diagram showing the structure of a wellness system of a seventh embodiment of the present invention. The same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the seventh embodiment is adapted to activate and deactivate its operation, and control the provision of a virtual reality environment and a load of a physical exercise, according to a user's gesture. In FIG. 10,
reference numeral 60 denotes a gesture input unit for identifying a gesture that a user makes and then furnishing the identifying result to thecontrol computer 10 of thecontrol unit gesture input unit 60, for taking an image of a part of the body of the user who makes a gesture with the part of the body, 62 denotes an image processing unit disposed in thegesture input unit 60, for processing image information taken by theimaging unit 61 SO as to extract image parameters representing the meaning of the gesture, such as the shape and an angle of a user's hand, and the center position of the user's hand, and 63 denotes a gesture identifying unit disposed in thegesture input unit 60, for identifying the gesture that the user has made on the basis of the image parameters obtained by theimage processing unit 62 and furnishing the identifying result to thecontrol computer 11 of thegeneral control unit 10. Furthermore,reference numeral 15 denotes a gesture-based-control data base which is disposed in thegeneral control unit 10, and which can be referred by thecontrol computer 11 when it activates and deactivates the operation of the wellness system, and control the virtual realityenvironment providing unit 20 and the exerciseload providing unit 30 according to the type of the gesture identified by thegesture identifying unit 63 of thegesture input unit 60. - 87. In operation, when the user wants to start or terminate the wellness system, or when the user wants to change the virtual reality environment on-screen or the load of a physical exercise which the user is doing, the user can do that by making a predetermined gesture with a part of the user's body such as a hand. The
imaging unit 61 of thegesture input unit 60 takes an image of the part of the user's body which makes the gesture and then furnishes the image information obtained to theimage processing unit 62. Theimage processing unit 62 performs a predetermined image processing on the image information furnished thereto to calculate image parameters required for identifying the gesture which the user has made and furnish the image parameters to thegesture identifying unit 63. Thegesture identifying unit 63 can identify the gesture which the user has made according to an algorithm for obtaining a correspondence between a pattern (e.g., values and variations in values which vary with time) of image parameters pre-registered and types of gestures, and furnish the identifying result to thegeneral control unit 10. Thecontrol computer 11 of thegeneral control unit 10 refers to the gesture-based-control data base 15, which is used for controlling the wellness system according to a user s gesture, according to the identifying result from thegesture input unit 60, which informs thegeneral control unit 10 of the meaning of the gesture which the user has made, and then thecontrol computer 11 of thegeneral control unit 10 activates or deactivates the wellness system, performs control such as emergency stop, or controls the provision of a virtual reality environment or the load of a physical exercise which the user is doing, according to the contents referred to of the gesture-based-control data base. - 88. Control of the provision of a virtual reality environment on-screen is carried out as follows. For example, when the user reaches a fork in the virtual reality environment displayed on the screen of the
image display unit 21 of the virtual realityenvironment providing unit 20 and then shows a direction in which the user will head with a direction of moving a user's hand, thegesture identifying unit 63 identifies the direction of moving the user's hand from image parameters obtained by theimage processing unit 62 and then the virtual realityenvironment providing unit 20 causes theimage display unit 21 to display an image of a branch path selected by the user on the screen thereof. When the user exhibits a user's psychological condition with a gesture, for example, when the user makes and raises a V sign showing a good feeling or when the user raises a fist showing a bad feeling, thegesture identifying unit 63 identifies the user s gesture from image parameters obtained by theimage processing unit 62 and then the virtual realityenvironment providing unit 20 varies the virtual reality environment on-screen by referring to the third data base 14 used for controlling the virtual reality environment according to a user's psychological condition. Control of the provision of a load of a physical exercise can be carried out as follows. For example, when the user moves up and down a user's hand while pointing the palm upward, the exercise load detection andcontrol unit 34 increases the load of a physical exercise provided for the user. On the contrary, when the user moves up and down a user's hand while pointing the palm downward, the exercise loaddetection control unit 34 reduces the load of a physical exercise provided for the user. The priorities of such the controls using a user's gesture must be assigned in consideration of the priorities of controls performed by the other control means. Preferably, the gesture showing the emergency stop takes precedence over all of the other controls. However, while giving a high priority to another control triggered by a user's predetermined gesture improves the performance of the control which is carried out according to the user's intention, it has a deleterious effect on the control based on the training plan which has been made by a doctor or a rehabilitation doctor. Therefore, it is preferable to assign priorities to controls triggered by user's predetermined gestures according to the purpose of the rehabilitation training and the physical strength and degree of recovery of the user. - 89. Thus, the user can handle the wellness system of this embodiment by himself or herself by making a gesture that is easy to learn, without having to use a special input device such as a remote controller. This means that the wellness system can not only allow the user to handle the system, but have a user interaction function of allowing the user to work upon the wellness system autonomously. Such the user interaction encourages the user to face rehabilitation aggressively. Furthermore, since the user can move around in the virtual reality environment autonomously, the user can refresh himself or herself more effectively.
- 90. Referring next to FIG. 11, there is illustrated a block diagram showing the structure of a wellness system of an eighth embodiment of the present invention. The same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the eighth embodiment is adapted to add to the realism by displaying a part of the body of the user on the screen so that the user can see the part of the body in the virtual reality environment on-screen. In FIG. 10,
reference numeral 71 denotes an imaging unit for taking an image of a part of the user's body, 72 denotes an image processing unit for performing an image processing on the image taken by the imaging unit, and 73 denotes an image trimming unit for trimming the image so as to extract a needed part of the image including the part of the user's body. Furthermore,reference numeral 70 denotes a user's image capturing unit comprised of theimaging unit 71,image processing unit 72, andimage trimming unit 73, and connected to theimage display unit 21 of the virtual realityenvironment providing unit 20. In addition,reference numeral 21 d denotes disposed in theimage display unit 21 of the virtual realityenvironment providing unit 20, for superimposing the image extracted by theimage trimming unit 73 of the user'simage capturing unit 70 on the image of a virtual reality environment to be offered to produce and display the composite screen image on the screen of thedisplay 21 b. - 91. In operation, the
imaging unit 71 of the user'simage capturing unit 70 takes an image of a part of the user s body, e.g., feet or the end of a hand, and then furnishes the image to theimage processing unit 72. Theimage processing unit 72 converts the image furnished by theimaging unit 71 into an image in a form that the wellness system can handle and then furnishes the converted image to theimage trimming unit 73. Theimage trimming unit 73 trims the converted image from theimage processing unit 72 to extract a needed part of the image including the part of the user's body by utilizing a contrast and a luminance difference between the background image and the user s body, and then furnishes the extracted image to theimage display unit 21 of the virtual realityenvironment providing unit 20. Theimage superimposing unit 21 d of theimage display unit 21 superimposes the image extracted by theimage extracting unit 73 of the user'simage capturing unit 70 on the image of the virtual reality environment read out of theimage storing unit 21 a to produce and display the composite screen image on the screen of thedisplay 21 b. - 92. For example, by taking an image of the whole of the body of the user who is stepping for rehabilitation, and superimposing the image on an image of a virtual forest to produce and display the composite screen image on the screen of the display, the wellness system can provide the user with a virtual reality environment in which the user walk in the forest, thereby adding to the realism and hence motivating the user to do a rehabilitation physical exercise more strongly. In addition, by taking an image of the user's face and superimposing the image on an image of a virtual reality environment in which the user is staying to produce and display the composite screen image on the screen of the display, the wellness system can cause the user to entertain friendly sentiments toward the place where the user is staying and recognize the place. Especially, when the user is a child, the wellness system can encourage the user to face rehabilitation aggressively. Furthermore, by making an image of a part of the user's body which the user can see while stepping on the wellness system, for example, feet or a hand which can be viewed from the user's eyes with a camera attached to the user's head, and superimposing the image on an image of a virtual reality environment to produce and display the composite screen image on the screen of the display, the wellness system of this embodiment can provide the realism that causes the user to feel as if the user enters the virtual reality environment.
- 93. Referring next to FIG. 12, there is illustrated a block diagram showing the structure of a wellness system of a ninth embodiment of the present invention. The same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the ninth embodiment is adapted to communicate with a plurality of other wellness systems so that the user can meet and communicate with other persons who are using the respective other wellness systems. In FIG. 12,
reference numeral 80 denotes an information acquiring unit for acquiring information about an image and sounds which are associated with the user and are to be transmitted, 81 denotes an imaging unit for taking an image of at least a part of the user's body, 82 denotes an image processing unit for performing an image processing on the image made by the imaging unit, and 83 denotes an image trimming unit for trimming the image so as to extract a needed part of the image including the part of the user's body. These units are the same as those included in the user'simage capturing unit 70 of the wellness system of the eighth embodiment. In addition,reference numeral 84 denotes a microphone for gathering a sound generated by the user, and 85 denotes a sound recording unit for recording sound information gathered by themicrophone 84. Theinformation acquiring unit 80 is provided with theimaging unit 81,image processing unit 82,image trimming unit 83,microphone 84, andsound recording unit 85. - 94. Furthermore, 91 denotes a communications network through which a plurality of wellness systems can communicate with each other, 92 denotes a transmission data generating unit for converting the image and sound information from the transmission
information getting unit 80, and information about the position of the user in the virtual reality environment from thegeneral control unit 10, into transmission data in a predetermined transmission format so as to transmit the transmission data by way of thecommunications network 91 to at least another wellness system, 93 denotes a received data converting unit for receiving the position information about the user's position in the virtual reality environment and direction information about a direction in which the user is headed in the virtual reality environment or a direction toward which the user faces from thegeneral control unit 10 and converting the transmission data furnished thereto by way of thecommunications network 91 into data required for constructing a virtual reality environment in which the user can communicate with at least another person, so as to furnish the converted data to thegeneral control unit data generating unit 92 and receiveddata converting unit 93 to thecommunications network 91. The plurality of wellness systems each provided with thegeneral control unit 10, virtual realityenvironment providing unit 20, exerciseload providing unit 30, physiological and psychologicalcondition measurement unit 40, transmissioninformation acquiring unit 80, transmissiondata generating unit 92, receiveddata converting unit 93, andnetwork interface 94 are connected to each other by way of thecommunications network 91. FIG. 12 shows an example of this embodiment including two wellness systems which are so constructed. - 95. In the transmission
information acquiring unit 80, theimaging unit 81 takes an image of at least a part of the user's body, such as the user's face, or the whole of the user's body, and theimage processing unit 82 converts the image into data in a form that can be handled by the system. Theimage trimming unit 83 trims the image so as to extract and furnish a needed part of the image including the part of the user's body to theimage display unit 21 of the virtual realityenvironment providing unit 20 and also the transmissiondata generating unit 92 in the same wellness system. Furthermore, the wellness system acquires a sound that the user makes by means of themicrophone 84 and then records the sound as sound data by means of thesound recording unit 85. The sound data is furnished to the transmissiondata generating unit 92. Preferably, user's voices and the sound of footsteps, and sounds made in surroundings are acquired with a plurality of good-directional microphones 84 and a plurality ofsound recording units 85 such that the user's voices and sound of footsteps are isolated from the sounds made in surroundings. Alternatively, the wellness system can acquire a sound which the user actually makes by means of themicrophone 84, while it can directly furnish sound information which is generated and provided by thesound providing unit 22 of the virtual realityenvironment providing unit 20 to thesound recording unit 85, as indicated by a dotted line in FIG. 12. Thegeneral control unit 10 holds information about the user's position in the virtual reality environment, and updates the position information according to information from the exerciseload providing unit 30 and then furnishes the updated position information to the transmissiondata generating unit 92. - 96. When the transmission
data generating unit 92 receives the image and sound information from the transmissioninformation acquiring unit 80 and the position information from thegeneral control unit 10, it converts them to communications data in a predetermined communications format which complies with a protocol of thecommunications network 91 so as to furnish the communications data together with a code for identifying the user onto thecommunications network 91 by way of thenetwork interface 94. - 97. When the received
data converting unit 93 of the wellness system receives a code for identifying another person who is using another wellness system, information about an image and sounds associated with the other user, and information about the position of the other user in a virtual reality environment provided by the other wellness system, which have been transmitted by way of thecommunications network 91 by the transmissiondata generating unit 92 of the other wellness system, the receiveddata transforming unit 93 determines a relationship between the user's position in the virtual reality environment and the position of the other person in the other virtual reality environment provided by the other wellness system from the above information received and information about the user's position and direction in which the user is headed in the virtual reality environment from thegeneral control unit 10 of the same wellness system. If the other person is within a predetermined distance from the user in the virtual reality environment, the receiveddata converting unit 93 furnishes the sound information from the other wellness system together with information about a direction from which the sound made in the other wellness system comes, which is calculated from the above relationship, to thegeneral control unit 10. Simultaneously, the receiveddata transforming unit 93 searches the image information from the other wellness system and selects a part of the image that can be viewed in the virtual reality environment on the basis of the direction information showing the direction in which the user is headed in the virtual reality environment and the position information about the other person, and then transforms the part into an image that can be viewed from the user's position and furnishes the image to thegeneral control unit 10. - 98. The
control unit 10 furnishes the image information from the receiveddata converting unit 93 together with a signal for controlling the virtual reality environment to theimage display unit 21 of the virtual realityenvironment providing unit 20, and also furnishes the sound information to thesound providing unit 22. Theimage display unit 21 reads information about an image, which produces an original virtual reality environment, stored in the image storing unit according to the signal for controlling the virtual reality environment from thegeneral control unit 10, and then superimposing the image information associated with the other person, which has been furnished by thegeneral control unit 10, and the image information associated with the user, which has been furnished by the transmissioninformation acquiring unit 80, on the above image of the virtual reality environment so as to produce and display the composite screen image on the display of the wellness system. Thesound providing unit 22 chooses sound information stored in the sound data storing unit according to the signal for controlling the virtual reality environment from thegeneral control unit 10 and then synthesizes the sound information and the information about a sound that the other person has made, which has been furnished by thegeneral control unit 10, by using the direction information so as to offer the synthesized sound to the user. - 99. Thus, the wellness system of this embodiment can provide a common virtual space in which the user can meet a plurality of other persons, have a conversation with other persons while looking the persons in the faces or seeing how the persons are, and going for a walk with other persons. Such a common virtual space makes it possible to encourage the user to motivate himself or herself when the user does a rehabilitation physical exercise or receives exercise treatment. Furthermore, the user can refresh himself or herself by virtue of communication with other persons. Various types of communication can be made. For example, the user and another patient can exchange information about their progress toward recovery or methods of treatment. Furthermore, the user can demand an explanation of the progress toward recovery or consult with a medical authorized person such as a doctor or a rehabilitation doctor by way of the communications network. The medical authorized person can also cheer up the user through communication made by way of the communications network. In addition, the user can have a conversation about everyday life or the user's impressions of the virtual reality with the user's family or a helper. Thus, the wellness system provides a virtual reality environment that can produce a relaxed atmosphere in which the user can smoothly communicate with other persons. Furthermore, the wellness system of this embodiment can cause the user to feel as if the user holds space and time in common with other persons, thereby encouraging the user to create social relationships with other persons.
- 100. Referring next to FIG. 13, there is illustrated a block diagram showing the structure of a wellness system of a tenth embodiment of the present invention. The same components as those shown in FIG. 1 of the wellness system of the first embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the tenth embodiment is adapted to provide a virtual reality environment through which the user who is apart from a real environment can make contact with the real environment. In FIG. 13,
reference numeral 100 denotes an image information acquiring unit for acquiring information about an image of an object in a real environment which is apart from the user, 101 denotes a sound information acquiring unit for acquiring information about sounds (or a sound field) made in the real environment, 102 denotes a temperature and humidity information acquiring unit for acquiring information about the temperature and humidity of the real environment, 103 denotes a wind direction and speed information acquiring unit for acquiring information about the direction and speed of a wind blowing in the real environment, and 104 denotes a fragrance information acquiring unit for acquiring information about fragrance emitted out of the real environment. - 101. A moving
unit 105 in which the imageinformation acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, and fragranceinformation acquiring unit 104 are mounted is adapted to carry them. An information transmitting and receivingunit 106 mounted in the movingunit 105 transmits the information acquired by the imageinformation acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, and fragranceinformation acquiring unit 104 to thegeneral control unit 10, and receives information for controlling movements of the movingunit 105 from thegeneral control unit 10. An information transmitting and receiving unit 16 disposed in thegeneral control unit 10 receives the information acquired by the imageinformation acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, and fragranceinformation acquiring unit 104 from the information transmitting and receivingunit 106, and transmits information for controlling movements of the movingunit 105. - 102. In operation, the
control computer 11 of thegeneral control unit 10 controls the virtual realityenvironment providing unit 20 according to the information acquired by the imageinformation acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, and fragranceinformation acquiring unit 104, which has been received by the information transmitting and receiving unit 16, so as to provide the user with a virtual reality environment which originates from a real environment in which the movingunit 105 is placed, by means of theimage display unit 21,sound providing unit 22, and fragrance andwind generating unit 23. When the user does a stepping exercise, the exerciseload providing unit 30 detects a movement of the user who is doing the physical exercise and then furnishes the detected information to thecontrol computer 11. Thecontrol computer 11 creates information for controlling movements of the movingunit 105 from the detected information, and then furnishes it to the information transmitting and receivingunit 106 of the movingunit 105 by means of the information transmitting and receiving unit 16. - 103. The moving
unit 105 operates under the control of the received information for controlling movements of the moving unit, and moves according to the movement of the user who is doing the physical exercise. For example, when the user makes one step, the moving unit moves by the distance of one step. Accordingly, the movingunit 105 carries the imageinformation acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, and fragranceinformation acquiring unit 104, which are mounted in the moving unit, according to the physical exercise that the user is doing. These information acquiring units acquire information about images, information about sounds, and information about the real environment such as temperature, humidity, the direction of wind, the speed of wind, and fragrance at a number of places, during the interval that the moving unit is moving. The acquired information is transmitted to the information transmitting and receiving unit 16 of thegeneral control unit 10 by the transmitting and receivingunit 106, and is further furnished to thecontrol computer 11. Thecontrol computer 11 controls the virtual realityenvironment providing unit 20 according to the information received and then provides the user with a virtual reality environment showing the real environment to which the moving unit has been moved, by means of theimage display unit 21,sound providing unit 22, and wind andfragrance unit 23. - 104. For example, when the contents of a physical exercise that the user is doing are about walking in a park, the moving
unit 105 in which the imageinformation acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, and fragranceinformation acquiring unit 104 are mounted is placed in the park. The user can use the wellness system of this embodiment while lying on a bed. When the user does a stepping exercise, the movingunit 105 moves according to the user's steps together with the plurality of information acquiring units mounted in the moving unit and transmits the movement information including information about images, sounds, and the real environment to the control computer by way of the information transmitting and receivingunits 106 and 16, which makes the appropriate changes to the on-screen image provided by the virtual realityenvironment providing unit 20, and wind, sounds, fragrance, and so on. For example, as the user moves closer to a flower garden, the on-screen image is changed such that flowers in the flower garden move closer to the user gradually and the fragrance of the flowers becomes stronger. Furthermore, when the user continues to do a stepping exercise near the flower garden in the virtual reality environment, the kinds of flowers on the on-screen image are varied and the fragrance emitted out of the wellness system is varied according to a variation in the kinds of on-screen flowers. In addition, when a child is playing in the real environment which is the source of the virtual reality environment, the on-screen image and sound provided by the virtual reality environment providing unit are varied in real time according to movements of the child. - 105. As previously mentioned, the wellness system of this embodiment can cause the user to feel as if the user enters a real environment even though the user is apart from the real environment. Accordingly, the wellness system offers the advantage of being able to encourage the user to motivate himself or herself to do a rehabilitation physical exercise. Furthermore, the wellness system can provide interaction with a real world for any other purposes other than rehabilitation, thereby releasing the user from the stress of being confined in a room of a hospital or the user's house and hence causing the user to refresh himself or herself.
- 106. Referring next to FIG. 14, there is illustrated a block diagram showing the structure of a wellness system of an eleventh embodiment of the present invention. The same components as those shown in FIG. 13 of the wellness system of the tenth embodiment are designated by the same reference numerals, and the description about the components will be omitted hereinafter. The wellness system of the eleventh embodiment is adapted to provide a virtual reality environment through which the user can make interact with other persons who are staying in a real environment which is the source of the virtual reality environment. In FIG. 14,
reference numeral 21 e denotes a video camera disposed in theimage display unit 21 of the virtual realityenvironment providing unit 20, for taking an image of at least a part of the user's body or the whole of the user's body so as to acquire image information about the user, 21 f denotes an image capturing unit for capturing the image information acquired by thevideo camera 21 e and then furnishing it to theimage control unit control computer 11 of thegeneral control unit 10. - 107. Furthermore,
reference numeral 110 denotes an image information providing unit for receiving the image information about the user, which has been acquired by thevideo camera 21 e of theimage display unit 21 and has been captured by theimage capturing unit 21 f, and which has been transmitted to thecontrol computer 11 by theimage control unit 21 c, transmitted thereto by way of the information transmitting and receivingunits 16 and 106, so as to provide the image information for other persons staying in the real world which is the source of the virtual reality environment provided for the user, and 111 denotes a sound information providing unit for receiving the sound information about the user, which has been acquired by themicrophone 51 and which has been transmitted by thecontrol computer 11, transmitted thereto by way of the information transmitting and receivingunits 16 and 106, so as to provide the sound information for other persons staying in the real world which is the source of the virtual reality environment provided for the user. - 108. For example, when the user who stays in hospital uses the wellness system of the eleventh embodiment in order to interact with the user's family that is staying in a sight-seeing resort, the image
information acquiring unit 100, soundinformation acquiring unit 101, temperature and humidityinformation acquiring unit 102, wind direction and speedinformation acquiring unit 103, fragranceinformation acquiring unit 104,information transmitting unit 106, imageinformation providing unit 110, and soundinformation providing unit 111 which are mounted in the movingunit 105 are placed in the sight-seeing resort, while the other components of the wellness system are placed in the hospital in which the user stays. The wellness system acquires information about an image of parts of the bodies of members of the user's family or the whole of the bodies of all of the members, an image of a piece of scenery in the sight-seeing resort, sounds which the members of the user's family make, and sounds made in surroundings in the sight-seeing resort, by means of the imageinformation acquiring unit 100 and soundinformation acquiring unit 101 which are placed in the sight-seeing resort. The acquired image and sound information is transmitted to the main body of the wellness system place in the hospital by the information transmitting and receivingunit 106. The wellness system receives the information transmitted thereto through the information transmitting and receiving unit 16, and furnishes it to thecontrol computer 11 of thegeneral control unit 10. Thecontrol computer 11 controls the virtual realityenvironment providing unit 20 on the basis of the information transmitted thereto so as to provide how the members of the user's family staying in the sight-seeing resort are for the user staying in the hospital. - 109. The wellness system acquires information about an image of a part of the body of the user who is staying in the hospital or the whole of the user's body by means of the
video camera 21 e of theimage display unit 21 of the virtual realityenvironment providing unit 20 which is placed in the hospital. Then, theimage capturing unit 21 f captures the image taken by the video camera, and theimage control unit 21 c transmits the captured image to thecontrol computer 11. Thecontrol computer 11 receives the image information transmitted thereto and furnishes it to the information transmitting and receivingunit 106 which is placed in the sight-seeing resort through the information transmitting and receiving unit 16. The image information is further furnished to the imageinformation providing unit 110 and then is provided for the members of the family. Similarly, the wellness system acquires information about sounds such as a sound which the user makes by means ofmicrophone 51. Then, the acquired sound information is furnished to thecontrol computer 11. Thecontrol computer 11 furnishes the sound information to the information transmitting and receivingunit 106 which is placed in the sight-seeing resort through the information transmitting and receiving unit 16. The sound information is further furnished to the soundinformation providing unit 111 and then is provided for the members of the family. - 110. Thus, the wellness system of this embodiment can provide a situation in which the user feels as if the user stays together with the user's family staying in a real world which is apart from the user, such as a sight-seeing resort. Furthermore, by changing the sight-seeing resort to a schoolroom of a school, and changing the user's family to a teacher and user's friends, the wellness system of this embodiment can provide a virtual reality environment in which the user can feel as if the user goes to school while staying in hospital.
- 111. As previously mentioned, the wellness system of this embodiment can cause the user to interact with a real world and communicate with persons which stay in the real world for any other purposes other than rehabilitation, thereby releasing the user from the stress of being restrained in a room of a hospital or the user's house and hence causing the user to refresh himself or herself. Furthermore, since the wellness system can give the user an opportunity of participating in society, it is useful for the care of the mental health of the user.
- 112. As previously mentioned, the present invention offers the following advantages.
- 113. In accordance with a preferred embodiment of the present invention, there is provided a wellness system which can display an image which produces a virtual reality environment according to a movement of the user who is doing a physical exercise, which has been measured by an exercise load providing unit, while setting its angle of view to be larger than an angle of view of a corresponding object or scene which was shot by using a video camera or the like. Therefore, the wellness system of the embodiment can provide a virtual reality environment that offers and adds realism to cause the user to feel as if the user enters the screen of the virtual reality environment providing unit.
- 114. In accordance with another preferred embodiment of the present invention, there is provided a wellness system which can display an image which produces a virtual reality environment which is controlled according to a user's psychological condition evaluated by a physiological and psychological condition evaluating unit, while setting the angle of view of the image on-screen to be larger than an angle of view of a corresponding object or scene which was shot. Therefore, the wellness system of the embodiment can provide a virtual reality environment that offers and adds realism according to the evaluated user's psychological condition.
- 115. In accordance with another preferred embodiment of the present invention, there is provided a wellness system which can replay a plurality of dynamic image cuts, which were taken at a plurality of places of a real environment which is a source of the virtual reality environment, cut by cut according to a user's movement measured by the exercise load providing unit. Therefore, the wellness system can prevent the user from doing a physical exercise to excess according to an image on-screen of the virtual reality environment provided for the user.
- 116. In accordance with another preferred embodiment of the present invention, the wellness system can provide the user with a sound, a wind, and fragrance which are associated with each of the plurality of dynamic image cuts, in synchronization with the replay of each of the plurality of dynamic image cuts. Therefore, the embodiment offers the advantage of being able to cause the user to feel as if the user walks actually in a place shown by the virtual reality environment.
- 117. In accordance with another preferred embodiment of the present invention, there is provided a wellness system which can provide a negative load of a physical exercise to help the user to do a physical exercise. Accordingly, the wellness system of the embodiment can enable and help the user who cannot move by himself or herself to do a physical exercise such as a passive rehabilitation exercise by himself or herself according to his or her capacity for locomotion. Furthermore, since a user who cannot move by himself or herself can move in the virtual reality environment, the user can temporarily get rid of the stress of being confined to a bed and therefore mentally refresh himself or herself.
- 118. In accordance with another preferred embodiment of the present invention, there is provided a wellness system which can control the load of a physical exercise provided by the exercise load providing unit according to a data which defines a pattern of the physical exercise which the user is to do. Accordingly, this embodiment can provide a load of a physical exercise suitable for the user. Furthermore, the user can repeat a safe rehabilitation exercise, the contents of which can be set manually or through an exercise load data input unit by a doctor or a rehabilitation doctor when the user starts to be trained. Therefore, the wellness system of this embodiment can prevent a reduction in the chance of rehabilitation due to a short supply of rehabilitation doctors.
- 119. In accordance with another preferred embodiment of the present invention, the wellness system can comprise a position detecting sensor for detecting a position of a load providing unit of the exercise load providing unit which is manually moved by a doctor or a rehabilitation doctor according to an exercise pattern suitable for rehabilitation when the user starts to be trained, and a speed detecting sensor for simultaneously detecting the moving speed of the load providing unit which is being moved manually. Furthermore, the exercise load providing unit can use outputs from the position detecting sensor and the speed detecting sensor as the data which defines the pattern of the physical exercise which the user is to do. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable a doctor or a rehabilitation doctor to input a data which defines a pattern of a physical exercise that the user does by manually moving the load providing unit according to the contents of a desired rehabilitation physical exercise.
- 120. In accordance with another preferred embodiment of the present invention, the wellness system further comprises an exercise load data input unit through which the data which defines the physical exercise pattern can be input when the user starts physical training using the wellness system. Accordingly, the wellness system offers the advantage of being able to enable the user to do a safe rehabilitation physical exercise, the contents of which has been set by a rehabilitation doctor or the like by inputting numerical data.
- 121. In accordance with another preferred embodiment of the present invention, there is provided a wellness system which can control the load of a physical exercise which the user is doing according to an active mass of a muscle estimated by a muscle active mass estimating unit from a electromyogram of the muscle measured by an electromyograph unit. Accordingly, the wellness system of this embodiment offers the advantage of being able to provide a user's muscle with a load of a physical exercise according to the active mass of the muscle, thereby preventing the user's muscle from atrophying.
- 122. In accordance with another preferred embodiment of the present invention, there is provided a wellness system which can apply an electric shock to a user's muscle through electrodes attached to a diseased part in cast according to the active mass of the muscle estimated from an electromyogram of the muscle. Accordingly, the wellness system of this embodiment offers the advantage of being able to provide a pseudo load of a physical exercise for the user in order to maintain the muscular strength, thereby keeping a reduction in the muscular strength to a minimum.
- 123. In accordance with another preferred embodiment of the present invention, there is provided a wellness system comprising which can activate or deactivate the wellness system, control the virtual reality environment providing unit, and control the exercise load providing unit, according to a user's gesture. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable the user to handle the wellness system of this embodiment by himself or herself by making a gesture that is easy to learn, thereby causing the user to work upon the wellness system autonomously and face rehabilitation aggressively.
- 124. In accordance with another preferred embodiment of the present invention, there is provided a wellness system provided with a unit for taking and capturing an image of at least a part of the user's body, and a unit for superimposing the image captured on an image of the virtual reality environment to be provided to display the composite image. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable the user to see the movement of the user's body in the virtual reality environment, thereby adding to the realism.
- 125. In accordance with another preferred embodiment of the present invention, there is provided a wellness system comprising a transmission information acquiring unit for acquiring information about an image and a sound associated with the user, and a transmission data generating unit for converting the information about an image and a sound acquired by the transmission information acquiring unit and information about a position of the user in the virtual reality environment, which is furnished by the control unit, into communications data in predetermined communications format so as to transmit the communications data to another wellness system by way of a communications network. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable a plurality of users to meet each other and communicate with each other in the virtual reality environment.
- 126. In accordance with another preferred embodiment of the present invention, there is provided a wellness system comprising an image information acquiring unit movably disposed for acquiring information about an image of a real environment that is apart from the user, a sound information acquiring unit movably disposed for acquiring information about sounds made in the real environment that is apart from the user, an environment information acquiring unit movably disposed for acquiring information about the real environment that is apart from the user, and a control unit for moving the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit according to a user's movement measured by the exercise load providing unit, and for controlling the virtual reality environment provided by the virtual reality environment providing unit using the information acquired by the image information acquiring unit, the sound information acquiring unit, and the environment information acquiring unit. Accordingly, the wellness system of this embodiment offers the advantage of being able to cause the user who is apart from the real environment to feel as if the user is staying in the real environment.
- 127. In accordance with a preferred embodiment of the present invention, the wellness system further comprises a user's image information acquiring unit for acquiring information about an image of at least a part of the user's body, a user's sound information acquiring unit for acquiring information about a sound that the user makes, an image information providing unit for providing the image information acquired by the user's image information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment, and an image information providing unit for providing the sound information acquired by the user's sound information acquiring unit for persons staying in the real environment which is a source of the virtual reality environment. Accordingly, the wellness system of this embodiment offers the advantage of being able to enable the user who is apart from the real environment to interact with persons staying in the real environment.
- 128. Many widely different embodiments of the present invention may be constructed without departing from the spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific embodiments described in the specification, except as defined in the appended claims.
Claims (15)
1. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and
a control means for controlling the virtual reality environment provided by said virtual reality environment providing means according to the user's movement measured by said exercise load providing means, and wherein when providing the virtual reality environment, said virtual reality environment providing means displays an image which produces the virtual reality environment by setting its angle of view to be larger than an angle of view of a corresponding object or scene which was shot.
2. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment;
a physiological and psychological condition evaluating means for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and
a control means for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by said physiological and psychological condition evaluating means, and for controlling the virtual reality environment provided by said virtual reality environment providing means according to the user's psychological condition evaluated by said physiological and psychological condition evaluating means, and wherein when providing the virtual reality environment, said virtual reality environment providing means displays an image which produces the virtual reality environment by setting its angle of view to be larger than an angle of view of a corresponding object or scene which was shot.
3. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and
a control means for controlling the virtual reality environment provided by said virtual reality environment providing means according to the user's movement measured by said exercise load providing means, and wherein said virtual reality environment providing means can store a plurality of dynamic image cuts which were taken at a plurality of places of a real environment which is a source of the virtual reality environment, and can replay them cut by cut according to the user' movement measured by said exercise load providing means.
4. The wellness system according to , wherein said virtual reality environment providing means can provide the user with a sound, a wind, and fragrance which are associated with each of the plurality of dynamic image cuts, in synchronization with the replay of each of the plurality of dynamic image cuts.
claim 3
5. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and
a control means for controlling the load of the physical exercise provided by said exercise load providing means, and wherein said virtual reality environment providing means can provide a negative load of a physical exercise to help the user to do the physical exercise.
6. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and
a control means for controlling the load of the physical exercise provided by said exercise load providing means according to a data which defines a pattern of the physical exercise which the user is to do.
7. The wellness system according to , wherein said exercise load providing means includes a load providing means for directly providing the load of the physical exercise for the user, a position detecting sensor for detecting a position of said load providing means, and a speed detecting sensor for detecting a moving speed of said load providing means, and wherein said exercise load providing means can use outputs from said position detecting sensor and said speed detecting sensor as the data which defines the pattern of the physical exercise which the user is to do.
claim 6
8. The wellness system according to , further comprising an exercise load data input means through which the data which defines the physical exercise pattern can be input when the user starts physical training using said wellness system.
claim 6
9. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment;
a physiological and psychological condition evaluating means for acquiring information representing user's physiological and psychological conditions so as to evaluate the user's physiological and psychological conditions; and
a control means for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by said physiological and psychological condition evaluating means, and wherein said physiological and psychological condition evaluating means is provided with an electromyogram measuring means for measuring an electromyogram of a muscle on which the load of the physical exercise is imposed, a muscle active mass estimating means for estimating an active mass of the muscle from the electromyogram measured by said electromyogram measuring means.
10. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment;
a physiological and psychological condition evaluating means for acquiring information representing user's physiological and psychological conditions so as to evaluate user's physiological and psychological conditions; and
a control means for controlling the load of the physical exercise which the user is doing according to the user's physiological condition evaluated by said physiological and psychological condition evaluating means, and wherein said physiological and psychological condition evaluating means is provided with an electromyograph means for obtaining an electromyogram of a muscle of a diseased part in cast of the user by means of electrodes attached to the diseased part in cast, a muscle active mass estimating means for estimating an active mass of the muscle from the electromyogram obtained by said electromyograph means, and wherein said exercise load providing means is provided with an electric shock applying means for applying an electric shock to the user's muscle through other electrodes attached to the diseased part in cast, and an electric shock control means for controlling said electric shock applying means according to the active mass of the muscle estimated by said muscle active mass estimating means, thereby providing a pseudo load of a physical exercise for the user by using electric shocks.
11. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment;
a gesture identifying means for detecting the shape of a part of the user's body which makes a gesture and then identifying the gesture; and
a control means for activating or deactivating said wellness system, controlling said virtual reality environment providing means, and controlling said exercise load providing means, according to the user's gesture identified by said gesture identifying means.
12. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment; and
a control means for controlling the virtual reality environment provided by said virtual reality environment providing means according to the user's movement measured by said exercise load providing means, and wherein said virtual reality environment providing means is provided with a means for taking and capturing an image of at least a part of the user's body, and a means for superimposing the image captured on an image of the virtual reality environment to be provided to display the composite image when providing the virtual reality environment.
13. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment;
a control means for controlling the virtual reality environment provided by said virtual reality environment providing means according to the user's movement measured by said exercise load providing means;
a transmission information acquiring means for acquiring information about an image and a sound associated with the user;
a transmission data generating means for converting the information about an image and a sound acquired by said transmission information acquiring means and information about a position of the user in the virtual reality environment, which is furnished by said control means, into communications data in predetermined communications format so as to produce the communications data to be transmitted by way of a communications network; and
a received data transforming means for transforming communications data transmitted to said wellness system by way of the communications network into data required for said virtual reality environment providing means to construct the virtual reality environment.
14. A wellness system comprising:
an exercise load providing means for providing a load of a physical exercise for a user, and for measuring a movement of the user who is doing the physical exercise;
a virtual reality environment providing means for providing the user with a virtual reality environment according to the contents of the virtual reality environment;
an image information acquiring means movably disposed for acquiring information about an image of a real environment that is apart from the user;
a sound information acquiring means movably disposed for acquiring information about sounds made in the real environment that is apart from the user;
an environment information acquiring means movably disposed for acquiring information about the real environment that is apart from the user; and
a control means for moving said image information acquiring means, said sound information acquiring means, and said environment information acquiring means according to the user's movement measured by said exercise load providing means, and for controlling the virtual reality environment provided by said virtual reality environment providing means using the information acquired by said image information acquiring means, said sound information acquiring means, and said environment information acquiring means.
15. The wellness system according to , further comprising a user's image information acquiring means for acquiring information about an image of at least a part of the user's body, a user's sound information acquiring means for acquiring information about a sound that the user makes, an image information providing means for providing the image information acquired by said user's image information acquiring means for persons staying in the real environment which is a source of the virtual reality environment, and an image information providing means for providing the sound information acquired by said user's sound information acquiring means for persons staying in the real environment which is a source of the virtual reality environment.
claim 14
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/730,833 US20010001303A1 (en) | 1996-11-25 | 2000-12-07 | Physical exercise system having a virtual reality environment controlled by a users movement |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP31386096A JP3469410B2 (en) | 1996-11-25 | 1996-11-25 | Wellness system |
JP313860/96 | 1996-11-25 | ||
US08/866,302 US6244987B1 (en) | 1996-11-25 | 1997-05-30 | Physical exercise system having a virtual reality environment controlled by a user's movement |
US09/730,833 US20010001303A1 (en) | 1996-11-25 | 2000-12-07 | Physical exercise system having a virtual reality environment controlled by a users movement |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/866,302 Division US6244987B1 (en) | 1996-11-25 | 1997-05-30 | Physical exercise system having a virtual reality environment controlled by a user's movement |
Publications (1)
Publication Number | Publication Date |
---|---|
US20010001303A1 true US20010001303A1 (en) | 2001-05-17 |
Family
ID=18046384
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/866,302 Expired - Fee Related US6244987B1 (en) | 1996-11-25 | 1997-05-30 | Physical exercise system having a virtual reality environment controlled by a user's movement |
US09/730,833 Abandoned US20010001303A1 (en) | 1996-11-25 | 2000-12-07 | Physical exercise system having a virtual reality environment controlled by a users movement |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US08/866,302 Expired - Fee Related US6244987B1 (en) | 1996-11-25 | 1997-05-30 | Physical exercise system having a virtual reality environment controlled by a user's movement |
Country Status (2)
Country | Link |
---|---|
US (2) | US6244987B1 (en) |
JP (1) | JP3469410B2 (en) |
Cited By (85)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1308192A1 (en) * | 2001-10-19 | 2003-05-07 | Konami Corporation | Exercise apparatus with computer game |
EP1262158A3 (en) * | 2001-05-25 | 2003-10-29 | Siemens Aktiengesellschaft | Interactive rehabilitation apparatus using gesture recognition |
US20040101447A1 (en) * | 2000-05-26 | 2004-05-27 | Yukinobu Tajima | Method and apparatus for generating smell |
US20050195128A1 (en) * | 2004-03-03 | 2005-09-08 | Sefton Robert T. | Virtual reality system |
WO2006008704A1 (en) * | 2004-07-17 | 2006-01-26 | Koninklijke Philips Electronics N.V. | Exercise system and method |
US20060073449A1 (en) * | 2004-08-18 | 2006-04-06 | Rakesh Kumar | Automated trainee monitoring and performance evaluation system |
US20060271217A1 (en) * | 2005-05-31 | 2006-11-30 | Fujitsu Limited | Manufacturing study support device |
US20070239479A1 (en) * | 2006-03-29 | 2007-10-11 | Juha Arrasvuori | System and method for gaming |
US20070254778A1 (en) * | 2006-04-14 | 2007-11-01 | Ashby Darren C | Exercise apparatuses, components for exercise apparatuses and related methods |
US20080261696A1 (en) * | 2007-04-20 | 2008-10-23 | Nintendo Co., Ltd. | Game controller, storage medium storing game program, and game apparatus |
US20090298649A1 (en) * | 2008-05-28 | 2009-12-03 | Precor Incorporated | Exercise device visual representation |
US20100156760A1 (en) * | 2008-12-19 | 2010-06-24 | At&T Intellectual Property I, L.P. | Motion controlled multimedia content viewing method and system |
US20100222179A1 (en) * | 2009-02-27 | 2010-09-02 | Sinclair Temple | Presenting information to users during an activity, such as information from a previous or concurrent outdoor, physical activity |
US20110102570A1 (en) * | 2008-04-14 | 2011-05-05 | Saar Wilf | Vision based pointing device emulation |
US8079251B2 (en) | 2009-03-09 | 2011-12-20 | Nintendo Co., Ltd. | Computer readable storage medium storing information processing program and information processing apparatus |
US20120021873A1 (en) * | 2008-11-19 | 2012-01-26 | Wolfgang Brunner | Arrangement for Gait Training |
US8152640B2 (en) | 2008-11-28 | 2012-04-10 | Nintendo Co., Ltd. | Information processing apparatus and computer readable storage medium |
EP2490772A1 (en) * | 2009-10-20 | 2012-08-29 | Touret, Félix | Device particularly intended for sports training |
US20130035208A1 (en) * | 2011-08-03 | 2013-02-07 | Icon Health & Fitness, Inc. | Exercise device with fan controllable by a physiological condition of a user |
US8387437B2 (en) | 2007-10-31 | 2013-03-05 | Nintendo Co., Ltd. | Weight applying unit for calibration and weight applying method for calibration |
US8395582B2 (en) | 2009-03-30 | 2013-03-12 | Nintendo Co., Ltd. | Computer-readable storage medium and information processing apparatus |
US20130083941A1 (en) * | 2010-08-03 | 2013-04-04 | Intellisysgroup Llc | Devices, Systems, and Methods for Games, Sports, Entertainment And Other Activities of Engagement |
TWI396567B (en) * | 2010-06-17 | 2013-05-21 | Univ Nat Kaohsiung 1St Univ Sc | Auxiliary device for rehabilitation of kneecap pain syndrome |
US20130190135A1 (en) * | 2001-03-07 | 2013-07-25 | Motion Games, Llc | Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction |
US20130328925A1 (en) * | 2012-06-12 | 2013-12-12 | Stephen G. Latta | Object focus in a mixed reality environment |
US8612247B2 (en) | 2008-12-26 | 2013-12-17 | Nintendo Co., Ltd. | Biological information management system |
US8654073B2 (en) | 2009-09-30 | 2014-02-18 | Nintendo Co., Ltd. | Information processing program having computer-readable storage medium therein and information processing apparatus |
CN103735270A (en) * | 2013-09-22 | 2014-04-23 | 国家康复辅具研究中心 | Meridian circulation, dredging, guiding and feedback rehabilitation training system for upper-limb potential development |
US20140135173A1 (en) * | 2012-10-31 | 2014-05-15 | Icon Health & Fitness, Inc. | System and method for an interactive exercise routine |
US8751179B2 (en) | 2009-09-29 | 2014-06-10 | Nintendo Co., Ltd. | Computer-readable storage medium having stored information processing program thereon, and information processing apparatus |
US20140255890A1 (en) * | 2013-03-07 | 2014-09-11 | Hill-Rom Services, Inc. | Patient support apparatus with physical therapy system |
US20140336003A1 (en) * | 2013-05-08 | 2014-11-13 | The Regents Of The University Of Colorado, A Body Corporate | System and methods for measuring propulsive force during ambulation and providing real-time feedback |
US8905844B2 (en) | 2007-10-05 | 2014-12-09 | Nintendo Co., Ltd. | Storage medium storing load detecting program and load detecting apparatus |
US8938124B2 (en) | 2012-05-10 | 2015-01-20 | Pointgrab Ltd. | Computer vision based tracking of a hand |
US20150105220A1 (en) * | 2013-10-14 | 2015-04-16 | Healthstream Taiwan Inc. | Trainer control method and fitness device using the same |
US20150238819A1 (en) * | 2014-02-27 | 2015-08-27 | Flextronics Ap, Llc | Exercise equipment with improved user interaction |
US20160055680A1 (en) * | 2014-08-25 | 2016-02-25 | Samsung Electronics Co., Ltd. | Method of controlling display of electronic device and electronic device |
US20160091877A1 (en) * | 2014-09-29 | 2016-03-31 | Scott Fullam | Environmental control via wearable computing system |
US9367668B2 (en) | 2012-02-28 | 2016-06-14 | Precor Incorporated | Dynamic fitness equipment user interface adjustment |
US9421456B2 (en) | 2007-10-09 | 2016-08-23 | Nintendo Co., Ltd. | Storage medium storing a load detecting program and load detecting apparatus |
US9480918B2 (en) | 2009-09-28 | 2016-11-01 | Nintendo Co., Ltd. | Computer-readable storage medium having information processing program stored therein and information processing apparatus |
US20160365000A1 (en) * | 2015-06-10 | 2016-12-15 | Seiko Epson Corporation | Exercise instruction system, instruction content generation method, exercise instruction device, and instruction content generation device |
WO2017165860A1 (en) * | 2016-03-25 | 2017-09-28 | Tangible Play, Inc. | Activity surface detection, display and enhancement of a virtual scene |
US9939961B1 (en) | 2012-10-15 | 2018-04-10 | Tangible Play, Inc. | Virtualization of tangible interface objects |
US10033943B1 (en) | 2012-10-15 | 2018-07-24 | Tangible Play, Inc. | Activity surface detection, display and enhancement |
US10188890B2 (en) | 2013-12-26 | 2019-01-29 | Icon Health & Fitness, Inc. | Magnetic resistance mechanism in a cable machine |
US10204525B1 (en) | 2007-12-14 | 2019-02-12 | JeffRoy H. Tillis | Suggestion-based virtual sessions engaging the mirror neuron system |
US10220259B2 (en) | 2012-01-05 | 2019-03-05 | Icon Health & Fitness, Inc. | System and method for controlling an exercise device |
US10226396B2 (en) | 2014-06-20 | 2019-03-12 | Icon Health & Fitness, Inc. | Post workout massage device |
US10252109B2 (en) | 2016-05-13 | 2019-04-09 | Icon Health & Fitness, Inc. | Weight platform treadmill |
US10258828B2 (en) | 2015-01-16 | 2019-04-16 | Icon Health & Fitness, Inc. | Controls for an exercise device |
US10272317B2 (en) | 2016-03-18 | 2019-04-30 | Icon Health & Fitness, Inc. | Lighted pace feature in a treadmill |
US10279212B2 (en) | 2013-03-14 | 2019-05-07 | Icon Health & Fitness, Inc. | Strength training apparatus with flywheel and related methods |
US10293211B2 (en) | 2016-03-18 | 2019-05-21 | Icon Health & Fitness, Inc. | Coordinated weight selection |
US10343017B2 (en) | 2016-11-01 | 2019-07-09 | Icon Health & Fitness, Inc. | Distance sensor for console positioning |
CN110022835A (en) * | 2017-04-25 | 2019-07-16 | 株式会社mediVR | Rehabilitation support system, rehabilitation support method and rehabilitation support program |
US10375320B2 (en) * | 2008-12-23 | 2019-08-06 | At&T Intellectual Property I, L.P. | System and method for creating and manipulating synthetic environments |
US10376736B2 (en) | 2016-10-12 | 2019-08-13 | Icon Health & Fitness, Inc. | Cooling an exercise device during a dive motor runway condition |
US10391361B2 (en) | 2015-02-27 | 2019-08-27 | Icon Health & Fitness, Inc. | Simulating real-world terrain on an exercise device |
US10426989B2 (en) | 2014-06-09 | 2019-10-01 | Icon Health & Fitness, Inc. | Cable system incorporated into a treadmill |
US10433612B2 (en) | 2014-03-10 | 2019-10-08 | Icon Health & Fitness, Inc. | Pressure sensor to quantify work |
US10441844B2 (en) | 2016-07-01 | 2019-10-15 | Icon Health & Fitness, Inc. | Cooling systems and methods for exercise equipment |
US10471299B2 (en) | 2016-07-01 | 2019-11-12 | Icon Health & Fitness, Inc. | Systems and methods for cooling internal exercise equipment components |
US10493349B2 (en) | 2016-03-18 | 2019-12-03 | Icon Health & Fitness, Inc. | Display on exercise device |
US10500473B2 (en) | 2016-10-10 | 2019-12-10 | Icon Health & Fitness, Inc. | Console positioning |
US20190388733A1 (en) * | 2013-11-08 | 2019-12-26 | Performance Lab Technologies Limited | Automated Prescription of Activity Based on Physical Activity Data |
US10537764B2 (en) | 2015-08-07 | 2020-01-21 | Icon Health & Fitness, Inc. | Emergency stop with magnetic brake for an exercise device |
US10543395B2 (en) | 2016-12-05 | 2020-01-28 | Icon Health & Fitness, Inc. | Offsetting treadmill deck weight during operation |
US10561877B2 (en) | 2016-11-01 | 2020-02-18 | Icon Health & Fitness, Inc. | Drop-in pivot configuration for stationary bike |
US10561894B2 (en) | 2016-03-18 | 2020-02-18 | Icon Health & Fitness, Inc. | Treadmill with removable supports |
US10625114B2 (en) | 2016-11-01 | 2020-04-21 | Icon Health & Fitness, Inc. | Elliptical and stationary bicycle apparatus including row functionality |
US10625137B2 (en) | 2016-03-18 | 2020-04-21 | Icon Health & Fitness, Inc. | Coordinated displays in an exercise device |
US10657694B2 (en) | 2012-10-15 | 2020-05-19 | Tangible Play, Inc. | Activity surface detection, display and enhancement of a virtual scene |
US10661114B2 (en) | 2016-11-01 | 2020-05-26 | Icon Health & Fitness, Inc. | Body weight lift mechanism on treadmill |
US10671705B2 (en) | 2016-09-28 | 2020-06-02 | Icon Health & Fitness, Inc. | Customizing recipe recommendations |
US10702736B2 (en) | 2017-01-14 | 2020-07-07 | Icon Health & Fitness, Inc. | Exercise cycle |
US10729965B2 (en) | 2017-12-22 | 2020-08-04 | Icon Health & Fitness, Inc. | Audible belt guide in a treadmill |
US20200261763A1 (en) * | 2016-01-12 | 2020-08-20 | Samsung Electronics Co., Ltd. | Display device and control method therefor |
US10953305B2 (en) | 2015-08-26 | 2021-03-23 | Icon Health & Fitness, Inc. | Strength exercise mechanisms |
US11022863B2 (en) | 2018-09-17 | 2021-06-01 | Tangible Play, Inc | Display positioning system |
US11103787B1 (en) | 2010-06-24 | 2021-08-31 | Gregory S. Rabin | System and method for generating a synthetic video stream |
US11138766B2 (en) * | 2017-05-08 | 2021-10-05 | T. Hasegawa Co., Ltd. | Method for expressing image with colors and color expression drawing |
US20210404826A1 (en) * | 2020-06-24 | 2021-12-30 | George Mason University | Exertion-aware path generation |
US11451108B2 (en) | 2017-08-16 | 2022-09-20 | Ifit Inc. | Systems and methods for axial impact resistance in electric motors |
CN117319661A (en) * | 2023-09-26 | 2023-12-29 | 中移凯普(北京)技术服务有限公司 | Image transmission system for visual communication display |
Families Citing this family (127)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6539336B1 (en) * | 1996-12-12 | 2003-03-25 | Phatrat Technologies, Inc. | Sport monitoring system for determining airtime, speed, power absorbed and other factors such as drop distance |
US7949488B2 (en) | 1994-11-21 | 2011-05-24 | Nike, Inc. | Movement monitoring systems and associated methods |
US6808472B1 (en) | 1995-12-14 | 2004-10-26 | Paul L. Hickman | Method and apparatus for remote interactive exercise and health equipment |
DE19839638C2 (en) * | 1998-08-31 | 2000-06-21 | Siemens Ag | System for enabling self-control of the body movement sequences to be carried out by the moving person |
US7749089B1 (en) | 1999-02-26 | 2010-07-06 | Creative Kingdoms, Llc | Multi-media interactive play system |
JP2000267610A (en) * | 1999-03-16 | 2000-09-29 | Sanyo Electric Co Ltd | Fragrance generator |
DE29910326U1 (en) * | 1999-06-14 | 1999-08-26 | Maier Folker | Energy-carrying device to be worn on the body |
US7628730B1 (en) | 1999-07-08 | 2009-12-08 | Icon Ip, Inc. | Methods and systems for controlling an exercise apparatus using a USB compatible portable remote device |
US7537546B2 (en) | 1999-07-08 | 2009-05-26 | Icon Ip, Inc. | Systems and methods for controlling the operation of one or more exercise devices and providing motivational programming |
US7985164B2 (en) * | 1999-07-08 | 2011-07-26 | Icon Ip, Inc. | Methods and systems for controlling an exercise apparatus using a portable data storage device |
US8029415B2 (en) | 1999-07-08 | 2011-10-04 | Icon Ip, Inc. | Systems, methods, and devices for simulating real world terrain on an exercise device |
US7166062B1 (en) * | 1999-07-08 | 2007-01-23 | Icon Ip, Inc. | System for interaction with exercise device |
US7445550B2 (en) | 2000-02-22 | 2008-11-04 | Creative Kingdoms, Llc | Magical wand and interactive play experience |
US6761637B2 (en) | 2000-02-22 | 2004-07-13 | Creative Kingdoms, Llc | Method of game play using RFID tracking device |
US7878905B2 (en) | 2000-02-22 | 2011-02-01 | Creative Kingdoms, Llc | Multi-layered interactive play experience |
DE10111315B4 (en) * | 2000-03-13 | 2017-05-24 | Anton Reck | Movement device with two interconnected, movable actuators for a pair of extremities of a person |
US7066781B2 (en) | 2000-10-20 | 2006-06-27 | Denise Chapman Weston | Children's toy with wireless tag/transponder |
KR100466665B1 (en) * | 2001-06-12 | 2005-01-15 | 주식회사 코디소프트 | method of automatically evaluating physical health state using a game |
JP2003022326A (en) * | 2001-07-09 | 2003-01-24 | Fujitsu Ltd | Program for virtual waiting room |
US8046408B2 (en) * | 2001-08-20 | 2011-10-25 | Alcatel Lucent | Virtual reality systems and methods |
JP3694663B2 (en) * | 2001-10-05 | 2005-09-14 | 国新産業株式会社 | Mobile simulation experience apparatus and method |
US6921351B1 (en) | 2001-10-19 | 2005-07-26 | Cybergym, Inc. | Method and apparatus for remote interactive exercise and health equipment |
US20030091966A1 (en) * | 2001-11-14 | 2003-05-15 | Collodi David J. | Excercise/simulation device |
US6881382B2 (en) | 2002-04-02 | 2005-04-19 | International Flavors & Fragrances Inc. | Fragrance signaling of an event |
US20070066396A1 (en) | 2002-04-05 | 2007-03-22 | Denise Chapman Weston | Retail methods for providing an interactive product to a consumer |
US6967566B2 (en) | 2002-04-05 | 2005-11-22 | Creative Kingdoms, Llc | Live-action interactive adventure game |
JP3959306B2 (en) * | 2002-06-20 | 2007-08-15 | 株式会社竹中工務店 | Training support method using virtual space |
US7674184B2 (en) | 2002-08-01 | 2010-03-09 | Creative Kingdoms, Llc | Interactive water attraction and quest game |
ITBO20020677A1 (en) * | 2002-10-25 | 2004-04-26 | Technogym Spa | GYMNASTIC MACHINE. |
US20040103146A1 (en) * | 2002-11-26 | 2004-05-27 | Seung-Hun Park | Method and system for physically exercising with plurality of participants using network |
US20050130741A1 (en) * | 2003-02-18 | 2005-06-16 | Raj Pandian | Human power conversion system based on video game play with exercise bicycle |
US9446319B2 (en) | 2003-03-25 | 2016-09-20 | Mq Gaming, Llc | Interactive gaming toy |
US8323156B2 (en) * | 2003-05-21 | 2012-12-04 | Panasonic Corporation | Leg training equipment |
US6837827B1 (en) * | 2003-06-17 | 2005-01-04 | Garmin Ltd. | Personal training device using GPS data |
US7497807B2 (en) | 2003-07-15 | 2009-03-03 | Cube X Incorporated | Interactive computer simulation enhanced exercise machine |
US20050054492A1 (en) * | 2003-07-15 | 2005-03-10 | Neff John D. | Exercise device for under a desk |
US7497812B2 (en) | 2003-07-15 | 2009-03-03 | Cube X, Incorporated | Interactive computer simulation enhanced exercise machine |
CN1327920C (en) * | 2003-10-31 | 2007-07-25 | 上海科技馆 | Apparatus and method for stimulating bicycle motion |
WO2005069928A2 (en) * | 2004-01-16 | 2005-08-04 | Respondesign, Inc. | Instructional gaming methods and apparatus |
US20080070752A1 (en) * | 2004-02-05 | 2008-03-20 | Motorika, Inc. | Fine Motor Control Rehabilitation |
US7398151B1 (en) | 2004-02-25 | 2008-07-08 | Garmin Ltd. | Wearable electronic device |
WO2006014810A2 (en) * | 2004-07-29 | 2006-02-09 | Kevin Ferguson | A human movement measurement system |
JP4747846B2 (en) * | 2005-01-28 | 2011-08-17 | セイコーエプソン株式会社 | Treatment position selection apparatus, treatment position selection system, treatment position selection method, and computer program |
WO2006111109A1 (en) * | 2005-04-21 | 2006-10-26 | Aleksander Winiarski | Method and device for use in health orientation |
JP4618795B2 (en) * | 2005-07-15 | 2011-01-26 | 独立行政法人産業技術総合研究所 | Rehabilitation equipment |
JP4608656B2 (en) * | 2005-08-01 | 2011-01-12 | 国立大学法人佐賀大学 | Limb function recovery support device |
US20070171199A1 (en) * | 2005-08-05 | 2007-07-26 | Clement Gosselin | Locomotion simulation apparatus, system and method |
JP4805633B2 (en) | 2005-08-22 | 2011-11-02 | 任天堂株式会社 | Game operation device |
US7942745B2 (en) | 2005-08-22 | 2011-05-17 | Nintendo Co., Ltd. | Game operating device |
US8313379B2 (en) | 2005-08-22 | 2012-11-20 | Nintendo Co., Ltd. | Video game system with wireless modular handheld controller |
US7927216B2 (en) | 2005-09-15 | 2011-04-19 | Nintendo Co., Ltd. | Video game system with wireless modular handheld controller |
US8870655B2 (en) | 2005-08-24 | 2014-10-28 | Nintendo Co., Ltd. | Wireless game controllers |
JP4262726B2 (en) | 2005-08-24 | 2009-05-13 | 任天堂株式会社 | Game controller and game system |
US8308563B2 (en) | 2005-08-30 | 2012-11-13 | Nintendo Co., Ltd. | Game system and storage medium having game program stored thereon |
US20100197462A1 (en) * | 2005-09-07 | 2010-08-05 | Bvp Holding, Inc. | 3-d, interactive exercise analysis, gaming, and physical therapy system |
US8157651B2 (en) | 2005-09-12 | 2012-04-17 | Nintendo Co., Ltd. | Information processing program |
WO2007034494A2 (en) * | 2005-09-26 | 2007-03-29 | Hadasit Medical Research Services & Development Company Ltd. | A system and method for treating chronic pain |
JP4151982B2 (en) | 2006-03-10 | 2008-09-17 | 任天堂株式会社 | Motion discrimination device and motion discrimination program |
JP4684147B2 (en) * | 2006-03-28 | 2011-05-18 | 任天堂株式会社 | Inclination calculation device, inclination calculation program, game device, and game program |
DE202006011058U1 (en) * | 2006-07-18 | 2006-10-12 | Jerichow, Ulrich, Dr. | Generation of a virtual environment for fitness training uses computer system control of wind and temperature and noise simulations |
US20080026914A1 (en) * | 2006-07-28 | 2008-01-31 | Shih-Yuan Chen | Composite structure for display device |
ITPD20060413A1 (en) | 2006-11-10 | 2008-05-11 | Khymeia S R L | EQUIPMENT FOR TRAINING AND MOTOR TRAINING OF THE HUMAN BODY |
JP5127242B2 (en) | 2007-01-19 | 2013-01-23 | 任天堂株式会社 | Acceleration data processing program and game program |
WO2008134745A1 (en) * | 2007-04-30 | 2008-11-06 | Gesturetek, Inc. | Mobile video-based therapy |
TWI377055B (en) * | 2007-08-10 | 2012-11-21 | Ind Tech Res Inst | Interactive rehabilitation method and system for upper and lower extremities |
US20110021317A1 (en) * | 2007-08-24 | 2011-01-27 | Koninklijke Philips Electronics N.V. | System and method for displaying anonymously annotated physical exercise data |
KR100903411B1 (en) * | 2007-10-16 | 2009-06-18 | (주)다산알앤디 | Treadmill with automatic speed control and Control Module of the same |
US8717411B2 (en) | 2008-02-05 | 2014-05-06 | Olympus Imaging Corp. | Virtual image generating apparatus, virtual image generating method, and recording medium storing virtual image generating program |
JP4965475B2 (en) * | 2008-02-05 | 2012-07-04 | オリンパス株式会社 | Virtual moving display device |
US8595632B2 (en) * | 2008-02-21 | 2013-11-26 | International Business Machines Corporation | Method to monitor user trajectories within a virtual universe |
US20100069724A1 (en) * | 2008-04-24 | 2010-03-18 | Searete Llc | Computational system and method for memory modification |
US9282927B2 (en) | 2008-04-24 | 2016-03-15 | Invention Science Fund I, Llc | Methods and systems for modifying bioactive agent use |
US9239906B2 (en) | 2008-04-24 | 2016-01-19 | The Invention Science Fund I, Llc | Combination treatment selection methods and systems |
US9026369B2 (en) * | 2008-04-24 | 2015-05-05 | The Invention Science Fund I, Llc | Methods and systems for presenting a combination treatment |
US20100100036A1 (en) * | 2008-04-24 | 2010-04-22 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational System and Method for Memory Modification |
US20100042578A1 (en) * | 2008-04-24 | 2010-02-18 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational system and method for memory modification |
US20100015583A1 (en) * | 2008-04-24 | 2010-01-21 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational System and method for memory modification |
US20100081861A1 (en) * | 2008-04-24 | 2010-04-01 | Searete Llc | Computational System and Method for Memory Modification |
US20090270688A1 (en) * | 2008-04-24 | 2009-10-29 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for presenting a combination treatment |
US20090271122A1 (en) * | 2008-04-24 | 2009-10-29 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for monitoring and modifying a combination treatment |
US20100022820A1 (en) * | 2008-04-24 | 2010-01-28 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational system and method for memory modification |
US20100041958A1 (en) * | 2008-04-24 | 2010-02-18 | Searete Llc | Computational system and method for memory modification |
US20100081860A1 (en) * | 2008-04-24 | 2010-04-01 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational System and Method for Memory Modification |
US20090270694A1 (en) * | 2008-04-24 | 2009-10-29 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for monitoring and modifying a combination treatment |
US9560967B2 (en) * | 2008-04-24 | 2017-02-07 | The Invention Science Fund I Llc | Systems and apparatus for measuring a bioactive agent effect |
US20100076249A1 (en) * | 2008-04-24 | 2010-03-25 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational system and method for memory modification |
US9649469B2 (en) | 2008-04-24 | 2017-05-16 | The Invention Science Fund I Llc | Methods and systems for presenting a combination treatment |
US9064036B2 (en) * | 2008-04-24 | 2015-06-23 | The Invention Science Fund I, Llc | Methods and systems for monitoring bioactive agent use |
US20100030089A1 (en) * | 2008-04-24 | 2010-02-04 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for monitoring and modifying a combination treatment |
US20100125561A1 (en) * | 2008-04-24 | 2010-05-20 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational system and method for memory modification |
US9662391B2 (en) * | 2008-04-24 | 2017-05-30 | The Invention Science Fund I Llc | Side effect ameliorating combination therapeutic products and systems |
US20090312668A1 (en) * | 2008-04-24 | 2009-12-17 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational system and method for memory modification |
US20090269329A1 (en) * | 2008-04-24 | 2009-10-29 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Combination Therapeutic products and systems |
US20100041964A1 (en) * | 2008-04-24 | 2010-02-18 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for monitoring and modifying a combination treatment |
US20100130811A1 (en) * | 2008-04-24 | 2010-05-27 | Searete Llc | Computational system and method for memory modification |
US20100063368A1 (en) * | 2008-04-24 | 2010-03-11 | Searete Llc, A Limited Liability Corporation | Computational system and method for memory modification |
US9449150B2 (en) | 2008-04-24 | 2016-09-20 | The Invention Science Fund I, Llc | Combination treatment selection methods and systems |
US20100017001A1 (en) * | 2008-04-24 | 2010-01-21 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational system and method for memory modification |
US20090271009A1 (en) * | 2008-04-24 | 2009-10-29 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Combination treatment modification methods and systems |
US20100280332A1 (en) * | 2008-04-24 | 2010-11-04 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for monitoring bioactive agent use |
US20090271347A1 (en) * | 2008-04-24 | 2009-10-29 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Methods and systems for monitoring bioactive agent use |
CN101582166A (en) * | 2008-05-12 | 2009-11-18 | 皇家飞利浦电子股份有限公司 | System and method for tracking target |
KR101557025B1 (en) * | 2008-11-14 | 2015-10-05 | 삼성전자주식회사 | 3 3d interface apparatus and interface method using the same |
DE202010018235U1 (en) * | 2009-03-27 | 2014-11-13 | Icon Ip, Inc. | Systems and devices for simulating a real-world terrain on a training device |
US8251874B2 (en) | 2009-03-27 | 2012-08-28 | Icon Health & Fitness, Inc. | Exercise systems for simulating real world terrain |
US20100265326A1 (en) * | 2009-04-20 | 2010-10-21 | Kujala Kevin A | Sensory enhancement method and system for visual media |
FR2944615B1 (en) * | 2009-04-21 | 2013-11-22 | Eric Belmon | CARPET ADAPTED TO DISPLACEMENTS IN A VIRTUAL REALITY |
KR100938922B1 (en) * | 2009-06-26 | 2010-01-27 | (주)이랜서 | Treadmill system and device method of the same |
WO2011025466A1 (en) * | 2009-08-25 | 2011-03-03 | Sefik Isik | SINGLE OR MULTIPLE SPORTS UNIT WITH 2D or 3D DISPLAY (FILM), SOUND AND AIR SUPPORT |
US9375629B2 (en) * | 2012-02-13 | 2016-06-28 | Gusto Technologies, Inc. | Method and apparatus for visual simulation of exercise |
JP5298214B2 (en) * | 2012-03-28 | 2013-09-25 | オリンパス株式会社 | Virtual moving display device |
US9671566B2 (en) | 2012-06-11 | 2017-06-06 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
US8532675B1 (en) | 2012-06-27 | 2013-09-10 | Blackberry Limited | Mobile communication device user interface for manipulation of data items in a physical space |
US20140142397A1 (en) | 2012-11-16 | 2014-05-22 | Wellness & Prevention, Inc. | Method and system for enhancing user engagement during wellness program interaction |
CA3000969C (en) | 2012-11-28 | 2021-08-10 | Vrsim, Inc. | Simulator for skill-oriented training |
WO2014160172A1 (en) * | 2013-03-14 | 2014-10-02 | Jintronix, Inc. | Method and system for analysing a virtual rehabilitation activity/exercise |
US10262462B2 (en) | 2014-04-18 | 2019-04-16 | Magic Leap, Inc. | Systems and methods for augmented and virtual reality |
US10228242B2 (en) | 2013-07-12 | 2019-03-12 | Magic Leap, Inc. | Method and system for determining user input based on gesture |
WO2015006784A2 (en) | 2013-07-12 | 2015-01-15 | Magic Leap, Inc. | Planar waveguide apparatus with diffraction element(s) and system employing same |
US10156721B2 (en) * | 2015-03-09 | 2018-12-18 | Microsoft Technology Licensing, Llc | User-based context sensitive hologram reaction |
US20200042160A1 (en) * | 2018-06-18 | 2020-02-06 | Alessandro Gabbi | System and Method for Providing Virtual-Reality Based Interactive Archives for Therapeutic Interventions, Interactions and Support |
CN112654951A (en) | 2018-09-27 | 2021-04-13 | 苹果公司 | Mobile head portrait based on real world data |
US11120599B2 (en) | 2018-11-08 | 2021-09-14 | International Business Machines Corporation | Deriving avatar expressions in virtual reality environments |
KR102033939B1 (en) * | 2018-12-27 | 2019-11-08 | (주)맨엔텔 | Training equipment to improve the ability of Cognition and Memory and the muscle power of Upper and Lower Limb and Training method thereof |
JP7189811B2 (en) | 2019-03-08 | 2022-12-14 | 株式会社フジ医療器 | controller chair |
US11567563B2 (en) | 2020-07-30 | 2023-01-31 | International Business Machines Corporation | Adapting extended reality applications to user capability and preference |
WO2023214569A1 (en) * | 2022-05-02 | 2023-11-09 | 株式会社メルティンMmi | Motion assistance system and method applied in motion assistance system |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5759534A (en) | 1980-09-27 | 1982-04-09 | Miki Yamamoto | Therapeutic exerciser for rehabiritation of leg part |
US4645459A (en) * | 1982-07-30 | 1987-02-24 | Honeywell Inc. | Computer generated synthesized imagery |
JPS63120606A (en) | 1986-11-11 | 1988-05-25 | 三谷セキサン株式会社 | Manufacture of concrete product, surface of which has washing section |
JPH0315812A (en) | 1989-06-14 | 1991-01-24 | Seiko Epson Corp | Rear surface projection type display device |
JPH0480711A (en) | 1990-07-23 | 1992-03-13 | Canon Inc | Projection type display device |
US5234346A (en) * | 1991-02-01 | 1993-08-10 | Rice James W | Educational and training simulator system and method |
JP2505073B2 (en) | 1991-05-28 | 1996-06-05 | 松下電工株式会社 | Refresh device |
JPH06231A (en) | 1992-06-19 | 1994-01-11 | Matsushita Electric Works Ltd | Fitness cycling system |
JPH0611767A (en) | 1992-06-25 | 1994-01-21 | Sony Corp | Projector device |
JPH06154354A (en) | 1992-11-16 | 1994-06-03 | Kanji Murakami | Training device using stereoscopic image |
US5495576A (en) * | 1993-01-11 | 1996-02-27 | Ritchey; Kurtis J. | Panoramic image based virtual reality/telepresence audio-visual system and method |
US5466200A (en) * | 1993-02-02 | 1995-11-14 | Cybergear, Inc. | Interactive exercise apparatus |
JPH0780096A (en) | 1993-09-14 | 1995-03-28 | Sony Corp | Virtual experience device with image display device |
US5562572A (en) * | 1995-03-10 | 1996-10-08 | Carmein; David E. E. | Omni-directional treadmill |
US5577981A (en) * | 1994-01-19 | 1996-11-26 | Jarvik; Robert | Virtual reality exercise machine and computer controlled video system |
US5580249A (en) * | 1994-02-14 | 1996-12-03 | Sarcos Group | Apparatus for simulating mobility of a human |
US5385519A (en) * | 1994-04-19 | 1995-01-31 | Hsu; Chi-Hsueh | Running machine |
US5584700A (en) * | 1994-12-19 | 1996-12-17 | Advanced Technology And Research Corporation | Virtual-reality based flycycle exercise machine |
US5610674A (en) * | 1995-06-19 | 1997-03-11 | Martin; David A. | Precision fragrance dispenser apparatus |
US5905499A (en) * | 1995-07-05 | 1999-05-18 | Fakespace, Inc. | Method and system for high performance computer-generated virtual environments |
US5702323A (en) * | 1995-07-26 | 1997-12-30 | Poulton; Craig K. | Electronic exercise enhancer |
US5779596A (en) * | 1995-09-20 | 1998-07-14 | Weber; Daniel W. | Remote controller mechanism for use with a videocassette recorder or the like |
-
1996
- 1996-11-25 JP JP31386096A patent/JP3469410B2/en not_active Expired - Lifetime
-
1997
- 1997-05-30 US US08/866,302 patent/US6244987B1/en not_active Expired - Fee Related
-
2000
- 2000-12-07 US US09/730,833 patent/US20010001303A1/en not_active Abandoned
Cited By (120)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7718119B2 (en) * | 2000-05-26 | 2010-05-18 | Yukinobu Tajima | Method and apparatus for generating smell |
US20040101447A1 (en) * | 2000-05-26 | 2004-05-27 | Yukinobu Tajima | Method and apparatus for generating smell |
US20130190135A1 (en) * | 2001-03-07 | 2013-07-25 | Motion Games, Llc | Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction |
US8892219B2 (en) * | 2001-03-07 | 2014-11-18 | Motion Games, Llc | Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction |
EP1262158A3 (en) * | 2001-05-25 | 2003-10-29 | Siemens Aktiengesellschaft | Interactive rehabilitation apparatus using gesture recognition |
US6796927B2 (en) | 2001-10-19 | 2004-09-28 | Konami Corporation | Exercise assistance controlling method and exercise assisting apparatus |
EP1308192A1 (en) * | 2001-10-19 | 2003-05-07 | Konami Corporation | Exercise apparatus with computer game |
US20050195128A1 (en) * | 2004-03-03 | 2005-09-08 | Sefton Robert T. | Virtual reality system |
US7224326B2 (en) | 2004-03-03 | 2007-05-29 | Volo, Llc | Virtual reality system |
US20070229397A1 (en) * | 2004-03-03 | 2007-10-04 | Volo, Llc | Virtual reality system |
WO2006008704A1 (en) * | 2004-07-17 | 2006-01-26 | Koninklijke Philips Electronics N.V. | Exercise system and method |
US7949295B2 (en) * | 2004-08-18 | 2011-05-24 | Sri International | Automated trainee monitoring and performance evaluation system |
US20060073449A1 (en) * | 2004-08-18 | 2006-04-06 | Rakesh Kumar | Automated trainee monitoring and performance evaluation system |
US20060271217A1 (en) * | 2005-05-31 | 2006-11-30 | Fujitsu Limited | Manufacturing study support device |
US20070239479A1 (en) * | 2006-03-29 | 2007-10-11 | Juha Arrasvuori | System and method for gaming |
US8845496B2 (en) * | 2006-03-29 | 2014-09-30 | Nokia Corporation | System and method for gaming |
US20070254778A1 (en) * | 2006-04-14 | 2007-11-01 | Ashby Darren C | Exercise apparatuses, components for exercise apparatuses and related methods |
US20080261696A1 (en) * | 2007-04-20 | 2008-10-23 | Nintendo Co., Ltd. | Game controller, storage medium storing game program, and game apparatus |
US8740705B2 (en) | 2007-04-20 | 2014-06-03 | Nintendo Co., Ltd. | Game controller, storage medium storing game program, and game apparatus |
US9289680B2 (en) | 2007-04-20 | 2016-03-22 | Nintendo Co., Ltd. | Game controller, storage medium storing game program, and game apparatus |
US8574080B2 (en) | 2007-04-20 | 2013-11-05 | Nintendo Co., Ltd. | Game controller, storage medium storing game program, and game apparatus |
US8100770B2 (en) | 2007-04-20 | 2012-01-24 | Nintendo Co., Ltd. | Game controller, storage medium storing game program, and game apparatus |
US8905844B2 (en) | 2007-10-05 | 2014-12-09 | Nintendo Co., Ltd. | Storage medium storing load detecting program and load detecting apparatus |
US9421456B2 (en) | 2007-10-09 | 2016-08-23 | Nintendo Co., Ltd. | Storage medium storing a load detecting program and load detecting apparatus |
US10343058B2 (en) | 2007-10-09 | 2019-07-09 | Nintendo Co., Ltd. | Storage medium storing a load detecting program and load detecting apparatus |
US8887547B2 (en) | 2007-10-31 | 2014-11-18 | Nintendo Co., Ltd. | Weight applying unit for calibration and weight applying method for calibration |
US8387437B2 (en) | 2007-10-31 | 2013-03-05 | Nintendo Co., Ltd. | Weight applying unit for calibration and weight applying method for calibration |
US10204525B1 (en) | 2007-12-14 | 2019-02-12 | JeffRoy H. Tillis | Suggestion-based virtual sessions engaging the mirror neuron system |
US20110102570A1 (en) * | 2008-04-14 | 2011-05-05 | Saar Wilf | Vision based pointing device emulation |
US7758469B2 (en) * | 2008-05-28 | 2010-07-20 | Precor Incorporated | Exercise device visual representation |
US20090298649A1 (en) * | 2008-05-28 | 2009-12-03 | Precor Incorporated | Exercise device visual representation |
US20160144238A1 (en) * | 2008-11-19 | 2016-05-26 | Wolfgang Brunner | Arrangement for Training the Gait |
US20120021873A1 (en) * | 2008-11-19 | 2012-01-26 | Wolfgang Brunner | Arrangement for Gait Training |
US8152640B2 (en) | 2008-11-28 | 2012-04-10 | Nintendo Co., Ltd. | Information processing apparatus and computer readable storage medium |
US20100156760A1 (en) * | 2008-12-19 | 2010-06-24 | At&T Intellectual Property I, L.P. | Motion controlled multimedia content viewing method and system |
US10375320B2 (en) * | 2008-12-23 | 2019-08-06 | At&T Intellectual Property I, L.P. | System and method for creating and manipulating synthetic environments |
US11064136B2 (en) * | 2008-12-23 | 2021-07-13 | At&T Intellectual Property I, L.P. | System and method for creating and manipulating synthetic environments |
US20190356865A1 (en) * | 2008-12-23 | 2019-11-21 | At&T Intellectual Property I, L.P. | System and method for creating and manipulating synthetic environments |
US8612247B2 (en) | 2008-12-26 | 2013-12-17 | Nintendo Co., Ltd. | Biological information management system |
US7972245B2 (en) * | 2009-02-27 | 2011-07-05 | T-Mobile Usa, Inc. | Presenting information to users during an activity, such as information from a previous or concurrent outdoor, physical activity |
US20100222179A1 (en) * | 2009-02-27 | 2010-09-02 | Sinclair Temple | Presenting information to users during an activity, such as information from a previous or concurrent outdoor, physical activity |
US8707768B2 (en) | 2009-03-09 | 2014-04-29 | Nintendo Co., Ltd. | Computer readable storage medium storing information processing program and information processing apparatus |
US8079251B2 (en) | 2009-03-09 | 2011-12-20 | Nintendo Co., Ltd. | Computer readable storage medium storing information processing program and information processing apparatus |
US8395582B2 (en) | 2009-03-30 | 2013-03-12 | Nintendo Co., Ltd. | Computer-readable storage medium and information processing apparatus |
US9480918B2 (en) | 2009-09-28 | 2016-11-01 | Nintendo Co., Ltd. | Computer-readable storage medium having information processing program stored therein and information processing apparatus |
US8751179B2 (en) | 2009-09-29 | 2014-06-10 | Nintendo Co., Ltd. | Computer-readable storage medium having stored information processing program thereon, and information processing apparatus |
US8654073B2 (en) | 2009-09-30 | 2014-02-18 | Nintendo Co., Ltd. | Information processing program having computer-readable storage medium therein and information processing apparatus |
EP2490772A1 (en) * | 2009-10-20 | 2012-08-29 | Touret, Félix | Device particularly intended for sports training |
TWI396567B (en) * | 2010-06-17 | 2013-05-21 | Univ Nat Kaohsiung 1St Univ Sc | Auxiliary device for rehabilitation of kneecap pain syndrome |
US11103787B1 (en) | 2010-06-24 | 2021-08-31 | Gregory S. Rabin | System and method for generating a synthetic video stream |
US20130083941A1 (en) * | 2010-08-03 | 2013-04-04 | Intellisysgroup Llc | Devices, Systems, and Methods for Games, Sports, Entertainment And Other Activities of Engagement |
US9285241B2 (en) * | 2010-08-03 | 2016-03-15 | Intellisys Group, Llc | Devices, systems, and methods for games, sports, entertainment and other activities of engagement |
US20160332064A1 (en) * | 2010-08-03 | 2016-11-17 | Intellisysgroup Llc | Devices, systems and methods for games, sports, entertainment and other activities of engagement |
US20130035208A1 (en) * | 2011-08-03 | 2013-02-07 | Icon Health & Fitness, Inc. | Exercise device with fan controllable by a physiological condition of a user |
US8920288B2 (en) * | 2011-08-03 | 2014-12-30 | Icon Health & Fitness, Inc. | Exercise device with fan controllable by a physiological condition of a user |
US10220259B2 (en) | 2012-01-05 | 2019-03-05 | Icon Health & Fitness, Inc. | System and method for controlling an exercise device |
US9367668B2 (en) | 2012-02-28 | 2016-06-14 | Precor Incorporated | Dynamic fitness equipment user interface adjustment |
US8938124B2 (en) | 2012-05-10 | 2015-01-20 | Pointgrab Ltd. | Computer vision based tracking of a hand |
US20130328925A1 (en) * | 2012-06-12 | 2013-12-12 | Stephen G. Latta | Object focus in a mixed reality environment |
US10033943B1 (en) | 2012-10-15 | 2018-07-24 | Tangible Play, Inc. | Activity surface detection, display and enhancement |
US11495017B2 (en) | 2012-10-15 | 2022-11-08 | Tangible Play, Inc. | Virtualization of tangible interface objects |
US10984576B2 (en) | 2012-10-15 | 2021-04-20 | Tangible Play, Inc. | Activity surface detection, display and enhancement of a virtual scene |
US9939961B1 (en) | 2012-10-15 | 2018-04-10 | Tangible Play, Inc. | Virtualization of tangible interface objects |
US10726266B2 (en) | 2012-10-15 | 2020-07-28 | Tangible Play, Inc. | Virtualization of tangible interface objects |
US10657694B2 (en) | 2012-10-15 | 2020-05-19 | Tangible Play, Inc. | Activity surface detection, display and enhancement of a virtual scene |
US20140135173A1 (en) * | 2012-10-31 | 2014-05-15 | Icon Health & Fitness, Inc. | System and method for an interactive exercise routine |
US20140255890A1 (en) * | 2013-03-07 | 2014-09-11 | Hill-Rom Services, Inc. | Patient support apparatus with physical therapy system |
US10279212B2 (en) | 2013-03-14 | 2019-05-07 | Icon Health & Fitness, Inc. | Strength training apparatus with flywheel and related methods |
US20140336003A1 (en) * | 2013-05-08 | 2014-11-13 | The Regents Of The University Of Colorado, A Body Corporate | System and methods for measuring propulsive force during ambulation and providing real-time feedback |
CN103735270A (en) * | 2013-09-22 | 2014-04-23 | 国家康复辅具研究中心 | Meridian circulation, dredging, guiding and feedback rehabilitation training system for upper-limb potential development |
US20150105220A1 (en) * | 2013-10-14 | 2015-04-16 | Healthstream Taiwan Inc. | Trainer control method and fitness device using the same |
US20190388733A1 (en) * | 2013-11-08 | 2019-12-26 | Performance Lab Technologies Limited | Automated Prescription of Activity Based on Physical Activity Data |
US10589150B2 (en) * | 2013-11-08 | 2020-03-17 | Performance Lab Technologies Limited | Automated prescription of activity based on physical activity data |
US10744373B2 (en) * | 2013-11-08 | 2020-08-18 | Performance Lab Technologies Limited | Automated prescription of activity based on physical activity data |
US11872020B2 (en) * | 2013-11-08 | 2024-01-16 | Performance Lab Technologies Limited | Activity classification based on activity types |
US10188890B2 (en) | 2013-12-26 | 2019-01-29 | Icon Health & Fitness, Inc. | Magnetic resistance mechanism in a cable machine |
US9630060B2 (en) * | 2014-02-27 | 2017-04-25 | Flextronics Ap, Llc | Exercise equipment with improved user interaction |
US20150238819A1 (en) * | 2014-02-27 | 2015-08-27 | Flextronics Ap, Llc | Exercise equipment with improved user interaction |
US9844699B2 (en) * | 2014-02-27 | 2017-12-19 | Flextronics Ap, Llc | Exercise equipment with improved user interaction |
US10433612B2 (en) | 2014-03-10 | 2019-10-08 | Icon Health & Fitness, Inc. | Pressure sensor to quantify work |
US10426989B2 (en) | 2014-06-09 | 2019-10-01 | Icon Health & Fitness, Inc. | Cable system incorporated into a treadmill |
US10226396B2 (en) | 2014-06-20 | 2019-03-12 | Icon Health & Fitness, Inc. | Post workout massage device |
US20160055680A1 (en) * | 2014-08-25 | 2016-02-25 | Samsung Electronics Co., Ltd. | Method of controlling display of electronic device and electronic device |
US9946393B2 (en) * | 2014-08-25 | 2018-04-17 | Samsung Electronics Co., Ltd | Method of controlling display of electronic device and electronic device |
US20160091877A1 (en) * | 2014-09-29 | 2016-03-31 | Scott Fullam | Environmental control via wearable computing system |
US10345768B2 (en) * | 2014-09-29 | 2019-07-09 | Microsoft Technology Licensing, Llc | Environmental control via wearable computing system |
US10258828B2 (en) | 2015-01-16 | 2019-04-16 | Icon Health & Fitness, Inc. | Controls for an exercise device |
US10391361B2 (en) | 2015-02-27 | 2019-08-27 | Icon Health & Fitness, Inc. | Simulating real-world terrain on an exercise device |
US20160365000A1 (en) * | 2015-06-10 | 2016-12-15 | Seiko Epson Corporation | Exercise instruction system, instruction content generation method, exercise instruction device, and instruction content generation device |
US10537764B2 (en) | 2015-08-07 | 2020-01-21 | Icon Health & Fitness, Inc. | Emergency stop with magnetic brake for an exercise device |
US10953305B2 (en) | 2015-08-26 | 2021-03-23 | Icon Health & Fitness, Inc. | Strength exercise mechanisms |
US20200261763A1 (en) * | 2016-01-12 | 2020-08-20 | Samsung Electronics Co., Ltd. | Display device and control method therefor |
US11020628B2 (en) * | 2016-01-12 | 2021-06-01 | Samsung Electronics Co., Ltd. | Display device and control method therefor |
US10293211B2 (en) | 2016-03-18 | 2019-05-21 | Icon Health & Fitness, Inc. | Coordinated weight selection |
US10272317B2 (en) | 2016-03-18 | 2019-04-30 | Icon Health & Fitness, Inc. | Lighted pace feature in a treadmill |
US10561894B2 (en) | 2016-03-18 | 2020-02-18 | Icon Health & Fitness, Inc. | Treadmill with removable supports |
US10493349B2 (en) | 2016-03-18 | 2019-12-03 | Icon Health & Fitness, Inc. | Display on exercise device |
US10625137B2 (en) | 2016-03-18 | 2020-04-21 | Icon Health & Fitness, Inc. | Coordinated displays in an exercise device |
GB2564784B (en) * | 2016-03-25 | 2019-07-10 | Tangible Play Inc | Activity surface detection, display and enhancement of a virtual scene |
GB2564784A (en) * | 2016-03-25 | 2019-01-23 | Tangible Play Inc | Activity surface detection, display and enhancement of a virtual scene |
WO2017165860A1 (en) * | 2016-03-25 | 2017-09-28 | Tangible Play, Inc. | Activity surface detection, display and enhancement of a virtual scene |
US10252109B2 (en) | 2016-05-13 | 2019-04-09 | Icon Health & Fitness, Inc. | Weight platform treadmill |
US10441844B2 (en) | 2016-07-01 | 2019-10-15 | Icon Health & Fitness, Inc. | Cooling systems and methods for exercise equipment |
US10471299B2 (en) | 2016-07-01 | 2019-11-12 | Icon Health & Fitness, Inc. | Systems and methods for cooling internal exercise equipment components |
US10671705B2 (en) | 2016-09-28 | 2020-06-02 | Icon Health & Fitness, Inc. | Customizing recipe recommendations |
US10500473B2 (en) | 2016-10-10 | 2019-12-10 | Icon Health & Fitness, Inc. | Console positioning |
US10376736B2 (en) | 2016-10-12 | 2019-08-13 | Icon Health & Fitness, Inc. | Cooling an exercise device during a dive motor runway condition |
US10661114B2 (en) | 2016-11-01 | 2020-05-26 | Icon Health & Fitness, Inc. | Body weight lift mechanism on treadmill |
US10343017B2 (en) | 2016-11-01 | 2019-07-09 | Icon Health & Fitness, Inc. | Distance sensor for console positioning |
US10625114B2 (en) | 2016-11-01 | 2020-04-21 | Icon Health & Fitness, Inc. | Elliptical and stationary bicycle apparatus including row functionality |
US10561877B2 (en) | 2016-11-01 | 2020-02-18 | Icon Health & Fitness, Inc. | Drop-in pivot configuration for stationary bike |
US10543395B2 (en) | 2016-12-05 | 2020-01-28 | Icon Health & Fitness, Inc. | Offsetting treadmill deck weight during operation |
US10702736B2 (en) | 2017-01-14 | 2020-07-07 | Icon Health & Fitness, Inc. | Exercise cycle |
CN110022835A (en) * | 2017-04-25 | 2019-07-16 | 株式会社mediVR | Rehabilitation support system, rehabilitation support method and rehabilitation support program |
US11138766B2 (en) * | 2017-05-08 | 2021-10-05 | T. Hasegawa Co., Ltd. | Method for expressing image with colors and color expression drawing |
US11451108B2 (en) | 2017-08-16 | 2022-09-20 | Ifit Inc. | Systems and methods for axial impact resistance in electric motors |
US10729965B2 (en) | 2017-12-22 | 2020-08-04 | Icon Health & Fitness, Inc. | Audible belt guide in a treadmill |
US11022863B2 (en) | 2018-09-17 | 2021-06-01 | Tangible Play, Inc | Display positioning system |
US20210404826A1 (en) * | 2020-06-24 | 2021-12-30 | George Mason University | Exertion-aware path generation |
CN117319661A (en) * | 2023-09-26 | 2023-12-29 | 中移凯普(北京)技术服务有限公司 | Image transmission system for visual communication display |
Also Published As
Publication number | Publication date |
---|---|
US6244987B1 (en) | 2001-06-12 |
JPH10151223A (en) | 1998-06-09 |
JP3469410B2 (en) | 2003-11-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6244987B1 (en) | Physical exercise system having a virtual reality environment controlled by a user's movement | |
US6317151B1 (en) | Image reproducing method and image generating and reproducing method | |
CN104298722B (en) | Digital video interactive and its method | |
US8892219B2 (en) | Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction | |
Schönauer et al. | Full body interaction for serious games in motor rehabilitation | |
Desai et al. | Augmented reality-based exergames for rehabilitation | |
US20090023553A1 (en) | Exercise systems in local or global network | |
Pirovano et al. | Intelligent game engine for rehabilitation (IGER) | |
Borghese et al. | An intelligent game engine for the at-home rehabilitation of stroke patients | |
US20190369725A1 (en) | Guided virtual reality system for relaxing body and mind | |
CN102473320A (en) | Bringing a visual representation to life via learned input from the user | |
WO2002001478A1 (en) | Method and device for wireless transmission and processing of psychophysiological data | |
JPH10153946A (en) | Sensation information presenting device | |
US20220314078A1 (en) | Virtual environment workout controls | |
Mocanu et al. | A Kinect based adaptive exergame | |
CN114344865A (en) | Dummy for fighting training, entertainment and security | |
Tiator et al. | Venga! climbing in mixed reality | |
WO2021039857A1 (en) | Video generation device | |
CN108969864A (en) | Depression recovery therapeutic equipment and its application method based on VR technology | |
Burns | On the relevance of using virtual humans for motor skills teaching: A case study on karate gestures | |
KR20220014254A (en) | Method of providing traveling virtual reality contents in vehicle such as a bus and a system thereof | |
WO2023204035A1 (en) | Exercise menu management device, exercise management method, and computer program | |
Troy et al. | Biomechanics and biomechatronics in sports, exercise, and entertainment | |
JP2003024467A (en) | Developing system of healthy body and developing method of healthy body | |
Han et al. | Ai-based next-generation sensors for enhanced rehabilitation monitoring and analysis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |