WO2001008417A1 - System, apparatus, and method for telemetry and monitoring of desired targets - Google Patents

System, apparatus, and method for telemetry and monitoring of desired targets Download PDF

Info

Publication number
WO2001008417A1
WO2001008417A1 PCT/US2000/020465 US0020465W WO0108417A1 WO 2001008417 A1 WO2001008417 A1 WO 2001008417A1 US 0020465 W US0020465 W US 0020465W WO 0108417 A1 WO0108417 A1 WO 0108417A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
remote unit
target
processor
remote
Prior art date
Application number
PCT/US2000/020465
Other languages
French (fr)
Other versions
WO2001008417A9 (en
Inventor
Joseph Charles Bok
Original Assignee
Joseph Charles Bok
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Joseph Charles Bok filed Critical Joseph Charles Bok
Priority to AU68904/00A priority Critical patent/AU6890400A/en
Publication of WO2001008417A1 publication Critical patent/WO2001008417A1/en
Publication of WO2001008417A9 publication Critical patent/WO2001008417A9/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021Tracking a path or terminating locations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1112Global tracking of patients, e.g. by using GPS
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1113Local tracking of patients, e.g. in a hospital or private home
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • A61B5/7207Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
    • A61B5/721Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/10Athletes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20Workers
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/40Animals
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02Operational features
    • A61B2560/0204Operational features of power management
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A61B5/02055Simultaneously evaluating both cardiovascular condition and temperature
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021Measuring pressure in heart or blood vessels
    • A61B5/022Measuring pressure in heart or blood vessels by applying pressure to close blood vessels, e.g. against the skin; Ophthalmodynamometers
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14532Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring glucose, e.g. by tissue impedance measurement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0021Tracking a path or terminating locations
    • A63B2024/0025Tracking the path or location of one or more users, e.g. players of a game
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2208/00Characteristics or parameters related to the user or player
    • A63B2208/12Characteristics or parameters related to the user or player specially adapted for children
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/10Positions
    • A63B2220/12Absolute positions, e.g. by using GPS
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/10Positions
    • A63B2220/13Relative positions
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/30Speed
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/40Acceleration
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/83Special sensors, transducers or devices therefor characterised by the position of the sensor
    • A63B2220/836Sensors arranged on the body of the user
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2225/00Miscellaneous features of sport apparatus, devices or equipment
    • A63B2225/50Wireless data transmission, e.g. by radio transmitters or telemetry
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/04Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/04Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • A63B2230/06Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/20Measuring physiological parameters of the user blood composition characteristics
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/20Measuring physiological parameters of the user blood composition characteristics
    • A63B2230/202Measuring physiological parameters of the user blood composition characteristics glucose
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/30Measuring physiological parameters of the user blood pressure
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/50Measuring physiological parameters of the user temperature

Definitions

  • the invention generally relates to an apparatus and method for monitoring desired targets. More specifically, the invention involves collecting, transmitting, and or displaying data and/or images of one or more targets.
  • Various methods for displaying and monitoring desired subjects are known.
  • television broadcasts provide images and other information about athletes and competitions.
  • Visual images of the subjects alone do not, however, always provide all the information a viewer or other user may desire or require.
  • a team coach or physician may not easily be able to determine the physical condition of an athlete during the competition merely by viewing the athlete from a distance.
  • a viewer of the athletic competition may desire more detailed information, such as acceleration data, that may not be readily apparent from visual images of the athletes.
  • the invention is a system, apparatus, and method for monitoring characteristics of a desired target.
  • the desired target can be a person, animal, plant, or inanimate object. More specifically, the invention is a system, apparatus, and method for collecting, transmitting, and/or displaying data and/or images of one or more desired targets.
  • target is used to reference the person, animal, plant, or inanimate object that is being monitored by the invention.
  • the invention may be used to monitor individuals involved in various activities, or who require medical monitoring.
  • the invention may also be used to monitor devices, including athletic equipment such as baseball bats and footballs, that are subject to movements.
  • the remote unit may be a telemetry transceiver device capable of sensing, acquiring, processing, transmitting, receiving, recording, and/or displaying real-time physiological and other performance data from the target to one or more receiving sites capable of receiving the transmitted signal.
  • the receiving site may include a receiver for receiving the data and a processor for processing the data.
  • a display may also be provided, which may be part of the receiving site.
  • the telemetry signals can be sent from multiple targets to one or more receivers wirelessly, and from the receiver can be forwarded in real-time to a personal computer or other processor, and then on to other media such as the Internet and/or television broadcasts.
  • the transceivers themselves may have embedded TCP/IP code, thus allowing each target to be its own web page or URL.
  • all data from a target can be accessed in real-time over the Internet by the unique URL.
  • the individual web page of each target and its associated data can be accessed by a web server via the Internet and viewed by multiple users at the same time.
  • the remote unit on the target may consist of an ASIC, FPGA, CMOS IC, and/or can be implemented in several integrated circuit, chip-size modular sections. Sensors, A/D convertor, processor, transceiver, and/or antenna may be located in a small (such as pager-size or smaller) package that transmits to one or more receivers.
  • the Data Acquisition (DAQ) section would monitor and measure functions of the target, for example, if the target were an athlete, the DAQ section would monitor and measure functions such as ECG, heart rate, breathing rate, blood pressure, positive and negative acceleration, positive and negative G's, and vibration.
  • Various sensors could be used, including analog and/or digital, as well as MEMS type. The sensors may all be non-invasive, depending on the particular application.
  • the receiving site recovers data from one or more remote units in the field.
  • the receiving site can send the data to a computer where the data is sent to the Internet of to some other media where it can be broadcast to viewers, or accessed upon demand for viewers.
  • multiple receivers can be used to provide wireless, headset viewer access to the live video, audio, and/or data information that is being transmitted from the target.
  • the invention may include a real-time data acquisition system that is capable of sensing, acquiring, processing, transmitting, receiving, recording, and/or displaying remote analog, digital, and/or serial data in real-time wirelessly to the Internet.
  • the design allows dat from a sensor to be immediately transmitted wirelessly to the Internet where data can be displayed and/or accessed by multiple users.
  • the system may operate on the Ethernet standard and incorporate two distinct sections: The Data acquisition and processing section and the transceiver section (such as an RF transmitter/receiver). Both sections may have embedded TCP/IP network capable protocols.
  • the system can thus allow for command, control, and communication in real-time, wirelessly, to and from remote units and to and from the network and/or the Internet.
  • One embodiment of the invention comprises a remote unit to be worn on a target.
  • the remote unit is capable of sensing, acquiring, processing, transmitting, receiving, recording, and/or displaying real-time data, such as physiological and other performance data, from the target to a receiver capable of receiving the transmitted signal.
  • the remote unit may consist of a data acquisition circuit, a communication circuit (such as an RF circuit), and one or more sensors.
  • the elements of the remote unit may be integrally formed on a self- contained application-specific integrated circuit (ASIC) chip and/or can be implemented in several CMOS integrated circuits, chip-size modular sections.
  • ASIC application-specific integrated circuit
  • Sensors, A/D converter, processor, transceiver, memory, and/or antenna can all be located in a small (such as pager- size) package that transmits to a receiver.
  • One or more, or even all, of the elements of the remote unit, such as the sensor(s) and/or antenna, may be embedded in a substrate, such as the substrate of a chip that forms the remote unit.
  • the antenna may be a planar antenna or traced onto the substrate with copper or graphite such that it is integral with the chip set.
  • the remote unit can be worn by the athlete, either directly on the athlete's body, or on or inside of a piece of apparel, such as a helmet, wristband, shoe, or other padding.
  • the remote unit can include one or more sensors for gathering biometric data about the athlete's physiological condition, such as ECG data, blood pressure, heart rate, perspiration rate, and body temperature.
  • biometric data may include chemical analysis of perspiration and/or blood, such as monitoring of blood sugar levels and other blood chemistry monitoring.
  • the remote unit may also include sensors for gathering data regarding the acceleration, speed, vibration, movement, and/or location of the target.
  • the remote unit includes an accelerometer that determines accelerations of the target in one or more directions.
  • the accelerometer can determine accelerations in 3 axes.
  • the acceleration data can be in the form of "g-forces" or other units as desired for a particular application.
  • the accelerometer is a tri-axial accelerometer, such as a solid-state angular rate sensor sold by Systron Dormer Parts under the name Gyro-Chip(TM).
  • a quartz flexure accelerometer sold by the same company.
  • One or more of the sensors may be MEMS (micro-electromechanical systems) sensors, which may be configured to be integrated into a single chip that forms the remote unit. Such integration could be in the form of building the MEMS sensor or sensors, such as a MEM accelerometer, into the substrate of the actual chip.
  • the sensors could be of various types, including analog, digital, MEMS, and/or other sensors.
  • the sensors may all be non-invasive, particularly where the target is a human.
  • the remote unit may include a transmitter that transmits the biometric and/or other data from the remote unit to a receiving site, which may include as a processor that receives the data and provides the data in a desired format to a display.
  • the remote unit may also include a receiver for receiving transmissions from various sources.
  • the remote unit may include a combined transmitter and receiver, known as a transceiver, that receives and transmits data.
  • the biometric and/or other data is transmitted from the remote unit in an Internet-compatible format, such as so-called TCP/IP format, so that the data is immediately accessible through internet protocols.
  • the remote unit may be equipped with a transceiver (receiver and transmitter) so that it can transmit and receive data in Internet-compatible format.
  • Each remote unit may act as a stand alone network device, with an individual network address for each remote unit that can be accessed by Internet users.
  • the sensors themselves are configured to provide the biometric and or other data in Internet compatible format.
  • the remote unit includes a memory for storing the sensor data.
  • the memory may be in various forms, and may provide short-term, long-term, and/or permanent storage of data.
  • the remote unit includes a GPS receiver for receiving GPS position data from GPS satellites.
  • the remote unit can store the GPS data, and/or transmit the GPS data to another location, such as a network address or a desired display.
  • the remote unit is part of a system that includes one or more remote units on one or more targets, one or more receivers for receiving data from the remote units, one or more processors for processing the data, and one or more displays for selectively displaying images of the targets on the screen, simultaneously with representations of the biometric and/or other data collected from the remote units attached to the targets.
  • the representations of the biometric and/or other data may be in various forms, such as graphical and/or numerical representations of the data.
  • multiple remote units and personal display units could be used in sports stadiums to provide viewer access to the live video, audio, and/or data information that is being transmitted from the athletes.
  • the link to the personal display units could be wireless, via a local computer server, and/or via a direct connection, or the display units could be located in the seat-backs and data could be accessed by the stadium fan.
  • the personal display units could be rented out to spectators for a fee at a game.
  • the personal display units could be adapted to provide a televised or similar sportscast of the game for an up-close experience.
  • dedicated cameras situated around the arena can be used to collect video/audio to a processor linked to the personal display units.
  • Each personal display unit may be thin client-type computing device with a video monitor or other visual display.
  • the system could provide real-time telemetry data from the athletes to the personal display unit, with the wearer selecting the particular telemetry data and athletes desired for viewing.
  • the system could also provide non-real time data about the athletic competitions and/or athletes, such as athlete statistics that may be provided to a viewer, with the viewer selecting the type of data desired for display.
  • a spectator could select the video/audio from any of the available cameras for viewing along with real-time telemetry data from several of the athletes on the field, rink, or other playing area.
  • the remote unit may include a power source.
  • the power source may include a battery, solar array, capacitor, and/or other source for providing power to the remote unit.
  • Other power sources that might be used include sources that derive power from the target, such as an athlete. For example, heat and/or perspiration by the athlete could be used as a power source, as well as movement of the athlete (which can be harnessed through means such as the winding mechanism for a so-called "self-winding" watch).
  • Such alternative power sources may have particular applicability for remote units that use relatively small amounts of power.
  • the system of the invention may include a system memory for storing the data transmitted by and/or received from the remote units.
  • a system memory can be in lieu of, or in addition to, the previously-discussed memory positioned on or in the remote sensor.
  • the system may also include a system processor, apart from or in place of any processor on the remote units, that processes the data from the remote units.
  • the system of the invention can include one or more remote units providing data from one or more targets. If multiple targets are involved, the remote units each preferably provide the data with a format or frequency or other differentiating characteristic that permits data from a particular target to be recognized as coming from the remote unit on that target.
  • the system of the invention can include one or more cameras to provide images of the target and/or of the target's environment.
  • the camera may be positioned on the target and may form a part of the remote unit.
  • the camera may be positioned at a distance from the target, in order to provide a desired image of the target in the particular environment.
  • remote units can be attached to various players, and one or more cameras may be positioned so as to provide a view of the football teams' members on the playing field during and between various football plays.
  • the camera(s) can provide images to the display for simultaneous presentation with the biometric and or other data from the remote unit.
  • the data and image from the camera(s) are preferably correlated, so that the data displayed correlates to the action of the target. For example, g- forces experienced by a football player could be displayed in real-time in a windows (picture- in-picture) format positioned in a corner of a larger view showing the movements of the player.
  • a camera could also be positioned on or in an inanimate object, such as a camera positioned inside and looking out of an end of a football. Note that such cameras may provide unsteady images, particularly where the target is moving.
  • the system may provide for image stabilization that compensates for such movements. For example, a camera looking out of a football would, during a spiral pass, provide a rotating and probably wobbling image.
  • the system could, through various techniques such as the use of software, provide a stablized image to the display that compensates for the rotation and other wobbling movement.
  • the system of the invention may also include one or more microphones that provide audio data.
  • the microphones may be positioned on or near the target, and may be part of the remote unit.
  • the system may include one or more displays, with different data provided to different displays.
  • biometric data may be provided to one screen for private viewing by an athlete's physician or coach, while data regarding speed, position, and/or acceleration can be provided to a second set of displays intended for public viewing.
  • the displays of the invention can, in one embodiment, provide viewing of an athletic event with simultaneous viewing of biometric and/or other data about one or more athletes in the event.
  • the biometric and/or other data is provided on the same screen as the actual viewing of the athletic event.
  • the biometric and/or other data may be provided in a format and manner that enhances, preferably without detracting from, the viewing of the athletic event itself.
  • the displays may be part of a personal computer, television set, or other display.
  • the data can be sent to the display through various methods, including the Internet, World Wide Web, the Internet via an Application Service Provider software program residing either on a client web-site or our own enabled with a browser specific health related "my health" box located on the browser menu bar, on cable television systems, broadcast systems, satellite transmission, and/or phone lines.
  • the invention can be applied to various applications where data, such as location, movement, or biomedical information, is desired from a target.
  • the invention could be applied to a wide variety of sports and recreational activities, including professional and amateur sports.
  • the invention could also be used in military and civil applications to train and monitor personnel.
  • soldiers, pilots, firefighters, police, and hazardous materials specialists could use the invention to enhance their effectiveness, in both training and real-life situations.
  • the invention could also be applied to entertainment venues. Television game shows could make use of the invention, where, for example, a contestant was equipped with remote unit providing heart rate data that can be shown to a viewing audience to indicate the contestant's heart rate during the contest.
  • the invention may also be used to monitor individuals who require medical monitoring, such as individuals in medical care facilities, nursing homes, or who require home care and monitoring, and passengers in automobiles, airplanes, and boats or ships.
  • the invention could additionally be used to monitor persons whose movements are desired to be restricted, such as individuals who imprisoned or under house arrest.
  • the invention could also be applied to non-human targets, such as for use in monitoring livestock, commercial packages, etc.
  • remote units could be used to monitor the condition and/or movements of various farm and ranch animals, including cows, pigs, and chickens.
  • a rancher could use the invention to monitor the condition and/or movements of many individual animals, with the data maintained in a detailed database on a central computer that correlates condition and or movements with time.
  • the invention could have particular application in monitoring animals, such as cows and horses, that may range over a large field or other area.
  • the invention could also be applied to free or wild animals, such as deer or fish.
  • the invention could also be applied to monitoring the condition and/or movements of plants and inanimate objects.
  • the invention thus allows for simultaneous access to target information, in real-time and/or archival formats, that cen be easily integrated and customized according to the needs of the particular broadcast venue.
  • the data from a particular target can be stored to archived files as a portfolio for the particular target.
  • the data for a particular athlete can be archived as player statistics.
  • the data for such statistics could cover a single game, a season, or a career of the particular athlete.
  • Data from various targets, such as various players, could be cross-referenced and compared with such archived files.
  • FIGURE 1 shows an overview of a block diagram showing a system according to an embodiment of the current invention
  • FIG. 2 depicts a block diagram of a system in accordance with a further embodiment of the invention.
  • FIG. 3a and 3b depict block diagrams of a camera control system in accordance with an embodiment of the invention.
  • FIG. 4 depicts an overview of a system according to an embodiment of the invention
  • FIG. 5 depicts a block diagram of a remote unit in accordance with an embodiment of the invention.
  • FIG. 6 depicts a block diagram of a power supply in accordance with an embodiment of the invention.
  • FIG. 7 is a flowchart depicting the operation of aspects of a remote unit according to an embodiment of the invention.
  • FIG. 8 is a flowchart depicting the operation of aspects of a processor according to an embodiment of the invention.
  • FIG. 9 depicts a display in accordance with an embodiment of the invention
  • FIG. 10 depicts a display in accordance with a further embodiment of the invention
  • FIG. 1 1 depicts a display in accordance with another embodiment of the invention
  • FIG. 12 depicts a display in accordance with an embodiment of the invention
  • FIG. 1 depicts a box diagram of a system according to an embodiment of the invention.
  • the system 10 depicted includes a plurality of remote units 12a-12d associated with individual targets 15a-15d.
  • the remote units 12 transmit data to a receiver 14 that provides the data to a processor 16, such as a PC server, that in turn provides the data to displays 18a, 18b, 18c.
  • the system may also include one or more cameras 20a, 20b, such as television cameras, that provide real-time images of the particular event.
  • the event may be, for example, an athletic competition wherein remote units are secured to the athletes and/or the athletic equipment (e.g., a ball).
  • the cameras 20a, 20b may provide the real-time images directly to the displays 18a, 18b, 18c, and or may provide the real-time images to the processor 16 so that the processor can merge the real-time images with the desired biometric/other data for presentation on the displays 18a, 18b, 18c.
  • the processor 16 may be locally controlled, such as by a person in actual attendance at a sporting event providing input to the processor 16 through a keyboard 17 or other input device.
  • the central processor 16 may actually consist of several different processors, with each processor accessing different data from the remote units 12.
  • display 18a is representative of a set of one or more monitors that depict a specific set of data and images. In fact there could be multiple displays 18a showing the same data and images, such as is the case where a television network provides coverage of a sporting event to multiple home viewers. The same is true for displays 18b and 18c, with displays 18a showing data and images different from that of displays 18b or 18c.
  • the system may be configured to selectively provide different data to different displays.
  • the biometric data can be provided to one display, with the acceleration data provided to a different display.
  • a system processor can be used that receives all the data from the remote units and selectively provides the different data to different displays.
  • the different data may be transmitted from the remote unit at different frequencies and/or in different formats (such as coded formats), so that a particular display is only provided with data from a select set of frequencies and/or formats.
  • the system can provide a first set of data, such as acceleration and/or speed data, to a first set of displays (such as a television network) that can be viewed by a first group of people (such as the viewing audience of an athletic competition), while the biometric data may be provided to a second set of one or more displays that can only be viewed by a second group of people, such as the coach, team physician, and/or other team personnel.
  • the second group of people may be separate from, or be a subpart of, the first group.
  • the processor 16 which may actually be several processors, may be configured to analyze and/or modify the data received from the remote units 12. For example, the processor 16 may be configured to, using the acceleration data, calculate the resulting speeds and/or positions of the target, such as an athlete, in real time.
  • Fig. 2 depicts a system 10 according in accordance with an embodiment of the invention configured for use in an athletic competition, in this embodiment a football game, for broadcasting of real-time metrics from football players.
  • the metrics can include biometric data and or movement-related information, such as accelerations, etc.
  • the system 10 includes remote units 12 which can be worn by one or more players 15. The sensors of each remote unit 12 provide data on an associated football player 15.
  • Athletic equipment such as a football
  • the football's remote unit would preferably be configured with the football so as to ensure that the football has the same weight, balance, and other physical characteristics as a regular football, so that the football performs identically to a regular football.
  • the remote unit 12 worn by an athlete 15 may include an accelerometer capable of monitoring accelerations in 3 dimensions.
  • the remote unit 12 may be positioned on the athlete's helmet, on a shoulder pad, directly on the athlete's body, etc.
  • the remote unit is preferably small so that it can be worn without hampering the athlete's performance.
  • the remote unit can further include speed and or position sensors that provide data regarding the athlete's speed and/or position.
  • the remote unit 12 can further include biometric sensors, such as sensors monitoring heart rate, blood pressure, blood oxygen content, etc.
  • biometric sensors such as sensors monitoring heart rate, blood pressure, blood oxygen content, etc.
  • the data from the remote unit is preferably provided in real time to a display.
  • the remote unit can be configured to transmit directly to the sideline, the fans, the internet, and/or a control room.
  • the raw data from the sensors may be processed by the remote unit 12 to form useful metrics, which are then transmitted to one or more system receivers 14.
  • the transmitted metric data may be transmitted wirelessly and/or in the form of streams of digital packets.
  • the system receiver 14 is preferably located within transmission range to receive and transmit data to and from all of the remote units.
  • the system receiver 14 provides the received metric data to a processor 16, such as a PC server.
  • Cameras 20a-20e are positioned about the football field 22 to provide realtime video images.
  • multiple cameras are provided to provide video from multiple perspectives.
  • the video from the cameras is sent to a control facility 24, such as a mobile truck-mounted studio, from which a program director can view multiple video feeds from the various cameras 20a-20e on one or more video feed display screens 26a- 26c.
  • the director can select the video feed desired for broadcast at a particular time.
  • the selected video feed is virtually instantly broadcast as a video signal to television viewers via a broadcast system 28, such as a satellite system, a cable system, and/or direct broadcast.
  • the video signal may include overlaid data, such as scoring, statistics, advertisements, etc. Such overlaid data may be performed prior to transmission from the control facility, using known methods.
  • the processor 16 can provide the director with additional overlaid information in the form of aesthetically useful and meaningful graphic displays and other visuals of selected metric data from the athletes and/or the athletic equipment, such as data on location, g-forces, pulse rates, etc of individual players. Such data may be presented to the director on one or more dedicated metric data displays 30a-30b. The director can thus select the desired metric data and display, and have that data converged in an overlay fashion with any of the video feeds received from the cameras 20a-20e. The resulting converged video is then transmitted to the viewing audience for viewing on their home televisions 32.
  • the receiver 14 and processor 16 are co-located at the control facility 24.
  • the receiver 14 and/or processor 16 could also function separately as third party equipment providing new enhanced content, including real-time metrics, to a broadcaster, re-broadcaster, or subscriber.
  • the selection of which metric data to overlay on the video seen by the end viewer may be made by the viewer.
  • Such viewer selection of metric data could be part of an interactive broadcast.
  • One or more of the cameras could be controlled by an operator physically pointing each camera.
  • One or more cameras could be controlled by remote control, such as by a person controlling the cameras from a control booth.
  • Another method could involve using the metric data received from the remote units to control, completely or partially, the pointing and/or focus of one or more cameras.
  • the pointing and/or focus of the camera 20 could be controlled by the processor 16 based on metric data received from one or more of the remote units 12. For example, if it was desired to follow the moves of a particular player, the processor 16 could use the movement-related data from that player to anticipate and track the movements of the player 15.
  • the metric data from that player's remote unit 12, which would received by the receiver 14 and provided to the processor 16, might indicate the acceleration or deceleration involved in the turn more rapidly than a human camera operator could detect the move.
  • the processor 16 could be configured to use the movement-related data, such as acceleration, from the remote unit 12 to predict the movements of the player 15, and then control the camera 20 to follow the predicted path of the player 15.
  • the processor's control of the camera 20 could be partial, with another operator, such as a human operator, having override capability.
  • the metric data could also be used to select which target, such as a particular player or piece of equipment, one or more particular cameras would track.
  • target such as a particular player or piece of equipment
  • the processor 16 might control one or more of the cameras 20 to point at and possibly zoom in on that particular player 15a.
  • the processor could control one or more cameras to point toward and possibly zoom in on the football.
  • processors could in fact be used. Each processor might handle different tasks from the others. For example, one processor could be dedicated to camera control, while another could be dedicated to presentation of metric data, etc.
  • Fig. 4 depicts a block diagram of a sub-system 34 of system 10 for facilitating internet broadcast of real-time metrics from remote units 12 in accordance with a further embodiment of the invention.
  • Subsystem 34 makes all or a portion of the metrics from each of the remote units 12 available for immediate access over the internet 36 by a home viewer sitting at a computer 38, a Internet-enhanced television 40, or other device capable of receiving and/or displaying data over the Internet.
  • the displays of such devices may be configured to converge data in order to simultaneously display real-time metric data from one or more of the remote units, as well as real-time video from the cameras.
  • metrics are transmitted by each remote unit 12 in an Internet-compatible format, such as TCP/IP format, so that such data is immediately accessible to and from processor 16 to the Internet 36 using conventional routing equipment such as gateway 42 and routers 44a-c.
  • an Internet-compatible format such as TCP/IP format
  • each remote unit acts as a stand-alone network device with an individual network address or URL (universal registration locator)
  • each remote unit will function as its own web site with real-time data available over the internet.
  • the processor 16 may serve as a web server, providing selected metric data from one or more of the remote units to home viewers over the Internet as web-page accessible content.
  • the processor 16 may itself function as its own web site, with its own individual network address or URL, providing compiled metrics on, for example, a dedicated web site.
  • the processor 16 may also forward compiled metric data to the broadcast network's internet server (e.g., ABC, CBS, NBC, CNN). Each of the servers could then make the metrics available on its dedicated web site.
  • the broadcast network's internet server e.g., ABC, CBS, NBC, CNN.
  • Enhanced content can also be made available to team members and staff, for example, the coach and/or team physician can view enhanced content made available on either on a dedicated system, such as a dedicated broadcast or internet-enable monitor, in real-time or in archival format for later playback and review.
  • a dedicated display could be provided that, based on various metrics such as player blood pressure and/or blood sugar levels, could be used in determining rotation of players, game plays, and other game planning.
  • FIG. 5 depicts a block diagram of a remote unit 12 in accordance with an embodiment of the invention.
  • the remote unit includes a power supply 46 (such as a battery), a biometric sensor 48, an accelerometer 50, a transceiver 52, a memory 54, and a data acquisition unit 56.
  • the remote unit 12 can be positioned on or in an individual target. For example, in a game such as football or hockey, individual players may each wear a remote unit. Such a remote unit may be positioned on or in the player's shoulder pad, helmet, knee pad, shoe, or anywhere on the athlete's body and/or apparel.
  • the biometric sensor 48 provides a biometric signal 49 on one or more biometric functions, and may actually consist of several different sensors collecting the various data.
  • the biometric data collected by such sensors may include blood pressure, heart rate, perspiration rate, body temperature, and/or blood chemistry such as blood sugar levels.
  • the accelerometer 50 provides an acceleration signal 51 on accelerations in three dimensions.
  • the accelerometer 50 may be a tri-axial accelerometer, such as a solid- state angular rate sensor sold by Systron Conner Parts under the name Gyro-Chip.
  • Other accelerometers that may used include quartz flexure accelerometers and MEM accelerometers.
  • Data from the accelerometer can be used to determine acceleration, speed, location, and impact of a target, such as of an athlete wearing the remote unit. For example, where a remote unit is worn by a football player, the accelerometer on the remote unit can provide data that can be used to determine the impact experienced by the player in a collision with another player or object.
  • GPS receiver might be used in place of, or in addition to, the accelerometer 50, depending on the particular application.
  • the data acquisition unit 56 may include a microprocessor, such as a 8051- type core microprocessor.
  • the processor may run a specific instruction set program engine that is stored therein or in the memory 54.
  • the data acquisition unit 56 collects the raw data from the biometric sensor(s) and accelerometer. This raw data is internally processed by the data acquisition unit 56 to generate appropriate metrics, which can be stored in the memory 54 and/or transmitted via the transceiver 52 to a remote location, such as the receiver 14 of Fig. 1.
  • the memory 54 may be in various forms, and may provide short-term, long-term, and/or permanent storage of data.
  • the instruction set, memory requirements, processing speed, firmware, communications, power levels, and other hardware and software design parameters are typically all inter-related and are selected on the basis of a particular application.
  • the transceiver 52 of the remote unit 12 transmits the biometric data and acceleration data to a receiver 14.
  • the data can be transmitted through various methods, including use of RF, infrared, laser, and other transmission methods.
  • the data may, for example, be transmitted as associated streams of digital packets derived from the respective raw sensor data.
  • the transmission link may be a wireless link employing conventional radio frequency (RF) wireless protocols, such as IEEE 802.11, at data rates that can exceed 9MB/sec.
  • RF radio frequency
  • any number of different transmission protocols and modulation methods might be suitable to transmit data from the remote unit 12 to the receiver 14.
  • the transceiver 52 itself may have embedded TCP/IP code, which is the established network protocol, thus allowing each remote unit 12 to be its own web page or URL.
  • TCP/IP code which is the established network protocol, thus allowing each remote unit 12 to be its own web page or URL.
  • all data from the remote unit 12, which is the data acquired from the target can be accessed in real-time over the Internet using the unique URL of the remote unit.
  • Such a remote unit could communicate directly with a network server, so that the wearer of the remote unit, such as an athlete, is in effect an individual web site.
  • the data can be archived in the memory 54 of the remote unit or in a memory located elsewhere, for later retrieval and/or processing.
  • the sensors themselves may be configured to provide biometric and/or other data in Internet compatible format.
  • the receiver 14 can provide the data to the central processor 16, which may provide all the data to the display 18a.
  • the central processor 16 may only provide limited data to each display.
  • the central processor may provide different types of data to different displays.
  • the central processor 16 of Fig. 1 may provide a first set of data to a first display 18a, with a second set of data provided to a second display 18b, a third set of data provided to a third display 18c, etc.
  • the display 18a may correspond to a specific group of displays, namely the television sets of home viewers, which may depict accelerations and other data along with camera views of the game.
  • the second display 18b may correspond to a monitor that is viewed only by the coach and/or team physician of one team, while the third display may be viewed only by the coach and or team physician of the other team.
  • the second and third displays 18b, 18c may depict biometric data that can be of use in determining rotation of players, game plays, and other game planning.
  • One or more of the displays 18a, 18b, 18c can show television images of the athletic event as provided by the cameras 20a, 20b.
  • the displays can also provide simultaneous displays of biometric and/or other data received from the remote units.
  • the remote unit may be equipped with one or more cameras that provide video images of the event from the athlete's perspective.
  • a remote unit mounted in or on a football player's helmet could provide continuous video images showing the football player's view of the event.
  • the remote unit may also include a microphone or similar sensor for providing audio signals.
  • the remote unit on the target may consist of an ASIC and or CMOS construction, and can be implemented in several integrated circuit, chip-size modular sections. Sensors, A/D convertor, processor, transceiver, and or antenna may all be located in a small (such as pager-size or smaller) package that transmits to one or more receivers. Anywhere from one to all of the elements of the remote unit may be integrally formed as part of a single integrated circuit chip. For example, an 8051 microprocessor could be built into an ASIC chip, with MEM sensors, a planar antenna, and a power source built into the substrate of the chip.
  • the power supply 46 consists of a small battery 58, such as a lithium watch-type battery, in combination with a capacitor 60 and a solar cell 62.
  • the capacitor 60 may be an ultracapacitor of the type sold by Maxwell Technologies, capable of collecting, storing, and releasing electrical energy for peak power requirements, such as may be required to power the transmitter of the remote unit.
  • the capacitor 60 stores energy for rapid discharge of "cache" power for peak power delivery requirements
  • the battery 58 provides general (i.e., lower) power delivery.
  • a solar cell 62 can charge both the battery 58 and the capacitor 60.
  • the solar cell 62 may charge the capacitor 60 first, with overflow charging provided to the battery 58 after the capacitor 60 is charged.
  • Use of the capacitor 60 for brief peak power requirements, in combination with a battery 58 for general power requirements, can significantly reduce the size of the power source 46 while still meeting peak power requirements.
  • the system may include a power-down sequence, for example, when the remote unit is not required to transmit information, or where it has lost contact with a system receiver/transmitter/controller, the remote unit may power down its own transmitter.
  • the remote unit can continue to collect data, storing the data in the remote unit's memory. Use of such a "store and forward" power conserving method can substantially reduce the power requirements of the remote unit.
  • the remote unit can also continue to receive data from the system transmitter. Because the sensor(s), memory, and receiver often use substantially less energy than a transmitter, the "store and forward" mode will typically draw much less energy than when the transmitter is operated.
  • the system may power up the transmitter at regular intervals to transmit its data.
  • the system may also power up the transmitter in response to a signal from the system transmitter, such as where a the signal from the system transmitter is received after a period of "dead-time," such as may occur when the remote unit is beyond the range of the system transmitter.
  • FIG. 7 is a flow chart depicting the operation of an embodiment of a remote unit.
  • sensors 48 and 50 collect raw data that is passed, at step 66, to the data acquisition unit 56.
  • the data acquisition unit digitizes the data and applies known heuristic and correlational algorithms to generate relevant biometric and/or movement related data in the form of streams of digital packets. These packets are appropriately formatted using selected protocols at step 70.
  • the formatted data from the remote unit is tagged (step 72) with a unique Internet protocol address or DNS Domain Name Server that serves to specifically identify the remote unit 12 to the receiver 14 and processor 16, as well as to all the nodes coupled to the Internet.
  • the transceiver encodes outbound associated data packets and transmits them to the receiver 14 using known methods.
  • Fig. 8 is a flow chart describing various alternate operation of processor 16 for enabling real-time presentation of metrics in the form of one or more appropriate visuals and graphics superimposed over a live television broadcast as depicted by Figs. 9 and 10.
  • a related real-time presentation of similar visuals and graphics in the form of a webcast sportscast is depicted in Fig. 11 and accomplished substantially independently from the control facility 24.
  • processor 16 decodes each set of inbound data packets from receiver 14 associated with the various remote units 12.
  • processor 16 manipulates the metrics to generate predetermined visuals/graphics as shown in Figs. 9-11, described further below in the particular embodiment of a football game sportscast.
  • the metric visuals/graphics are selectively superimposed over incoming live video feeds from one or more broadcast cameras 20.
  • processor 16 transmits a first set of selected data to a first set of displays, such as a monitor that is seen by the coach or team physician.
  • This first set of selected data may include biometric data the physical condition of players that the coach and/or physician may find useful, but that may not be desirable to publicly broadcast.
  • the processor transmits converged video and metric visuals to the control facility 24 for selection by a program director responsible for the sportscast.
  • the video and metrics are not shown to the program director in converged form, but are instead presented separately. This allows the program director to pick and choose the metric visuals to incorporate into the various video feeds that may be available.
  • the processor transmits and/or records selected metrics, alone or converged with video, for archival purposes.
  • selected metrics alone or converged with video
  • Such archived metrics and/or videos can be used for game replay and or for later playback.
  • Steps 92 to 98 describe possible alternate embodiments for using real-time metrics to further enhance the experience of a live sportscast by employing the Internet (i.e., webcasting of the game).
  • the processor digitizes a live video signal in Internet- compatible format. This permits the video to be broadcast over the Internet and viewed by a computer user using a computer-driven monitor or other display, which may involve the use of a streaming video software program such as Quicktime(TM).
  • TM Quicktime
  • Appropriate icons or user- selectable pull-down menus can be superimposed over the digitally encoded sportcast to make it possible for the computer user to individually and remotely select among various real-time visuals/graphics of actual player/team metrics and to have these displayed in a non- obtrusive manner over the real-time webcast of the game.
  • Figure 9 depicts an embodiment of a display of the invention, including a monitor screen 100.
  • the monitor 100 provides a television image 102 of the football game, which may be similar to standard television coverage of similar football games.
  • the monitor 100 includes in its lower right corner a graphical representation 104 of acceleration data from a remote unit attached to one of the players, namely "PLAYER 34" as indicated by reference 106.
  • a graphical representation 108 of the player's heart rate In the lower left corner is a graphical representation 108 of the player's heart rate.
  • a viewer can see football plays on the monitor, with simultaneous viewing of the player's heart rate graphics 108 and experienced g-forces 104 during the football play.
  • Fig. 9 depicts a graphical representation of the heart rate and acceleration data, other data, including combinations of data, could be presented.
  • presentations of data may be made in non-graphical form, such as in numeric form, or with a combination of numeric and graphical displays.
  • Fig. 9 depicts data from only one player, other embodiments could involve data from more players.
  • Fig. 10 depicts a monitor screen 100 providing a television image 102 of the football game, except that Fig. 10 depicts the acceleration (i.e., shock) graphs for all players on each team. The data is provided on bar graphs 110 corresponding to each player's number. In the embodiment depicted, the graphic data is overlaid onto the television image 102 along either side of the screen, in such a way as to minimize any potential for distraction from visual images of the game.
  • a remote unit may be provided on selected non-players, such as the team coach.
  • the heart rate of the team coach might be shown to home viewers at particularly exciting parts of the game.
  • data from multiple players can be combined to provide to group data.
  • the accelerations of all players on a team could be combined into a single value over the course of the game as an indication of "total energy" of the team.
  • the total energy could be determined as the energy expended at particular instant in time, or over a longer period, such as over a particular play or over the entire game.
  • Fig. 11 shows a display 100 according to an embodiment of the invention, as may be seen by a home viewer during a live televised football sportscast.
  • tachometer-like graphics 1 10, 112 of team energy, bar charts 114 of g-forces, sliding indicators 116 of player temperature, and other visuals and graphics 118 are overlaid on the live image 102 of the game to enhance the home viewer experience in a non-obtrusive, visually stimulating manner.
  • Separate, converged, or overlaid video/data/audio graphics, such as item 120, may also be used to promote a variety of products for generating advertising revenues for the networks in conjunction with the various displayed visuals.
  • Fig. 12 shows a display similar to Fig. 11 but in the context of a live webcast of a football game.
  • the monitor display 100 is a computer monitor.
  • Selection buttons/controls 122, 124 which may be overlaid on the monitor display 100 or similar display as indicated, provide for customization of the webcast by enabling the viewer to select specific visuals to be displayed, if any, as well as enabling/disabling of available audio features.
  • Displays such as those depicted in Figs. 9-12 might be modified so that, during play that is broadcast live, only the visual images of the game are provided.
  • the biometric and/or other data might be reserved for use only during instant replays.
  • Figs. 9-12 Although the above discussion with respect to Figs. 9-12 was directed to use in a football game, such a system could be applied to a variety of other applications, including sporting events such as hockey, baseball, soccer, boxing, cross-country races, etc.
  • the remote unit can include biometric sensors. Additionally, the remote unit can include one or more accelerometers and/or other movement sensors (e.g., speed, position, etc.).
  • the remote unit includes an accelerometer mounted in the boxer's glove. This accelerometer can provide real-time data regarding the acceleration/deceleration of the boxer's fists, so that the "g's" of a punch can be measured.
  • the remote unit may be mounted in the wrist area of the glove.
  • the accelerometer can be mounted on the boxer's head to determine head accelerations and/or movements during a boxing match.
  • the accelerometer may be sized to fit into a boxer's mouthpiece.
  • the accelerometer can be mounted in the headgear.
  • a first display for public use (such as provided to a TV network) can provide simultaneous images of the fight along with representations of the acceleration data of the boxer's fists and/or heads.
  • a second display may provide a second set of data, which may include the acceleration data as well as biometric data for selective display to the boxer's coach and/or physician. This second display may also include simultaneous images of the fight, so that the boxer's biometric and acceleration can be associated with particular events during the fight.
  • the invention could be used for cross-country activities, such as marathons, triathlons, biathlons, or cross-country bicycle races.
  • a remote unit can be provided that provides data on biometric functions, position, acceleration, and/or velocity.
  • the remote unit might monitor heart rate, blood pressure, and blood sugar levels of an athlete, while also monitoring the speed and distances involved. This information could be provided to the athlete and/or to a athlete monitoring the competitor's progress.
  • the remote unit includes a GPS receiver that determines the location of the athlete using GPS satellite data.
  • the remote unit can transmit and/or store the location data, thus providing a record of the competitor's movements throughout the activity.
  • the invention can be used as a tracking device to confirm that a competitor has actually completed the event without deviating from the set course. For example, by positioning receivers at selected locations along a marathon's course, the receivers can receive transmissions from a remote unit as the runner wearing the particular remote unit passes that location. If the remote unit and/or system is equipped to determine locations of the remote units, such as be inclusion of a GPS receiver in the remote unit, the position data can be used to confirm that the competitor followed the set course.
  • the invention has application not just to athletes but also for use by any individuals, such as patient under a doctor's care, who require monitoring of various conditions and/or movements.
  • a person can wear a remote unit configured to monitor biometric performance data, such as blood pressure, body temperature, and ECG.
  • the remote unit may store the biometric data in a memory for downloading to a system receiver at a later time, such as at the end of a day.
  • the remote unit may alternatively provide a continuous stream of data in real-time to the system receiver.
  • the system receiver can provide the data to a personal computer, television, or other system for displaying and/or recording of the data.
  • the user or another individual can retrieve the data acquired by the remote unit over a period of time.
  • the data could be used, possibly along with data from other individuals, for trend analysis and chrono-biological studies.
  • the data can be made available on a web site. Such an application could also be useful for prenatal and infant monitoring.

Abstract

A system, method, and apparatus for monitoring and/or displaying characteristics of a target such as an athlete (15a-15d) . A remote unit (12a-12d) is provided which is worn on a remote target's body or embedded in moving or standing objects. Each remote unit includes a data acquisition circuit (56) and one or more internal sensors integrally formed on a self-contained application specific integrated circuit, or integrated circuit chipset. The system provides enhanced viewing capabilities by combining video images with collected data regarding the target.

Description

SYSTEM, APPARATUS, AND METHOD FOR TELEMETRY AND MONITORING OF
DESIRED TARGETS
CROSS-REFERENCE TO RELATED APPLICATIONS
The present application claims priority from provisionally-filed U.S. Patent Application No. 60/145,621, filed July 26, 1999, entitled "System, Apparatus, And Method For Telemetry And Monitoring of Desired Targets."
BACKGROUND OF THE INVENTION
The invention generally relates to an apparatus and method for monitoring desired targets. More specifically, the invention involves collecting, transmitting, and or displaying data and/or images of one or more targets.
Various methods for displaying and monitoring desired subjects, such as athletes involved in competition, are known. For example, television broadcasts provide images and other information about athletes and competitions. Visual images of the subjects alone do not, however, always provide all the information a viewer or other user may desire or require. For example, a team coach or physician may not easily be able to determine the physical condition of an athlete during the competition merely by viewing the athlete from a distance. Additionally, a viewer of the athletic competition may desire more detailed information, such as acceleration data, that may not be readily apparent from visual images of the athletes.
What has been needed and heretofore unavailable is an improved method and apparatus for monitoring and displaying characteristics of various targets. The present invention satisfies this need.
SUMMARY OF THE INVENTION:
The invention is a system, apparatus, and method for monitoring characteristics of a desired target. The desired target can be a person, animal, plant, or inanimate object. More specifically, the invention is a system, apparatus, and method for collecting, transmitting, and/or displaying data and/or images of one or more desired targets.
Note that the term "target" is used to reference the person, animal, plant, or inanimate object that is being monitored by the invention. The invention may be used to monitor individuals involved in various activities, or who require medical monitoring. The invention may also be used to monitor devices, including athletic equipment such as baseball bats and footballs, that are subject to movements.
The remote unit may be a telemetry transceiver device capable of sensing, acquiring, processing, transmitting, receiving, recording, and/or displaying real-time physiological and other performance data from the target to one or more receiving sites capable of receiving the transmitted signal. The receiving site may include a receiver for receiving the data and a processor for processing the data. A display may also be provided, which may be part of the receiving site.
The telemetry signals can be sent from multiple targets to one or more receivers wirelessly, and from the receiver can be forwarded in real-time to a personal computer or other processor, and then on to other media such as the Internet and/or television broadcasts. The transceivers themselves may have embedded TCP/IP code, thus allowing each target to be its own web page or URL. Operationally, all data from a target can be accessed in real-time over the Internet by the unique URL. the individual web page of each target and its associated data can be accessed by a web server via the Internet and viewed by multiple users at the same time.
The remote unit on the target may consist of an ASIC, FPGA, CMOS IC, and/or can be implemented in several integrated circuit, chip-size modular sections. Sensors, A/D convertor, processor, transceiver, and/or antenna may be located in a small (such as pager-size or smaller) package that transmits to one or more receivers. The Data Acquisition (DAQ) section would monitor and measure functions of the target, for example, if the target were an athlete, the DAQ section would monitor and measure functions such as ECG, heart rate, breathing rate, blood pressure, positive and negative acceleration, positive and negative G's, and vibration. Various sensors could be used, including analog and/or digital, as well as MEMS type. The sensors may all be non-invasive, depending on the particular application.
The receiving site recovers data from one or more remote units in the field. The receiving site can send the data to a computer where the data is sent to the Internet of to some other media where it can be broadcast to viewers, or accessed upon demand for viewers. In addition, multiple receivers can be used to provide wireless, headset viewer access to the live video, audio, and/or data information that is being transmitted from the target. The invention may include a real-time data acquisition system that is capable of sensing, acquiring, processing, transmitting, receiving, recording, and/or displaying remote analog, digital, and/or serial data in real-time wirelessly to the Internet. The design allows dat from a sensor to be immediately transmitted wirelessly to the Internet where data can be displayed and/or accessed by multiple users. The system may operate on the Ethernet standard and incorporate two distinct sections: The Data acquisition and processing section and the transceiver section (such as an RF transmitter/receiver). Both sections may have embedded TCP/IP network capable protocols. The system can thus allow for command, control, and communication in real-time, wirelessly, to and from remote units and to and from the network and/or the Internet.
One embodiment of the invention comprises a remote unit to be worn on a target. The remote unit is capable of sensing, acquiring, processing, transmitting, receiving, recording, and/or displaying real-time data, such as physiological and other performance data, from the target to a receiver capable of receiving the transmitted signal. The remote unit may consist of a data acquisition circuit, a communication circuit (such as an RF circuit), and one or more sensors. The elements of the remote unit may be integrally formed on a self- contained application-specific integrated circuit (ASIC) chip and/or can be implemented in several CMOS integrated circuits, chip-size modular sections. Sensors, A/D converter, processor, transceiver, memory, and/or antenna can all be located in a small (such as pager- size) package that transmits to a receiver. One or more, or even all, of the elements of the remote unit, such as the sensor(s) and/or antenna, may be embedded in a substrate, such as the substrate of a chip that forms the remote unit. The antenna may be a planar antenna or traced onto the substrate with copper or graphite such that it is integral with the chip set.
Where the target is an athlete, the remote unit can be worn by the athlete, either directly on the athlete's body, or on or inside of a piece of apparel, such as a helmet, wristband, shoe, or other padding. The remote unit can include one or more sensors for gathering biometric data about the athlete's physiological condition, such as ECG data, blood pressure, heart rate, perspiration rate, and body temperature. Other biometric data may include chemical analysis of perspiration and/or blood, such as monitoring of blood sugar levels and other blood chemistry monitoring.
The remote unit may also include sensors for gathering data regarding the acceleration, speed, vibration, movement, and/or location of the target. In one embodiment, the remote unit includes an accelerometer that determines accelerations of the target in one or more directions. In one embodiment, the accelerometer can determine accelerations in 3 axes. The acceleration data can be in the form of "g-forces" or other units as desired for a particular application.
In one embodiment, the accelerometer is a tri-axial accelerometer, such as a solid-state angular rate sensor sold by Systron Dormer Parts under the name Gyro-Chip(TM). Another device that might be applied to the invention is a quartz flexure accelerometer sold by the same company. One or more of the sensors may be MEMS (micro-electromechanical systems) sensors, which may be configured to be integrated into a single chip that forms the remote unit. Such integration could be in the form of building the MEMS sensor or sensors, such as a MEM accelerometer, into the substrate of the actual chip.
The sensors could be of various types, including analog, digital, MEMS, and/or other sensors. The sensors may all be non-invasive, particularly where the target is a human.
The remote unit may include a transmitter that transmits the biometric and/or other data from the remote unit to a receiving site, which may include as a processor that receives the data and provides the data in a desired format to a display. The remote unit may also include a receiver for receiving transmissions from various sources. The remote unit may include a combined transmitter and receiver, known as a transceiver, that receives and transmits data.
In one embodiment, the biometric and/or other data is transmitted from the remote unit in an Internet-compatible format, such as so-called TCP/IP format, so that the data is immediately accessible through internet protocols. The remote unit may be equipped with a transceiver (receiver and transmitter) so that it can transmit and receive data in Internet-compatible format. Each remote unit may act as a stand alone network device, with an individual network address for each remote unit that can be accessed by Internet users.
In another embodiment, the sensors themselves are configured to provide the biometric and or other data in Internet compatible format. In an embodiment, the remote unit includes a memory for storing the sensor data. The memory may be in various forms, and may provide short-term, long-term, and/or permanent storage of data.
In one embodiment, the remote unit includes a GPS receiver for receiving GPS position data from GPS satellites. The remote unit can store the GPS data, and/or transmit the GPS data to another location, such as a network address or a desired display.
In one embodiment, the remote unit is part of a system that includes one or more remote units on one or more targets, one or more receivers for receiving data from the remote units, one or more processors for processing the data, and one or more displays for selectively displaying images of the targets on the screen, simultaneously with representations of the biometric and/or other data collected from the remote units attached to the targets. The representations of the biometric and/or other data may be in various forms, such as graphical and/or numerical representations of the data.
In applications such as athletic competitions, multiple remote units and personal display units could be used in sports stadiums to provide viewer access to the live video, audio, and/or data information that is being transmitted from the athletes. The link to the personal display units could be wireless, via a local computer server, and/or via a direct connection, or the display units could be located in the seat-backs and data could be accessed by the stadium fan. The personal display units could be rented out to spectators for a fee at a game. The personal display units could be adapted to provide a televised or similar sportscast of the game for an up-close experience. In an embodiment, dedicated cameras situated around the arena can be used to collect video/audio to a processor linked to the personal display units. Each personal display unit may be thin client-type computing device with a video monitor or other visual display. The system could provide real-time telemetry data from the athletes to the personal display unit, with the wearer selecting the particular telemetry data and athletes desired for viewing. The system could also provide non-real time data about the athletic competitions and/or athletes, such as athlete statistics that may be provided to a viewer, with the viewer selecting the type of data desired for display. A spectator could select the video/audio from any of the available cameras for viewing along with real-time telemetry data from several of the athletes on the field, rink, or other playing area.
The remote unit may include a power source. The power source may include a battery, solar array, capacitor, and/or other source for providing power to the remote unit. Other power sources that might be used include sources that derive power from the target, such as an athlete. For example, heat and/or perspiration by the athlete could be used as a power source, as well as movement of the athlete (which can be harnessed through means such as the winding mechanism for a so-called "self-winding" watch). Such alternative power sources may have particular applicability for remote units that use relatively small amounts of power.
The system of the invention may include a system memory for storing the data transmitted by and/or received from the remote units. Such a system memory can be in lieu of, or in addition to, the previously-discussed memory positioned on or in the remote sensor. The system may also include a system processor, apart from or in place of any processor on the remote units, that processes the data from the remote units.
The system of the invention can include one or more remote units providing data from one or more targets. If multiple targets are involved, the remote units each preferably provide the data with a format or frequency or other differentiating characteristic that permits data from a particular target to be recognized as coming from the remote unit on that target.
The system of the invention can include one or more cameras to provide images of the target and/or of the target's environment. The camera may be positioned on the target and may form a part of the remote unit. The camera may be positioned at a distance from the target, in order to provide a desired image of the target in the particular environment. For example, in a football game, remote units can be attached to various players, and one or more cameras may be positioned so as to provide a view of the football teams' members on the playing field during and between various football plays. The camera(s) can provide images to the display for simultaneous presentation with the biometric and or other data from the remote unit. The data and image from the camera(s) are preferably correlated, so that the data displayed correlates to the action of the target. For example, g- forces experienced by a football player could be displayed in real-time in a windows (picture- in-picture) format positioned in a corner of a larger view showing the movements of the player.
A camera could also be positioned on or in an inanimate object, such as a camera positioned inside and looking out of an end of a football. Note that such cameras may provide unsteady images, particularly where the target is moving. The system may provide for image stabilization that compensates for such movements. For example, a camera looking out of a football would, during a spiral pass, provide a rotating and probably wobbling image. The system could, through various techniques such as the use of software, provide a stablized image to the display that compensates for the rotation and other wobbling movement.
The system of the invention may also include one or more microphones that provide audio data. The microphones may be positioned on or near the target, and may be part of the remote unit.
The system may include one or more displays, with different data provided to different displays. For example, biometric data may be provided to one screen for private viewing by an athlete's physician or coach, while data regarding speed, position, and/or acceleration can be provided to a second set of displays intended for public viewing.
The displays of the invention can, in one embodiment, provide viewing of an athletic event with simultaneous viewing of biometric and/or other data about one or more athletes in the event. In one embodiment, the biometric and/or other data is provided on the same screen as the actual viewing of the athletic event. The biometric and/or other data may be provided in a format and manner that enhances, preferably without detracting from, the viewing of the athletic event itself.
The displays may be part of a personal computer, television set, or other display. The data can be sent to the display through various methods, including the Internet, World Wide Web, the Internet via an Application Service Provider software program residing either on a client web-site or our own enabled with a browser specific health related "my health" box located on the browser menu bar, on cable television systems, broadcast systems, satellite transmission, and/or phone lines.
The invention can be applied to various applications where data, such as location, movement, or biomedical information, is desired from a target. For example, the invention could be applied to a wide variety of sports and recreational activities, including professional and amateur sports. The invention could also be used in military and civil applications to train and monitor personnel. For example, soldiers, pilots, firefighters, police, and hazardous materials specialists could use the invention to enhance their effectiveness, in both training and real-life situations. The invention could also be applied to entertainment venues. Television game shows could make use of the invention, where, for example, a contestant was equipped with remote unit providing heart rate data that can be shown to a viewing audience to indicate the contestant's heart rate during the contest. The invention may also be used to monitor individuals who require medical monitoring, such as individuals in medical care facilities, nursing homes, or who require home care and monitoring, and passengers in automobiles, airplanes, and boats or ships. The invention could additionally be used to monitor persons whose movements are desired to be restricted, such as individuals who imprisoned or under house arrest.
The invention could also be applied to non-human targets, such as for use in monitoring livestock, commercial packages, etc. For example, remote units could be used to monitor the condition and/or movements of various farm and ranch animals, including cows, pigs, and chickens. A rancher could use the invention to monitor the condition and/or movements of many individual animals, with the data maintained in a detailed database on a central computer that correlates condition and or movements with time. The invention could have particular application in monitoring animals, such as cows and horses, that may range over a large field or other area. The invention could also be applied to free or wild animals, such as deer or fish. The invention could also be applied to monitoring the condition and/or movements of plants and inanimate objects.
The invention thus allows for simultaneous access to target information, in real-time and/or archival formats, that cen be easily integrated and customized according to the needs of the particular broadcast venue.
The data from a particular target can be stored to archived files as a portfolio for the particular target. For example, for athletic competitions, the data for a particular athlete can be archived as player statistics. The data for such statistics could cover a single game, a season, or a career of the particular athlete. Data from various targets, such as various players, could be cross-referenced and compared with such archived files.
BRIEF DESCRIPTION OF THE DRAWINGS
FIGURE 1 shows an overview of a block diagram showing a system according to an embodiment of the current invention;
FIG. 2 depicts a block diagram of a system in accordance with a further embodiment of the invention;
FIG. 3a and 3b depict block diagrams of a camera control system in accordance with an embodiment of the invention.
FIG. 4 depicts an overview of a system according to an embodiment of the invention;
FIG. 5 depicts a block diagram of a remote unit in accordance with an embodiment of the invention;
FIG. 6 depicts a block diagram of a power supply in accordance with an embodiment of the invention;
FIG. 7 is a flowchart depicting the operation of aspects of a remote unit according to an embodiment of the invention;
FIG. 8 is a flowchart depicting the operation of aspects of a processor according to an embodiment of the invention;
FIG. 9 depicts a display in accordance with an embodiment of the invention; FIG. 10 depicts a display in accordance with a further embodiment of the invention;
FIG. 1 1 depicts a display in accordance with another embodiment of the invention; FIG. 12 depicts a display in accordance with an embodiment of the invention;
DETAILED DESCRIPTION OF THE INVENTION
Figure 1 depicts a box diagram of a system according to an embodiment of the invention. The system 10 depicted includes a plurality of remote units 12a-12d associated with individual targets 15a-15d. The remote units 12 transmit data to a receiver 14 that provides the data to a processor 16, such as a PC server, that in turn provides the data to displays 18a, 18b, 18c. The system may also include one or more cameras 20a, 20b, such as television cameras, that provide real-time images of the particular event. The event may be, for example, an athletic competition wherein remote units are secured to the athletes and/or the athletic equipment (e.g., a ball). The cameras 20a, 20b may provide the real-time images directly to the displays 18a, 18b, 18c, and or may provide the real-time images to the processor 16 so that the processor can merge the real-time images with the desired biometric/other data for presentation on the displays 18a, 18b, 18c.
The processor 16 may be locally controlled, such as by a person in actual attendance at a sporting event providing input to the processor 16 through a keyboard 17 or other input device. The central processor 16 may actually consist of several different processors, with each processor accessing different data from the remote units 12.
Note that display 18a is representative of a set of one or more monitors that depict a specific set of data and images. In fact there could be multiple displays 18a showing the same data and images, such as is the case where a television network provides coverage of a sporting event to multiple home viewers. The same is true for displays 18b and 18c, with displays 18a showing data and images different from that of displays 18b or 18c.
The system may be configured to selectively provide different data to different displays. For example, the biometric data can be provided to one display, with the acceleration data provided to a different display. Various approaches can be used to accomplish this. A system processor can be used that receives all the data from the remote units and selectively provides the different data to different displays. In another approach, the different data may be transmitted from the remote unit at different frequencies and/or in different formats (such as coded formats), so that a particular display is only provided with data from a select set of frequencies and/or formats. Using such approaches, the system can provide a first set of data, such as acceleration and/or speed data, to a first set of displays (such as a television network) that can be viewed by a first group of people (such as the viewing audience of an athletic competition), while the biometric data may be provided to a second set of one or more displays that can only be viewed by a second group of people, such as the coach, team physician, and/or other team personnel. The second group of people may be separate from, or be a subpart of, the first group.
The processor 16, which may actually be several processors, may be configured to analyze and/or modify the data received from the remote units 12. For example, the processor 16 may be configured to, using the acceleration data, calculate the resulting speeds and/or positions of the target, such as an athlete, in real time.
Fig. 2 depicts a system 10 according in accordance with an embodiment of the invention configured for use in an athletic competition, in this embodiment a football game, for broadcasting of real-time metrics from football players. The metrics can include biometric data and or movement-related information, such as accelerations, etc. The system 10 includes remote units 12 which can be worn by one or more players 15. The sensors of each remote unit 12 provide data on an associated football player 15.
Athletic equipment, such as a football, may also be equipped with a special remote unit positioned inside to provide movement data, and possibly video images, from the equipment. In the football example, the football's remote unit would preferably be configured with the football so as to ensure that the football has the same weight, balance, and other physical characteristics as a regular football, so that the football performs identically to a regular football.
The remote unit 12 worn by an athlete 15 may include an accelerometer capable of monitoring accelerations in 3 dimensions. The remote unit 12 may be positioned on the athlete's helmet, on a shoulder pad, directly on the athlete's body, etc. The remote unit is preferably small so that it can be worn without hampering the athlete's performance. The remote unit can further include speed and or position sensors that provide data regarding the athlete's speed and/or position.
The remote unit 12 can further include biometric sensors, such as sensors monitoring heart rate, blood pressure, blood oxygen content, etc. The data from the remote unit is preferably provided in real time to a display. In various embodiments of the invention, the remote unit can be configured to transmit directly to the sideline, the fans, the internet, and/or a control room.
The raw data from the sensors may be processed by the remote unit 12 to form useful metrics, which are then transmitted to one or more system receivers 14. The transmitted metric data may be transmitted wirelessly and/or in the form of streams of digital packets. The system receiver 14 is preferably located within transmission range to receive and transmit data to and from all of the remote units. The system receiver 14 provides the received metric data to a processor 16, such as a PC server.
Cameras 20a-20e are positioned about the football field 22 to provide realtime video images. In the embodiment depicted, multiple cameras are provided to provide video from multiple perspectives. The video from the cameras is sent to a control facility 24, such as a mobile truck-mounted studio, from which a program director can view multiple video feeds from the various cameras 20a-20e on one or more video feed display screens 26a- 26c. The director can select the video feed desired for broadcast at a particular time. The selected video feed is virtually instantly broadcast as a video signal to television viewers via a broadcast system 28, such as a satellite system, a cable system, and/or direct broadcast.
The video signal may include overlaid data, such as scoring, statistics, advertisements, etc. Such overlaid data may be performed prior to transmission from the control facility, using known methods. With the current invention, the processor 16 can provide the director with additional overlaid information in the form of aesthetically useful and meaningful graphic displays and other visuals of selected metric data from the athletes and/or the athletic equipment, such as data on location, g-forces, pulse rates, etc of individual players. Such data may be presented to the director on one or more dedicated metric data displays 30a-30b. The director can thus select the desired metric data and display, and have that data converged in an overlay fashion with any of the video feeds received from the cameras 20a-20e. The resulting converged video is then transmitted to the viewing audience for viewing on their home televisions 32.
In the embodiment of Fig. 2, the receiver 14 and processor 16 are co-located at the control facility 24. The receiver 14 and/or processor 16 could also function separately as third party equipment providing new enhanced content, including real-time metrics, to a broadcaster, re-broadcaster, or subscriber.
The selection of which metric data to overlay on the video seen by the end viewer may be made by the viewer. Such viewer selection of metric data could be part of an interactive broadcast.
One or more of the cameras could be controlled by an operator physically pointing each camera. One or more cameras could be controlled by remote control, such as by a person controlling the cameras from a control booth. Another method could involve using the metric data received from the remote units to control, completely or partially, the pointing and/or focus of one or more cameras. As depicted in the block diagram of Fig. 3a, the pointing and/or focus of the camera 20 could be controlled by the processor 16 based on metric data received from one or more of the remote units 12. For example, if it was desired to follow the moves of a particular player, the processor 16 could use the movement-related data from that player to anticipate and track the movements of the player 15. If a player 15 made a sudden tum, the metric data from that player's remote unit 12, which would received by the receiver 14 and provided to the processor 16, might indicate the acceleration or deceleration involved in the turn more rapidly than a human camera operator could detect the move. Moreover, even when an operator visually detected the movement, there is typically a delay in the pointing of the camera to follow the movement of the player. In the embodiment depicted in Fig. 3a, the processor 16 could be configured to use the movement-related data, such as acceleration, from the remote unit 12 to predict the movements of the player 15, and then control the camera 20 to follow the predicted path of the player 15. The processor's control of the camera 20 could be partial, with another operator, such as a human operator, having override capability.
The metric data could also be used to select which target, such as a particular player or piece of equipment, one or more particular cameras would track. For example, as depicted in the block diagram of Fig. 3b, if the metric data received from the remote units 12a-12c indicated that a particular player 15a had been subjected to a substantial g-force, such as may be received during a blocking maneuver [Joe — I need the proper football term here], the processor 16 might control one or more of the cameras 20 to point at and possibly zoom in on that particular player 15a. Similarly, if metric data received from a remote unit on a football (where the football was so equipped) indicated a sudden unexpected acceleration deceleration of the football, such as may be associated with a fumble, the processor could control one or more cameras to point toward and possibly zoom in on the football.
Although the system depicted includes a single processor, multiple processors could in fact be used. Each processor might handle different tasks from the others. For example, one processor could be dedicated to camera control, while another could be dedicated to presentation of metric data, etc.
Fig. 4 depicts a block diagram of a sub-system 34 of system 10 for facilitating internet broadcast of real-time metrics from remote units 12 in accordance with a further embodiment of the invention. Subsystem 34 makes all or a portion of the metrics from each of the remote units 12 available for immediate access over the internet 36 by a home viewer sitting at a computer 38, a Internet-enhanced television 40, or other device capable of receiving and/or displaying data over the Internet. The displays of such devices may be configured to converge data in order to simultaneously display real-time metric data from one or more of the remote units, as well as real-time video from the cameras.
In the embodiment of Fig. 4, metrics are transmitted by each remote unit 12 in an Internet-compatible format, such as TCP/IP format, so that such data is immediately accessible to and from processor 16 to the Internet 36 using conventional routing equipment such as gateway 42 and routers 44a-c.
Where each remote unit acts as a stand-alone network device with an individual network address or URL (universal registration locator), each remote unit will function as its own web site with real-time data available over the internet. In such an embodiment, the processor 16 may serve as a web server, providing selected metric data from one or more of the remote units to home viewers over the Internet as web-page accessible content.
The processor 16 may itself function as its own web site, with its own individual network address or URL, providing compiled metrics on, for example, a dedicated web site. The processor 16 may also forward compiled metric data to the broadcast network's internet server (e.g., ABC, CBS, NBC, CNN). Each of the servers could then make the metrics available on its dedicated web site.
Enhanced content can also be made available to team members and staff, for example, the coach and/or team physician can view enhanced content made available on either on a dedicated system, such as a dedicated broadcast or internet-enable monitor, in real-time or in archival format for later playback and review. A dedicated display could be provided that, based on various metrics such as player blood pressure and/or blood sugar levels, could be used in determining rotation of players, game plays, and other game planning.
Figure 5 depicts a block diagram of a remote unit 12 in accordance with an embodiment of the invention. The remote unit includes a power supply 46 (such as a battery), a biometric sensor 48, an accelerometer 50, a transceiver 52, a memory 54, and a data acquisition unit 56.
The remote unit 12 can be positioned on or in an individual target. For example, in a game such as football or hockey, individual players may each wear a remote unit. Such a remote unit may be positioned on or in the player's shoulder pad, helmet, knee pad, shoe, or anywhere on the athlete's body and/or apparel.
The biometric sensor 48 provides a biometric signal 49 on one or more biometric functions, and may actually consist of several different sensors collecting the various data. The biometric data collected by such sensors may include blood pressure, heart rate, perspiration rate, body temperature, and/or blood chemistry such as blood sugar levels.
The accelerometer 50 provides an acceleration signal 51 on accelerations in three dimensions. The accelerometer 50 may be a tri-axial accelerometer, such as a solid- state angular rate sensor sold by Systron Conner Parts under the name Gyro-Chip. Other accelerometers that may used include quartz flexure accelerometers and MEM accelerometers.
Data from the accelerometer can be used to determine acceleration, speed, location, and impact of a target, such as of an athlete wearing the remote unit. For example, where a remote unit is worn by a football player, the accelerometer on the remote unit can provide data that can be used to determine the impact experienced by the player in a collision with another player or object.
Note that other sensors are also within the scope of the invention. For example, a GPS receiver might be used in place of, or in addition to, the accelerometer 50, depending on the particular application.
The data acquisition unit 56 may include a microprocessor, such as a 8051- type core microprocessor. The processor may run a specific instruction set program engine that is stored therein or in the memory 54. The data acquisition unit 56 collects the raw data from the biometric sensor(s) and accelerometer. This raw data is internally processed by the data acquisition unit 56 to generate appropriate metrics, which can be stored in the memory 54 and/or transmitted via the transceiver 52 to a remote location, such as the receiver 14 of Fig. 1. The memory 54 may be in various forms, and may provide short-term, long-term, and/or permanent storage of data.
The instruction set, memory requirements, processing speed, firmware, communications, power levels, and other hardware and software design parameters are typically all inter-related and are selected on the basis of a particular application.
If the remote unit of Fig. 5 were incorporated into a system such as that depicted in Fig. 1, the transceiver 52 of the remote unit 12 transmits the biometric data and acceleration data to a receiver 14. The data can be transmitted through various methods, including use of RF, infrared, laser, and other transmission methods. The data may, for example, be transmitted as associated streams of digital packets derived from the respective raw sensor data. The transmission link may be a wireless link employing conventional radio frequency (RF) wireless protocols, such as IEEE 802.11, at data rates that can exceed 9MB/sec. Depending on the requirements for a particular application, including any governing regulations, any number of different transmission protocols and modulation methods might be suitable to transmit data from the remote unit 12 to the receiver 14.
The transceiver 52 itself may have embedded TCP/IP code, which is the established network protocol, thus allowing each remote unit 12 to be its own web page or URL. Operationally, all data from the remote unit 12, which is the data acquired from the target, can be accessed in real-time over the Internet using the unique URL of the remote unit. Such a remote unit could communicate directly with a network server, so that the wearer of the remote unit, such as an athlete, is in effect an individual web site. The data can be archived in the memory 54 of the remote unit or in a memory located elsewhere, for later retrieval and/or processing. The sensors themselves may be configured to provide biometric and/or other data in Internet compatible format.
If the remote unit 12 of Fig. 5 is used as a part of a system 10 such as that depicted in Fig. 1 or Fig. 2, the receiver 14 can provide the data to the central processor 16, which may provide all the data to the display 18a. Alternatively, the central processor 16 may only provide limited data to each display. The central processor may provide different types of data to different displays. For example, the central processor 16 of Fig. 1 may provide a first set of data to a first display 18a, with a second set of data provided to a second display 18b, a third set of data provided to a third display 18c, etc. For example, in a football game, the display 18a may correspond to a specific group of displays, namely the television sets of home viewers, which may depict accelerations and other data along with camera views of the game. The second display 18b may correspond to a monitor that is viewed only by the coach and/or team physician of one team, while the third display may be viewed only by the coach and or team physician of the other team. The second and third displays 18b, 18c may depict biometric data that can be of use in determining rotation of players, game plays, and other game planning.
One or more of the displays 18a, 18b, 18c can show television images of the athletic event as provided by the cameras 20a, 20b. The displays can also provide simultaneous displays of biometric and/or other data received from the remote units.
The remote unit may be equipped with one or more cameras that provide video images of the event from the athlete's perspective. For example, a remote unit mounted in or on a football player's helmet could provide continuous video images showing the football player's view of the event. The remote unit may also include a microphone or similar sensor for providing audio signals.
Due to size and weight constraints, especially where the remote unit 12 is to be worn by a person, it may be desirable to keep the remote unit as small as possible while still maintaining proper performance. The remote unit on the target may consist of an ASIC and or CMOS construction, and can be implemented in several integrated circuit, chip-size modular sections. Sensors, A/D convertor, processor, transceiver, and or antenna may all be located in a small (such as pager-size or smaller) package that transmits to one or more receivers. Anywhere from one to all of the elements of the remote unit may be integrally formed as part of a single integrated circuit chip. For example, an 8051 microprocessor could be built into an ASIC chip, with MEM sensors, a planar antenna, and a power source built into the substrate of the chip.
One of the more sizeable elements, depending on the power requirements, can be the power supply. In one embodiment of the invention, depicted in Fig. 6, the power supply 46 consists of a small battery 58, such as a lithium watch-type battery, in combination with a capacitor 60 and a solar cell 62. The capacitor 60 may be an ultracapacitor of the type sold by Maxwell Technologies, capable of collecting, storing, and releasing electrical energy for peak power requirements, such as may be required to power the transmitter of the remote unit. Thus, the capacitor 60 stores energy for rapid discharge of "cache" power for peak power delivery requirements, whereas the battery 58 provides general (i.e., lower) power delivery. A solar cell 62 can charge both the battery 58 and the capacitor 60. The solar cell 62 may charge the capacitor 60 first, with overflow charging provided to the battery 58 after the capacitor 60 is charged. Use of the capacitor 60 for brief peak power requirements, in combination with a battery 58 for general power requirements, can significantly reduce the size of the power source 46 while still meeting peak power requirements.
In order to save power, the system may include a power-down sequence, for example, when the remote unit is not required to transmit information, or where it has lost contact with a system receiver/transmitter/controller, the remote unit may power down its own transmitter. The remote unit can continue to collect data, storing the data in the remote unit's memory. Use of such a "store and forward" power conserving method can substantially reduce the power requirements of the remote unit. The remote unit can also continue to receive data from the system transmitter. Because the sensor(s), memory, and receiver often use substantially less energy than a transmitter, the "store and forward" mode will typically draw much less energy than when the transmitter is operated. The system may power up the transmitter at regular intervals to transmit its data. The system may also power up the transmitter in response to a signal from the system transmitter, such as where a the signal from the system transmitter is received after a period of "dead-time," such as may occur when the remote unit is beyond the range of the system transmitter.
FIG. 7 is a flow chart depicting the operation of an embodiment of a remote unit. At step 64, sensors 48 and 50 collect raw data that is passed, at step 66, to the data acquisition unit 56. At step 68, the data acquisition unit digitizes the data and applies known heuristic and correlational algorithms to generate relevant biometric and/or movement related data in the form of streams of digital packets. These packets are appropriately formatted using selected protocols at step 70.
In one embodiment, the formatted data from the remote unit is tagged (step 72) with a unique Internet protocol address or DNS Domain Name Server that serves to specifically identify the remote unit 12 to the receiver 14 and processor 16, as well as to all the nodes coupled to the Internet. At step 74, the transceiver encodes outbound associated data packets and transmits them to the receiver 14 using known methods.
Fig. 8 is a flow chart describing various alternate operation of processor 16 for enabling real-time presentation of metrics in the form of one or more appropriate visuals and graphics superimposed over a live television broadcast as depicted by Figs. 9 and 10. A related real-time presentation of similar visuals and graphics in the form of a webcast sportscast is depicted in Fig. 11 and accomplished substantially independently from the control facility 24.
At step 80, processor 16 decodes each set of inbound data packets from receiver 14 associated with the various remote units 12. At step 82, processor 16 manipulates the metrics to generate predetermined visuals/graphics as shown in Figs. 9-11, described further below in the particular embodiment of a football game sportscast. At step 84, the metric visuals/graphics are selectively superimposed over incoming live video feeds from one or more broadcast cameras 20.
At step 88, processor 16 transmits a first set of selected data to a first set of displays, such as a monitor that is seen by the coach or team physician. This first set of selected data may include biometric data the physical condition of players that the coach and/or physician may find useful, but that may not be desirable to publicly broadcast.
At step 90, the processor transmits converged video and metric visuals to the control facility 24 for selection by a program director responsible for the sportscast. In some applications, the video and metrics are not shown to the program director in converged form, but are instead presented separately. This allows the program director to pick and choose the metric visuals to incorporate into the various video feeds that may be available.
At step 90, the processor transmits and/or records selected metrics, alone or converged with video, for archival purposes. Such archived metrics and/or videos can be used for game replay and or for later playback.
Steps 92 to 98 describe possible alternate embodiments for using real-time metrics to further enhance the experience of a live sportscast by employing the Internet (i.e., webcasting of the game). At step 92, the processor digitizes a live video signal in Internet- compatible format. This permits the video to be broadcast over the Internet and viewed by a computer user using a computer-driven monitor or other display, which may involve the use of a streaming video software program such as Quicktime(TM). Appropriate icons or user- selectable pull-down menus can be superimposed over the digitally encoded sportcast to make it possible for the computer user to individually and remotely select among various real-time visuals/graphics of actual player/team metrics and to have these displayed in a non- obtrusive manner over the real-time webcast of the game.
Figure 9 depicts an embodiment of a display of the invention, including a monitor screen 100. The monitor 100 provides a television image 102 of the football game, which may be similar to standard television coverage of similar football games. In the embodiment depicted, the monitor 100 includes in its lower right corner a graphical representation 104 of acceleration data from a remote unit attached to one of the players, namely "PLAYER 34" as indicated by reference 106. In the lower left corner is a graphical representation 108 of the player's heart rate. In such an embodiment, a viewer can see football plays on the monitor, with simultaneous viewing of the player's heart rate graphics 108 and experienced g-forces 104 during the football play. Although Fig. 9 depicts a graphical representation of the heart rate and acceleration data, other data, including combinations of data, could be presented. Moreover, presentations of data may be made in non-graphical form, such as in numeric form, or with a combination of numeric and graphical displays.
Although Fig. 9 depicts data from only one player, other embodiments could involve data from more players. Fig. 10 depicts a monitor screen 100 providing a television image 102 of the football game, except that Fig. 10 depicts the acceleration (i.e., shock) graphs for all players on each team. The data is provided on bar graphs 110 corresponding to each player's number. In the embodiment depicted, the graphic data is overlaid onto the television image 102 along either side of the screen, in such a way as to minimize any potential for distraction from visual images of the game.
A remote unit may be provided on selected non-players, such as the team coach. For example, the heart rate of the team coach might be shown to home viewers at particularly exciting parts of the game.
In a further embodiment of the invention, data from multiple players can be combined to provide to group data. For example, the accelerations of all players on a team could be combined into a single value over the course of the game as an indication of "total energy" of the team. The total energy could be determined as the energy expended at particular instant in time, or over a longer period, such as over a particular play or over the entire game. Fig. 11 shows a display 100 according to an embodiment of the invention, as may be seen by a home viewer during a live televised football sportscast. In the image shown, tachometer-like graphics 1 10, 112 of team energy, bar charts 114 of g-forces, sliding indicators 116 of player temperature, and other visuals and graphics 118 are overlaid on the live image 102 of the game to enhance the home viewer experience in a non-obtrusive, visually stimulating manner. Separate, converged, or overlaid video/data/audio graphics, such as item 120, may also be used to promote a variety of products for generating advertising revenues for the networks in conjunction with the various displayed visuals. Fig. 12 shows a display similar to Fig. 11 but in the context of a live webcast of a football game. The monitor display 100 is a computer monitor. Selection buttons/controls 122, 124, which may be overlaid on the monitor display 100 or similar display as indicated, provide for customization of the webcast by enabling the viewer to select specific visuals to be displayed, if any, as well as enabling/disabling of available audio features.
Displays such as those depicted in Figs. 9-12 might be modified so that, during play that is broadcast live, only the visual images of the game are provided. In such an embodiment, the biometric and/or other data might be reserved for use only during instant replays.
Although the above discussion with respect to Figs. 9-12 was directed to use in a football game, such a system could be applied to a variety of other applications, including sporting events such as hockey, baseball, soccer, boxing, cross-country races, etc.
In boxing, the remote unit can include biometric sensors. Additionally, the remote unit can include one or more accelerometers and/or other movement sensors (e.g., speed, position, etc.). In one embodiment, the remote unit includes an accelerometer mounted in the boxer's glove. This accelerometer can provide real-time data regarding the acceleration/deceleration of the boxer's fists, so that the "g's" of a punch can be measured. The remote unit may be mounted in the wrist area of the glove. In another embodiment, the accelerometer can be mounted on the boxer's head to determine head accelerations and/or movements during a boxing match. The accelerometer may be sized to fit into a boxer's mouthpiece. In a further embodiment applicable in fights where the boxer's are wearing headgear (such as a padded helmet), the accelerometer can be mounted in the headgear.
As with football, the data in boxing can be selectively provided to different displays. A first display for public use (such as provided to a TV network) can provide simultaneous images of the fight along with representations of the acceleration data of the boxer's fists and/or heads. A second display may provide a second set of data, which may include the acceleration data as well as biometric data for selective display to the boxer's coach and/or physician. This second display may also include simultaneous images of the fight, so that the boxer's biometric and acceleration can be associated with particular events during the fight.
The invention could be used for cross-country activities, such as marathons, triathlons, biathlons, or cross-country bicycle races. In one embodiment for such activities, a remote unit can be provided that provides data on biometric functions, position, acceleration, and/or velocity. For example, on a cross-country bicycle race, the remote unit might monitor heart rate, blood pressure, and blood sugar levels of an athlete, while also monitoring the speed and distances involved. This information could be provided to the athlete and/or to a athlete monitoring the competitor's progress.
In an embodiment of the invention, the remote unit includes a GPS receiver that determines the location of the athlete using GPS satellite data. The remote unit can transmit and/or store the location data, thus providing a record of the competitor's movements throughout the activity.
The invention can be used as a tracking device to confirm that a competitor has actually completed the event without deviating from the set course. For example, by positioning receivers at selected locations along a marathon's course, the receivers can receive transmissions from a remote unit as the runner wearing the particular remote unit passes that location. If the remote unit and/or system is equipped to determine locations of the remote units, such as be inclusion of a GPS receiver in the remote unit, the position data can be used to confirm that the competitor followed the set course.
The invention has application not just to athletes but also for use by any individuals, such as patient under a doctor's care, who require monitoring of various conditions and/or movements. For example, a person can wear a remote unit configured to monitor biometric performance data, such as blood pressure, body temperature, and ECG. The remote unit may store the biometric data in a memory for downloading to a system receiver at a later time, such as at the end of a day. The remote unit may alternatively provide a continuous stream of data in real-time to the system receiver. The system receiver can provide the data to a personal computer, television, or other system for displaying and/or recording of the data. Thus, the user or another individual can retrieve the data acquired by the remote unit over a period of time. The data could be used, possibly along with data from other individuals, for trend analysis and chrono-biological studies. The data can be made available on a web site. Such an application could also be useful for prenatal and infant monitoring.

Claims

I CLAIM:
1. An apparatus for monitoring and/or displaying one or more characteristics of one or more desired targets, substantially as shown and described herein.
2. A method for monitoring and/or displaying one or more characteristics of one or more desired targets, substantially as shown and described herein.
3. A system for monitoring and/or displaying one or more characteristics of one or more desired targets, substantially as shown and described herein.
PCT/US2000/020465 1999-07-26 2000-07-26 System, apparatus, and method for telemetry and monitoring of desired targets WO2001008417A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU68904/00A AU6890400A (en) 1999-07-26 2000-07-26 System, apparatus, and method for telemetry and monitoring of desired targets

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14562199P 1999-07-26 1999-07-26
US60/145,621 1999-07-26

Publications (2)

Publication Number Publication Date
WO2001008417A1 true WO2001008417A1 (en) 2001-02-01
WO2001008417A9 WO2001008417A9 (en) 2002-09-06

Family

ID=22513890

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/020465 WO2001008417A1 (en) 1999-07-26 2000-07-26 System, apparatus, and method for telemetry and monitoring of desired targets

Country Status (2)

Country Link
AU (1) AU6890400A (en)
WO (1) WO2001008417A1 (en)

Cited By (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002096097A1 (en) * 2001-05-22 2002-11-28 Marc Arseneau Multi-video receiving method and apparatus
EP1304073A2 (en) * 2001-10-19 2003-04-23 Andrezj Dr. Slawinski Biofeedback method and device, as well as a method for producing and presenting data
WO2003041411A1 (en) * 2001-11-08 2003-05-15 Revolution Company, Llc Video system and methods for operating a video system
WO2003049425A1 (en) * 2001-12-04 2003-06-12 Wells & Verne Investments Limited Computer-aided system for image production
WO2003065891A2 (en) * 2002-02-07 2003-08-14 Ecole Polytechnique Federale De Lausanne (Epfl) Body movement monitoring device
EP1459274A2 (en) * 2001-12-10 2004-09-22 Medic4all AG Method and device for measuring physiological parameters at the wrist
FR2870966A1 (en) * 2004-05-28 2005-12-02 France Telecom Participant position informing system for e.g. cycle race, has mobile terminal with user interface that restores, to participant, information representative of position calculated for mobile terminal of that participant
FR2885531A1 (en) * 2005-05-10 2006-11-17 Thierry Lapousterle Sportsman training assistance system for use during e.g. golf practice, has wireless link for transmission of radiolocation data towards golf cart, and driving unit to drive camera based on radiolocation data
US7193645B1 (en) 2000-07-27 2007-03-20 Pvi Virtual Media Services, Llc Video system and method of operating a video system
WO2007132245A1 (en) * 2006-05-16 2007-11-22 Cambridge Design Partnership Limited Method and apparatus for real time performance assessment
WO2008149058A1 (en) * 2007-06-05 2008-12-11 Qinetiq Limited Data recorder
WO2009143554A1 (en) * 2008-05-28 2009-12-03 Rmtek Pty Ltd Remote telemetry and video
US7657920B2 (en) 2005-07-22 2010-02-02 Marc Arseneau System and methods for enhancing the experience of spectators attending a live sporting event, with gaming capability
WO2011066408A1 (en) * 2009-11-24 2011-06-03 F3M3 Companies, Inc. System and method for reviewing a play
US8127037B2 (en) 1998-02-23 2012-02-28 Koehler Steven M System and method for listening to teams in a race event
EP2363178A3 (en) * 2007-08-17 2012-05-30 adidas International Marketing B.V. Sports electronic training system with sport ball, and applications thereof
WO2012120083A1 (en) * 2011-03-10 2012-09-13 Alcatel Lucent Method for obtaining video content from cameras which relates to a user of a communication device, and associated apparatus
US8675073B2 (en) 2001-11-08 2014-03-18 Kenneth Joseph Aagaard Video system and methods for operating a video system
WO2015074659A1 (en) * 2013-11-22 2015-05-28 Fabian Gladigau Apparatus for transmitting biometric data from a riding animal
EP2191436A4 (en) * 2007-08-24 2015-12-23 Hmicro Inc Wireless physiological sensor patches and systems
US9517417B2 (en) 2013-06-06 2016-12-13 Zih Corp. Method, apparatus, and computer program product for performance analytics determining participant statistical data and game status data
US9531415B2 (en) 2013-06-06 2016-12-27 Zih Corp. Systems and methods for activity determination based on human frame
US9566471B2 (en) 2009-03-13 2017-02-14 Isolynx, Llc System and methods for providing performance feedback
US9626616B2 (en) 2014-06-05 2017-04-18 Zih Corp. Low-profile real-time location system tag
US9661455B2 (en) 2014-06-05 2017-05-23 Zih Corp. Method, apparatus, and computer program product for real time location system referencing in physically and radio frequency challenged environments
US9668164B2 (en) 2014-06-05 2017-05-30 Zih Corp. Receiver processor for bandwidth management of a multiple receiver real-time location system (RTLS)
US9699278B2 (en) 2013-06-06 2017-07-04 Zih Corp. Modular location tag for a real time location system network
ITUB20169981A1 (en) * 2016-01-14 2017-07-14 Samuele Celeri System to evaluate and select the performances of individual members of a team, in particular a football team
US9715005B2 (en) 2013-06-06 2017-07-25 Zih Corp. Method, apparatus, and computer program product improving real time location systems with multiple location technologies
US9759803B2 (en) 2014-06-06 2017-09-12 Zih Corp. Method, apparatus, and computer program product for employing a spatial association model in a real time location system
US9795830B2 (en) 2010-11-19 2017-10-24 Isolynx, Llc Associative object tracking systems and methods
US9848172B2 (en) 2006-12-04 2017-12-19 Isolynx, Llc Autonomous systems and methods for still and moving picture production
US9849334B2 (en) 2010-01-05 2017-12-26 Isolynx, Llc Systems and methods for analyzing event data
US9854558B2 (en) 2014-06-05 2017-12-26 Zih Corp. Receiver processor for adaptive windowing and high-resolution TOA determination in a multiple receiver target location system
US9950238B2 (en) 2013-06-04 2018-04-24 Isolynx, Llc Object tracking system optimization and tools
US9953196B2 (en) 2014-06-05 2018-04-24 Zih Corp. System, apparatus and methods for variable rate ultra-wideband communications
US10039128B2 (en) 2015-07-13 2018-07-31 Isolynx, Llc System and method for dynamically scheduling wireless transmissions without collision
US10191139B2 (en) 2012-11-12 2019-01-29 Isolynx, Llc System and method for object tracking anti-jitter filtering
EP2693945B1 (en) * 2011-04-08 2019-03-13 Dexcom, Inc. Systems and methods for processing and transmitting sensor data
US10261169B2 (en) 2014-06-05 2019-04-16 Zebra Technologies Corporation Method for iterative target location in a multiple receiver target location system
US10284923B2 (en) 2007-10-24 2019-05-07 Lifesignals, Inc. Low power radiofrequency (RF) communication systems for secure wireless patch initialization and methods of use
US10416275B2 (en) 2016-05-12 2019-09-17 Isolynx, Llc Advanced tools for an object tracking system
ES2725913A1 (en) * 2018-03-28 2019-09-30 Consejo Superior Investigacion DEVICE AND METHOD OF MONITORING OF ACTIVITY IN FISH (Machine-translation by Google Translate, not legally binding)
US10437658B2 (en) 2013-06-06 2019-10-08 Zebra Technologies Corporation Method, apparatus, and computer program product for collecting and displaying sporting event data based on real time data for proximity and movement of objects
US10509099B2 (en) 2013-06-06 2019-12-17 Zebra Technologies Corporation Method, apparatus and computer program product improving real time location systems with multiple location technologies
US10609762B2 (en) 2013-06-06 2020-03-31 Zebra Technologies Corporation Method, apparatus, and computer program product improving backhaul of sensor and other data to real time location system network
US11391571B2 (en) 2014-06-05 2022-07-19 Zebra Technologies Corporation Method, apparatus, and computer program for enhancement of event visualizations based on location data
US11423464B2 (en) 2013-06-06 2022-08-23 Zebra Technologies Corporation Method, apparatus, and computer program product for enhancement of fan experience based on location data
EP4138095A1 (en) * 2010-11-10 2023-02-22 Nike Innovate C.V. Systems and methods for time-based athletic activity measurement and display
US11935640B2 (en) 2023-01-30 2024-03-19 Nike, Inc. Systems and methods for time-based athletic activity measurement and display

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4051522A (en) * 1975-05-05 1977-09-27 Jonathan Systems Patient monitoring system
US4695879A (en) * 1986-02-07 1987-09-22 Weinblatt Lee S Television viewer meter
US5802467A (en) * 1995-09-28 1998-09-01 Innovative Intelcom Industries Wireless and wired communications, command, control and sensing system for sound and/or data transmission and reception

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4051522A (en) * 1975-05-05 1977-09-27 Jonathan Systems Patient monitoring system
US4695879A (en) * 1986-02-07 1987-09-22 Weinblatt Lee S Television viewer meter
US5802467A (en) * 1995-09-28 1998-09-01 Innovative Intelcom Industries Wireless and wired communications, command, control and sensing system for sound and/or data transmission and reception

Cited By (107)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9059809B2 (en) 1998-02-23 2015-06-16 Steven M. Koehler System and method for listening to teams in a race event
US8127037B2 (en) 1998-02-23 2012-02-28 Koehler Steven M System and method for listening to teams in a race event
US7193645B1 (en) 2000-07-27 2007-03-20 Pvi Virtual Media Services, Llc Video system and method of operating a video system
US7966636B2 (en) 2001-05-22 2011-06-21 Kangaroo Media, Inc. Multi-video receiving method and apparatus
WO2002096097A1 (en) * 2001-05-22 2002-11-28 Marc Arseneau Multi-video receiving method and apparatus
EP1304073A2 (en) * 2001-10-19 2003-04-23 Andrezj Dr. Slawinski Biofeedback method and device, as well as a method for producing and presenting data
EP1304073A3 (en) * 2001-10-19 2003-09-10 Andrezj Dr. Slawinski Biofeedback method and device, as well as a method for producing and presenting data
WO2003041411A1 (en) * 2001-11-08 2003-05-15 Revolution Company, Llc Video system and methods for operating a video system
US8675073B2 (en) 2001-11-08 2014-03-18 Kenneth Joseph Aagaard Video system and methods for operating a video system
WO2003049425A1 (en) * 2001-12-04 2003-06-12 Wells & Verne Investments Limited Computer-aided system for image production
EP1459274A2 (en) * 2001-12-10 2004-09-22 Medic4all AG Method and device for measuring physiological parameters at the wrist
EP1459274A4 (en) * 2001-12-10 2009-02-25 Medic4All Ag Method and device for measuring physiological parameters at the wrist
WO2003065891A2 (en) * 2002-02-07 2003-08-14 Ecole Polytechnique Federale De Lausanne (Epfl) Body movement monitoring device
WO2003065891A3 (en) * 2002-02-07 2003-11-13 Ecole Polytech Body movement monitoring device
US8109890B2 (en) * 2002-02-07 2012-02-07 Ecole Polytechnique Federale De Lausanne-Service Des Relations Industrielles Body movement monitoring device
FR2870966A1 (en) * 2004-05-28 2005-12-02 France Telecom Participant position informing system for e.g. cycle race, has mobile terminal with user interface that restores, to participant, information representative of position calculated for mobile terminal of that participant
FR2885531A1 (en) * 2005-05-10 2006-11-17 Thierry Lapousterle Sportsman training assistance system for use during e.g. golf practice, has wireless link for transmission of radiolocation data towards golf cart, and driving unit to drive camera based on radiolocation data
US8391774B2 (en) 2005-07-22 2013-03-05 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with automated video stream switching functions
US8051453B2 (en) 2005-07-22 2011-11-01 Kangaroo Media, Inc. System and method for presenting content on a wireless mobile computing device using a buffer
US8051452B2 (en) 2005-07-22 2011-11-01 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with contextual information distribution capability
US8391773B2 (en) 2005-07-22 2013-03-05 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with content filtering function
US7657920B2 (en) 2005-07-22 2010-02-02 Marc Arseneau System and methods for enhancing the experience of spectators attending a live sporting event, with gaming capability
US8391825B2 (en) 2005-07-22 2013-03-05 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with user authentication capability
US9065984B2 (en) 2005-07-22 2015-06-23 Fanvision Entertainment Llc System and methods for enhancing the experience of spectators attending a live sporting event
US8432489B2 (en) 2005-07-22 2013-04-30 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with bookmark setting capability
USRE43601E1 (en) 2005-07-22 2012-08-21 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with gaming capability
US8823524B2 (en) 2006-05-16 2014-09-02 Cambridge Design Partnership Llp Method and apparatus for real time performance assessment
WO2007132245A1 (en) * 2006-05-16 2007-11-22 Cambridge Design Partnership Limited Method and apparatus for real time performance assessment
US9355307B2 (en) 2006-05-16 2016-05-31 Gmax Technology Ltd. Method and apparatus for real time performance assessment
US11317062B2 (en) 2006-12-04 2022-04-26 Isolynx, Llc Cameras for autonomous picture production
US9848172B2 (en) 2006-12-04 2017-12-19 Isolynx, Llc Autonomous systems and methods for still and moving picture production
WO2008149058A1 (en) * 2007-06-05 2008-12-11 Qinetiq Limited Data recorder
EP2363180A3 (en) * 2007-08-17 2012-06-06 adidas International Marketing B.V. Sports electronic training system with sport ball, and applications thereof
EP2363178A3 (en) * 2007-08-17 2012-05-30 adidas International Marketing B.V. Sports electronic training system with sport ball, and applications thereof
EP2191436A4 (en) * 2007-08-24 2015-12-23 Hmicro Inc Wireless physiological sensor patches and systems
US10284923B2 (en) 2007-10-24 2019-05-07 Lifesignals, Inc. Low power radiofrequency (RF) communication systems for secure wireless patch initialization and methods of use
US20110267464A1 (en) * 2008-05-28 2011-11-03 Rmtek Pty Ltd Remote telemetry and video
WO2009143554A1 (en) * 2008-05-28 2009-12-03 Rmtek Pty Ltd Remote telemetry and video
US9566471B2 (en) 2009-03-13 2017-02-14 Isolynx, Llc System and methods for providing performance feedback
WO2011066408A1 (en) * 2009-11-24 2011-06-03 F3M3 Companies, Inc. System and method for reviewing a play
US10420981B2 (en) 2010-01-05 2019-09-24 Isolynx, Llc Systems and methods for analyzing event data
US9849334B2 (en) 2010-01-05 2017-12-26 Isolynx, Llc Systems and methods for analyzing event data
EP4138095A1 (en) * 2010-11-10 2023-02-22 Nike Innovate C.V. Systems and methods for time-based athletic activity measurement and display
US11817198B2 (en) 2010-11-10 2023-11-14 Nike, Inc. Systems and methods for time-based athletic activity measurement and display
US10071282B2 (en) 2010-11-19 2018-09-11 Isolynx, Llc Associative object tracking systems and methods
US9795830B2 (en) 2010-11-19 2017-10-24 Isolynx, Llc Associative object tracking systems and methods
US9560268B2 (en) 2011-03-10 2017-01-31 Alcatel Lucent Method for obtaining video content from cameras which relates to a user of a communication device, and associated apparatus
WO2012120083A1 (en) * 2011-03-10 2012-09-13 Alcatel Lucent Method for obtaining video content from cameras which relates to a user of a communication device, and associated apparatus
EP3536241A1 (en) * 2011-04-08 2019-09-11 Dexcom, Inc. Systems and methods for processing and transmitting sensor data
EP2693945B1 (en) * 2011-04-08 2019-03-13 Dexcom, Inc. Systems and methods for processing and transmitting sensor data
US11408969B2 (en) 2012-11-12 2022-08-09 Isolynx, Llc System and method for object tracking anti-jitter filtering
US10191139B2 (en) 2012-11-12 2019-01-29 Isolynx, Llc System and method for object tracking anti-jitter filtering
US10413802B2 (en) 2013-06-04 2019-09-17 Isolynx, Llc Object tracking system optimization and optimizers
US9950238B2 (en) 2013-06-04 2018-04-24 Isolynx, Llc Object tracking system optimization and tools
US10441867B2 (en) 2013-06-04 2019-10-15 Isolynx, Llc Systems and methods for tracking tag management
US10953304B2 (en) 2013-06-04 2021-03-23 Isolynx, Llc Self-configurable tracking tags and methods of use
US9699278B2 (en) 2013-06-06 2017-07-04 Zih Corp. Modular location tag for a real time location system network
US10212262B2 (en) 2013-06-06 2019-02-19 Zebra Technologies Corporation Modular location tag for a real time location system network
US9517417B2 (en) 2013-06-06 2016-12-13 Zih Corp. Method, apparatus, and computer program product for performance analytics determining participant statistical data and game status data
US11423464B2 (en) 2013-06-06 2022-08-23 Zebra Technologies Corporation Method, apparatus, and computer program product for enhancement of fan experience based on location data
US9882592B2 (en) 2013-06-06 2018-01-30 Zih Corp. Method, apparatus, and computer program product for tag and individual correlation
US9715005B2 (en) 2013-06-06 2017-07-25 Zih Corp. Method, apparatus, and computer program product improving real time location systems with multiple location technologies
US9531415B2 (en) 2013-06-06 2016-12-27 Zih Corp. Systems and methods for activity determination based on human frame
US9571143B2 (en) 2013-06-06 2017-02-14 Zih Corp. Interference rejection in ultra-wideband real time locating systems
US9985672B2 (en) 2013-06-06 2018-05-29 Zih Corp. Method, apparatus, and computer program product for evaluating performance based on real-time data for proximity and movement of objects
US11287511B2 (en) 2013-06-06 2022-03-29 Zebra Technologies Corporation Method, apparatus, and computer program product improving real time location systems with multiple location technologies
US10050650B2 (en) 2013-06-06 2018-08-14 Zih Corp. Method, apparatus, and computer program product improving registration with real time location services
US10437658B2 (en) 2013-06-06 2019-10-08 Zebra Technologies Corporation Method, apparatus, and computer program product for collecting and displaying sporting event data based on real time data for proximity and movement of objects
US9698841B2 (en) 2013-06-06 2017-07-04 Zih Corp. Method and apparatus for associating radio frequency identification tags with participants
US9602152B2 (en) 2013-06-06 2017-03-21 Zih Corp. Method, apparatus, and computer program product for determining play events and outputting events based on real-time data for proximity, movement of objects, and audio data
US10218399B2 (en) 2013-06-06 2019-02-26 Zebra Technologies Corporation Systems and methods for activity determination based on human frame
US9667287B2 (en) 2013-06-06 2017-05-30 Zih Corp. Multiple antenna interference rejection in ultra-wideband real time locating systems
US11023303B2 (en) 2013-06-06 2021-06-01 Zebra Technologies Corporation Methods and apparatus to correlate unique identifiers and tag-individual correlators based on status change indications
US9839809B2 (en) 2013-06-06 2017-12-12 Zih Corp. Method, apparatus, and computer program product for determining play events and outputting events based on real-time data for proximity, movement of objects, and audio data
US10778268B2 (en) 2013-06-06 2020-09-15 Zebra Technologies Corporation Method, apparatus, and computer program product for performance analytics determining play models and outputting events based on real-time data for proximity and movement of objects
US10707908B2 (en) 2013-06-06 2020-07-07 Zebra Technologies Corporation Method, apparatus, and computer program product for evaluating performance based on real-time data for proximity and movement of objects
US10333568B2 (en) 2013-06-06 2019-06-25 Zebra Technologies Corporation Method and apparatus for associating radio frequency identification tags with participants
US10609762B2 (en) 2013-06-06 2020-03-31 Zebra Technologies Corporation Method, apparatus, and computer program product improving backhaul of sensor and other data to real time location system network
US10509099B2 (en) 2013-06-06 2019-12-17 Zebra Technologies Corporation Method, apparatus and computer program product improving real time location systems with multiple location technologies
US9742450B2 (en) 2013-06-06 2017-08-22 Zih Corp. Method, apparatus, and computer program product improving registration with real time location services
US10421020B2 (en) 2013-06-06 2019-09-24 Zebra Technologies Corporation Method, apparatus, and computer program product for performance analytics determining participant statistical data and game status data
WO2015074659A1 (en) * 2013-11-22 2015-05-28 Fabian Gladigau Apparatus for transmitting biometric data from a riding animal
US9626616B2 (en) 2014-06-05 2017-04-18 Zih Corp. Low-profile real-time location system tag
US10261169B2 (en) 2014-06-05 2019-04-16 Zebra Technologies Corporation Method for iterative target location in a multiple receiver target location system
US9854558B2 (en) 2014-06-05 2017-12-26 Zih Corp. Receiver processor for adaptive windowing and high-resolution TOA determination in a multiple receiver target location system
US9864946B2 (en) 2014-06-05 2018-01-09 Zih Corp. Low-profile real-time location system tag
US9953196B2 (en) 2014-06-05 2018-04-24 Zih Corp. System, apparatus and methods for variable rate ultra-wideband communications
US10520582B2 (en) 2014-06-05 2019-12-31 Zebra Technologies Corporation Method for iterative target location in a multiple receiver target location system
US11391571B2 (en) 2014-06-05 2022-07-19 Zebra Technologies Corporation Method, apparatus, and computer program for enhancement of event visualizations based on location data
US9661455B2 (en) 2014-06-05 2017-05-23 Zih Corp. Method, apparatus, and computer program product for real time location system referencing in physically and radio frequency challenged environments
US10310052B2 (en) 2014-06-05 2019-06-04 Zebra Technologies Corporation Method, apparatus, and computer program product for real time location system referencing in physically and radio frequency challenged environments
US10285157B2 (en) 2014-06-05 2019-05-07 Zebra Technologies Corporation Receiver processor for adaptive windowing and high-resolution TOA determination in a multiple receiver target location system
US9953195B2 (en) 2014-06-05 2018-04-24 Zih Corp. Systems, apparatus and methods for variable rate ultra-wideband communications
US10942248B2 (en) 2014-06-05 2021-03-09 Zebra Technologies Corporation Method, apparatus, and computer program product for real time location system referencing in physically and radio frequency challenged environments
US9668164B2 (en) 2014-06-05 2017-05-30 Zih Corp. Receiver processor for bandwidth management of a multiple receiver real-time location system (RTLS)
US11156693B2 (en) 2014-06-06 2021-10-26 Zebra Technologies Corporation Method, apparatus, and computer program product for employing a spatial association model in a real time location system
US10591578B2 (en) 2014-06-06 2020-03-17 Zebra Technologies Corporation Method, apparatus, and computer program product for employing a spatial association model in a real time location system
US9759803B2 (en) 2014-06-06 2017-09-12 Zih Corp. Method, apparatus, and computer program product for employing a spatial association model in a real time location system
US10039128B2 (en) 2015-07-13 2018-07-31 Isolynx, Llc System and method for dynamically scheduling wireless transmissions without collision
US10904917B2 (en) 2015-07-13 2021-01-26 Isolynx, Llc System and method for dynamically scheduling wireless transmissions without collision
US11553520B2 (en) 2015-07-13 2023-01-10 Isolynx, Llc System and method for dynamically scheduling wireless transmissions without collision
ITUB20169981A1 (en) * 2016-01-14 2017-07-14 Samuele Celeri System to evaluate and select the performances of individual members of a team, in particular a football team
US10416275B2 (en) 2016-05-12 2019-09-17 Isolynx, Llc Advanced tools for an object tracking system
WO2019185965A1 (en) * 2018-03-28 2019-10-03 Consejo Superior De Investigaciones Científicas Device and method for monitoring activity in fish
EP3779849A4 (en) * 2018-03-28 2021-12-08 Consejo Superior De Investigaciones Científicas Device and method for monitoring activity in fish
ES2725913A1 (en) * 2018-03-28 2019-09-30 Consejo Superior Investigacion DEVICE AND METHOD OF MONITORING OF ACTIVITY IN FISH (Machine-translation by Google Translate, not legally binding)
US11935640B2 (en) 2023-01-30 2024-03-19 Nike, Inc. Systems and methods for time-based athletic activity measurement and display

Also Published As

Publication number Publication date
WO2001008417A9 (en) 2002-09-06
AU6890400A (en) 2001-02-13

Similar Documents

Publication Publication Date Title
WO2001008417A1 (en) System, apparatus, and method for telemetry and monitoring of desired targets
US11317062B2 (en) Cameras for autonomous picture production
US20200108292A2 (en) System and methods for providing performance feedback
US8477046B2 (en) Sports telemetry system for collecting performance metrics and data
JP6306833B2 (en) Group performance monitoring system and method
US20100185398A1 (en) System and Method for Monitoring Athletic Performance
US10552670B2 (en) Positional locating system and method
AU2017200769B2 (en) Autonomous systems and methods for still and moving picture production
JP2015525502A (en) Management for super reality entertainment
CN111050867A (en) System and apparatus for monitoring performance
KR101925007B1 (en) Multinational real time sports relay system and its relay method
US20190313131A1 (en) Apparatuses, networks, systems, and methods for real-time monitoring of remote events
AU2012201523B2 (en) Autonomous systems and methods for still and moving picture production
US20170014719A1 (en) System and method for super-reality entertainment

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

COP Corrected version of pamphlet

Free format text: PAGES 1/13-13/13, DRAWINGS, REPLACED BY NEW PAGES 1/11-11/11; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)