WO2001067349A1 - Communication systems and methods - Google Patents

Communication systems and methods Download PDF

Info

Publication number
WO2001067349A1
WO2001067349A1 PCT/US2001/007036 US0107036W WO0167349A1 WO 2001067349 A1 WO2001067349 A1 WO 2001067349A1 US 0107036 W US0107036 W US 0107036W WO 0167349 A1 WO0167349 A1 WO 0167349A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
processing system
identification
information
survey
Prior art date
Application number
PCT/US2001/007036
Other languages
French (fr)
Inventor
Jack K. Zhang
Original Assignee
Zhang Jack K
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhang Jack K filed Critical Zhang Jack K
Priority to US10/257,437 priority Critical patent/US20030223554A1/en
Priority to AU2001245442A priority patent/AU2001245442A1/en
Publication of WO2001067349A1 publication Critical patent/WO2001067349A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41415Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6156Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6181Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests

Definitions

  • This invention relates generally to commercial systems and, more particularly, to systems and methods that allow broadcast audience members to compile and transmit respective messages in response to the broadcast.
  • a method for a system having a transmitter that broadcasts a first signal comprises receiving the first signal; decoding the first signal into a second signal, the second signal being human perceptible; decoding the first signal into a third signal, the third signal being digital; receiving an input from a user, after the decoding steps; generating a fourth signal, responsive to the input; generating a fifth signal by appending the fourth signal to the third signal; and sending 5 the fifth signal.
  • Fig. 1 is a diagram showing an electronic device in accordance with a first preferred embodiment of the present invention.
  • [ 0 Fig.2 is a diagram showing use of wireless handheld devices with automated response enabling functions of preferred embodiments of the present invention, connecting to a Web- based information system for broadcasting and response applications (WISBRA) (illustrated only using radio broadcasting.
  • WISBRA Web- based information system for broadcasting and response applications
  • Fig. 3 is a diagram showing electronic media terminals and wireless handheld device 15 in accordance with preferred embodiments of the present invention.
  • Fig. 4 is a diagram showing generation of content and UMCID in commercial broadcasting.
  • Fig. 5 is a diagram showing signal processing in electronic media of preferred embodiments of the present invention for communication with handheld devices.
  • .0 Fig. 6 is a diagram showing signal processing in one preferred embodiment handheld device of preferred embodiments of the present invention for communication with WISBRA via wireless network.
  • Fig. 7 is a diagram of example procedures for automatically processing response message from handheld devices of preferred embodiments of the present invention.
  • >5 Fig. 8 is a diagram of signal processing in first preferred embodiment handheld device of preferred embodiments of the present invention for communication with WISRA via wireless network.
  • Fig. 9 is a diagram showing logic for single-button listener response to radio and other broadcasting.
  • SO Fig. 10 is a diagram showing logic for multiple-button listener response to radio and other broadcasting.
  • FIG. 1 shows a device 700 carried by a member 74 of a broadcast audience, in accordance with a first preferred embodiment of the present invention.
  • Device 700 includes a button 712 on an exterior housing of device 700.
  • Device 700 receives an on or off signal from button 712 and, responsive to activation of button 712 and the length of activation of button 712, generates a multivalued code and sends the code to signal combiner 806.
  • Device 700 receives a signal 660, generated by terminal 600, in response to receiving a broadcast signal 450.
  • Decoder in device 804 extracts a digital code from signal 660 and sends the code to signal combiner 806.
  • Transmitter 811 receives a signal from signal combiner 806 and transmits the combined signal over signal path 750.
  • Fig. 1 shows device 700 with a greatly exaggerated physical size, to allow certain structure in device 700 to be shown in Fig. 1.
  • device 700 is a small housing that can be carried by the user or worn on the user's belt.
  • Decoder 810 receives broadcast signal 450 and, responsive to signal 450, demodulates a component of signal 450 to produce a human perceptible signal 659.
  • this human perceptible signal is a sound wave.
  • the human perceptible signal also includes a light signal perceived by user 74.
  • Decoder 810 also generates a signal 660, described in more detail below, and sends
  • Decoder 810 includes modules 620, 630, 632, 634, 636, 638, 640, and 622 described below.
  • Decoder 802 includes modules 711 and 715.
  • Decoder 804 includes: modules 720, 722, 724, 726, 728 described below in Fig 6; or modules 720, 721, 723, 725, 726, 728 described below in Fig. 8.
  • Module 806 includes modules 730, 746, shared
  • Module 810 includes module 748 described below.
  • Fig. 2 shows a system 2000 in accordance with a first preferred embodiment of the present invention.
  • An object of system 2000 is the provision of a convenient method for TV, radio, or other electronic media audience to individually respond instantly to a program through a handheld device with one single action—pressing a button.
  • system 2000 Another objective of system 2000 is the provision of a system and apparatus for a person to easily respond to a media session through any electronic media he/she is exposed to anywhere, anytime. Yet another object of system 2000 is the provision of a method and system for all electronic media content to be universally identifiable so that audience can easily find the information related to a media session. This also provides valuable information for broadcasting or media companies to monitor their own performance and for manufacturers of electronics to see the use of their particular product.
  • System 2000 relates to a method, apparatus and system for instantly collecting, distributing and processing audience responses to a broadcast session.
  • System 2000 includes an operating electronic media terminal (radio, TV, CD player, computer, etc.) equipped with an apparatus for receiving, decoding and re-transmitting broadcast content identification information; an apparatus (typically a wireless handheld device) for receiving, decoding and storing the identification information from any one of the electronic media terminals; an interface in the apparatus that can be actuated by a user with one single action; a processor in the apparatus enabling, upon the actuation action from the user, automatic data collection, sampling, compiling and transmitting messages to a response processing center via a public network; and a processing center comprising hardware and software for processing such responses.
  • an operating electronic media terminal radio, TV, CD player, computer, etc.
  • an apparatus typically a wireless handheld device
  • an interface in the apparatus that can be actuated by a user with one single action
  • a processor in the apparatus enabling, upon the actuation action from the user,
  • System 2000 includes a computer system 10, broadcast facilities 2100, internet web 900, general computer 78, wireless messaging service provider 940, an electronic media terminal (radio, TV, CD/DVD/tape player or computer, etc.) 600, and a wearable wireless device (pager, cell phone, computers, etc) 700.
  • a computer system 10 broadcast facilities 2100, internet web 900, general computer 78, wireless messaging service provider 940, an electronic media terminal (radio, TV, CD/DVD/tape player or computer, etc.) 600, and a wearable wireless device (pager, cell phone, computers, etc) 700.
  • Computer system 10 is disclosed in detail in Provisional Application No. 60/168,070, the contents of which are herein incorporated by reference.
  • system 10 serves as Web-based Information System for Broadcast Response Applications ( WISBRA). Though bearing different name and slight variations in the description for clarity purpose, it is intended to refer to the same general computer system serving electronic media broadcasting, including scheduling, content storage, and all information processing.
  • WISBRA Web-based Information System for Broadcast Response Applications
  • Broadcast facility 2100 includes announcer application computer 430, producer application computer 435, broadcast program scheduler computer 460, transmission equipment 400, connections to the Internet web 830, 840, 850 and 870, and a signal converting UMCID encoder 500.
  • Computers 430, 435 and 460 are application computers in the sense that they respectively serve as browser interfaces of applications software for a broadcasting function. All the interfaces can reside on the same physical computer or accessible simultaneously via any computer of common browsers, such as Internet ExplorerTM, NetscapeTM, etc.
  • the on-line buyer's computer 480 similar to computer 460, is also an application 5 computer in this sense.
  • General computer 78 with email capability, is one designated by broadcast audience members 74 or 76 to receive information.
  • All the computers described above are connected to the Internet web 900 via DSL or other methods known in the art.
  • the preferred method for computers 430 and 435 are 0 high speed connections such as cable, DSL or Tl for constant-on features.
  • Computers 460 and 480 can be com ected to the web through any popular connection methods.
  • Wireless messaging service provider 940 capable of sending and receiving email from the internet, represents any of the terrestrial or satellite alpha-numeric paging providers, wireless internet service providers or any other forms of wireless messaging 5 service. Any wired connection serving such purpose of transmitting and receiving messages is an alternative.
  • Fig. 3 emphasizes subsystem 1100 of system 2000.
  • Subsystem 1100 comprises an electronic media terminal (radio, TV, computer, etc.) 600 and a wearable wireless device (pager, cell phone, computers, etc) 700.
  • Electronic media terminal 600 is any unit of radio receiver, TV set, computer, CD player, cassette player or digital format MP3 player on which an electronic media session can be performed to an audience of one or multiple individuals.
  • Terminal 600 illustrated using a radio receiver with dial 602, antenna 604, display 606 and speaker 608 with all the well-known features and functions found in a radio, receives radio broadcast signal 450.
  • *5 Broadcast signal 450 can be any electromagnetic signal-carrying analog or digital signals from land based tower or satellite remote to terminal 600.
  • Terminal 600 includes circuitry to extract information from radio signal 450, generate and transmit a new signal 660 different from 450, containing all or partial information in digital packet 670, through transducer 640 in media that is imperceptible to humans.
  • the 10 word circuitry encompasses dedicated hardware, and/or programmable hardware * , such as a
  • Terminal 600' is a television set including circuitry that may receive a broadcast signal, generates signal 660 for reception by device 700, and generates a human perceptible signal 659 including a light signal and a sound wave.
  • Terminal 600 is a computer that may receive a broadcast signal and generate signal 660 for reception by terminal 700 and a human perceptible light signal.
  • Terminal 600'" is a static billboard in a public place, such as an airport for example. Terminal 600'" receives no broadcast signal, but generates signal 660 for reception by device 700.
  • Static billboard 600'" may be a static film lighted from an opposite side of the viewing side.
  • static billboard 600'" may be a panel that sends a human perceptible light signal to a viewer by transmitting a light signal through the panel.
  • static billboard 600'" may be a reflective panel that merely reflects ambient light, allowing the user to view the contents of billboard 600'".
  • Transducer 640 is one or more energy transducers that can convert one form of energy, such as electricity, to an electromagnetic wave, ultrasound, or Infrared light, for example. Therefore, transducer 640 can be one or a combination of such transducers.
  • the typical transmission from transducer 640 is very short range by design, while fully satisfying application needs, minimizing interference and maximizing the accuracy of identification.
  • Wearable wireless device 700 includes one of any type of two-way pager, cell phone, PSA, PCS, Laptop, or other device capable of sending a wireless message, such as a wireless email message. Offering all common functions in the type of wireless device and using a pager for illustration only, Device 700 includes electronics not shown, a message display 706, and an antenna 704. Device 700 includes a transducer 720 for receiving signals from transducer 640 in 600, activation buttons 710, 712 and 714, located on the device 700 such that fingers in one hand can conveniently press any button to initiate and send a message from 700, to request more information or simultaneously activate one or more buttons to express selections in the options given in a media session, an opinion poll for example.
  • the device 700 includes circuitry to automatically collect media session information, generate a message with necessary information, send the message to WISBRA 10, which processes requests from device 700, the whole process is transparent to a user of device 700.
  • the user need merely press the appropriate button(s) 710, 712, or 714, to complete an information request in a single action.
  • the single action can be, in addition to pressing buttons, sliding of buttons, actuating knobs, etc., depending on the actual design of device 700.
  • Terminal 600 may generate the tuned-to-frequency component of signal 670 locally, or terminal 600 may extract the tuned-to-frequency component from broadcast signal 450.
  • access information may include an email address, a telephone number, or a combination of such information.
  • Time is a time- stamp generated by device 700.
  • the user id may be an id for identifying the holder of device 700.
  • User id may be a telephone number, for example.
  • signal 760 user selection is the code generated by button decoder 802.
  • program recording is a five second recording of the entire broadcast signal 450, in cases where a UMCID is not supplied to device 700, the system may nevertheless be able to identify the broadcast signal with this five second recording.
  • broadcast scheduler 30 and advertisement on-line buyers 50, 60 input broadcast content and programming time spots information via computers 460 and 480, respectively, into WISBRA 10.
  • the content can be advertisement script, recording, or other materials.
  • the Unified Media Content Identification (hereafter, UMCID) generator 462 Responsive to an advertisement session being entered through 418, the Unified Media Content Identification (hereafter, UMCID) generator 462
  • a typical UMCID contains at least 4 segments of information: a segment to identify the content originator, in this case advertisement end buyer; a segment to identify the agency representing the ad buyer; a segment to identify the broadcasting network; and a
  • the UMCID protocol enables terminals 600 to transmit information in a common format, allowing any device 700 in the vicinity to receive, recognize and understand the information.
  • a single person using the same device 700, may respond to a radio broadcast segment in the car when he is driving, then to a TV news broadcast when he gets home, and later to a movie from a DVD player.
  • system 2000 enables audience members to respond to a media session easily and conveniently, anywhere, anytime and to any media presented through a terminal 600.
  • Producer 35 will direct and produce the actual broadcast session partially from the 5 content in existence in WISBRA 10 accessible through application computer 435.
  • that recording will carry first two sections of UMCID: Advertiser and agency.
  • producer application client 436 When a song is played, producer application client 436 will, through hardwired or wireless connection 442, give command to activate the broadcast equipment 400 to [0 transmit the signal carrying the song.
  • the song recording will carry first two sections of
  • UMCID Song/singer and publisher.
  • the auto/special UMCID generator 437 in producer application client 436 will generate a UMCID consisting all four sections if UMCID is detected missing.
  • connection 510 Each time when a program is broadcast, via connection 510, the UMCID information is automatically sent to UMCID signal encoder 500 to be prepared for transmission with broadcast signal.
  • the UMCID is present in recordings as a beacon. As a result the UMCID will be 15 present, for example, at the beginning of the song recording, and is rebroadcast, by encoder
  • Fig. 5 shows how a broadcast signal 450 is processed by terminal 600 to generate identification signal 660 for reception by device 700.
  • signal 450 is so processed by radio receiver signal amplifying circuitry 610 to produce an audio signal for speaker 608.
  • This audio signal is a type of human perceptible signal.
  • UMCID Extraction Module 620 extracts the current UMCID 622 of the content in broadcasting, and sends UMCID 622 to state data writer 630, causing writer 630 to send data into state data register 632.
  • Data register 632 is a data holding center, responsible for keeping UMCID, radio receiver actual tuned-to frequency 612, mostly available from the amplification circuitry
  • radio receiver identification number 614 is stored in the receiver by the manufacturer.
  • Register 632 keeps as much state-change history as practical. As receiver ID 614 is typically a constant and frequency data 612 is less changeable as UMCID, the primary function of register 632 is to keep UMCID history.
  • state data sampler 634 There are several conditions that cause state data sampler 634 to fetch data from register 632 to initiate a data transmission 660.
  • data register 632 When data register 632 has a state change, either as a result of UMCID 622 update or the listener (in the case of radio) changes statiorj resulting new frequency data 612, it will send a trigger to data sampler 634, informing sampler 634 to fetch data from register 632.
  • a clock 607 will periodically prompt data sampler 634 to fetch data from register 632.
  • encoder 636 Each time the data is obtained by 634, they are forwarded to encoder 636 to assemble into desired format, then to signal transmitter 638 and further to antenna/speaker/IR diode 640 transmitted into signal 660.
  • terminal 600 uses ultrasound, the combination of all three transmission methods will improve overall ability, performance and versatility of 600 communicating to 700.
  • Terminal 600 transmits signal 670.
  • Signal 670 includes a wake-up segment 662 foi waking up device 700, which is typically in sleeping mode to allow for the intermittent nature of transmission 660.
  • Signal 670 also includes a segment for UMCID 612, a segmen for tuned-to f equency 612 and radio receiver ID segment 614.
  • terminal 600 employs amplitude modulation, other methods may be employed.
  • That information can be transmitted, via ultrasound in a protocol intended for device 700 to receive and capture.
  • Such information may be used in place of actual recording of audio/video signal for identification purpose with the benefit of saving bandwidth and transmission time.
  • Fig. 6 when antenna/sensor 720 receives signal 660 from the radio/TV receiver, the resulting signal is then fed into signal pre-processing module 722 for correction and amplification.
  • the output from module 722 is sent to decoder 724 to be written to handset state register 728 by handset state writer 726.
  • Handset state register 728 takes input, including current time and handset location information, from handset internal state
  • Device 700 may generate a multi-value code in response to the user's actuation of a single button 712, as shown in Fig. 8. Device 700 may also generate a code in response to the user's actuation of multiple buttons, such as button 712 in combination with button 714.
  • a user has the option of sending a response message at the time of selection or sending the message at a later time.
  • the selection inputs are short pulses when the user releases a button immediately after pressing. When one button is press-released, it represents first/ 1 /yes/for/good, etc; when two buttons are press-released, the input represents second/2/no/against/bad, etc; and three press-release's stand for
  • buttons are press-held for duration longer than a pre-set time period, the device will send a message including all selections stored in the device.
  • handset state data register 728 creates an entry including all the state data at the moment of
  • the register 728 holds the history log of all state data from all sources corresponding to the moment at which each input from 711 is entered.
  • handset state data sampler 730 requests a data transfer action from register 728 and handset stored info module 731.
  • Data in 731 includes information stored by the device manufacturer and those
  • the received message 760 is reassembled into four parts: UMCID and time 761; frequency, location and time 762; recording, time and location 763. Redundant information from UMCID, frequency and recording is purposely included here for illustration of how, when only some information present, the response is processed by WISBRA 10. Such information redundancy is typically desired for better quality of response message and versatility for processing. It is possible, however, the limitation of bandwidth may initially limit the use of actual
  • message 761 will be given first priority for processing in UMCID server 20, as it is data-efficient and containing all information to determine the audience's interest.
  • UMCID server 20 will retrieve all the information related to UMCID is 761 and create a data pack to pass on to logic module 21 to decide where the data pack will
  • processing outcome to a response There are at least three types of processing outcome to a response: To provide a reply message including links or info relative to response message; to use the response data to generate a report and email back the media company as the illustrative example "Polling"; to forward part or all information from a response to another system, which can
  • UMCID server 22 As described earlier, if an UMCID indicates "polling" response, the information output from UMCID server will be send to Polling server 22, where User ID/Selection/Reply information 764 is combined before sending to Poll report generator 23.
  • Example of a polling result report 832 is emailed to the polling station (AM630, for
  • .5 location and time 762 is available to Station server 18 and programming server 19 to determine the station and program to which the audience responded. If a program is found to be one that requested audience's opinions and aired time matches the audience response time, all resulting information from processing in server 18 and 19 is send to Polling server 22, whereon a report is generated and emailed as above described.
  • Polling may also be conducted for situations when only Information of recording, location and time 763 is available to Station server 18, programming server 19 and content data server 84 to determine the station and program to which the audience responded. This process is not as efficient as two previous steps as the content data server will run an actual comparison of recording to all program segment aired at the moment response message was created by the audience. If a program is found to be one that requested audience's opinions and aired time matches the audience response time, all resulting information from processing in server 18, 19 and 20 is send to Polling server 22, whereon a report is generated and emailed as above described.
  • UMCID indicates an information request by the audience
  • output from UMCID 20 or combined output from station server 18, programming server 19 and content data server 84 will be read in by listener server 16 along with user ID, selection and reply instruction 764 for processing.
  • response email generator 24 will then compile an email 822, which will be sent to requesting audience following reply instruction from the particular requester.
  • System 2000 enables a listener to send a message to a station in real time via WISBRA 10 by pressing one button 712 in device 700.
  • Such capability enables radio listeners to vote on polls, bid on offers, interact with a program or announcer simultaneously, anywhere, anytime, without having to call or write-in.
  • This responding ability also minimizes or eliminates common bottlenecking for listener call-ins or the time delay for people writing in.
  • a first preferred way for communication between 600 and 700 is using local oscillating frequency from listener's radio set. It is known that when a particular station is tuned to a radio set, the radio/TV set's internal oscillator generates a electromagnetic signal at a particular frequency. And such frequency can be correlated to the broadcasting frequency of the tuned-to station.
  • device 700 is equipped with a radio frequency receiver that registers the frequency of a radio/TV broadcast. The registered frequency generates a piece of data that dynamically changes as the listener changes radio station or getting close to an operating radio unit tuned to a station.
  • the above-mentioned piece of data will be included in the message send to WISBRA 10 and is compared with the frequencies of stations in a geological area, of which WISBRA hosts information application service.
  • the listener's actual location information can also be obtained from wireless providers or GPS output. Such method is preferred at present time due to the fact that almost all existing radio, TV and other electronic media terminals are not compatible for advanced features described in the exemplary system.
  • Another preferred way of communicating information to 700 is to include UMCID signal in the broadcast and have 600 re-broadcast such UMCID with other desired information to its immediate vicinity using short range wireless communication technologies like Bluetooth, Smart Dust, Portolan Project or Bluesky.
  • 600 is equipped to extrapolate UMCID and prepare the signals for short-range transmit.
  • the device 700 is equipped to recognize, capture and translate the signal into a useful data piece as previously described. This method is actively relaying the information to the vicinity. Therefore it is possible to implement into all forms of electronic media terminals and is preferred over the method described in the following paragraph for future applications.
  • This method is preferred for second phase implementation of the exemplary system for two reasons: it take time for the market to have enough device to be economical; it is a more advanced mode of the exemplary system offering higher data rate and interactivity.
  • a third way of communicating information to 700 is to modify radio sets to produce a non-intrusive signal, in ultrasound and/or Infrared, reflecting the radio/TV unit's actual tuned-to frequency, which is readily available for displaying channels or stations to the users.
  • a non-intrusive signal in ultrasound and/or Infrared, reflecting the radio/TV unit's actual tuned-to frequency, which is readily available for displaying channels or stations to the users.
  • Another way of capturing information for radio station identification is to use Ultrasound or Infrared to transmit UMCID into the immediate surroundings simultaneously with regular audio/text/video program by 600.
  • Device 700 is equipped to receive such information.
  • One advantage for this arrangement is its simplicity. Ultrasound and Infrared cannot go through walls. Therefore such arrangement does not need logic for determining who was in the room vs. next door as required by radio wave transmission such as BluetoothTM.
  • a fifth way of capturing information for radio station identification is to record the actual audio signal from the radio unit off the radio station actual broadcast.
  • a sixth way of identifying UMCID is to embed the UMCID in audio signal with a special coding technique that does not affect the audio quality perceived by listeners.
  • the 640 is the same as 608
  • Fig 6 is a generic embodiment of the invention with IR/acoustic/RF
  • Fig 8 is specifically with passive detection of RF emission of radio receivers corresponding to local osculating frequencies.
  • Fig. 8 details the first method preferred embodiment of the mobile device using
  • Handset state register 728 takes input, including current time and handset location information, from handset internal state memory 741, and even audio signal 717 if desired as well as handset built-in radio tuned to frequency data 713 in the case when a radio is integrated into a cell phone or pager.
  • the register 728 holds a history so log of state changes from all input sources. Such log creation can be programmed either automatically at a pre-set time interval or when it received an input representing Selection Button Activation 711.
  • Fig. 9 shows logic in button decode module 802, allowing a single button 712 to be used to indicate for both selection and transmission.
  • Logic in module 802 detects two types of button activation: press-release, generating a pulse signal with second half immediately follow the first half; and press-hold, generating a pulse signal with second half far apart from the first half.
  • Button 712 generates a DC level for the time that user 74 presses down on button 712.
  • Logic 802 measures the length of time of the level change, with a sustained level of less than one second being deemed press-release and a duration of greater than one second being deemed press-hold.
  • Logic 802 generates a code equal to 1 when the user does a single press-release of button 712, generates a 2 when the user generates two sequential press-releases of button 712, and generates a 3 when the user actuates button 712 to produce three sequential press-releases.
  • codes 1, 2, and 3 cause device 700 to save the codes for sending at a later time, and an electronic mail message for example.
  • logic 802 When logic 802 detects a press-release followed by a press-hold, logic 802 generates a code equal to four, when logic 802 detects two press-releases followed bya press-hold, logic 802 generates a code equal to 5 etc.
  • Fig. 9 indicates how system 2000 may interpret the codes generated by logic 802, which are subsequently combined with a signal from decoder 804, and transmitted by transmitter 11.
  • Fig. 10 shows an alternate scheme wherein button decoder logic 802 is responsive to signals from button 710 and 714, as well as button 712. Pushing one button 712 generates a single press-release, causing decoder logic 802 to generate a 1. Actuating buttons 712 and 714 simultaneously is equivalent to two press-releases, causing button decoder logic 802 to generate a 2. Actuating all three button simultaneously is equivalent to three press-releases of a single button, causing button decoder logic 802 to generate a 3.
  • Press-release is used to indicate for selection, for example, one press-release stands for first/1/yes/for/good, etc; while two consecutive press-release's stand for second/2/no/against/bad, etc; three consecutive press-release's stand for third/3/no- opinion/no-opinion/so-so, etc.
  • the practical time allowed for three consecutive press- release's is about one second. So the device can be programmed to detect pulses for a specified duration, as an example 1.2 second.
  • the press-hold can be used to initiate transmission.
  • the Button Activation module 719 detects a first half pulse and fails to detect the second half of the pulse for a specified duration, as an example, 1 second, it sends a command 715 to device State Data Sampler 730.
  • handset state data sampler 730 Upon detecting an input from user button selection 715, handset state data sampler 730 requests a data transfer from register 728 and stored device information 731 , which is provided by the user and updateable remotely via radio transmission from a central office of the wireless service provider. Data sampled by 730 are then complied into an email in response message generator 746. When activated to send the message, through the built-in message transmitter 748, single or multiple messages 760 are transmitted via wireless network connection 750 to WISBRA 10.
  • WISBRA 10 will ignore such data register log entries during message processing.
  • system 2000 is for creating and operating an integrated electronic media environment, especially for TV and radio, to enable close to real-time automatic media selling and buying, automatic content indexing and retrieval, automatic recognition of an operating electronic media receiver closest to a responding individual in a multi- receiver environment, and enabling instant wireless messaging in response to a broadcast or a general media session from anywhere and at anytime.
  • System 2000 provides electronic media receivers for exposing the audience to a media session and transmitting information related to the media session at a first location, a wireless handheld device for receiving information related to the media session from the electronic media receiver and for automatic compiling and transmitting one or more messages corresponding to user's response to the media session at a first location, a computer with web browser and internet service or a internet ready device located at a second location remote or close to first location, a web-based electronic media business application computer system for on-line media selling and buying, universal media content identification (UMCID) generating and management, audience service, station service, content management and security management at a third location remote to the first and second location, a computer with web browser and internet service located at a on-line media buyer's location, a computer functionally similar to the buyer's at broadcast programming personnel's location, a computer functionally similar to the buyer's at program producer's location and a computer functionally similar to the buyer's at a disk jockey's location.
  • System 2000 allows people to create
  • [5 media receivers at the first location receive the content at the receiver, generating humanly perceptible audio, video or browser display output and transmitting a humanly imperceptible signal with UMCID and other desirable information into the environment of the first location.
  • Device 700 registers a user input by the device upon activation of an interface on
  • the device generates a dynamic log of the signal, user input and time of the input temporarily stored in the wireless handheld device, automatically compiles an email message including the log and other desirable information at the device, and automatically transmits the message via wireless network to the electronic media business application system upon user activation of a send input interface in the device.
  • System 2000 then receives the message at electronic media business application system, processes the message at the system according to UMCID in the messages to (a) reply to a response message include links on the internet to information satisfying user's request; or (b) forward some or all the information in the message to another system or specific locations; or (c) compose and post a report on information in the messages for
  • SO publishing and access over the internet by authorized users, and returns, through internet per instruction in the message or UMCID, the processing results, to the computer at the second location or an internet ready device at the second location or to the device at the first location; to a computer to another system or specific locations; to one or more specific computers within the computer system or at a location remote to the system.
  • Terminal 600 may be a TV, CD player, tape player, MP3 player or a computer or any other device for electronically carrying and render information in forms that are humanly perceptible.
  • Terminal 600 may include circuitry to read and extract the UMCID information sent with regular content to web browsers; generate infrared light as active transmission media for human imperceptible signal; generate radio wave as active transmission media for human imperceptible signal.
  • the preferred embodiments of the exemplary system provide an apparatus and method for prompt wireless instant messaging in response to radio or tv broadcasting and other electronic media session.
  • terminal 600 being a housing and terminal 700 being a separate housing
  • the functions of terminal 600 and device 700 may be combined into a device with a single portable housing such as a small radio or a combination radio cellular phone handset.
  • signal combiner 806 generates a composite signal by combining the output of decoder 804 in a respective field different from fields occupied by the output of decoder logic 802, these two types of signals may be combined in a more integrated way, t( occupy a single field with a field value derived from the combination of the output of decoder logic 802 and the output of decoder 804.
  • the illustrated system includes a device 700 that transmits a combined system in an electronic mail message sent over a voice channel of a telephone network
  • the invention may be practiced with other modes of sending the combined signal.
  • an alternative device 700 may send the combined signal using some type of Short

Abstract

It is an object of the present invention to provide an efficient system for communicating with a broadcast audience. To achieve this and other objects of the present invention, there is a method for a system having a transmitter (811) that broadcasts a first signal (450). The method comprises receiving the first signal (450); decoding (810) the first signal into the second signal (659), the second signal being human perceptible; decoding the first signal into the third signal (660), the third signal being digital; receiving an input from a user (712), after the decoding steps (802); generating the fourth signal (806), responsive to the input (712); generating a fifth signal (750) by appending the fourth signal (806) to the third signal (660); and sending the fifth signal (750).

Description

COMMUNICATION SYSTEMS AND METHODS
BACKGROUND OF THE INVENTION
This Application claims the benefit of Application Serial No. 60/187,514 of JACK K.
ZHANG filed March 7, 2000 for APPARATUS AND METHOD FOR WIRELESS INSTANT
MESSAGING IN RESPONSE TO RADIO OR TV BROADCASTING IN OTHER
ELECTRONIC MEDIA SESSION, the contents of which are herein incorporated by reference.
Field of the Invention
This invention relates generally to commercial systems and, more particularly, to systems and methods that allow broadcast audience members to compile and transmit respective messages in response to the broadcast.
Description of Related Art
Issues affecting a broadcaster and advertisers include a constant interest in knowing about broadcast audience members, and getting interested members to respond anytime, anywhere, and quickly. Proposed methods to address these issues include voice calling, sending a hardcopy letter, sending a fax, sending electronic mail (email), or using a Mobile Track service. These proposed methods have shortcomings, however. For example, there are situations, such as driving a car or doing certain household chores, that do not permit an audience member to respond promptly to a broadcast. Subsequently, the audience member may likely forget important details about what might have interested him in the broadcast, contact information to respond, or to request for more detailed information after a substantial time lapse after the broadcast. Such delay prevents the instantaneous nature of broadcasting to be fully utilized.
SUMMARY OF THE INVENTION
It is an obj ect of the present invention to provide an efficient system for communicating with a broadcast audience.
To achieve this and other objects of the present invention, there is a method for a system having a transmitter that broadcasts a first signal. The method comprises receiving the first signal; decoding the first signal into a second signal, the second signal being human perceptible; decoding the first signal into a third signal, the third signal being digital; receiving an input from a user, after the decoding steps; generating a fourth signal, responsive to the input; generating a fifth signal by appending the fourth signal to the third signal; and sending 5 the fifth signal.
BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing an electronic device in accordance with a first preferred embodiment of the present invention. [ 0 Fig.2 is a diagram showing use of wireless handheld devices with automated response enabling functions of preferred embodiments of the present invention, connecting to a Web- based information system for broadcasting and response applications (WISBRA) (illustrated only using radio broadcasting.
Fig. 3 is a diagram showing electronic media terminals and wireless handheld device 15 in accordance with preferred embodiments of the present invention.
Fig. 4 is a diagram showing generation of content and UMCID in commercial broadcasting.
Fig. 5 is a diagram showing signal processing in electronic media of preferred embodiments of the present invention for communication with handheld devices. .0 Fig. 6 is a diagram showing signal processing in one preferred embodiment handheld device of preferred embodiments of the present invention for communication with WISBRA via wireless network.
Fig. 7 is a diagram of example procedures for automatically processing response message from handheld devices of preferred embodiments of the present invention. >5 Fig. 8 is a diagram of signal processing in first preferred embodiment handheld device of preferred embodiments of the present invention for communication with WISRA via wireless network.
Fig. 9 is a diagram showing logic for single-button listener response to radio and other broadcasting. SO Fig. 10 is a diagram showing logic for multiple-button listener response to radio and other broadcasting. The accompanying drawings, which are incorporated in and which constitute a part of this specification, illustrate embodiments of the invention. Throughout the drawings, corresponding parts are labeled with corresponding reference numbers.
DESCRIPTION OF THE PREFERRED EMBODIMENTS Fig. 1 shows a device 700 carried by a member 74 of a broadcast audience, in accordance with a first preferred embodiment of the present invention. Device 700 includes a button 712 on an exterior housing of device 700. Button decode logic 802, inside the
5 housing of device 700, receives an on or off signal from button 712 and, responsive to activation of button 712 and the length of activation of button 712, generates a multivalued code and sends the code to signal combiner 806. Device 700 receives a signal 660, generated by terminal 600, in response to receiving a broadcast signal 450. Decoder in device 804 extracts a digital code from signal 660 and sends the code to signal combiner 806.
[0 Transmitter 811 receives a signal from signal combiner 806 and transmits the combined signal over signal path 750.
Of course, Fig. 1 shows device 700 with a greatly exaggerated physical size, to allow certain structure in device 700 to be shown in Fig. 1. Preferably, device 700 is a small housing that can be carried by the user or worn on the user's belt.
[5 Decoder 810 receives broadcast signal 450 and, responsive to signal 450, demodulates a component of signal 450 to produce a human perceptible signal 659. When device 600 is a radio, this human perceptible signal is a sound wave. In the case of device 600', described below, the human perceptible signal also includes a light signal perceived by user 74.
Decoder 810 also generates a signal 660, described in more detail below, and sends
>0 the signal 660 to portable device 700.
Decoder 810 includes modules 620, 630, 632, 634, 636, 638, 640, and 622 described below. Decoder 802 includes modules 711 and 715. Decoder 804 includes: modules 720, 722, 724, 726, 728 described below in Fig 6; or modules 720, 721, 723, 725, 726, 728 described below in Fig. 8. Module 806 includes modules 730, 746, shared
.5 modules 741 , 731. Module 810 includes module 748 described below.
Fig. 2 shows a system 2000 in accordance with a first preferred embodiment of the present invention. An object of system 2000 is the provision of a convenient method for TV, radio, or other electronic media audience to individually respond instantly to a program through a handheld device with one single action—pressing a button.
SO Another objective of system 2000 is the provision of a system and apparatus for a person to easily respond to a media session through any electronic media he/she is exposed to anywhere, anytime. Yet another object of system 2000 is the provision of a method and system for all electronic media content to be universally identifiable so that audience can easily find the information related to a media session. This also provides valuable information for broadcasting or media companies to monitor their own performance and for manufacturers of electronics to see the use of their particular product.
System 2000 relates to a method, apparatus and system for instantly collecting, distributing and processing audience responses to a broadcast session. System 2000 includes an operating electronic media terminal (radio, TV, CD player, computer, etc.) equipped with an apparatus for receiving, decoding and re-transmitting broadcast content identification information; an apparatus (typically a wireless handheld device) for receiving, decoding and storing the identification information from any one of the electronic media terminals; an interface in the apparatus that can be actuated by a user with one single action; a processor in the apparatus enabling, upon the actuation action from the user, automatic data collection, sampling, compiling and transmitting messages to a response processing center via a public network; and a processing center comprising hardware and software for processing such responses.
System 2000 includes a computer system 10, broadcast facilities 2100, internet web 900, general computer 78, wireless messaging service provider 940, an electronic media terminal (radio, TV, CD/DVD/tape player or computer, etc.) 600, and a wearable wireless device (pager, cell phone, computers, etc) 700.
Computer system 10 is disclosed in detail in Provisional Application No. 60/168,070, the contents of which are herein incorporated by reference. In system 2000, system 10 serves as Web-based Information System for Broadcast Response Applications ( WISBRA). Though bearing different name and slight variations in the description for clarity purpose, it is intended to refer to the same general computer system serving electronic media broadcasting, including scheduling, content storage, and all information processing.
Broadcast facility 2100 includes announcer application computer 430, producer application computer 435, broadcast program scheduler computer 460, transmission equipment 400, connections to the Internet web 830, 840, 850 and 870, and a signal converting UMCID encoder 500. Computers 430, 435 and 460 are application computers in the sense that they respectively serve as browser interfaces of applications software for a broadcasting function. All the interfaces can reside on the same physical computer or accessible simultaneously via any computer of common browsers, such as Internet Explorer™, Netscape™, etc.
The on-line buyer's computer 480, similar to computer 460, is also an application 5 computer in this sense.
General computer 78, with email capability, is one designated by broadcast audience members 74 or 76 to receive information.
All the computers described above are connected to the Internet web 900 via DSL or other methods known in the art. The preferred method for computers 430 and 435 are 0 high speed connections such as cable, DSL or Tl for constant-on features. Computers 460 and 480 can be com ected to the web through any popular connection methods.
Wireless messaging service provider 940, capable of sending and receiving email from the internet, represents any of the terrestrial or satellite alpha-numeric paging providers, wireless internet service providers or any other forms of wireless messaging 5 service. Any wired connection serving such purpose of transmitting and receiving messages is an alternative.
Fig. 3 emphasizes subsystem 1100 of system 2000. Subsystem 1100 comprises an electronic media terminal (radio, TV, computer, etc.) 600 and a wearable wireless device (pager, cell phone, computers, etc) 700. !0 Electronic media terminal 600 is any unit of radio receiver, TV set, computer, CD player, cassette player or digital format MP3 player on which an electronic media session can be performed to an audience of one or multiple individuals. Terminal 600, illustrated using a radio receiver with dial 602, antenna 604, display 606 and speaker 608 with all the well-known features and functions found in a radio, receives radio broadcast signal 450. *5 Broadcast signal 450 can be any electromagnetic signal-carrying analog or digital signals from land based tower or satellite remote to terminal 600. Terminal 600 includes circuitry to extract information from radio signal 450, generate and transmit a new signal 660 different from 450, containing all or partial information in digital packet 670, through transducer 640 in media that is imperceptible to humans. In this Patent Application, the 10 word circuitry encompasses dedicated hardware, and/or programmable hardware*, such as a
CPU or reconfigurable logic array, in combination with programming data, such as sequentially fetched CPU instructions or programming data for a reconfigurable array. Terminal 600' is a television set including circuitry that may receive a broadcast signal, generates signal 660 for reception by device 700, and generates a human perceptible signal 659 including a light signal and a sound wave.
Terminal 600" is a computer that may receive a broadcast signal and generate signal 660 for reception by terminal 700 and a human perceptible light signal.
Terminal 600'" is a static billboard in a public place, such as an airport for example. Terminal 600'" receives no broadcast signal, but generates signal 660 for reception by device 700. Static billboard 600'" may be a static film lighted from an opposite side of the viewing side. In other words, static billboard 600'" may be a panel that sends a human perceptible light signal to a viewer by transmitting a light signal through the panel. Alternately, static billboard 600'" may be a reflective panel that merely reflects ambient light, allowing the user to view the contents of billboard 600'".
Transducer 640 is one or more energy transducers that can convert one form of energy, such as electricity, to an electromagnetic wave, ultrasound, or Infrared light, for example. Therefore, transducer 640 can be one or a combination of such transducers. The typical transmission from transducer 640 is very short range by design, while fully satisfying application needs, minimizing interference and maximizing the accuracy of identification.
Wearable wireless device 700 includes one of any type of two-way pager, cell phone, PSA, PCS, Laptop, or other device capable of sending a wireless message, such as a wireless email message. Offering all common functions in the type of wireless device and using a pager for illustration only, Device 700 includes electronics not shown, a message display 706, and an antenna 704. Device 700 includes a transducer 720 for receiving signals from transducer 640 in 600, activation buttons 710, 712 and 714, located on the device 700 such that fingers in one hand can conveniently press any button to initiate and send a message from 700, to request more information or simultaneously activate one or more buttons to express selections in the options given in a media session, an opinion poll for example. Since the device 700 includes circuitry to automatically collect media session information, generate a message with necessary information, send the message to WISBRA 10, which processes requests from device 700, the whole process is transparent to a user of device 700. The user need merely press the appropriate button(s) 710, 712, or 714, to complete an information request in a single action. The single action can be, in addition to pressing buttons, sliding of buttons, actuating knobs, etc., depending on the actual design of device 700.
Terminal 600 may generate the tuned-to-frequency component of signal 670 locally, or terminal 600 may extract the tuned-to-frequency component from broadcast signal 450.
5 Device 700 generates signal 760 by combining an output of button decoder logic
802 with components from signal 660. In signal 760, access information may include an email address, a telephone number, or a combination of such information. Time is a time- stamp generated by device 700. The user id may be an id for identifying the holder of device 700. User id may be a telephone number, for example. In signal 760, items in
.0 parenthesis are optimizations.
In signal 760, user selection is the code generated by button decoder 802. In signal 760, program recording is a five second recording of the entire broadcast signal 450, in cases where a UMCID is not supplied to device 700, the system may nevertheless be able to identify the broadcast signal with this five second recording.
.5 Referring to Fig. 2 and Fig. 4, broadcast scheduler 30 and advertisement on-line buyers 50, 60 input broadcast content and programming time spots information via computers 460 and 480, respectively, into WISBRA 10. The content can be advertisement script, recording, or other materials. Responsive to an advertisement session being entered through 418, the Unified Media Content Identification (hereafter, UMCID) generator 462
»0 assigns a unique code and attaches the code to advertisement content before uploading the entry through web communication client 432 to WISBRA 10.
A typical UMCID contains at least 4 segments of information: a segment to identify the content originator, in this case advertisement end buyer; a segment to identify the agency representing the ad buyer; a segment to identify the broadcasting network; and a
15 segment to identify the station/channel from which the audience actually receives the broadcast. The UMCID protocol enables terminals 600 to transmit information in a common format, allowing any device 700 in the vicinity to receive, recognize and understand the information.
Thus, for example, allowing two people in the same car, each having a device 700,
10 to individually respond to broadcast segments of interest to each one from the same radio receiver. Furthermore, a single person, using the same device 700, may respond to a radio broadcast segment in the car when he is driving, then to a TV news broadcast when he gets home, and later to a movie from a DVD player.
Thus, system 2000 enables audience members to respond to a media session easily and conveniently, anywhere, anytime and to any media presented through a terminal 600.
Producer 35 will direct and produce the actual broadcast session partially from the 5 content in existence in WISBRA 10 accessible through application computer 435. When a pre-recorded advertisement is played, that recording will carry first two sections of UMCID: Advertiser and agency.
When a song is played, producer application client 436 will, through hardwired or wireless connection 442, give command to activate the broadcast equipment 400 to [0 transmit the signal carrying the song. The song recording will carry first two sections of
UMCID: Song/singer and publisher. When the advertisement is to be read by the announcer 40, the auto/special UMCID generator 437 in producer application client 436 will generate a UMCID consisting all four sections if UMCID is detected missing.
When a polling question is aired, the producer will manually assign a "Polling" 15 UMCID through 437. Such UMCID will have a question serial number stored in WISBRA
10 in the first section and station or network ID in the second section. When an action is aired, the producer will manually assign an "Auction" UMCID through 437. Auction UMCID will have the serial number an article description stored in WISBRA 10 in the first section and auctioneer's ID in the second section. The UMCID generators 462 and 437 will »0 add the last two sections representing network affiliation and station/channel ID.
Each time when a program is broadcast, via connection 510, the UMCID information is automatically sent to UMCID signal encoder 500 to be prepared for transmission with broadcast signal.
The UMCID is present in recordings as a beacon. As a result the UMCID will be 15 present, for example, at the beginning of the song recording, and is rebroadcast, by encoder
500, every 20 seconds. Because the UMCIDs can be data-economical, the signal carrying the UMCIDs requires very little bandwidth.
Fig. 5 shows how a broadcast signal 450 is processed by terminal 600 to generate identification signal 660 for reception by device 700. Through antenna 604, signal 450 is so processed by radio receiver signal amplifying circuitry 610 to produce an audio signal for speaker 608. This audio signal is a type of human perceptible signal.
The pass through or preprocessed signal from 450 is sent to UMCID Extraction Module 620. Module 620 extracts the current UMCID 622 of the content in broadcasting, and sends UMCID 622 to state data writer 630, causing writer 630 to send data into state data register 632.
Data register 632 is a data holding center, responsible for keeping UMCID, radio receiver actual tuned-to frequency 612, mostly available from the amplification circuitry
610, and radio receiver identification number 614, number 614 is stored in the receiver by the manufacturer.
Register 632 keeps as much state-change history as practical. As receiver ID 614 is typically a constant and frequency data 612 is less changeable as UMCID, the primary function of register 632 is to keep UMCID history.
There are several conditions that cause state data sampler 634 to fetch data from register 632 to initiate a data transmission 660. When data register 632 has a state change, either as a result of UMCID 622 update or the listener (in the case of radio) changes statiorj resulting new frequency data 612, it will send a trigger to data sampler 634, informing sampler 634 to fetch data from register 632. When there is no change to register 632, a clock 607 will periodically prompt data sampler 634 to fetch data from register 632. Each time the data is obtained by 634, they are forwarded to encoder 636 to assemble into desired format, then to signal transmitter 638 and further to antenna/speaker/IR diode 640 transmitted into signal 660. Although terminal 600 uses ultrasound, the combination of all three transmission methods will improve overall ability, performance and versatility of 600 communicating to 700.
Terminal 600 transmits signal 670. Signal 670 includes a wake-up segment 662 foi waking up device 700, which is typically in sleeping mode to allow for the intermittent nature of transmission 660. Signal 670 also includes a segment for UMCID 612, a segmen for tuned-to f equency 612 and radio receiver ID segment 614. Although terminal 600 employs amplitude modulation, other methods may be employed.
In the cases when a TV is close-caption enabled, that information can be transmitted, via ultrasound in a protocol intended for device 700 to receive and capture. Such information may be used in place of actual recording of audio/video signal for identification purpose with the benefit of saving bandwidth and transmission time.
In Fig. 6, when antenna/sensor 720 receives signal 660 from the radio/TV receiver, the resulting signal is then fed into signal pre-processing module 722 for correction and amplification. The output from module 722 is sent to decoder 724 to be written to handset state register 728 by handset state writer 726. Handset state register 728 takes input, including current time and handset location information, from handset internal state
5 memory 741, and even audio signal 717 if desired, as well as handset built-in radio tuned to frequency data 713 in the case when a radio is integrated into a cell phone or pager.
Device 700 may generate a multi-value code in response to the user's actuation of a single button 712, as shown in Fig. 8. Device 700 may also generate a code in response to the user's actuation of multiple buttons, such as button 712 in combination with button 714.
10 More specifically, referring to Fig 10, a user has the option of sending a response message at the time of selection or sending the message at a later time. The selection inputs are short pulses when the user releases a button immediately after pressing. When one button is press-released, it represents first/ 1 /yes/for/good, etc; when two buttons are press-released, the input represents second/2/no/against/bad, etc; and three press-release's stand for
15 third/3/no-opinion/no-opinion/so-so, etc. If one or all buttons are press-held for duration longer than a pre-set time period, the device will send a message including all selections stored in the device.
Therefore, when input 711 from buttons in short pulses representing selections, handset state data register 728 creates an entry including all the state data at the moment of
»0 input 711. The register 728 holds the history log of all state data from all sources corresponding to the moment at which each input from 711 is entered. When input 715 from send button in a long pulse representing send command, handset state data sampler 730 requests a data transfer action from register 728 and handset stored info module 731. Data in 731 includes information stored by the device manufacturer and those
!5 provided by the user and updateable remotely via radio transmission from a central office of the wireless service provider. Data sampled by 730 are then complied into an email in response message generator 746. When activated to send the message, through the handset's own message transmitter 748, single or multiple messages 760 are transmitted via wireless network connection 750 to WISBRA 10.
SO Referring to Fig. 7, through Internet connection 890, the received message 760 is reassembled into four parts: UMCID and time 761; frequency, location and time 762; recording, time and location 763. Redundant information from UMCID, frequency and recording is purposely included here for illustration of how, when only some information present, the response is processed by WISBRA 10. Such information redundancy is typically desired for better quality of response message and versatility for processing. It is possible, however, the limitation of bandwidth may initially limit the use of actual
5 recording.
If all information is present, message 761 will be given first priority for processing in UMCID server 20, as it is data-efficient and containing all information to determine the audience's interest. UMCID server 20 will retrieve all the information related to UMCID is 761 and create a data pack to pass on to logic module 21 to decide where the data pack will
10 be forwarded.
There are at least three types of processing outcome to a response: To provide a reply message including links or info relative to response message; to use the response data to generate a report and email back the media company as the illustrative example "Polling"; to forward part or all information from a response to another system, which can
15 be "bidding", "voting", "rating", etc.
As described earlier, if an UMCID indicates "polling" response, the information output from UMCID server will be send to Polling server 22, where User ID/Selection/Reply information 764 is combined before sending to Poll report generator 23. Example of a polling result report 832 is emailed to the polling station (AM630, for
'.0 instance) at a specific cut off time. Similarly, if the message from audience is in response to a media session requesting "bidding", "voting", "rating", etc. from audience, Poll server 22 and polling report generator 23 will be respective "bidding", "voting", "rating", etc servers and report generators.
Polling can be conducted for situations when only Information of frequency,
.5 location and time 762 is available to Station server 18 and programming server 19 to determine the station and program to which the audience responded. If a program is found to be one that requested audience's opinions and aired time matches the audience response time, all resulting information from processing in server 18 and 19 is send to Polling server 22, whereon a report is generated and emailed as above described. iθ Polling may also be conducted for situations when only Information of recording, location and time 763 is available to Station server 18, programming server 19 and content data server 84 to determine the station and program to which the audience responded. This process is not as efficient as two previous steps as the content data server will run an actual comparison of recording to all program segment aired at the moment response message was created by the audience. If a program is found to be one that requested audience's opinions and aired time matches the audience response time, all resulting information from processing in server 18, 19 and 20 is send to Polling server 22, whereon a report is generated and emailed as above described.
If the UMCID indicates an information request by the audience, output from UMCID 20 or combined output from station server 18, programming server 19 and content data server 84 will be read in by listener server 16 along with user ID, selection and reply instruction 764 for processing. Including pertinent link or detail addressing the audience request, response email generator 24 will then compile an email 822, which will be sent to requesting audience following reply instruction from the particular requester.
It is advantageous for radio stations to have the ability to get listeners' instant feedback. System 2000 enables a listener to send a message to a station in real time via WISBRA 10 by pressing one button 712 in device 700. Such capability enables radio listeners to vote on polls, bid on offers, interact with a program or announcer simultaneously, anywhere, anytime, without having to call or write-in. This responding ability also minimizes or eliminates common bottlenecking for listener call-ins or the time delay for people writing in.
Media companies can determine audience information quickly and accurately. Such service, when provided to radio/TV stations, greatly improves the radio/TV broadcasting effectiveness as a media. Further, such ability for easy, instant direct response to a broadcast will significantly increase the value of radio/TV airtime, which in turn, increases profit and revenue of electronic media industry.
Methods for communicating between temiinal 600 and device 700 will now be described in more detail.
A first preferred way for communication between 600 and 700 is using local oscillating frequency from listener's radio set. It is known that when a particular station is tuned to a radio set, the radio/TV set's internal oscillator generates a electromagnetic signal at a particular frequency. And such frequency can be correlated to the broadcasting frequency of the tuned-to station. Using this principle, device 700 is equipped with a radio frequency receiver that registers the frequency of a radio/TV broadcast. The registered frequency generates a piece of data that dynamically changes as the listener changes radio station or getting close to an operating radio unit tuned to a station. The above-mentioned piece of data, as explained later in "Message" of this section, will be included in the message send to WISBRA 10 and is compared with the frequencies of stations in a geological area, of which WISBRA hosts information application service. The listener's actual location information can also be obtained from wireless providers or GPS output. Such method is preferred at present time due to the fact that almost all existing radio, TV and other electronic media terminals are not compatible for advanced features described in the exemplary system.
Another preferred way of communicating information to 700 is to include UMCID signal in the broadcast and have 600 re-broadcast such UMCID with other desired information to its immediate vicinity using short range wireless communication technologies like Bluetooth, Smart Dust, Portolan Project or Bluesky. 600 is equipped to extrapolate UMCID and prepare the signals for short-range transmit. The device 700 is equipped to recognize, capture and translate the signal into a useful data piece as previously described. This method is actively relaying the information to the vicinity. Therefore it is possible to implement into all forms of electronic media terminals and is preferred over the method described in the following paragraph for future applications. This method is preferred for second phase implementation of the exemplary system for two reasons: it take time for the market to have enough device to be economical; it is a more advanced mode of the exemplary system offering higher data rate and interactivity.
A third way of communicating information to 700 is to modify radio sets to produce a non-intrusive signal, in ultrasound and/or Infrared, reflecting the radio/TV unit's actual tuned-to frequency, which is readily available for displaying channels or stations to the users. Once captured by device 700, equipped to receive such signals, and sent to WISBRA 10, such data piece will provide information for identifying ratio stations a user of device 700 listened to.
Another way of capturing information for radio station identification is to use Ultrasound or Infrared to transmit UMCID into the immediate surroundings simultaneously with regular audio/text/video program by 600. Device 700 is equipped to receive such information. One advantage for this arrangement is its simplicity. Ultrasound and Infrared cannot go through walls. Therefore such arrangement does not need logic for determining who was in the room vs. next door as required by radio wave transmission such as Bluetooth™.
A fifth way of capturing information for radio station identification is to record the actual audio signal from the radio unit off the radio station actual broadcast. The actual
5 recording is sent to WISBRA 10 along with time and location as described before. The recording then will be compared with the digitized audio from all stations in the listener's geological area, at the time of sending the message. Using fuzzy logic and background noise processing, the match will automatically identify the station and the program/advertisement of interest to the requester.
.0 A sixth way of identifying UMCID is to embed the UMCID in audio signal with a special coding technique that does not affect the audio quality perceived by listeners. In this case, the 640 is the same as 608
One may also use a combination of two or more ways described above to facilitate communications between media terminals and the mobile device. Such arrangement can
,5 yield the more information allowing for more accurate data communication.
Fig 6 is a generic embodiment of the invention with IR/acoustic/RF, and Fig 8 is specifically with passive detection of RF emission of radio receivers corresponding to local osculating frequencies.
Fig. 8 details the first method preferred embodiment of the mobile device using
!0 passive communication mode, when oscillating signal 661 from the radio/TV receiver is received by antenna 720, the resulting signal is then feed into signal pre-processing module 721 to filter out unwanted signals and to provide amplification. The output from 721 is sent to Signal Frequency /strength analyzer 723 to identify the frequency with the most signal strength. The result from 723 is feed into a dynamic frequency data generator 725 for
»5 creating digital data useful for Frequency State Data writer 726 to input into Device State
Data register 728. Handset state register 728 takes input, including current time and handset location information, from handset internal state memory 741, and even audio signal 717 if desired as well as handset built-in radio tuned to frequency data 713 in the case when a radio is integrated into a cell phone or pager. The register 728 holds a history so log of state changes from all input sources. Such log creation can be programmed either automatically at a pre-set time interval or when it received an input representing Selection Button Activation 711. Fig. 9 shows logic in button decode module 802, allowing a single button 712 to be used to indicate for both selection and transmission. Logic in module 802 detects two types of button activation: press-release, generating a pulse signal with second half immediately follow the first half; and press-hold, generating a pulse signal with second half far apart from the first half. Button 712 generates a DC level for the time that user 74 presses down on button 712. Logic 802 measures the length of time of the level change, with a sustained level of less than one second being deemed press-release and a duration of greater than one second being deemed press-hold. Logic 802 generates a code equal to 1 when the user does a single press-release of button 712, generates a 2 when the user generates two sequential press-releases of button 712, and generates a 3 when the user actuates button 712 to produce three sequential press-releases. As shown in Fig. 9, codes 1, 2, and 3 cause device 700 to save the codes for sending at a later time, and an electronic mail message for example.
When logic 802 detects a press-release followed by a press-hold, logic 802 generates a code equal to four, when logic 802 detects two press-releases followed bya press-hold, logic 802 generates a code equal to 5 etc.
The right part of Fig. 9 indicates how system 2000 may interpret the codes generated by logic 802, which are subsequently combined with a signal from decoder 804, and transmitted by transmitter 11. Fig. 10 shows an alternate scheme wherein button decoder logic 802 is responsive to signals from button 710 and 714, as well as button 712. Pushing one button 712 generates a single press-release, causing decoder logic 802 to generate a 1. Actuating buttons 712 and 714 simultaneously is equivalent to two press-releases, causing button decoder logic 802 to generate a 2. Actuating all three button simultaneously is equivalent to three press-releases of a single button, causing button decoder logic 802 to generate a 3.
Press-release is used to indicate for selection, for example, one press-release stands for first/1/yes/for/good, etc; while two consecutive press-release's stand for second/2/no/against/bad, etc; three consecutive press-release's stand for third/3/no- opinion/no-opinion/so-so, etc. The practical time allowed for three consecutive press- release's is about one second. So the device can be programmed to detect pulses for a specified duration, as an example 1.2 second.
The press-hold can be used to initiate transmission. Thus when the Button Activation module 719 detects a first half pulse and fails to detect the second half of the pulse for a specified duration, as an example, 1 second, it sends a command 715 to device State Data Sampler 730.
Upon detecting an input from user button selection 715, handset state data sampler 730 requests a data transfer from register 728 and stored device information 731 , which is provided by the user and updateable remotely via radio transmission from a central office of the wireless service provider. Data sampled by 730 are then complied into an email in response message generator 746. When activated to send the message, through the built-in message transmitter 748, single or multiple messages 760 are transmitted via wireless network connection 750 to WISBRA 10.
If there is no radio station tuned to at the time of button activation, the last message will not have information for station identification. WISBRA 10 will ignore such data register log entries during message processing.
In summary, system 2000 is for creating and operating an integrated electronic media environment, especially for TV and radio, to enable close to real-time automatic media selling and buying, automatic content indexing and retrieval, automatic recognition of an operating electronic media receiver closest to a responding individual in a multi- receiver environment, and enabling instant wireless messaging in response to a broadcast or a general media session from anywhere and at anytime. System 2000 provides electronic media receivers for exposing the audience to a media session and transmitting information related to the media session at a first location, a wireless handheld device for receiving information related to the media session from the electronic media receiver and for automatic compiling and transmitting one or more messages corresponding to user's response to the media session at a first location, a computer with web browser and internet service or a internet ready device located at a second location remote or close to first location, a web-based electronic media business application computer system for on-line media selling and buying, universal media content identification (UMCID) generating and management, audience service, station service, content management and security management at a third location remote to the first and second location, a computer with web browser and internet service located at a on-line media buyer's location, a computer functionally similar to the buyer's at broadcast programming personnel's location, a computer functionally similar to the buyer's at program producer's location and a computer functionally similar to the buyer's at a disk jockey's location. System 2000 allows people to create an on-line advertisement over the internet by the on-line media buyer, the web- based electronic media business application computer system generating a unique UMCID
5 and attaching to that content created, reserve and marking one or more spots as sold in future play-list through browser in the media buyer's computer and updating such information in real time in the web-based electronic media business application computer system master database, entering text content or importing existing digital content linked to the sold spots through the media buyer's computer or similar computer into the master
0 database of the web-based electronic media business application computer system, dynamically feed time-driven spot and associated content information from the master database from the computer system into the computers at program producer's and disk jockey's locations over the internet, broadcasting the content from programming transmitter programming in audio, video or browser displayable format to one or more electronic
[5 media receivers at the first location, receive the content at the receiver, generating humanly perceptible audio, video or browser display output and transmitting a humanly imperceptible signal with UMCID and other desirable information into the environment of the first location.
Device 700 registers a user input by the device upon activation of an interface on
!0 the device, generates a dynamic log of the signal, user input and time of the input temporarily stored in the wireless handheld device, automatically compiles an email message including the log and other desirable information at the device, and automatically transmits the message via wireless network to the electronic media business application system upon user activation of a send input interface in the device.
55 System 2000 then receives the message at electronic media business application system, processes the message at the system according to UMCID in the messages to (a) reply to a response message include links on the internet to information satisfying user's request; or (b) forward some or all the information in the message to another system or specific locations; or (c) compose and post a report on information in the messages for
SO publishing and access over the internet by authorized users, and returns, through internet per instruction in the message or UMCID, the processing results, to the computer at the second location or an internet ready device at the second location or to the device at the first location; to a computer to another system or specific locations; to one or more specific computers within the computer system or at a location remote to the system.
Terminal 600 may be a TV, CD player, tape player, MP3 player or a computer or any other device for electronically carrying and render information in forms that are humanly perceptible.
Terminal 600 may include circuitry to read and extract the UMCID information sent with regular content to web browsers; generate infrared light as active transmission media for human imperceptible signal; generate radio wave as active transmission media for human imperceptible signal. Thus the preferred embodiments of the exemplary system provide an apparatus and method for prompt wireless instant messaging in response to radio or tv broadcasting and other electronic media session.
Though the illustrated system shows terminal 600 being a housing and terminal 700 being a separate housing, the functions of terminal 600 and device 700 may be combined into a device with a single portable housing such as a small radio or a combination radio cellular phone handset.
Although signal combiner 806 generates a composite signal by combining the output of decoder 804 in a respective field different from fields occupied by the output of decoder logic 802, these two types of signals may be combined in a more integrated way, t( occupy a single field with a field value derived from the combination of the output of decoder logic 802 and the output of decoder 804.
Although the illustrated system includes a device 700 that transmits a combined system in an electronic mail message sent over a voice channel of a telephone network, the invention may be practiced with other modes of sending the combined signal. For example, an alternative device 700 may send the combined signal using some type of Short
Message Service, sharing the spectrum of a control channel in a wireless cellular telephone system.
Additional advantages and modifications will readily occur to those skilled in the art. The invention in its broader aspects is therefore not limited to the specific details, representative apparatus, and illustrative examples shown and described. Accordingly, departures may be made from such details without departing from the spirit or the scope of Applicants' general inventive concept. The invention is defined in the following claims. Ir general, the words "first," "second," etc., employed in the claims do not necessarily denote an order.

Claims

What is claimed is:
1. A method for a system having a transmitter that broadcasts a first signal, the method comprising: receiving the first signal; decoding the first signal into a second signal, the second signal being human perceptible; decoding the first signal into a third signal, the third signal being digital; receiving an input from a user, after the decoding steps; generating a fourth signal, responsive to the input; generating a fifth signal by appending the fourth signal to the third signal; and sending the fifth signal.
2. The method of claim 1 wherein sending includes sending the fifth signal into a telephone network.
3. The method of claim 2 wherein sending further includes sending into a voice channel of the telephone network.
4. The method of claim 1 wherein sending includes generating an electronic mail message.
5. The method of claim 1 wherein the input has greater than 2 values.
6. The method of claim 1 wherein the third signal includes an identification of an originator of a content of the first signal.
7. The method of claim 1 wherein the third signal includes an identification of an agency representing a buyer of an advertisement in the first signal.
8. The method of claim 1 wherein the third signal includes an identification of a broadcasting network carrying the first signal.
9. The method of claim 1 wherein the third signal includes an identification of a station or channel carrying the first.
10. The method of claim 1 further including receiving fifth signals from a plurality of users; processing the received fifth signals to generate a composite signal.
11. The method of claim 10 wherein the second signal includes an invitation to respond to a survey, and the composite signal includes a result of the survey.
12. The method of claim 11 wherein the third signal includes an identifier corresponding to the survey.
13. The method of claim 12 wherein the identifier includes a number identifying a question in the survey.
14. The method of claim 1 further including periodically inserting the third signal into the first signal.
15. A processing system for a system having a transmitter that broadcasts a first signal, the processing system comprising: a receiver that receives the first signal; a decoder that decodes the first signal into a second signal, the second signal being human perceptible, and decodes the first signal into a third signal, the third signal being digital; a user interface that can generate 2 values in response to manipulation by the user; a signal generator that generates a fourth signal, responsive to the input, and a fifth signal by appending the fourth signal to the third signal; and a transmitter that transmits the fifth signal.
16. The processing system of claim 15 wherein the transmitter includes an interface into a telephone network.
17. The processing system of claim 15 wherein the transmitter includes a telephone.
18. The processing system of claim 15 further including software that generates an electronic mail message.
.
19. The processing system of claim 15 wherein the input has greater than 2 values.
20. The processing system of claim 15 wherein the third signal includes an identification of an originator of a content of the first signal.
21. The processing system of claim 15 wherein the third signal includes an identification of an agency representing a buyer of an advertisement in the first signal.
22. The processing system of claim 15 wherein the third signal includes an identification of a broadcasting network carrying the first signal.
23. The processing system of claim 15 wherein the third signal includes an identification of a station or channel carrying the first.
24. The processing system of claim 1 further including a network node that receives fifth signals from a plurality of users, the network node including a processor that processes the received fifth signals to generate a composite signal.
25. The processing system of claim 24 wherein the second signal includes an invitation to respond to a survey, and the composite signal includes a result of the survey.
26. The processing system of claim 25 wherein the third signal includes an identifier corresponding to the survey.
27. The processing system of claim 26 wherein the identifier includes a number identifying a question in the survey.
28. The processing system of claim 15 further including periodically inserting the third signal into the first signal.
PCT/US2001/007036 2000-03-07 2001-03-06 Communication systems and methods WO2001067349A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US10/257,437 US20030223554A1 (en) 2001-03-06 2001-03-06 Communication systems and methods
AU2001245442A AU2001245442A1 (en) 2000-03-07 2001-03-06 Communication systems and methods

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US18751400P 2000-03-07 2000-03-07
US60/187,514 2000-03-07

Publications (1)

Publication Number Publication Date
WO2001067349A1 true WO2001067349A1 (en) 2001-09-13

Family

ID=22689298

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/007036 WO2001067349A1 (en) 2000-03-07 2001-03-06 Communication systems and methods

Country Status (2)

Country Link
AU (1) AU2001245442A1 (en)
WO (1) WO2001067349A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4905080A (en) * 1986-08-01 1990-02-27 Video Research Ltd. Apparatus for collecting television channel data and market research data
US5907793A (en) * 1992-05-01 1999-05-25 Reams; David A. Telephone-based interactive broadcast or cable radio or television methods and apparatus
US6230156B1 (en) * 1995-06-21 2001-05-08 Microsoft Corporation Electronic mail interface for a network server

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4905080A (en) * 1986-08-01 1990-02-27 Video Research Ltd. Apparatus for collecting television channel data and market research data
US5907793A (en) * 1992-05-01 1999-05-25 Reams; David A. Telephone-based interactive broadcast or cable radio or television methods and apparatus
US6230156B1 (en) * 1995-06-21 2001-05-08 Microsoft Corporation Electronic mail interface for a network server

Also Published As

Publication number Publication date
AU2001245442A1 (en) 2001-09-17

Similar Documents

Publication Publication Date Title
US20030223554A1 (en) Communication systems and methods
US11265184B2 (en) Broadcast response method and system
US20020065034A1 (en) Methods and system for universal interactive services for broadcasting media
US20020032904A1 (en) Interactive system and method for collecting data and generating reports regarding viewer habits
CN1607832B (en) Method and system for inferring information about media stream objects
US7313360B2 (en) Dynamic data delivery apparatus and method for same
US8645995B2 (en) Communication system and method
US7363001B2 (en) Dynamic data delivery apparatus and method for same
CN101669310B (en) Program identification using a portable communication device
US20020056084A1 (en) Active media content access system
CA2836213A1 (en) Multiple radio signal processing and storing method and apparatus
US8583177B2 (en) Receiver for audio player
CN101128813A (en) Method and system for providing information which relates in broadcasting
US6993284B2 (en) Interactive access to supplementary material related to a program being broadcast
WO2002098029A1 (en) Interactive system and method for collecting data and generating reports regarding viewer habits
WO2001067349A1 (en) Communication systems and methods
WO2001041441A1 (en) Methods and system for universal interactive services for broadcasting media
EP1445952A1 (en) Interactive access to supplementary material related to a program being broadcast
US20090122993A1 (en) Information capturing method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 10257437

Country of ref document: US

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP