WO2004036902A1

WO2004036902A1 - Method and system for supporting user interaction in broadcasting

Info

Publication number: WO2004036902A1
Application number: PCT/FI2003/000764
Authority: WO
Inventors: Lari Aho
Original assignee: Infocast Systems Oy
Priority date: 2002-10-15
Filing date: 2003-10-15
Publication date: 2004-04-29
Also published as: AU2003268993A1; EP1552686A1; KR20050052538A; FI20021831A0; FI113133B

Abstract

Method for supporting user interaction in interactive TV and radio programs. The method enables a new way to implement the interaction, as well as new types of content services. For example, a viewer may obtain a picture of his/her favourite actor as follows: the viewer presses a key of a remote control when the favourite actor is shown on a TV-receiver, the TV-receiver sends a time code to the viewer's mobile phone, the viewer transmits the time code to a still image service, and the service sends the still image of the favourite actor in a MMS message to the viewer. The method is based on the idea that each piece of a broadcast can be mapped to a code, such as a time code. This way a TV-viewer can interact with a program pointing to any piece of the broadcast by using the time code.

Description

Method and system for supporting user interaction in broadcasting

Field of the invention

The present invention generally relates to video and/or audio broadcasts and user interaction with TV-programs and other types of interactive content services.

Background of the invention

Digital TV-broadcasts have been started in many countries and they will replace the present analog TV-broadcasts in the long run. Digital broadcasting involves digital television, cable TV, video streaming, radio, multimedia programmes, the Internet etc. A digital television set may be able to receive all of these types of services. Digital Audio Broadcasting (DAB) and Digital Video Broadcasting (DVB) are terms generally used in associa- tion with digital broadcasting.

An interactive TV or a two-way TV is a term that is usually used when viewers can communicate with interactive TV-programs. A viewer can send information to the broadcaster or to a service provider to make orders, answer quizzes, take part in polls, etc. A return channel or a back channel is a term meaning the channel that is intended for transrnitting viewer information, such as the viewer's identity and choices, to a broadcaster or a third party. A public switched telecommunication network (PSTN) or a mobile communication network can be utilized when implementing a return channel. A viewer may send his/her information via a return channel to a broadcaster, for example, by using a mobile phone. There are various ways known in the prior art to implement a return channel.

In this patent application we use the term "An interactive content service" meaning a service of which content is mainly transmitted via a video and/or audio broadcast network to users and which is coupled with at least one return channel. For example, TV-programs and advertisements can be considered as interactive content services. The viewers of TV-programs obtain the content of a service mainly via their TV- receivers and, if they wish, they may use a return channel to interact with the said service. GB 2360171 describes one example of using a return channel. A telecommunication system is used for interaction between a viewer and a

TV-program service. The viewer has a teddy bear with a control module. The viewer can act through the control module and as response to the user act, the TV-program service can, for example, move a leg of the teddy bear.

The prior art TV-advertisement may contain a phone number, a text TV page, or an Internet address through which information about the advertised product is available. The phone number or the text TV page shown in the TV-advertisement is associated with an advertised product. Thus, when the viewer calls to the said number or watches the said text TV page he/she gets information about the advertised product. If the TV- advertisement contains an Internet address, the said Internet address may be dedicated to the advertised product, or there is a link or a set of links through which the viewer obtains an Internet page containing information about the advertised product.

A phone number, a text TV page, and an Internet address are the prior art means intended for viewer interaction with a TV-advertisement or another TV-program. Therefore phone numbers, text TV pages and Internet addresses could be termed "action codes". When a viewer sees something interesting on TV, he/she may act using an action code shown on TV.

A TV-viewer is one example of a user and a radio listener is another example, thus the term "user" refers to the both of them. Sometimes an employee of a service provider working with a broadcast can be considered as a user, too. The first drawback of the prior art is that the usability of action codes is weak. Commercial breaks are often short, thus users may lack the time to write down a phone number. Anyway, making a phone call or using the Internet may cost too much to interest the users.

The second drawback of the prior art is that interaction possibilities are very limited, because a service provider strictly controls the interaction. The service producer allocates a set of action codes, maps the action codes to one or more TV-programs, and shows them in the TV-programs.

The third drawback is that there is a lack of means enabling a user to point to any piece in a broadcast when the user interacts with the service related to the broadcast. This kind of means would be very useful in some prior art content services and new types of content services. Summary of the invention

When implementing an interactive content service there is a basic question to solve: "How can a user point to a certain piece in a broadcast when he/she interacts with the broadcast?" In the new type of services the basic question is: "How can a user point to any piece in a broadcast when he/she interacts with the broadcast?" The objective of the invention is to solve the above-mentioned prior art drawbacks and offer a possibility to point to any piece in a broadcast. This pointing possibility enables the new type of services and a new way to implement the prior art services.

In addition to a phone number, a text TV page, and an Internet address, there is a new method to use. Most broadcasts include a time code. Thus, we may consider that a broadcast is divided into pieces so that each piece has a unique time code. In one aspect of the invention a user captures a time code from a broadcast, for example, by using a remote control. Then the user sends the captured time code in a short message to a predefined phone number. A system receiving the short message obtains the time code from the short message. The said system has access to storage in which the broadcast is stored. The system reads the storage and finds the certain piece of the broadcast to which the time code is mapped. The system determines the context of the user action on grounds of the found piece of the broadcast. For example, the context may be that the user wishes to get extra information about the product shown in the broadcast. A TV-receiver in accordance with the invention receives a signal initiated by a user and as response to the signal received obtains a time code or a corresponding code from the broadcast, wherein the said code identifies a certain piece in the broadcast. After that the TV-receiver presents the code to the user and/or sends the code to another device. The system in accordance with the invention is intended for one or more interactive content services. A still image service is one example of a new type of service. When a user captures a time code from a digital TV- broadcast and sends it to a service producer he/she will obtain, for example, a picture of his/her favourite actor in a message containing multimedia, such as an email or Multimedia Messaging Service -message. Brief description of the drawings

The invention is described more closely with reference to the accompanying drawings, in which

Figure 1 shows an example of time-based encoding,

Figure 2 shows an example of sequence number-based encoding,

Figure 3 shows a third example of encoding,

Figure 4 shows a TV-receiver for interactive programs,

Figure 5 shows a service display and an interaction logo intended for help- ing a viewer in interaction with a TV-program,

Figure 6 shows method for supporting user interaction,

Figure 7 shows an example of a system supporting user interaction.

Detailed description of the invention

The invention comprises the method and system for supporting user interaction, as well as a terminal for presenting a broadcast that contains an interactive program.

In many countries several TV- and radio channels simultaneously broadcast their programs. Some TV-channels show programs 24 hours a day and some of them have a transmission break at night. Let us suppose that the broadcast of a certain TV- or radio channel lasts at most 24 hours. If each piece of the broadcast is second's length, the broadcast is divided into at most 86400 pieces, wherein each piece is mapped to a certain code. The said code could be termed a POB code (a piece of broadcast code). A POB code can be used for the same purpose as a phone number, a TV text page, or an Internet address. There are various ways to encode POB codes and map the POB codes to the pieces of a broadcast.

FIG. 1 shows an example of time-based encoding. A broadcast 101 is divided into 86400 pieces, so that the first piece 102 of the broadcast is mapped to a POB code 00.00:00, the second piece 103 is mapped to a POB code 00.00:01 etc.

In the previous example each piece of the broadcast is one second in length. Pieces could be shorter or longer, too. A TV-broadcast can be divided into pieces that are still images. In that case, the POB codes mapped to the pieces of the TV-broadcast preferably include one hundredths of a second. Therefore a user can to point any still image he/she wants to by using the POB code mapped to it. This way the user may get, for example, a picture of his/her favourite actor, a video clip, or an animation.

FIG. 2 shows an example of sequence number-based encoding. A broadcast 201 is divided into 86400 pieces so, that the first piece 202 of the broadcast is mapped to a POB code 1 , the second piece 203 is mapped to a POB code 2, the third piece 204 is mapped to POB code 3 etc.

During a radio broadcast a radio listener may get information about a piece of music played on the radio by sending the POB code to the radio station. In this case, the piece of music is the piece of the broadcast to which the POB code is mapped. The piece of music may last, for example, two minutes, thus the said piece of the broadcast also lasts two minutes.

POB codes can be encoded using numbers and/or letters, or other characters. The pieces of a broadcast may or may not have a) the same length in time or b) the same size in bytes. Each piece does not need to be mapped to a POB code, because some programs presented on a channel may be non-interactive. Thus, POB codes can be omitted from non- interactive pieces of a broadcast. Alternatively, we may suppose that a null POB code is transmitted with each non-interactive piece of a broadcast. FIG. 3 shows an example of encoding, wherein the pieces of a broadcast are different in length and POB codes have been omitted from some pieces. The broadcast 301 is divided into pieces, so that the first piece 302 of the broadcast is mapped to a POB code "AA" and the longer second piece 303 is mapped to a POB code "AB". A POB code is omitted from the third piece 304. When using alphabet A-Z there are available 676 POB codes composed of two letters.

It is also possible that two or more pieces of the same broadcast have the same POB code. For example, an advertisement presented several times in a day may have the same POB code. We may define a POB code as follows: A code transmitted in a video and/or audio broadcast to a terminal and a) made visible and/or b) sent to another device as a response to a signal initiated by a user, wherein the POB code is mapped to a certain piece of the broadcast. However, a POB code is not necessarily transmitted in a broadcast, when the POB code is obtained using a determination based on frame size, or another size in bytes, or a time code, a pulse, or other data transmitted in the broadcast. The point of time shown on TV is not a POB code, because it changes all the time, second by second. Neither is a text TV page a POB code, because it is not obtainable from a broadcast as a time code. It is very important that a user can make a POB code visible and/or send it to another device when watching and/or listening to a broadcast. The prior art text TV pages are not like that.

The terminal in accordance with the invention is adapted to 1) receive a signal initiated by a user, 2) obtain a POB code from the broadcast, wherein the POB code identifies a certain piece in the broadcast, and 3a) display the POB code to the user and/or 3b) send the POB code to another device.

The terminal may be a TV- or radio receiver, or a terminal equipped with a TV- or radio receiver. Some known mobile phones already contain a radio receiver. Those mobile phones are very appropriate for inter- active radio programs, because a radio receiver and a return channel are integrated in one device. In addition, the said mobile phones may contain a relatively big display and JAVA support.

FIG. 4 shows a TV-receiver presenting an interactive program. The TV-receiver 401 receives a signal 402 initiated by a viewer 403 and as response to the signal obtains a POB code from broadcast 404. The TV- receiver 401 displays 405 the POB code to the viewer and sends 406 it to a mobile phone 407, for example, by using Bluetooth technology. After that the viewer may send the POB code from the mobile phone 407 to the system managing the interactive program. The Bluetooth wireless technology is a specification for a radio link that can be integrated into mobile devices. Bluetooth eliminates the need for using cables to connect computers, mobile phones, mobile computers and other types of electronic devices. There are also other possibilities to send a POB code from a TV-receiver to another device. For example, the TV- receiver 401 shown in FIG. 4 could be connected to the Internet. If so the TV- receiver can send the POB code via the Internet to another device. Before transmission the TV-receiver may request a confirmation from the viewer.

Each TV-channel needs only one phone number, because a POB code is mapped to a certain piece of the broadcast. The context of a user action can be determined on grounds of the said piece of the broadcast. FIG. 5 shows a service display and an interaction logo intended to help user interaction with a TV-program. When a TV-program includes an interactive part, an interaction logo 501 is shown in a TV-receiver 502. Then a viewer can act by pressing a remote control key. For example, the viewer may act when seeing his/her favourite actor 503 on TV. After pressing the key a service display 504 appears on the screen of the TV-receiver. The service display 504 contains the POB code "AFFE".

POB codes can be automatically mapped to the pieces of a broadcast, for example, by using a time code. However, it is also possible that a broadcaster or a content provider maps POB codes to some pieces of a broadcast before or during the broadcast. A POB code can be mapped to anything visible or audible in the broadcast. Thus, an employee of a broadcaster or a content provider, or a specific person or program can map a POB code to a certain piece of a broadcast. For example, a TV-commentator may select one or more still images related to a soccer game and map POB codes to the still images, after which viewers may watch and order the said still images.

In digital broadcasts the possibilities to utilize the invention are greater than in analog broadcasts. A digital broadcast may include JAVA bytecode or corresponding elements that are intended to show additional content, such as a service display or a menu, in terminals. An application programming interface (API) is an interface enabling the efficient execution of applications. The JAVA bytecode can be considered as an application and it can be delivered in a broadcast to terminals, such as digital TV-receivers. Multimedia Home Platform API (MHP-API) is intended for multimedia applications. JAVA objects, which are instantiated from JAVA bytecode in a terminal, may use MHP-API or some other API supporting JAVA. However, JAVA is just one possible programming language that can be used when implementing applications. FIG. 6 shows the method steps in accordance with the invention.

At first, the method receives (601) a user signal at a terminal presenting a digital TV-broadcast, and as response to the user signal received, the method obtains (602) a certain (POB) code mapped to a certain piece of the broadcast. The method presents (603) a service display on the terminal to a user which initiated the user signal, and when an option to use a return channel is missing (604) from the terminal, the method makes the said code visible through the service display (605). In any case, the method sends (606) the code from a site of the user to a server having access to a data storage in which at least a part of the broadcast is stored. Then, at the server, the method receives (606) the sent code. When the code is related to a predefined operation in which the certain piece of the broadcast is needed (608), the method fetches (609) the certain piece of the broadcast from the data storage by using said code as a search key and performs (610) the predefined operation. The predefined operation may result in, for example, the certain piece of the broadcast, which is fetched from the data storage, is transformed to MMS form before sending it to the user. The method may present (603), for example, a service display 504 shown in figure 5. When the terminal has the option to use the return channel (604) there is no need to present the code, i.e. the POB code, to the user. The option means here that 1 ) the terminal is equipped with the return channel, 2) the user allows usage of the return channel, and 3) a service provider providing the digital TV-broadcast allows the usage of the return channel. Otherwise, the option is missing.

The method may present the POB code for a predefined time, for example, one minute. Alternatively, the method may wait for another signal initiated by the user to remove the POB code from the display of the terminal. The point is that the POB code is presented to the user so that the user has enough time to use it.

A user may send user information of a different type with a POB code to the device handling the user interaction. The user information may include, for example, the user's phone number. Or, the user information may include one or more user choices. For example, a user may define how long a video clip he/she wants to obtain. When user information is +10, it could define that a user wants to have a video clip which starts from a point of time determined by the POB code and which ends ten seconds later. There are various ways to encode this kind of user information. If the user information includes the phone number, as mentioned above,

A video clip, a piece of music, a still image etc. are examples of user-specific content which a user may obtain as a response to the POB code and possible user information sent by the user. When receiving the code (606) from the site of the user, the method may simultaneously receive user information that includes at least one of the following types information: 1) information defined by the user, 2) information identifying the user, 3) information identifying a certain device from which the information was sent, and/or 4) a location information of the user. If the method should send one or more messages to the user, the method needs the user information that includes the information identifying the user and/or the information identifying the certain device. This message/ messages includes, for example, a still image or a video clip. The consideration whether the code is related to the predefined operation in which the certain piece of the broadcast is needed (608) is based on the TV-program of which piece the code is mapped.

The POB code and/or the user information may be sent to the server in a message via a network which is able to charge the message. The predefined operation may include at least one of the following sub-operations: storing a piece of user information for a later use or changing a value of a certain counter which is related to the user information.

The system in accordance with the invention is adapted to:

1 ) store at least a part of a digital TV-broadcast with a set of non- visible codes in a data storage, each code being mapped to at least one piece of said broadcast,

2) receive a code from a site of a user, wherein as response to a user signal initiated by the user said code is obtained from the digital TV- broadcast presented through a terminal at the site of the user, 3) fetch said piece from the data storage by using said code as a search key in a case that said code is related to a predefined operation in which the certain piece of the broadcast is needed, and 4) perform the predefined operation. FIG. 7 shows an example of a system supporting user interaction. There is a set of viewers 701 and the system 702. Various networks could be used in a communication between the viewers and the system, but these implementation specific details are omitted from FIG. 7. Let us suppose that the system is composed of a server 703 and a database 704, and interactive TV-programs belonging to a broadcast are stored in the database 704. The system 702 receives a POB code 705 sent by a first viewer and a POB code 706 sent by a second viewer. Both POB codes 705 and 706 are "19.21". In addition, the system receives user information from both viewers. The said user information contains the phone number of the viewer and a "yes/no" answer. Let us suppose that the POB code "19.21" is mapped to a piece of broadcast containing the TV- quiz question number 3. Therefore the system performs an operation related to the said piece. The operation could be, for example, running a service that handles the viewer answers to the TV-quiz. In addition to POB code 705 and 706, the system receives a POB code 707 from a third viewer. The POB code 707 is "21.32:45.02" which is associated to a soccer match broadcasted 21-23 in the evening. In more detail, the POB code 707 is mapped to the first goal made in the said soccer match. In this case, the system may run a service that sends a still image of the first goal 708 to the third viewer.

Sending a still image, a video clip, or another user-specific content to the user is just one example of a result of a predefined operation. The predefined operation is composed of one or more sub-operations.

The predefined operation may include at least one of the following sub-operations: storing a piece of the user information for a later use, or changing a value of a certain counter which is related to the user information. The counter values and/or the pieces of the user information may be stored in the same data storage as the digital TV-broadcast, but they can be stored to another data storage, too. The system may be further adapted to calculate statistics using at least one of the following entity: the stored piece of the user information or the value of the certain counter.

TV-channel broadcaster that utilizes the system can use the user information and/or values of counters when implementing various services. For example, a service may calculate statistics or perform analysis. Thus, the service may measure activity of TV-viewers, practice direct marketing to TV- viewers, or offer interactivity possibilities among the TV-viewers interested of the particular part of the broadcast. The above-mentioned examples are just some examples of how to utilize the inventive method and system. There are several other possible modifications that can be made to the disclosed solutions without departing from the scope of the invention as defined in the patent claims.

Claims

1. A method for supporting user interaction in digital TV-broadcasting, c h a ra ct e ri z e d by the steps of: transmitting a digital TV-broadcast with a set of non-visible codes, each code being mapped to at least one piece of said broadcast, receiving a user signal at a terminal presenting the broadcast, and as response to the user signal received, a) obtaining a certain code mapped to a certain piece of the broadcast, b) presenting a service display on the terminal to the user which initiated the user signal, and when an option to use a return channel is missing from the terminal, c) making said code visible through the service display; sending the code from a site of the user to a server having access to a data storage in which at least a part of the broadcast is stored; at the server receiving the sent code, and when said code is related to a predefined operation in which the certain piece of the broadcast is needed, fetching said piece from the data storage by using said code as a search key; and performing the predefined operation.

2. The method as defined in claim 1 , c h a ra ct e r i z e d by the further step of: in addition to presenting the service display on the terminal to the user, presenting a still image on the terminal as response to the user signal received.

3. The method as defined in claim 2, c h a ra ct e r i z e d in that as response to the sent code sending the still image from the server to a device defined by the user, wherein said still image is obtained from the certain piece of the broadcast.

4. The method as defined in claim ^characterized in that in addition to sending the code, sending user information from the site of the user to the server, said user information including at least one of the following types information: information defined by the user, information identifying the user, information identifying a certain device from which the information was sent, a location information of the user.

5. The method as defined in claim 4, characterized in that the predefined operation includes at least one of the following sub- operations: storing a piece of user information for a later use, changing a value of a certain counter which is related to the user information.

6. The method as defined in claim 4, characterized in that the predefined operation includes sending a period of the broadcast to the user as response to the user information received, said period of the broadcast being determined by the user information.

7. The method as defined in claim 1, characterized in that the code is sent to the server in a message via a network which is able to charge the message.

8. A system for supporting user interaction in digital TV-broadcasting, characterized in that the system is adapted to: store at least a part of a digital TV-broadcast with a set of non- visible codes in a data storage, each code being mapped to at least one piece of said broadcast, receive a code from a site of a user, wherein as response to a user signal initiated by the user said code is obtained from the digital TV- broadcast presented through a terminal at the site of the user, and fetch said piece from the data storage by using said code as a search key in a case that said code is related to a predefined operation in which the certain piece of the broadcast is needed, and perform the predefined operation.

9. The system as defined in claim 8, characterized in that in for performing the predefined operation the system is adapted to send the still image to a device defined by the user, wherein said still image is obtained from the certain piece of the broadcast.

10. The system as defined in claim 8, characterized in that the system is further adapted to receive user information from the site of the user, wherein said user information includes at least one of the following types information: information defined by the user, information identifying the user, information identifying a certain device from which the information was sent, a location information of the user.

11. The system as defined in claim 10, characterized in that for performing the predefined operation the server is adapted to send a period of the broadcast to the user, said period of the broadcast being determined by the user information.

12. The system as defined in claim 10, characterized in that the predefined operation includes at least one of the following sub- operations: storing a piece of the user information for a later use, changing a value of a certain counter which is related to the user information.

13. The system as defined in claim 12, characterized in that the system is further adapted to calculate statistics using at least one of the following entity: the stored piece of the user information, the value of the certain counter.

14. The system as defined in claim 8, characterized in that the code is sent to the system in a message via network which is able to charge the message.