DE102008002276B4 - Method and arrangement for transmitting image data and a corresponding computer program and a corresponding computer-readable storage medium - Google Patents

Abstract

Method for transmitting image data, wherein data comprising at least one camera-equipped mobile terminal video data is at least partially transmitted to a data processing device via at least one wireless communication link,
wherein the at least one wireless communication link is established by a call, and
at least the video data is converted by the data processing device into a broadcastable signal and forwarded to a television server (4) or stored as a video codec in a data memory (8), wherein at least the video data is synchronized and / or stabilized by the data processing device before further processing ,

Description

The The invention relates to a method and an arrangement for transmission of image data as well as a corresponding computer program and a corresponding computer-readable storage medium, which in particular can be used in the television production for timely embedding from mobile picture material in television programs.

Field of the invention

The The leading medium of television is about to change in a sustainable way. in the In the course of technical development "smaller, faster, cheaper" has at Spectators at home a revolution occurred! Almost everyone is capable of moving pictures and sounds, on a high technical level, with his mobile phone (cellphone) with Camera, a mobile phone camera or other mobile-enabled device such as handheld device, PDA o. Like. To produce and ship. This fact becomes interesting in the Regard to "Neves", where it on topicality and speed matters. Mobile phone, camera on it, comment spoken. So could direct, immediate and different views on a current Event arise. So far, these production alternatives can be found no way to the TV. Especially the participation of the "amateur" finds so far in the professional Area barely held. Instead, platforms like Youtube are booming. They offer space for individual created content that blocks the way to classical television remains. So far, the mass medium television has not succeeded for an interaction to open with the crowd.

there the advantages are obvious. In the production of news is saved and mobile users are usually always closer than a television team. And at the touch of a button pictures and sounds without additional Equipment sent to a central office.

Not forget: media are more democratic, because of the multitude The cell phone owner creates plurality. More choice, more perspectives, more opinions. Of course, this flood of information must be filtered and edited. To prevent an information overkill and quality standards to secure.

Various solutions for the transmission of video data in IP environments are already known from the prior art. So describes z. B. the German patent DE 103 20 889 B3 a method and apparatus for generating and transmitting a television program on the Internet. A livecoder PC is used, which presupposes the presence of a stable picture and sound signal at the location of the encoding. This requirement is not given in the transmission via mobile device in the rule.

In the international patent application WO 03/056822 A1 a portable switching device for video streams is presented. This switching device receives video streams from various recording devices, selects one of the video streams, and transmits it to a destination. Video streams can also be fed into a traditional broadcast system.

A mobile information system is mentioned in the patent application GB 2 358 326 A described. Here several cameras and a computer are installed in a vehicle. The computer splits the data stream from the cameras and forwards it in parallel to several modems, which transmit it to a receiving station, where the data stream is recombined and played live. Playback can be done on the internet or in a conventional broadcast system.

The The object of the invention is thus to provide a method and a Arrangement for transmission of image data as well as a corresponding computer program and a provide appropriate computer-readable storage medium, which fix the disadvantages of the known solutions and in particular enable, Video data sent from mobile devices in television studios editorially edit and essentially in real time TV program to integrate.

These The object is achieved by the Features in the claims 1, 12, 20 and 21 solved. Advantageous embodiments The invention are contained in the subclaims.

A particular advantage of the method according to the invention for the transmission of image data is that the video data transmitted by a mobile terminal can be processed in a simple manner in a conventional television studio essentially without loss of time. This is achieved by data comprising video data from at least one mobile terminal, which is advantageously equipped with a camera (ie video data alone or together with additional data - hereinafter the term 'video data' implies that this video data alone or together with others Data is transmitted) to a data processing device, where at least the video data is converted into a broadcastable signal. The at least one mobile terminal device is preferably a mobile phone camera, a personal digital assistant (PDA) or the like, and the transmission of the video data preferably takes place at least in part over a wireless communication link, such as 3g or 4g networks. The data processing device receives the video data transmitted by the at least one mobile terminal, converts these into signals which can be fed into a television program and can be transmitted there, and then forwards them to a television server. Alternatively, the signals resulting from the conversion, broadcastable signals can also be stored as a video codec in a data memory.

In a preferred embodiment In the invention, the broadcast-capable signals are standard definition broadcasting signals (SD broadcasting signals). The data processing device therefore comprises in one embodiment means, by which the ones sent by the at least one mobile terminal and video data received from the data processing device into an SD broadcasting signal be converted.

In a further preferred embodiment The invention comprises the unit for converting the video data into an SD broadcasting signal at least one frame synchronizer, at least one A / D converter and at least one audio embedder (so-called Black Magic Multiconverter).

The Video data can from the at least one sending mobile terminal as a video stream, video call or as a file (eg mp4 file) to the data processing device be sent. Another preferred embodiment of the method according to the invention Therefore, provides that the video data in an analog signal, preferably into an analog video / audio signal such as a PAL signal, be converted before being converted into the SD broadcasting signal become. A preferred embodiment the invention provides that of the at least one transmitting mobile terminal received video data is received by a receiving station, which makes the conversion to the analog video / audio signal. The analog signals can then, for example, over a PAL output, such as. B. a video output as a receiving station used mobile phone camera, transferred to a CVBS connection become.

in the In general, data is transferred to the data processing device, which information includes from which video data extract to let. The extraction of the video data is performed by the data processing device. Subsequently As described, the conversion into an analog signal and the forwarding to the TV server.

In a further preferred embodiment the analog signal is converted to the SD broadcasting signal before conversion synchronized and / or stabilized, for example by a Mixer or Frame Synchronizer.

A Another preferred embodiment of Invention provides that the video data, which of the at least a mobile device are received from a similar second mobile terminal which is included by the data processing device. (In the following, the at least one sending mobile terminal is also called first mobile device In general, however, to receive the at least transmit a first mobile terminal Video data each receiving station can be used, which in a communication link with the at least one first mobile terminal can occur. This communication connection can for example, constructed by the at least one first mobile terminal Alternatively, it is equally possible that the communication link from the data processing device or from the receiving station is built. For example, a communication connection be built by a mobile phone camera, which serves as a receiving station is used to call one or more of the first mobile terminals.

When it proves particularly advantageous if incoming calls from the receiving station automatically accepted and for further processing to get redirected. The forwarding and / or further processing the video data incoming with the call is made according to information which the incoming call and / or video stream through the receiving station be removed. For example, this information is to the transmitting with the call and / or video stream phone number of the sending first mobile terminal, the call time, the location of the sending mobile terminal, metadata the sending first mobile terminal (eg a sending mobile terminal) Cell phone camera) o. The like. This list is not as final to understand. This information is transmitted by the receiving station evaluated and, for example, for the forwarding and / or further processing of the incoming video data used.

An arrangement according to the invention for the transmission of image data comprises at least a first mobile terminal, which is equipped with a camera, a data processing device and a television server. According to the invention, the arrangement is set up such that video data is transmitted from the at least one mobile terminal to the data processing device via at least one wireless communication link. From the data processing device The video data is converted into a broadcastable signal and forwarded to a television server. Alternatively, the video data converted into the broadcast-capable signal can be stored as a video codec in a data memory.

Preferably the first mobile terminal is a cell phone camera, a staff Digital Assistant (PDA) or the like

In a preferred embodiment the data processing device comprises at least one receiving station for receiving the video data, wherein the receiving station, for example as a second mobile terminal accomplished may be, which corresponds to the first terminal.

In a further preferred embodiment is provided that the data processing device also at least a means for synchronizing and / or stabilizing an analogue Includes video / audio signal.

A computer program for transmitting image data allows a data processing device, after it has been loaded into the memory of the data processing device, to carry out a method for transmitting image data, wherein at least one mobile terminal (FIG. 1 ) At least partially via at least one wireless communication link to a data processing device, at least the video data converted by the data processing device into a broadcastable signal and to a television server ( 4 ) or as a video codec in a data memory ( 8th ) are stored.

In a further preferred embodiment The invention provides that the computer program according to the invention modular, with individual modules on different components installed the inventive arrangement are.

Such Computer programs can for example (for a fee or free of charge, freely accessible or password protected) downloadable provided in a data or communication network become. The provided computer programs can then be harnessed by a method in which a computer program Claim 22 from an electronic data network, such as from the Internet, to a data processing device connected to the data network is downloaded.

In order to carry out the method according to the invention for the transmission of image data, it is provided to use a computer-readable storage medium on which a program is stored which, after being loaded into the memory of the data processing device, allows a data processing device to carry out a method for transmitting image data. wherein at least one mobile terminal ( 1 ) At least partially via at least one wireless communication link to a data processing device, at least the video data converted by the data processing device into a broadcastable signal and to a television server ( 4 ) or as a video codec in a data memory ( 8th ) are stored.

By The invention solves two questions. First, how can cell phone Sequences are processed technically, so they broadcast standards fulfill (Broadcast capability), and secondly, how should the workflow be structured to allow an editorial staff in a given time from the mass of posts, those with the highest quality can filter out? Therefor an editorial office and a studio will be set up to deliver the Handymaterial edited by a variety of users and a broad public to disposal provides.

following the invention with reference to the figures of the drawings based on an embodiment be explained in more detail. Show it:

1a . 1b : a first exemplary method for the timely ("live") integration of mobile picture material in TV / Internet programs and

2a . 2 B a second exemplary method for the timely integration of mobile picture material in TV / Internet programs.

In a first embodiment According to the invention, a large number of users shoot a five-minute short film.

Some of these users, eg. For example, a 10-member team will use modern cell phone cameras in this first embodiment 1 equipped with them the entire time through video streams 5 via a PAL interface 3 (PAL = Phase Alternation Line [method]) to a server, such as a television server 4 to send to an editor. Over a period of about ten days, each individual user wears a cell phone camera 1 , which sends in different cases (cf. 1a and b).

Under a PAL interface 3 In the following, a device is understood which receives video data, possibly contained in other data, this video data in an analog signal, preferably an analog video / audio signal such as a PAL signal, converts. Preferably, the PAL interface includes 2 also means for converting the analog signal into an SD broadcasting signal.

• 1. eine Handy-Kamera 1 ruft eine Empfangsstation 2 (beispielsweise ein Mobiltelefon) an,
• 2. Empfangsstation 2 nimmt das Gespräch entgegen,
• 3. Empfangsstation 2 wandelt Gespräch (Video-Call) in analoges Video/Audio-Signal (stereo oder mono) um,
• 4. das Video/Audio-Signal wird von einem Frame Synchroniser 6 (auch als Mischer bezeichnet) synchronisiert und stabilisiert,
• 5. von da an wird das Video/Audio-Signal als SD-Broadcasting-Signal (SD = Standard-Definition) behandelt.

This can be done in the following way:

• 1. a mobile phone camera 1 calls a receiving station 2 (for example, a mobile phone),
• 2. receiving station 2 take the call,
• 3. receiving station 2 converts conversation (video call) to analog video / audio signal (stereo or mono),
• 4. The video / audio signal is from a frame synchroniser 6 (also called mixer) synchronized and stabilized,
• 5. From then on, the video / audio signal is treated as an SD (standard definition) broadcasting signal.

• 1. Empfangsstation 2 ruft Handy-Kamera 1 als Video-Call via 3g (UMTS) an,
• 2. Handy-Kamera 1 nimmt Anruf als Video-Call entgegen,
• 3. Empfangsstation 2 wandelt Gespräch (Video-Call) in analoges Video/Audio-Signal (stereo oder mono) um,
• 4. das Video/Audio-Signal wird von einem Frame Synchroniser 6 synchronisiert und stabilisiert,
• 5. von da an wird das Video/Audio-Signal als SD-Broadcasting-Signal behandelt.

Alternatively, the process can be implemented as follows:

• 1. receiving station 2 calls mobile phone camera 1 as a video call via 3G (UMTS),
• 2. Mobile phone camera 1 takes a call as a video call,
• 3. receiving station 2 converts conversation (video call) to analog video / audio signal (stereo or mono),
• 4. The video / audio signal is from a frame synchroniser 6 synchronized and stabilized,
• 5. From then on, the video / audio signal is treated as SD broadcasting signal.

The signal streams, ie the video streams 5 , the ten cell phone cameras 1 are prepared in the editorial office using a data processing device or designed and published on a specially created website. In addition to articles, reports and moderation texts, pictures and life streams were published on this website.

In an exemplary embodiment, the data processing device is in the PAL interface 3 integrated.

The advantage of using a mobile phone as a receiving station 2 lies in the possibility of direct reception of the incoming call from the mobile phone camera 1 (Live-idea). In addition, this structure opens up the possibility of so-called image and sound feedback. Therefore, the receiver can talk to the sender (live switching call).

• – Studiomoderation (mindestens eine Kamera (PAL)) vor blue screen;
• – mehrere, z. B. zehn, Außenstellen: Handy-Kameras 1 als Satellite News Gathering (SNG);
• – Standort mit zentralem Fernsehserver 4 und zentraler Regie.

The technical structure of an exemplary arrangement for the transmission of image data:

• - Studio generation (at least one camera (PAL)) in front of blue screen;
• - Several, z. B. ten, field offices: cell phone cameras 1 as Satellite News Gathering (SNG);
• - Location with central television server 4 and central direction.

• – eine Empfangsstation 2 (das kann ein zweites Handy sein), welche über einen FBAS-Anschluß 7 mit
• – einer PAL-Schnittstelle 3 verbunden ist, die wiederum den Zugang zum Fernsehserver 4 herstellt.

This exemplary arrangement can be supplemented by

• - a receiving station 2 (this can be a second phone), which has a CVBS connection 7 With
• - a PAL interface 3 connected, which in turn gives access to the TV server 4 manufactures.

The technical components of the invention have been disclosed in the exemplary embodiment in line with the requirements for a TV news program selected.

Exemplary procedures:

• - Post finished on mobile phone camera 1 cut, completion and transfer
• - Contribution up-to-date: delivery during ongoing program or shortly before via mobile phone cameras) 1 ,
• - supply of raw material via mobile phone cameras) 1 for further, preferably computer-aided, processing

With a small time offset while broadcast TV images were directly from the mobile phone camera 1 supplied. Technically, this was realized as follows: In the mobile phone camera 1 a short video is saved as mp4. The native quality of these images is in principle already such that they could be shown on TV. Now all that matters is getting this data to a receiving station 2 (For example, second mobile phone) to transmit over an arbitrary distance in principle, and from there with the interposition of a PAL interface 3 into a TV server 4 to import. The transmission can be done via video stream ( 1a and b) or in the form of a file ( 2a and b). This structure allows, with a small time offset (due to caching on the phone camera 1 ) a good picture quality. A conversion of the data (which would be associated with further losses) is thanks to the PAL interface 3 Not required, because when received directly a PAL signal received that can be processed in a conventional SD broadcasting environment properly and without loss of time.

The PAL interface 3 In one exemplary embodiment, it consists of a video output (comparable to a video output already provided in the Nokia N95, which is provided there for films stored on the mobile phone). By means of a Black-Magic Multi Converter (Frame Snychronizer, A / D converter, Audio Embedder), the image of the incoming call becomes broadcastable SD-SDI signal (SD-SDI = Standard-Definition-Serial Digital Interface) processed, directly from any standard television server 3 can be further processed. Alternatively, there is a caching as a video codec in a dedicated data storage 8th that via LAN with the TV server 3 is connected. The PAL interface 3 can do it in the phone camera 1 or in the TV server 3 be integrated, or realized as an independent module. The data store 8th can be arranged separately or integrated into a component of the arrangement according to the invention.

The real live broadcast in broadcast quality is included corresponding transmission protocols also possible. Available so far However, 3g networks (eg UMTS) are a bottleneck, so that usually concessions to the picture quality must be made. The bandwidth is too low and the susceptibility in this case (especially indoors) too high for a stable acceptable broadcast image signal via UMTS stream. In an exemplary embodiment is provided, an amplifier to improve UMTS reception.

With introduction the 4g networks (Wmax or LTE = Long Term Evolution) also provides one Live broadcast in broadcast quality in principle no problem anymore. The HSUPA (High Speed Uplink Packet Access) is an alternative to transmission in broadcast quality. The actual limitation is less in the transmission networks than rather, in the low efficiency of the currently still for the so-called. Video call established standards.

The potential (commercial) applications in the TV field are diverse: instead very expensive transfer via fiber optic or uplink (Satellite News Gathering) comes easy a mobile phone camera 1 for use. You can go through the news and sports section here Saving on transmission line and technology in the current transmission operation of several million euros p. a. save on. An application would be especially everywhere there advantageous, where for regular technology there is not enough space or no approval.

Another advantage is the greater mobility and the larger, convenient nationwide availability of mobile phone cameras 1 to deliver images. Meanwhile, a politician waiting for his connecting flight at the airport at the gate can easily call his cell phone camera 1 be "connected" to an existing live broadcast.

But Also new, attractive applications that involve the viewer / user are due to the data management according to the invention easy to implement: For example, a call-in with video image to one moderate studio broadcast.

Data management:

For data management 9 In an exemplary embodiment, a Quantel Newsbox with sQ Cut, sQ edit and sQ edit plus was used. The advantages of the system are above all the possibility of direct further processing and addressing of the incoming material with a time loss of <10 seconds. The addressing is done in an exemplary embodiment by real-time code. That is, the incoming post is assigned the source and time of the input). Another development, is that on meta-data of the sending mobile phone camera 1 is accessed.

Also the central data management 9 is because of the large number of incoming signal streams 5 mobile phone image signals are a prerequisite of central importance: the available data capacities allow us to cope with the large quantity of qualitatively simple material: it is very important to select from the large number of images offered. To sift through the material and to name and mount it, in order to return to the actual task in this way: To tell a story exciting and concise. For this purpose, in an exemplary embodiment, existing methods from the "call-in" areas are used, whereby this technology is transferred into the method according to the invention.

The image and sound succeeded in an exemplary embodiment, first as a call, z. As "video call", to the receiving station 2 , For this purpose, an automated call management is integrated into the structure in an exemplary embodiment. The incoming call is from the receiving station 2 automatically accepted. Important information about the caller (transferred number, call time, if necessary meta data of the mobile phone, location) is assigned to the automatic naming of the feed to be imported to the picture and sound signal and together with this to the TV server 4 transfer.

In an exemplary embodiment, this is done in detail as follows:
If there is a call in the receiving station 2 a, so the TV server generates 4 automatically a sub-directory in which the new incoming video data is stored. The sub-directory is named after the incoming phone number. (For example, if the subscriber calls +49171122345678, the subdirectory will get the Na men / + 49,171,122,345,678). With the help of a time code generator, which is clocked on UTC (Universal Time Coordinated), is during the process of reading into the TV server 4 , the image data, the precise time as a time code added (so-called real-time code). Beyond this information, there is the possibility of metadata about the calling mobile phone camera 1 to pair with this information. This is done in detail as follows: subscribers are automatically located by means of the cell information from a separate server (called: "location server"). This was previously an application to the phone camera 1 loaded, which transmits the cell information to the location server, wherein preferably the release of the transmission of the cell information to the location server is carried out automatically by the application. The process of locating occurs constantly and regardless of whether the subscriber calls or not.

Goes now in the television server 4 When a call is received, it will match the number of the calling party with the meta data (eg location) stored on the location server. This is done by comparing the caller's number with the numbers stored on the location server. Since this meta data requires only a small bandwidth, this query can be made via the Internet. In practice, the image information of the incoming call can now be associated with the current exact location (eg a mark on digital map material such as googlemaps).

Furthermore a separate log of incoming calls is created. This will quickly locate the relevant audiovisual supplies guaranteed. In a test setup of another embodiment the manual import of two simultaneously incoming sources was realized.

Further technical details can be found in the enclosed drawing.

The Invention restricts in their embodiment not to the preferred embodiments given above. Rather, a number of variants are conceivable that of the inventive method and the inventive arrangement also in principle different types Make use.

LIST OF REFERENCE NUMBERS

1

Cell phone camera

2

receiving station

3

PAL Interface

4

TV server

5

video stream

6

frame Synchroniser

7

Composite video connection

8th

data storage

9

data management

Claims (22)

A method of transmitting image data, wherein at least one camera-equipped mobile terminal video data is at least partially transmitted via at least one wireless communication link to a data processing device, wherein the at least one wireless communication link is established by a call, and at least the video data through the Data processing device converted into a broadcastable signal and to a television server ( 4 ) or as a video codec in a data memory ( 8th ), wherein at least the video data is synchronized and / or stabilized by the data processing device prior to further processing. Method according to claim 1, characterized in that that the data is received by the data processing device and at least the video data into a standard definition broadcasting signal be converted. Method according to claim 2, characterized in that that the conversion of the video data into the standard definition broadcasting signal at least partially done by a Black Magic Multi Converter. Method according to claim 2 or 3, characterized that at least the video data before the conversion into the standard definition broadcasting signal be converted into an analog signal. Method according to one of Claims 2 to 4, characterized in that the standard definition broadcasting signal is sent to the television server ( 4 ) is forwarded. Method according to one of claims 1 to 5, characterized in that the data comprising the video data of at least one integrated into the data processing device, second mobile terminal ( 2 ) are received. Method according to one of claims 1 to 6, characterized that the data processing device incoming data, which the video data includes automatically receives. Method according to one of claims 1 to 7, characterized in that in the at least ei NEN mobile terminal a video sequence is stored and then transmitted to the data processing device. Method according to one of claims 1 to 8, characterized, that the data comprising the video data - as a video stream or - when file transfer become. Method according to one of claims 1 to 9, characterized that for the management of the received from the data processing device Data at least the video data are addressed by real-time code. Method according to one of claims 1 to 10, characterized that for the management of the received from the data processing device Data meta-data of the sending evaluated at least one mobile terminal become. Arrangement for transmitting image data, comprising at least one mobile terminal equipped with a camera, a data processing device and a television server ( 4 ), wherein the arrangement is set up such that data comprising at least one mobile terminal is at least partially transmitted to the data processing device via at least one wireless communication link established by a call, at least converting the video data into a broadcastable signal by the data processing device and to a television server ( 4 ) or as a video codec in a data memory ( 8th ), wherein at least the video data is synchronized and / or stabilized by the data processing device prior to further processing. Arrangement according to claim 12, characterized in that the at least one mobile terminal is a mobile phone camera ( 1 ) or - a Personal Digital Assistant (PDA). Arrangement according to claim 12 or 13, characterized in that the data processing device at least one receiving station ( 2 ) for receiving the data comprising the video data. Arrangement according to one of claims 12 to 14, characterized in that the data processing device has at least one means for Synchronizing and / or stabilizing includes. Arrangement according to one of claims 14 or 15, characterized in that the at least one receiving station ( 2 ) and the data processing device are connected via at least one video output and at least one CVBS connection. Arrangement according to one of claims 14 to 16, characterized in that the at least one receiving station ( 2 ) is formed as a second mobile terminal. Arrangement according to one of claims 12 to 17, characterized in that the data processing device comprises at least one means which is set up so that images of incoming video data in a Standard definition broadcast signal be converted. Arrangement according to claim 18, characterized that the means, which is arranged such that images are more detailed Video data is converted into a standard definition broadcasting signal, at least one frame synchronizer, at least one A / D converter and at least one audio embedder. Computer program that allows a data processing device after it has been loaded into storage means of the data processing device to perform a method for transmitting image data, wherein transmitted from at least one equipped with a camera mobile terminal video data at least partially via at least one wireless communication link to a data processing device in which the at least one wireless communication link is established by a call, and at least the video data is converted by the data processing device into a broadcast-capable signal and sent to a television server ( 4 ) or as a video codec in a data memory ( 8th ), wherein at least the video data is synchronized and / or stabilized by the data processing device prior to further processing. A computer-readable storage medium on which a program is stored which, after having been loaded into storage means of the data processing device, enables a data processing device to perform a method for transmitting image data, wherein data comprising at least one camera-equipped mobile device at least partially comprises data at least one wireless communication link is transmitted to a data processing device, wherein the at least one wireless communication link is established by a call, and at least the video data converted by the data processing device into a broadcastable signal and to a television server ( 4 ) or as a video codec in a data memory ( 8th ), wherein at least the video data is synchronized and / or stabilized by the data processing device prior to further processing. Method in which a computer program according to claim 20 from an electronic data network, such as from the Internet, to a connected to the data network data processing device is downloaded.

Images