CN1871602A - Method, system, apparatus, and machine-readable medium for use in connection with a server that uses images or audio for initiating remote function calls - Google Patents

Abstract

Images, audio, biometric information, and other data is captured by a user device. The captured data is sent to a server that pre-processes and then decodes the captured data to identify its contents. Once identified, the captured data is associated with a function string that specifies a function and parameters that correspond to the captured data. The function is called and executed to provide information back to the user device that is relevant to the captured data, or to initiate other operations. The relevant information to return to the user device can include product information, translations, auction data, electronic device settings, audio, and others. Operations that may be initiated include software registration, people searches, or user authentication to allow access to restricted services.

Description

The method, system, equipment and the machine-readable medium that use with the server of image that use to start remote function calls or audio frequency

Technical field

The present invention relates generally to image capturing and treatment technology and the data communication by network, the catching and communicating by letter of the one dimension (1D) that is specifically related to but is not limited to be undertaken or two dimension (2D) image or audio frequency by subscriber equipment, use remote function calls to obtain the information relevant at server, the information of being obtained is turned back to the authentication of subscriber equipment and/or subscriber equipment with image/audio frequency.

Background technology

The Internet is to be used to obtain one of general and popular instrument about the information of any theme almost.For example, Internet user's (abbreviating Web " surfer " sometimes as) can obtain relevant they wish to buy the information (as price, the description of product, manufacturer's information or the like) of product, about favorite exercise team or athletic statistical information, the informedness content on relevant travel purpose ground or the like.In fact, people replace by the information of searching in surfing on the Internet that to search the situation of information by traditional print media almost omnipresent.

Yet, although be widely used and abundant information,, the Internet still usually is considered to clumsy and inconvenient instrument.For example, if shopper finds the product of a price reduction in a shop, this shopper is merely able to read in detail a spot of printed material of following the scene of this product usually.Under many circumstances, the information deficiency that the printed material at such scene provides, and the shopper is not allowed to open the packing of product when the shop so that check the more detailed product information that wherein may maybe may not comprise.On the contrary, be the guarantee statement that obtains relevant this specific products, manufacturer, function declaration book, relevant annex, the more detailed information of product review or the like, the user generally need go home, be connected to the Internet, use some internet search engine to search relevant information then.

This example has been given prominence to some significant disadvantage.At first, the shopper need remember name of product and manufacturer before leaving the shop, so that can determine search inquiry for internet search engine after family the shopper.Shopper's memory may be poor and/or the shopper interest of product begun after leaving the shop to die down under the situation of (particularly under the situation of before the shopper surfs the Net, having spent several days), this will have problems.Therefore, very big business opportunity may be lost in manufacturer and shop, and the shopper also can lose the chance of buying required product.

Secondly, this example hypothesis shopper grasps computer skill and/or the resource that possesses skills at home.Yet the fact is not but not always like this.That is, although many individuals have basic understanding to the actual use of the Internet, many individuals can use some to improve when tempering their on-line search skill, usually can not utilize their search inquiry to search maximally related and Useful Information.Many individuals also do not have home computer (and depend on the computing machine of work unit, they are general only to use a computer on weekdays during office hours), or have very slow the Internet and connect.

The 3rd, some information can not obtain from the Internet.For example, some goods producer does not have the website, thereby requires the client directly to contact with the service representative by phone, surface mail, Email or the like.In other cases, manufacturer or its hetero-organization provide information by the channel that is different from the Internet, but potential customers may not find such alternative information channel like a cork.

Although scheme as described above is under the situation of product and shopping, be appreciated that related with individual's unlimited information requirement widely situation.For example, suppose that traveller through some cities and towns sees the some statues in the local parking lot, and wish to understand more information about the historic significance of this statue.If this traveller gets back to hotel room and sets up the computing machine connection, then this user may be by the information of relevant this statue of Internet search.Yet,, during the suitable key word of user in the inquiry of selecting most possibly to cause " hitting ", be only limited to hit-and-miss method because internet search engine provides the text based search inquiry.Be difficult to express the image that passes through statue or pass on word text, thereby cause when search engine returns incoherent information, making the user to feel disappointed by any other entity target.

Be further appreciated that for audio frequency also to have similar problem, hear a first song or a sound as the someone, but can not title and/or people is related with this audio frequency.Is very clumsy for carrying out text query with word expression audio frequency, is difficult to carry out in many situations.

Summary of the invention

An aspect provides and comprises the method for reception about equipment active user's the information of catching.The information of catching is decoded, determining its content, and the content determined and the content of storage is compared, so that the user is carried out authentication.If the user has passed through authentication, this method call has the function of parameter, and carries out this function, the service that can use by device access with the user who allows through authentication.

Another aspect provides and comprises the method for reception about the medium of the theme of being caught by equipment.The medium that receive are decoded to determine its content.The content and function character string of determining is associated.Method call is also carried out the function of discerning by function string, information is turned back to the equipment relevant with the theme of catching.

Description of drawings

Below with reference to the nonrestrictive and non-exhaustive embodiment of following pattern description, wherein, unless otherwise mentioned, in each view, similar parts like the Reference numeral representation class.

Fig. 1 has described the various electronic equipments that can be used for realizing various embodiment.

Fig. 2 has shown can be by example image or the audio frequency of catching according to the electronic equipment of Fig. 1 of various embodiment.

Fig. 3 A-3B is the system component of embodiment and the process flow diagram of related operation.

Fig. 4 is the diagrammatic representation of an embodiment of framework of storage unit of the system of Fig. 3 A-3B.

Fig. 5 is the synoptic diagram according to the function string of embodiment.

Fig. 6 A-6B has shown the object model according to embodiment.

Fig. 7 has described the process flow diagram according to the authentication process itself of embodiment.

Fig. 8 is media capture, decoding, the remote function calls of having described according to embodiment, the process flow diagram that information is returned.

Embodiment

To describe below and use server to carry out the embodiment of remote function calls with the technology of obtaining the information related with the image of catching (and audio frequency).In the following description, many concrete details have been set forth to provide to comprehensive understanding of the present invention.Yet, those skilled in the art will recognize that the present invention can implement under the situation of not using one or more details, perhaps can implement with additive method, assembly, material or the like.In other cases, do not show or describe known structure, material or operation in detail, to avoid that some aspect of the present invention is thickened.

In this manual " embodiment " or quoting of " embodiment " are meaned, relate to the described specific function of embodiment, structure or feature and comprise at least one embodiment of the present invention.The phrase " in one embodiment " that each position so, in this manual occurs or " in an embodiment " differ to establish a capital and are meant same embodiment.In addition, in one or more embodiments, specific function, structure or feature can make up in any suitable manner.

As general introduction, embodiment provides and has allowed relevant information to turn back to the user's of the electronic equipment such as mobile wireless device technology.For example, the user can utilize the mobile phone that can take a picture to take a picture for the automobile in sale of automobile shop, and sends images to server.Server is decoded with the theme of recognition image to image, obtains the information relevant with this theme (as manufacturer, model, product review, price, competing product or the like) then.The serviced device of this information turns back to mobile phone, and information shows in mobile phone for the user and checks.Although it should be noted that and can use the example of mobile phone as consumer electronic devices,, in an embodiment, can use any suitable device that can catch image and/or sound.

According to various embodiment, the image of being caught by the user can be 1D or 2D image.The example of 1D image comprises bar code or other inhuman discernible images.The example of 2D image comprises, but be not limited only to, the image (boundary mark, animal, inanimate object or the like) of alphanumeric character string, logo, slogan, brand name, sequence number, text, biological characteristic (as fingerprint or appearance), various objects, or the discernible image of people of any kind that can represent with the 2D form.In an embodiment, also can catch three-dimensional (3D) image (or its outward appearance), and represent, as hologram with the 2D form.According to embodiment, also can capturing audio (comprising the voice recognition implementation), be converted to file, and send to server and handle.

In an embodiment, server uses at least one plug-in card program in a plurality of plug-in card programs to discern the image that receives.After image was identified, the function string with function shielding was related with the image that is identified.Function string comprises the identity of the function that will call and will be delivered to this function parameters and/or parameter value.Parameter is related with the media information that will be returned to user's mobile phone (for example) with parameter value.So, when calling and carry out function,, it is handled, and turn back to user's mobile phone retrieve media information.The image of catching of the specific function that can (or can not) special identification will call or sound or other medium are called as " symbol " here.

Below various implementations will be described.For example, the embodiment of module can be used to provide product information, and software is registered, and complimentary ticket is handled, and carries out the electronics setting, receives competing product information, and the user is carried out authentication, translate foreign languages, and the search auction is carried out biological characteristic and is handled or the like.Should be appreciated that these only are examples, the present invention is not limited only to any specific one or more described implementation.

Be the image that helps identification to receive, an embodiment provides the image pretreatment system.Image pretreatment system application image treatment technology with from ropy or differentiate the image of rate variance and extract symbol, thereby improves the success ratio of identification.

Fig. 1 has described the various electronic equipments that can be used for realizing various embodiment.Should be appreciated that Fig. 1 has only described can capturing audio or some example of the electronic equipment of image (comprising video), other embodiment also can use can be to other electronic device types of Server Transport audio frequency or image.In addition, should be appreciated that the electronic equipment of Fig. 1 may have common function in some cases, as camera, microphone, network coupling assembling, biological characteristic scanner, display screen, Web browser or the like.Because the various functions of these electronic equipments are known for the those skilled in the art that understand the application's advantage, therefore, just are not described in detail such function here.

Mobile phone 100 comprises camera 102, and this camera allows the user by suitably the relevant object of mobile phone 100 sensings being taken pictures or otherwise catching image (comprising video).Computing machine 104 such as desktop personal computers (PC) or kneetop computer comprises Web camera 106, and this camera can make audio frequency and image transmit by network (as the Internet) or carry out this locality and preserve.Other examples comprise scanner 108, and this scanner can be with generating the electronic image that is initially hard copy format.

Internet Protocol (IP) phone 110 allows the user to carry out telephone talk or send fax by IP telephony network.The IP phone 110 of an embodiment (and described any other electronic equipment) can comprise the biological characteristic scanner 112 (being used to catch fingerprint, face-image, retina scanning or the like) that is used for the user is carried out authentication, and microphone 112.

Other possible electronic equipment examples comprise facsimile recorder 116 and personal digital assistant 118 or other wireless devices.Other image-capture devices 120 and/or audio-video device 122 also can be used for various embodiment.

The electronic equipment of Fig. 1 can communicate with network 126 by wireless and/or wired connection 124.Network 126 can comprise the Internet, Local Area Network, virtual lan, public switched telephone network (PSTN), IP telephony network, satellite communication network, fiber optic network, VPN (virtual private network) (VPN), and other are wireless or cable network, or its any combination.In an embodiment, server (below will relatively explaining) is provided, and this server can communicate by network 126 and electronic equipment, so that provide about the audio frequency of catching or the relevant information of image to electronic equipment, for some purposes, electronic equipment is carried out authentication or the like.

Fig. 2 has shown example image (object) or the audio frequency that can catch by the electronic equipment of Fig. 1 according to various embodiment.Emphasize again that should be appreciated that, Fig. 2 has only shown example, and does not limit one time.For Fig. 2 is described, will use mobile phone 100 as catching image or the audio frequency electronic equipment example of (as by using camera 102).Mobile phone 100 comprises display screen 200, and this display screen can be used for allowing the image that user's preview catches and check the relevant information that can return from server.

Can catch the image (or other inhuman discernible 1D or 2D images) of bar code 202 by mobile phone 100.Bar code 202 can be arranged in the product of the packing of product or any other tape font code.Image by catching bar code 202 also sends images to server, can be with the relevant information such as product price, product detail information, relevant website uniform resource locator (URL) address, perhaps the information about competing product turns back to mobile phone 100.

Also can catch and handle the image of foreign language object 204.In this example, foreign language to as if to the west of the signature write of class's tooth language.Server 100 can provide English Translation or any other foreign language word of " Hacienda " to mobile phone 100.

The user can use mobile phone 100 to catch the image of software product 206 (as its package design, bar code, sequence number, trade mark, name of product or the discernible 2D image of other related people).Like this, the user can register (also passing through display screen 200 confirmations of receipt of mobile phone) to software product 206, receives product information and price, receives the information of relevant competing product, receives product review or the like.

If the user has entered a tame sale of automobile shop and seen automobile 208, the user can take the photo of automobile 208 (or its product volume 210), receives the comment to this automobile.Can receive comment or other relevant information as stream-type video, figure or text, URL link, audio frequency or the like by mobile phone 100.

For traveller or other users, can catch the image of a certain historic ruins 212 Space Needle of Seattle, the State of Washington (as be positioned at).Then, the user can receive historical information, ticket price, business hours, or other relevant information that generate from local tourism organization, municipal government, man page and other sources.For be hunted down any object of (also being applicable to the audio frequency of catching) of its image, also can return the Internet engine search result to mobile phone 100.For example, in case the image of server identification historic ruins 212 is SpaceNeedle, then server can be at Google ^TMOr start image or text search on other internet search engines, and to obtain the hit list of Search Results, then, this tabulation can be delivered to mobile phone 100, read in detail for the user.

If the user has seen the figure of scoreboard 214 in university's football match, the user can take the photo of scoreboard 214, and sends images to server.In case server has derived information (as the title of school team) from image, it is fight songs of this school that server can make the tinkle of bells of mobile phone 100.This just response catch and handle a information type that image and/or audio frequency can realize or an example of function.

For going on to say with other examples, mobile phone 100 can be used to complimentary ticket 216 is scanned.Then, can handle the image of complimentary ticket 216,, or otherwise complimentary ticket 216 be repaid with product application discount to using in the website by server.Can take the image of CD (CD) front cover, digital video disk (DVD) front cover or film pictorial poster 218, the tinkle of bells that this image will allow the user to receive streaming film afterbody, song example, can buy, the demonstration timetable, artist information, comment, arenas or store locations or the like.

The user can take simple must be as the photo of the object of one bottle of wine 220 and so on.The information that the user can receive on mobile phone can comprise the food of going with wine of suggestion, the price list of local businessman, brewery and wine brewing information or the like.As another example, the user can take the photo of collectibles (as stamp 222), and this photo is submitted to server.Then, server can be handled by comparison film, returning auction information to the user, as is used in Ebay ^TMOr the tabulation of the stamp of auctioning on other auction site.

Embodiment can be used for authentication and security purpose.For example, provide by using face recognition 224 or voice recognition 226 to come access rights for the user of mobile phone 100 or IP phone 110 to any phone on the network.Alternatively or additionally, also can use the biological information such as fingerprint image 228 or retin image.

As first example, the IP telephony network of a company can be provided to its employee's connection.Yet some employee can have authority different with other employees or access rights (as local, long-distance or international call function).In addition, also should be able to send IP phone and call out, rather than be only limited to just a people's office and send these IP phone and call out from any phone of company or position.

Correspondingly, embodiment allows the user to accept authentication from any phone and/or position.This authentication can be undertaken by the biological characteristic scanner 112 on voice recognition 226, face recognition 224, fingerprint 228 or the use IP phone 110 or other authentications based on biological characteristic of other input equipments.The information of catching is sent to the server that carries out authentication.If passed through authentication, so, server can start the complete process of the connection of IP phone calling.Different Permission Levels are provided for different users.

As second example, in case of emergency, federation or state government, municipal government, Department of Homeland Security, or other mechanisms or entity can order, and reserves some wireless frequencies and only use (as law enforcement agency, emergency response personnel, city leader people, army or the like) for the individual who authorizes.So, for such system importantly, these frequencies in case of emergency can be used the personnel that are authorized to, and hacker or unwarranted user can not endanger the availability and the use of these frequencies.

Correspondingly, the embodiment of back-end server comes the user is carried out authentication by biological information (as the image of fingerprint or appearance or the like or the sound of being caught by user's electronic equipment) is compared with the rear end image/audio frequency or other information that can be used for authentication.After the user had passed through authentication, the electronic equipment that server will start the user was connected with limited frequency.

As another example of Fig. 2, can take the image 230 of a people itself or others (even animal).Then, image 230 can be sent to server,, on the date that search has similar outward appearance, be out of shape or the like with search name human or animal's look-alike.As another possible application, the personnel of law enforcement agency or investigator can catch a suspect's image individually, and rear end image file and the previous conviction with these images and refugee compares then.

Can catch and discern the audio frequency 232 of any kind of or otherwise handle by server.For example, the user can be captured in the audio frequency or the sound byte of the attracting tune of playing on the radio, and allows server return title, artist, album title such as song, sells the data the store locations of this special edition.For the catching and handling of audio frequency 232, many different application can be arranged.

Fig. 3 A-3B is the process flow diagram that has shown the related operation of the assembly of system 300 and embodiment.For the purpose of explanation, only show and described the process and the assembly of the operation of being convenient to understand embodiment here.In one embodiment, at least some process and assembly can be with software or the instruction that can read that is stored on the medium that machine readable gets by the other machines that one or more processors are carried out realize.Neutralize various direction arrows described in other figures of Fig. 3 A-3B do not define the unique possible flow direction of data or instruction-opposite rigorously, such direction arrow has only shown the flow direction of possible data or process prevailingly, should be appreciated that, can add other flow processs or assembly, deletion, modification, or not necessarily to be made up with the described identical mode of Fig. 3 A-3B (or in other figures).

Mail Gateway 302 is connected to network 126 with received communication therefrom with communication mode.Specifically, according to an embodiment, Mail Gateway 302 can receive Email or other communication that sends from one of them the subscriber equipment 102-122 that has caught image/audio frequency.Under the situation of E-mail communication, image or audio frequency can present the form of one or more attachment files of Email.The possible form of image can be JPEG, GIF, MPEG or the like, and audio frequency can be .mp3 .wav or the like.Mail Gateway 302 comprises mail units 304, and this unit is used to receive Email, and peels off or otherwise extract and have the image of catching and annex or other information of audio frequency.Mail units 304 also is used to provide the interface with server 306.For example, after the Email that receives extracts annex, mail units 304 is provided to server 306 with the information of extracting.

According to an embodiment, Mail Gateway 302 conducts independently Simple Mail Transfer protocol (SMTP) server move, so that serve decoding request (for example, communicate being decoded to server 306).Moreover, should be appreciated that Mail Gateway 302 can be operated according to any suitable mail protocol or platform.Mail Gateway 302 provides each session ability that (by server 306) decodes to a plurality of imagery collaterals, wherein, automatically all relevant details (as the content in the row of Email, subject field, annex or the like) of the mail that imports into are analyzed, and be delivered to server 306.

Server 306 comprises and is used to the various software and hardware assemblies handling, communicate by letter, store or the like.One or more processors 308 are connected to one or more storage mediums 310 with communication mode.Storage medium 310 can comprise suitable storage medium or its combination of database, random-access memory (ram), ROM (read-only memory) (ROM), file system, hard disk, optical medium or any other kind.In an embodiment, storage medium 310 can storing software, object, static state or dynamic code, data, and processor 308 content that (for example, carrying out) can read with the other machines of carrying out various functions as described herein of can cooperating with it.For ease of explanation, the server 306 of Fig. 3 has a lot of assemblies, and these assemblies can be realized-should be appreciated that, can have at least some in these component softwares in storage medium 310 with the software that separates with storage medium 310.

One of these softwares (or hardware) assembly is pre-service and decoding unit 312.This unit 312 is used to receive the medium (as image or audio file) that extract from mail units 304, the medium that receive are carried out pre-service (if necessary) improving its quality and/or to place suitable form so that decode medium, and the medium that receive are decoded with information identification there.

About decoding, the unit 312 of an embodiment uses a plurality of demoder plug-in card program 314-320 (or other suitable decoder module).Plug-in card program 314 is used for the 1D bar code is decoded; Plug-in card program 316 is used for the 2D bar code is decoded; Plug-in card program 318 is used for decoding or otherwise discerns (ID) image (comprising frame of video); And plug-in card program 320 is used for audio frequency is decoded.The more or less plug-in card program that shows clearly than Fig. 3 A can be arranged.In one embodiment, plug-in card program can comprise the media decoder program of selling on any suitable market at image, audio frequency or other medium.

In one embodiment, the media file that unit 312 receives each repeatedly (as image or audio file) sends to each plug-in card program 314-320, the content that media file could successfully be decoded and discern to some programs in these plug-in card programs (for example, can identification sequence number, the object in the image, the sound of the people in the audio file or the like), and the result turned back to unit 312.In another embodiment, unit 312 can be designed to special the media file that receives is directed to plug-in card program 314-320 some (or certain is several), rather than repeatedly the media file that receives is sent in them each.To 1D or 2D bar code or carry under the situation that the image of other data successfully decodes, plug-in card program 314 or 316 returns alphanumeric text or by other entrained data of this image.Plug-in card program 314 or 316 can use one or more third party's Decode engine 322 to help decode or otherwise 1D or 2D bar code are made an explanation, to obtain the data of carrying thereon.

For the image or the audio frequency that may not necessarily carry data, plug-in card program 318 or 320 can be distinguished access function enquiry module 324 to help recognition image/audio frequency and related function string.For example, if the image that receives is the image of the historic ruins 212 of Fig. 2, so, any one or both of the functional query module medium that will visit Fig. 3 B in functional query unit 326 (judging which function string is related with historic ruins 212) or media store position 328 (identification historic ruins 212 are Space Needle).Search coupling if desired, then can use fuzzy logic or verification and.

Medium to functional query unit 326 and/or media store position 328 may reside in the server 326 or be present in the external memory unit 330.In an embodiment, medium comprise question blank or the database of listing the function related with the content identified of medium (or function string, will illustrate below) to functional query unit 326, wherein, can discern media content by access medium memory location 328.Media store position 328 can be database, question blank, file system or other suitable data structures, they can the storage file image, audio frequency, fingerprint, sound clip, text, figure or almost any information type, these information can be related with the media content that receives or be compared, so that this media content that receives of identification plug-in card program 318-320 or other plug-in card programs.

According to an embodiment, before decoded, the medium that receive can formatted or " cleaning ", so that improve the possibility of successfully decoding.For example, in the context of 2D bar code decoding device plug-in unit 316, this plug-in card program may require image to decode with 8 bitmap formats.So, embodiment carries out pretreated function to medium before being provided at decoding with the form of operation set, operation set is operated as media filter, so as before decoding, the image that receives to be placed suitable form and/or improve image/audio quality (for example, sharpening granular or blurred picture or audio frequency).

In the example of Fig. 3 A, 1D bar code decoding device plug-in card program 314 has two operation sets (1D picture filter 332 and 334).Filtrator 332 is carried out contrast adjustment 336 and smoothing 338.Filtrator 334 is carried out black and white (BW) conversion 340.In an embodiment, be not that all operation sets all need be used before decoding.For example, if the application of first operation set (filtrator 332) causes decoding successfully to be carried out, so, just do not need to use second operation set (filtrator 334), or vice versa.Yet, if first operation set does not cause decoding successfully to be carried out, so, can use more operation set, up to the result who succeeds.

Other examples of operation set among Fig. 3 A comprise 2D picture filter 342, and any one operation or both that this filtrator can be carried out in BW conversion 344 and contrast adjustment 346 operations carry out.Image recognition (ID) filtrator can be carried out and adjust size 350 operation or other operations, and voice band filter 352 can be carried out other operations 354 to improve or to change audio quality and form.Should be appreciated that the various operations described in Fig. 3 A only are illustrative, for any one plug-in card program among the plug-in card program 314-320, is not detailed or restrictive.

Under the situation of successfully decoding, plug-in card program 314-320 generates or return function character string as a result of.For 1D and 2D bar code (or carrying the image of other data), the result who returns generally is the character string of alphanumeric character.For other images and audio frequency, the result who returns also can be the alphanumeric function string, as obtaining to functional query unit 326 from medium.As described after a while, the shielding of function string and function is associated, and specified function, the value of function parameter and parameter.

Function string is provided to function and parameter request unit 356 by pre-service and decoding unit 312.356 pairs of function string of request unit are analyzed, and with the ID of the function that obtains appointment, obtain the value of this function parameters and parameter from the storage unit 330 of Fig. 3 B.The storage unit 330 of an embodiment comprises function memory location 358, this location storage function name and function itself (as formula, code, script, logical relation, object or the like).Storage unit 330 also comprises parameter name and value memory location 360.The value of these memory location 360 stored parameter titles, association, and can be used as other information of parameter or other data that can use by the function of correspondence.

In case call or otherwise obtained function, parameter and parameter value by request unit 356, then the subscriber equipment 102-122 that unit 362 is carried out the function of appointment and the result turned back to correspondence is carried out and returned to function.In one embodiment, by realizing pending service logic or other intelligence, can in server 306, carry out function.In Fig. 3 A 364 in shown in server 306 these functions of carrying out.

Alternatively or additionally, can far call and/or carry out function.For example and with reference to figure 3B, can be with communication mode and from a plurality of server unit 366-370 of server 306 long-range connections.These server units 366-370 can the corresponding function 372-376 of trustship (and execution).Each function 372-376 again can with other networking component cooperations, with get parms, parameter value and spendable in the process of implementation other data.As example, function 372 can obtain data from the third-party server 378 that moves old-fashioned application program; Function 374 can obtain data from apps server 380; And function 376 can obtain data from external data base 382 or other sources.

In one embodiment, function is carried out and is returned unit 362 and can directly return response message to originating user equipment 102-122, as by network 126, and does not need response message is routed to Mail Gateway 302.Alternatively or additionally, function is carried out and is returned unit 362 and response message can be sent to Mail Gateway 302, so that allow mail units 304 receive.Then, mail units 304 can be directed to response message originating user equipment 102-122, or response message is routed to the response unit 384 of Mail Gateway 302.

In one embodiment, response unit 384 uses the response message that receives from server 306 to search and to form the response to subscriber equipment.For example, the response message that receives from server 306, the result as the execution of the function of correspondence can indicate to generate mail and URL and send to subscriber equipment.Response unit 384 is to carry out this operation like this, obtain mail and/or URL (or other medium or data) from the media database 386 of Mail Gateway 302, generate response therefrom with suitable response format, provide the response of generation to mail units 304, so that be transferred to originating user equipment 102-122.

Certainly, should be appreciated that in other embodiments, server 306 elements own can be carried out this response and generate and Media Inquiries, thereby eliminate or reduced the necessity of the assembly (for example, response unit 384 and media database 386) that provides independent in the Mail Gateway 302.In other embodiments, any one in response unit 384 and the media database 386 or both can be arranged in server 306.

Fig. 4 is under the situation of storage unit 330 with the realization of database form of Fig. 3 B, the diagrammatic representation of an embodiment of the framework 400 of storage unit 330.Should be appreciated that, framework with and content only be illustrative, also can use other frameworks, data structure or data relationship.

Function table 402 comprises the clauses and subclauses of and function association.These clauses and subclauses can include but not limited to, quantity, function name, URL, user name and the password of function ID, function shielding character string, parameter.Function ID is the alphanumeric code that identifies each function uniquely.Function shielding character string is specified the length (below will illustrate) of each function string.Each function can specify any number parameter and function name.These clauses and subclauses of URL, user name and password are defined in where call function and other standards on the particular server unit 366-370 (or server 306).

Clauses and subclauses link (describing at 404 places) in the function table 402 is to function's parameter list 406.Function's parameter list 406 comprises the clauses and subclauses related with each function parameters.For example, for each function ID, the time slot ID (for example, the time slot in the function string) with the relevant parameters names associate is arranged, the relevant parameters title is used by this function.

Clauses and subclauses link (describing at 408 and 410 places) in the function's parameter list 406 is to function parameter value table 412.For example, link 408 to function's parameter list 406, is linked to the value clauses and subclauses of the parameter in the function's parameter list 412 and link 410 with this function parameters (having specified specifically, the time slot ID of parameter) with the function link of correspondence.Function's parameter list 412 can have the field of the function of comprising ID, time slot ID, value ID (that is, being assigned to the ID of the value of each parameter), value and value title.

Table 414-418 relates to response chain, response and response medium.For example, if will send specific responses (perhaps or except the such response of compilation Mail Gateway 302) from server 306, table 414-418 can be used for the specific function character string is associated with the specific response content.To functional query unit 326 and media store position 328, table 414-418 can be used for index specific medium fragment and these media fragments are associated with specific function about medium.Each media fragment, response and response chain can have their related title and ID.

Fig. 5 is the synoptic diagram according to the function string of embodiment.Shown the function string example at 500 places.This embodiment of function string 500 comprises nine digital character strings 101002001, should be appreciated that, function string 500 can be any suitable length, character format (numeral, letter, scale-of-two or the like) content or the like.Character 101002001 can be included in the bar code, and extracts from bar code, or related with the image of identification (by using medium to functional query unit 326).

Function string 500 and functions shield 502 associations.Function shielding 502 is used for the form of defined function character string and function string is analyzed to discern the corresponding function and the mode of function parameter.In this example, function shielding 502 comprises by the pipeline symbol | the # symbol sebolic addressing that separates.The pipeline symbol | function string is divided into the group of three # symbols, wherein, first group of three # symbol definition function numbering, second group of three # symbol related with time slot 1, the 3rd group of three # symbols are related with time slot 2.Each # symbol is all represented the numeral from 0-9, and therefore, three # symbols of each group can be represented the numeral between the 000-999.Should be appreciated that the sum of the # symbol in the function shielding 502 can be any suitable fixing or distance to go, the pipeline symbol | needn't necessarily function string only be divided into the group of three # symbols.

In this example, first group of 3 numeral in the function string 500 are numerals 101, corresponding to certain function with numeral 101 signs in the function memory location.For this example, function 101 is functions of WAPPUSH by name, and this function relates to the function that provides/push away information to the wireless user equipment that uses wireless applications agreement (WAP).Following 3 numerals in the time slot 1 of function string 500 are 002, corresponding to some parameter that finds in memory location 360.In this example, the title corresponding to this parameter of 002 is MESSAGE.Because function string 500 also remains 3 numerals (001), this means, can be delivered to another parameter of function 101 in addition.In this example, this other parameter is called URL, and it is identified by 001 clauses and subclauses in the memory location 360.

So, corresponding to the function of character string 500 be WAPPUSH (MESSAGE, URL).In the example implementation mode, after catching and sending image and after function is carried out, the user will receive at his mobile phone 100 MESSAGE (as " and if you wish to check competing product? wish, then click herein; "), and the link that is provided to the URL of competing product information.MESSAGE " if you wish to check competing product? wish, then click herein, " and the specific URL of link is provided is the value that is delivered to two parameters of function 101, and can be stored in the memory location 360 and 360 obtain from the memory location.

Although the example of Fig. 5 has been described the implementation of function string 500, wherein according to function ID and be then parameter I D in each time slot subsequently by segmentation,, should be appreciated that, also can use other data organization technique.For example, some time slot can specify the quantity of the parameter that will use, corresponding to the value quantity of each parameter, value ID numbering, even parameter name, value title or value itself or its combination.Can there be a plurality of function shieldings related, be included in different hierarchy nesting function shieldings (may be different length) with each image or audio fragment.

Fig. 6 A-6B has shown the total object model according to an embodiment.The element of object model can be with software, code, module or is stored in the instruction that the other machines on the medium that machine readable gets can read and realizes.For example, the object model of Fig. 6 A-6B can represent to be stored in software in storage medium 310 and/or the storage unit 330 and that can be carried out by processor 308.Some element at least among Fig. 6 A-6B or operation (or its part) can be consistent with element or operation described in Fig. 3 A-3B.

The principal function operation that main or central process object 600 is called as server 306 with the initialization decode procedure, loads configuration data, or carries out and medium are decoded and return other the related processes that respond to subscriber equipment.About initialization procedure, process object 600 load configuration information and call sign decoder object 602.

Symbol decoder object 602 is loaded into each demoder plug-in card program 314-320 in the storer.Then, each demoder plug-in card program 314-320 loads the operation set (for example, media filter 332-352) of its configuration.Operation set can comprise one or more objects 604 of quantity that the assigned operation set name claims, operates or the like.Then, object 604 is loaded into and comes the padding collection in the storer by operating 606.

When server 306 receives images or other media files when decoding, embodiment is loaded into media file in the media object 608, and this media object is operated as the type of " packet assembler " of media file.Sound that receives or image media can also be the objects stored 610 in the impact damper.Alternatively, or except wanting the decoded media file, object 608 and 610 also can be represented will be encapsulated in the medium in the response of subscriber equipment or other information.

Then, will the decoded media file transfers arrive symbol decoder object 602, this object reference " decode media " function/operation, the operation set of the loading of the demoder plug-in card program 314-320 on this function/operation operation media file.That is, operation set is handled medium, with " it is cleaned out ", or medium is placed suitable form, then, these medium is decoded.Where necessary, can also call third party's demoder by the decoded media function and discern the medium that receive.

If successfully decode, so, process object 600 is created the symbol object 612 of decoding.The symbol object 612 of decoding is got back to process object 600 with data tape, point out content (for example, the identification of the content of image or audio frequency), function string (whether is directly to obtain from the bar code of decoding as function string), status information or the error message (whether successful) of symbol as decoding when discerning medium.

Next, process object 600 is called " create functionfrom symbol " method in function object 614.When carrying out the method, the symbol of identification is used to from the function string of the related correspondence of parameter object 616 request and function titles, function ID and parameter name, value and ID.

Process object 600 next " executefunction " method in the call function object 614 to call and to carry out function.Whether function returns object 618 and provides about function by the status information of successfully calling and carrying out, and returns the output (or be responsible for sending to subscriber equipment other unit of the output) of the function of execution to Mail Gateway 302.

Fig. 6 B has shown employed other objects of embodiment.For example, response chain object 620, response object 622 and response media object 624 can be arranged.These objects 620-624 is used for based on the availability format of function of carrying out and response medium and encapsulation response, to send to subscriber equipment.

Described other object examples in Fig. 6 A, some are at least wherein arranged can be optional.The software version that version objects 626 expressions are used by server 306.Servlet (as FloodServlet) 628 is with process object 600 operations.Daily record object 630 is used to misregistration or is used for other information of debugging (or other purposes).Batch processing decoder object 632 can be used for by providing a collection of image for decoding to come test symbol decoder object 602.Database connects data source object 634 and the operation of visit is used with relating to.

Fig. 7 is the process flow diagram of having described according to the authentication process itself of embodiment 700, and this authentication process itself is at least in part based on the described principle of the figure of reference front.In square frame 702, catch user (as mobile phone or IP phone user's) image, sound or other biological feature functionality, and send to server 306.As example, the user attempts to accept authentication or is authorized to using some mobile phone frequency when emergency takes place, or uses other people IP phone to dial trunk call.

In square frame 704, server 306 receives the data of catching, and in appropriate circumstances, carries out pre-service, and attempts the data of catching are decoded.Specifically, in this example, server 306 is attempted the essence (for example, judging has face in image, sound is arranged in the audio frequency, and fingerprint or the like is arranged in the image) of the content of recognition data.Use plug-in card program 318 and/or 320 and filtrator 348-352 in suitable one, carry out these operations.

Recognizing data when comprising face, sound, fingerprint or the like, the server 306 at square frame 706 places compares the data of decoding and the data of storage, the user is carried out authentication (for example, judging that whether image, sound or the biological characteristic of packet assembler user's identification are corresponding to the people who is authorized to).Can carry out this operation by allowing plug-in card program 318 and/or 320 that the data of decoding and the reference data of the storage in the media store position 328 among Fig. 6 B are compared.

If coupling does not then mean, prove that the user is not an authorized users, so, in square frame 710, call corresponding function and conduct interviews with refusing user's.When calling this function, load transfer function coefficient and parameter value are carried out this function then, encapsulation response in square frame 712, and send to the user.Response can be the message (providing by parameter value) that shows, for example, says " sorry.Do not allow you to use this equipment this moment.”

Yet if the user has passed through authentication in square frame 708, so, call function in square frame 714 is to allow user access.When calling this function, load transfer function coefficient and parameter value are carried out after this function then, encapsulation response in square frame 716, and send to the user.Response can be the message that shows, as " you are by authentication.Continue by any key." for allowing visit, server 718 is carried out these same functions or another function and thought that to start suitable network (for example, cellular network or IP telephony network) user's equipment opens frequency.

Fig. 8 be media capture according to embodiment has been described, to the process flow diagram 800 that the medium of catching are decoded, remote function calls and information are returned, this process flow diagram also is based in part on some accompanying drawing at least as described above.As an example, process flow diagram 800 expressions can be bought the related operation of product with " twice click " method of use.

In square frame 802, catch the medium of some kind by subscriber equipment, as the image of the product in some shops.This may relate to allows the user carry out " click for the first time " (or other first users operations) to button on mobile phone 100, taking the photo of product, and starts the process of the image that is produced to Mail Gateway 302 transmission.

In square frame 804-806, the image of catching is sent to server 306, and it is carried out pre-service, and decodes to obtain the function string corresponding to the image of catching.In this specific example, can relate to provide the function string (comparing) of " competing product " information for the function string of this image configurations with the information of the related specific products of relevant and the image of catching.

In square frame 808, the function of appointment in the call function character string comprises and obtains function parameter and parameter value.Parameter value can comprise such as to the image of the URL of rival website link, competing product, say " you wish to check other similar products like? be/not, " project and other information of one or more message and so on.

When in square frame 810, carrying out function, generate the response related with competing product.In server 306, can carry out this function, respond to generate, or in remote server unit 366-370, carry out.Alternatively or additionally, can in Mail Gateway 302, generate response.In square frame 812, the response of generation is returned to user's equipment.

The response that generates and turn back to user's equipment can comprise arrives link of informedness website or the like by the image of competing product information, competing product.In square frame 814, the user can buy packet assembler and be sent to the product of original image of Mail Gateway 302 or one of them competing product that returns in response.According to the embodiment of twice click purchasing method, the user can carry out in square frame 814 for the second time and click (or other users' operations) to buy product.

Click some other network site that related information is sent to Mail Gateway 302 or online order is handled therewith for the second time.In square frame 816, order is handled, can be comprised such as send the order list to the user and filling in, provide the activity of choice menus and so on or other activities related with the order of filling in the user to the user by it.

That quote in this instructions and/or whole in above-mentioned United States Patent (USP), U.S. Patent application publication, U.S. Patent application, foreign patent, foreign patent application and the non-patent publications that the request for data page or leaf is listed are intactly here quoted.

The foregoing description of shown embodiment is included in the content described in " summary ", is not detailed description or the present invention is limited to illustrated form accurately.Although, described specific embodiment and example here for ease of explanation,, can make various equivalent modifications schemes within the scope of the invention, and can under situation without departing from the spirit and scope of the present invention, make.

For example, in Fig. 3 A, Mail Gateway 302 and server 306 have been shown as independent assembly.Should be appreciated that, in an embodiment, can use single component that identical functions is provided.For example, can completely or partially carry out Email reception, image/audio extraction, response generation and other operations by server 306.Similarly, also can carry out some decoding, rather than only carry out by server 306 by Mail Gateway 302.

Can be based on foregoing detailed description, the present invention is made these and other modification.Employed term should not be interpreted as the present invention is limited to specific embodiment illustrated in instructions and the claim in the following claim.On the contrary, scope of the present invention is determined by following claim that fully claim should be explained according to the fixed principle that claim is explained.

Claims (49)

1. method comprises:

Reception is about equipment active user's the information of catching;

The information of catching is decoded to determine its content;

The definite content and the content of storage are compared so that the user is carried out authentication; And

If the user has passed through authentication, then call function, and carry out this function, the service that can use by device access with the user who allows through authentication with parameter.

2. method according to claim 1 wherein, is carried out this function and is comprised with the step of permission through the user capture service of authentication: carry out this function and serve with the user capture IP phone that allows the process authentication.

3. method according to claim 1 wherein, is carried out this function and is comprised with the step of permission through the user capture service of authentication: carry out this function to allow the restricted wireless channel of user capture through authentication.

4. method according to claim 1 comprises that further the content and function character string that will determine is associated, wherein this function string specified function and at least one parameter of passing to this function.

5. method according to claim 1, wherein, the step of calling and carry out this function comprises: far call and execution function.

6. method according to claim 1, wherein, the step that receives the information catch comprises: receive at least one in image, audio frequency and the biological attribute data related with the active user of equipment.

7. method according to claim 1 further comprises, if the user does not pass through authentication, then calls the function of another denied access, and sends corresponding response message to equipment.

8. method according to claim 1, further being included in decodes carries out pre-service to the information of catching that receives before, so that carry out at least one operation in the form that improves this quality of information and this information of change.

9. method according to claim 1, the step that the information of catching is decoded comprises: use a plurality of different demoders the information of catching to be decoded attempting, at least one demoder in these demoders causes decoding successfully to be carried out.

10. method comprises:

Reception is about the medium of the theme of being caught by equipment;

The medium that receive are decoded to determine its content;

The content and function character string of determining is associated; And

Call and carry out function, information is turned back to the equipment relevant with the theme of catching by function string identification.

11. method according to claim 10, wherein, the step of receiving media comprises: at least one in the discernible image of people of reception theme, audio frequency, biological information and the inhuman discernible image related with theme.

12. method according to claim 11, wherein, the step that receives inhuman discernible image comprises: receive at least one in 1D and the 2D bar code.

13. method according to claim 10, wherein, the medium that receive are decoded comprises and attempts repeatedly by a plurality of different demoders medium to be decoded that at least one demoder in these demoders causes decoding successfully to be carried out.

14. method according to claim 10, further being included in decodes carries out pre-service to the medium that receive before.

15. method according to claim 10, wherein, the step that the content and function character string of determining is associated comprises: the content determined is shielded with the function of the such part that is used to define this function string be associated, promptly this part is used to identify at least one of this function and this function parameter.

16. method according to claim 10, wherein, the step that the content and function character string of determining is associated comprises: be associated with the content of determining and the ID that function is provided with about the alphanumeric character string of these function parameters data.

17. method according to claim 10, call function comprise the server unit call function from the server of the medium of catching away from reception.

18. method according to claim 10 wherein, is carried out this function and is comprised and provide visit to restricted services to equipment through the user of authentication.

19. method according to claim 10, wherein, the step to the equipment return message relevant with the theme of catching comprises: return data, translate foreign languages term, software registration information, product information, historical data, electronic equipment setting, complimentary ticket redemption, film information, competing product data, menu suggestions, the affirmation of face or at least one in voice recognition, auction list, biometric identity authorization information, people's search data and the voice data about the bar code of catching.

20. method according to claim 10, wherein, receiving media comprises the medium of reception as the part of Email, this method further comprise from Email extract medium and with the communicate extracted at least one demoder.

21. a product comprises:

Stored the medium that the machine readable of instruction is got thereon, described instruction is used for:

The information of catching about the equipment active user is carried out pre-service;

The information of catching is decoded to determine its content;

The definite content and the content of storage are compared so that the user is carried out authentication; And

If the user has passed through authentication, then call such function, promptly this function has the parameter of having specified about through the value of authentication user's authority, and carries out this function, the service that can use by device access with the user who allows through authentication.

22. product according to claim 21 wherein, carries out pretreated instruction to the information of catching and comprises carrying out pretreated instruction by in sound, image and the biological attribute data that the active user provided at least one.

23. product according to claim 21, wherein, the instruction of carrying out this function comprises and allowing through the restricted wireless frequency of user capture of authentication and at least one the instruction in the IP phone service.

24. product according to claim 21 wherein, carries out decoded instruction to the information of catching and comprises and attempt to utilize a plurality of different demoders that the information of catching is decoded repeatedly, a decoded instruction that success is provided in these demoders.

25. product according to claim 21, wherein, the medium that machine readable is got further comprise storage thereon, with the instruction that the content of determining is associated with the function string of being represented by the function shielding, wherein this function string is used to specify this function and will passes to this function parameters.

26. a system comprises:

Be used to receive device about the medium of the theme of catching by equipment;

Be used for the medium that receive are decoded to determine the device of its content;

The device that the content and function character string that is used for determining is associated; And

Be used to call and carry out the function of discerning by function string, information is turned back to the device of the equipment relevant with the theme of catching.

27. system according to claim 26 wherein, is used for the device that the medium that receive are decoded comprised being used for device that the discernible or inhuman discernible medium of people are decoded.

28. system according to claim 26 further comprises the device that is used for extracting from the communication of the equipment of being received from the medium that receive, and the device that is used to generate the response with relevant information.

29. system according to claim 26 further comprises the device that is used for the user of equipment is carried out authentication.

30. system according to claim 26 further comprises the device that is used to catch theme and is used to send the theme of catching to be decoded.

31. system according to claim 26 further comprises the device of the function string that is used to define and function and this function parameters association.

32. system according to claim 26 further comprises being used to store about function, reference data and the device of information of waiting the medium of the equipment that turns back to.

33. system according to claim 26 further comprises:

Be used to handle the device of the first user operation related with catching theme; And

Be used to handle the device of the second user operation related with buying the product that relates to the theme of catching.

34. an equipment comprises:

The first module of the medium that reception is caught;

Be connected to first module at least one Unit second so that the medium of catching are decoded;

Be connected to Unit second to ask function and this function Unit the 3rd corresponding to the parameter of decoded medium; And

Be connected to Unit the 3rd with the function of carrying out request and the Unit the 4th that returns the result who relates to the execution function of catching medium.

35. equipment according to claim 34 further comprises being connected at least one Unit second, before decoding the medium of catching are carried out pretreated at least one Unit the 5th.

36. equipment according to claim 35, wherein, at least one Unit the 5th comprises a plurality of filtrators, and these filtrators have operation set, these operation sets with operational applications to the medium of catching to improve its quality or to change its form.

37. equipment according to claim 34, wherein, at least one Unit second comprises a plurality of different demoder that can be used for different medium types.

38. equipment according to claim 34 further comprises another unit that function string is related with decoded media.

39. equipment according to claim 34 further comprises at least one processor and storage medium, wherein, some unit is to be stored on the storage medium and can be realized by the form of software that processor is carried out at least.

40. equipment according to claim 34 further comprises the storage unit that is used for storage function information, parameter and parameter value and medium.

41. according to the described equipment of claim 40, wherein, storage unit comprises medium to the functional query unit, with the association of decoded media and function.

42. equipment according to claim 34 further comprises another unit at least of carrying out this function in the above.

43., wherein, search another unit at least from some other unit medium-long range at least according to the described equipment of claim 42.

44. equipment according to claim 34 further comprises the medium that extraction is caught from the communication that is received from subscriber equipment, and the medium of catching is provided to the mail units of first module.

45., comprise that further response unit is with the result as the function that the response encapsulation of subscriber equipment is carried out according to the described equipment of claim 44.

46. according to the described equipment of claim 45, wherein, any one in mail units and the response unit or both are arranged in the Mail Gateway equipment away from other unit.

47. equipment according to claim 34, wherein, one of them Unit second comprises the subscriber authentication unit.

48. equipment according to claim 34, wherein, Unit second comprises the demoder plug-in card program.

49. equipment according to claim 34, wherein, some element at least of described unit is realized as object.

Images