US20130344916A1 - Content sharing methods and systems - Google Patents

Content sharing methods and systems Download PDF

Info

Publication number
US20130344916A1
US20130344916A1 US14/010,180 US201314010180A US2013344916A1 US 20130344916 A1 US20130344916 A1 US 20130344916A1 US 201314010180 A US201314010180 A US 201314010180A US 2013344916 A1 US2013344916 A1 US 2013344916A1
Authority
US
United States
Prior art keywords
image content
data
user
cell phone
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/010,180
Inventor
Tony F. Rodriguez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Digimarc Corp
Original Assignee
Digimarc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digimarc Corp filed Critical Digimarc Corp
Priority to US14/010,180 priority Critical patent/US20130344916A1/en
Assigned to DIGIMARC CORPORATION reassignment DIGIMARC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RODRIGUEZ, TONY F.
Publication of US20130344916A1 publication Critical patent/US20130344916A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/16Communication-related supplementary services, e.g. call-transfer or call-hold
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0272Details of the structure or mounting of specific components for a projector or beamer module assembly
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/30Details adapted to collapse or fold, e.g. for portability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/52Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the present technology relates to pocket projector systems, and methods of their use.
  • a cell phone may have a camera, it may also have a projector. Projectors are being deployed in cell phones offered for sale by CKing (the N70 model, distributed by ChinaVision) and Samsung, while LG and other vendors have shown prototypes.
  • CKing the N70 model, distributed by ChinaVision
  • Samsung while LG and other vendors have shown prototypes.
  • Microvision offers the PicoP Display Engine, which can be integrated into a variety of devices to yield projector capability, using a micro-electro-mechanical scanning mirror (in conjunction with laser sources and an optical combiner).
  • Other suitable projection technologies include 3M's liquid crystal on silicon (LCOS) and Displaytech's ferroelectric LCOS systems.
  • FIG. 1 shows a block diagram of a cell phone embodying certain aspects of the present technology.
  • FIG. 2 shows two cell phones, employing certain aspects of the present technology.
  • FIG. 3 shows a data structure that can be used in certain embodiments of the present technology.
  • FIG. 4 shows a multi-field watermark payload
  • the content may be imagery, but can also include audio, games, maps, text documents, spreadsheets, or any other form of content.
  • an exemplary cell phone 12 includes a processor 14 , a memory 16 , a camera 18 and a projector 20 .
  • a selection of other elements are also depicted, such as laser pointer 22 .
  • Laser pointer 22 (Since cell phones and associated technology are well known, their conventional features are not belabored. This specification focuses instead on the novel aspects.)
  • projectors are being deployed in cell phones by CKing (the N70 model, distributed by ChinaVision) and Samsung, while LG and other vendors have shown prototypes. These projectors are understood to use electronically-steerable digital micro-mirror arrays from Texas Instruments, in conjunction with LED or laser illumination. Microvision offers the PicoP Display Engine, which can be integrated into cell phones to yield projector capability, using a micro-electro-mechanical scanning minor (in conjunction with laser sources and an optical combiner). Other suitable projection technologies include 3M's liquid crystal on silicon (LCOS) and Displaytech's ferroelectric LCOS systems.
  • the memory 16 of the depicted cell phone 12 includes a variety of software instructions, and data.
  • the software includes the phone's operating system, together with user interface software.
  • a variety of other software modules are typically provided—some user-selectable (e.g., downloaded from a vendor's application store, such as the Apple AppStore).
  • the software in memory 16 also includes watermark software, such as for embedding a steganographic digital watermark pattern into imagery projected by the cell phone projector 20 , and/or for decoding digital watermark data conveyed in imagery captured by the cell phone camera 18 .
  • Watermark software such as for embedding a steganographic digital watermark pattern into imagery projected by the cell phone projector 20 , and/or for decoding digital watermark data conveyed in imagery captured by the cell phone camera 18 .
  • Digital watermark technology is known from Digimarc's patent filings, including U.S. Pat. Nos. 6,122,403, 6,307,949, 6,590,996, and 6,975,744, and pending application Ser. No. 12/337,029, filed Dec. 17, 2008 (published as 20100150434).
  • a cell phone “A” uses its projector 20 to present an image on a display surface 24 .
  • the display surface can be essentially anything, including a wall, a person's t-shirt, etc.
  • a second cell phone “B” uses its camera 18 to capture imagery from a field of view that includes some of the display surface.
  • the camera's field of view can encompass just a part of the projected image, or it can encompass just the full projected image, or it can encompass the full image and more (as depicted).
  • the watermark software in cell phone B decodes the digital watermark encoded in the captured imagery.
  • the watermark decoding performed by cell phone B may include—as a preliminary process—finding subliminal orientation signals in the captured imagery (e.g., a pattern of spatial frequency domain signals), by which geometrical distortions of the captured imagery from its originally-encoded state can be determined (e.g., scale, rotation, affine transformation).
  • the watermark decoder in cell phone B extracts a plural-bit watermark payload from the image.
  • the watermark payload can be used by cell phone B to obtain content desired by the user. The content may be obtained from cell phone A, but this is not necessary.
  • the processor in cell phone A digitally watermarks the projected video with a payload indicating the source of the video.
  • YouTube index number for the video dMH0bHeiRNg
  • name The Evolution of Dance
  • The-dot-convention is used in this specification to prevent the link from being rendered as a live link in electronic presentations of the patent text.
  • the viewing friends may use cell phone B to capture a still image, or video clip, from the projected imagery.
  • the watermark decoder software recovers the encoded payload data—desirably (although not necessarily) as soon as the imagery is captured.
  • Cell phone B can auto-retrieve the same content from YouTube, or it can save the payload information in memory, in a historical listing of watermarks decoded from captured content. The user can then employ this information at a later time to obtain a copy of the video clip.
  • watermark payload comprises the full URL
  • retrieval of the video clip is straightforward. If just the video title, or index number, is provided, then further processing may be required—such as searching YouTube or Google with the payload information.
  • a set of rules stored in cell phone B may establish a protocol of different methods that are to be successively tried to obtain content.
  • the first rule may be to parse the payload data to see if it appears to be a complete URL. If so, the rule may specify passing the payload to the cell phone browser for loading.
  • the third rule may be to check if any of the payload appears to be a word, such as by checking a dictionary database. If so, the cell phone processor can instruct the browser to search Google's web index for the payload as a text phrase. Hopefully, the desired content will be listed near the top of the Google search results, and the user can select same to load.
  • the payload encoded into the projected imagery by cell phone A is an arbitrary identifier, such as a unique ID (UID).
  • Cell phone A can write an entry to a data structure (e.g., a table) that associates the UID with information about the content—such as address information detailing where the content can be obtained.
  • a data structure e.g., a table
  • the data structure may be in the memory of cell phone A, or it can be elsewhere, e.g., in a remote computer server—as depicted in FIG. 2 . In the former case it may be accessed by cell phone B using technology such as a Bluetooth link. In the latter case, it may be accessed by cell phone B over the internet.
  • FIG. 3 An exemplary data structure is shown in FIG. 3 , and serves to associate UIDs conveyed by projected watermarks with corresponding address information. Shown are links to YouTube, Flickr, Apple, Xerox, and Rockstar Games.
  • the Apple link is actually a link to a song at the Apple iTunes store. This illustrates that the content to be shared need not be visual content.
  • the music player application on cell phone A e.g., iTunes
  • Cell phone A can encode the presented imagery with a watermark encoding a UID that points (through the FIG. 3 table) to a source of the music—in this case to the iTunes store.
  • the Xerox link is a link to an Excel spreadsheet on a Xerox server.
  • cell phone A can encode projected imagery with a UID that points to a data structure record indicating where the displayed document can be found.
  • access to the document may be protected from unlimited public access, such as by an encryption key, or an access password.
  • the watermark payload encoded by cell phone A can include a portion (e.g., a field) that allows the user of cell phone B to access the indicated content from the protected website.
  • cell phone A may use a payload that requires routing—such as resolving the UID into associated URL information.
  • UID may need to be resolved each time in order to retrieve the content, allowing the owner of cell phone A to retain control over the material, restricting sharing so that only one person at a time can have “it,” similar to a physical object. Or, it might limit the person with cell phone B to project the content but not pass it on (e.g., because that second recipient is not granted access to the routing table), etc.
  • DRM there is an element of DRM that can be inherent in certain implementations of content sharing.
  • the Rockstar Games link relates to the game Grand Theft Auto—Chinatown Wars.
  • the user of cell phone A may have reached an unusually high level while playing the game on the phone and projecting the game display, and gained access to features with online counterparts.
  • the encoded link information gives the user's friend access to that same special online content (or to an archive of the game as-played, or to executable game software, etc.).
  • the watermark payload embedded in the projected display is a time/date stamp.
  • Cell phone A can maintain a history file detailing all of the content it processes and/or projects, as a function of date/time.
  • cell phone B captures imagery projected from cell phone A, it can consult the history file (immediately, or later) to obtain information related to the content displayed by cell phone A at the date/time indicated by the decoded watermark data.
  • the history file can be in table form, and can be stored on cell phone A, or remotely.
  • the data structures in the foregoing arrangements store pointers to corresponding content data
  • the data structure can store the corresponding content data itself. For example, whenever cell phone A projects information using the projector, it may simultaneously write the same information to a data store, where that content can be accessed by others.
  • the watermark payload can include multiple fields—including one identifying the projecting cell phone (or its user).
  • FIG. 4 shows one such multi-field watermark payload.
  • a first field is an identifier associated with the user (e.g., by reference to a data structure that associates a numeric identifier with textual identification information); the second field is a key permitting access to online content; the third is an identifier of content (e.g., a URL or otherwise); the fourth is data indicating the date/time of projection.
  • this encoding may be static throughout the life of the phone.
  • an optical encoder such as a film in the projection path, patterned with a subtle pattern encoding a user ID watermark, can be employed. Additional fields of the watermark can be encoded by electronically processing the image data prior to projection.
  • the content may—but need not—be visual; watermarked pixels can serve as a proxy for any other form of data.
  • Another usage model includes collaboration, in which cell phone B projects imagery—on top of or adjacent to the imagery projected from cell phone A—so as to create a visual collaboration.
  • Applications include the creation of collaborative works, such as drawings, where each user—using their cell phone's UI (buttons, keys, touch-screen, proximity sensor, accelerometer, etc.)—controls a drawing application, using typical tools such as a paintbrush or eraser, to draw in the in the shared projected space.
  • UI buttons, keys, touch-screen, proximity sensor, accelerometer, etc.
  • Facilitating the collaboration is that each device separately watermarks its contribution to the projected image, providing linkage to data structures that are accessible (via Bluetooth, internet, etc.) and that describe the session and the objects being drawn.
  • Many cell phones—including A and B, as well as others, can participate in the drawing session, either actively, or passively—as an observer only.
  • a simple illustration of such collaboration is a user of cell phone A drawing a circle (e.g., using the Microsoft drawing application Visio) and projecting the drawing using the projector.
  • the user of cell phone B operating that phone's UI, then “grabs” a control point at the perimeter of the projected circle (e.g., using control points presented by Visio), and distorts the circle into an ellipse.
  • Some embodiments have the ability to both project imagery onto, and sense imagery from the same display surface 24 simultaneously, or in quickly alternating, synchronized fashion; other embodiments do not.
  • the user of cell phone B positions the camera so that the control point is at the center of the camera's field of view, and then operates a control on the phone's UI—like activating a mouse button. Once grabbed, the user of cell phone B operates the cell phone to indicate the position to which the edge of the circle is to be stretched. This may be done by holding the control while moving the phone so that the center of the camera's field of view is located at a position corresponding to the desired distortion of the circle (as is familiar from Visio). The user then releases the control.
  • cell phone B communicates the new edge position of the circle to cell phone A by transmitting ⁇ x,y ⁇ position data for the point originally grabbed, and ⁇ x,y ⁇ position data for the point's ending location.
  • This position data is expressed in terms of the frame of reference defined by the orientation signal encoded in the original projected image by cell phone A (e.g., with the upper left corner being the origin), such as a number of projected pixels to the right and down.
  • Communication can be by Bluetooth or otherwise.
  • the center of the field of view of the camera in cell phone B can be denoted by a cross-hair overlaid on the screen of camera B that shows the imagery being captured by the phone's image sensor. (In other embodiments, other positions can be used; use of the center of the field of view is not critical.)
  • cell phone B may project a pointer spot—which may be a laser point or otherwise—to indicate a particular location to be “grabbed,” and a particular end location after stretching.
  • the camera in cell phone A may sense these markings, and update the projected Visio drawing accordingly.
  • the pointer spot may have two modes, tracking and clicking. In tracking mode the pointer is visible, but no responsive action is taken. In clicking mode, the pointer momentarily signals to a responsive camera system that an action is to be taken based on the current location of the pointer spot. This can be signaled by changing the color of the spot, by modulating its amplitude with a distinctive temporal pattern, or otherwise.
  • the pointer spot is unchanging, but the pointer mode is indicated by another data channel, such as a Bluetooth broadcast from cell phone B.
  • cell phone B decodes the watermark encoded by cell phone A in the projected circle drawing.
  • the payload of this watermark may convey the name of the Visio file on cell phone A, or a pointer to the file.
  • Cell phone B uses this payload data to obtain a copy of the drawing file.
  • the user of cell phone B manipulates the drawing copy, e.g., stretching it into an ellipse.
  • Cell phone B projects its revised image for review by the user of cell phone A.
  • the user of cell phone A can likewise capture the revised drawing image projected by cell phone B and decode the watermark encoded into it by cell phone B.
  • cell phone A can obtain a copy of the edited drawing file, e.g., from cell phone B. It can load the edited version, make a further proposed edit, and project the twice-edited version. Edits can ping-pong back and forth, with each cell phone processor running Visio and loading successively-edited versions of drawings.
  • the drawing program is not resident on the cell phones, but rather is a cloud-based application, to which both cell phones have access.
  • the data files need not be exchanged between phones. They can be stored remotely (in the cloud) too.
  • the cloud application can support multiple users editing a single drawing file.
  • Any usage scenario that supports or requires collaboration can be facilitated in such manner.
  • Other examples include multiple individuals having an ad-hoc jam session—creating scores and drum tracks that are played back on one or more devices; gaming, e.g., with multiple drivers in a race car game; multi-user war games where “mercenaries” can join ad-hoc groups of gamers in the high-school lunchroom, etc.
  • the participation in a session need not require cell phone B to project on top of cell phone A's image at all times. Simultaneous projection may occur just when cell phone B enters the session (akin to logging-in), after which that user may participate in the session without the projector, shaking their cell phone as a maraca, strumming the guitar application from the iTunes store, etc. The session may continue even if the user is no longer in proximity of the cell phone user A, yet may continue to participate in a game, etc.
  • Collaboration may also occur with streaming content, such as where cell phone A is projecting a sporting event and cell phone B is projecting stats or historical information about the team or potentially an individual player during the game. The information may track with the individual players or event occurring.
  • any simultaneous (or alternating) image projections by both cell phones A and B will commonly overlap, but need not.
  • the common reference frame established by orientation signals can be used even if the projections do not overlap.
  • the Apple iPhone is one example of a cell phone. (Details of the iPhone, including its touch interface, are provided in published patent application 20080174570.)
  • Other personal digital assistant devices which may include the functions of a computer, a music player, a projector and/or a camera, etc., are also meant to be encompassed by the term “cell phone” as used in this specification—even if “phone” functionality is not provided.
  • the watermark encoder software in cell phone A can run continuously—marking all content presented by the cell phone (whether presented on the built-in display, or projected by a projector).
  • the encoder may be activated selectively, such as when the projector is activated.
  • the watermark decoder in cell phone B can run whenever the device is processing image or video information, or only selectively (such as when the user activates a control).
  • the projected content can be identified by deriving a “fingerprint” from the captured pixels, and identifying a corresponding record in a data structure—as detailed, e.g., in published patent documents 20070174059 (Digimarc), 20070253594 (Vobile), 20080317278 (Thomson) and 20050141707 (Philips/Gracenote).
  • the projected content is watermarked by cell phone A according to a stored rule set.
  • content downloaded from the web may be encoded with the URL from which it was fetched; game displays may be encoded with the game name and level number; camera images earlier captured and stored on the cell phone may be encoded with the image file names, etc.
  • the user of cell phone A is given control over the watermark payload. The user can summon a UI that presents a menu of possible payloads with which projected content can be encoded.
  • a user may selectively instruct that album art projected during playback of a song be encoded with (i) a link to the song on iTunes; (ii) a link to the song on Amazon; (iii) a link to the top-ranked music video of that song on YouTube; (iv) a link to a shared library of MP3 song data stored on cell phone A (including the song being played back and others), etc.
  • cell phone A watermarks the projected content
  • the content may have been earlier watermarked.
  • most television in the US is digitally watermarked by encoding equipment at broadcasting stations, which embeds a source ID (e.g., WABC) and a timestamp.
  • source ID e.g., WABC
  • timestamp e.g., a timestamp
  • These encoders are part of a network employed by The Nielsen Company to help track television consumption. Nielsen maintains a database that details the program lineup for each channel in each geographic market and national network, by date and time. This database is fed by program guide information compiled by vendors such as Tribune Media Company and/or TV Guide.
  • program guide information compiled by vendors such as Tribune Media Company and/or TV Guide.
  • YouTube and other content distributors can similarly watermark their content before it is provided to cell phone A.
  • Suitable computing environments encompass a broad range, from general purpose programmable computing devices, to specialized circuitry, and arrangements including a combination of both.
  • the processes and system components may be implemented as instructions for computing devices, including general purpose processor instructions for a variety of programmable processors, including microprocessors, digital signal processors, etc. These instructions may be implemented as software, firmware, etc. These instructions can also be converted to various forms of processor circuitry, including programmable logic devices, application specific circuits, including digital, analog and mixed analog/digital circuitry. Execution of the instructions can be distributed among processor and/or made parallel across processors within a device or across a network of devices. Transformation of content signal data may also be distributed among different processor and memory devices.
  • Each computing device includes, as necessary, one or more processors, one or more memories (including computer readable media), input devices, output devices, and communication among these components (e.g., a bus). Communication between devices can be wired, but is more typically wireless (e.g., WiFi, WiMax, Bluetooth, etc.)
  • processors for software/firmware, instructions are read from computer readable media, such as optical, electronic or magnetic storage media via a communication bus, interface circuit or network and executed on one or more processors.
  • the above processing of content signals includes transforming of these signals in various physical forms.
  • Imagery and video forms of electromagnetic waves traveling through physical space and depicting physical scenes
  • These signals are typically converted to and processed in electronic and digital form to implement the components and processes described above, they may also be captured, processed, transferred and stored in other physical forms, including electronic, optical, magnetic and electromagnetic wave forms.
  • the content signals are transformed during processing to encode and decode watermark information, including writing and reading various data structure representations information as explained above.
  • the data structure signals in memory are transformed for manipulation during indexing, reading, writing, loading, etc.

Abstract

A first device (such as a cell phone) is equipped with a micro-projector, and used to present imagery on a display surface. A second device (such as a second cell phone) is equipped with a digital camera, and used to capture some of the projected imagery. The captured imagery allows a user of the second device to access digital content of interest from a user of the first device, or from elsewhere. The content may be visual, or of other form (content examples include audio, games, maps, text documents, video, spreadsheets, etc.). In one particular arrangement, the projected imagery is encoded with digital watermark data. Through such arrangements, one user can readily share content, and also engage in collaborative activities—such as cooperative game play, with one or more other users. A great variety of other features and arrangements are also detailed.

Description

    RELATED APPLICATION DATA
  • This application is continuation of copending application Ser. No. 12/482,372, filed Jun. 10, 2009 (now U.S. Pat. No. 8,512,217).
  • TECHNICAL FIELD
  • The present technology relates to pocket projector systems, and methods of their use.
  • BACKGROUND
  • Just as a cell phone may have a camera, it may also have a projector. Projectors are being deployed in cell phones offered for sale by CKing (the N70 model, distributed by ChinaVision) and Samsung, while LG and other vendors have shown prototypes.
  • These projectors are understood to use Texas Instruments electronically-steerable digital micro-minor arrays, in conjunction with LED or laser illumination.
  • Microvision offers the PicoP Display Engine, which can be integrated into a variety of devices to yield projector capability, using a micro-electro-mechanical scanning mirror (in conjunction with laser sources and an optical combiner). Other suitable projection technologies include 3M's liquid crystal on silicon (LCOS) and Displaytech's ferroelectric LCOS systems.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows a block diagram of a cell phone embodying certain aspects of the present technology.
  • FIG. 2 shows two cell phones, employing certain aspects of the present technology.
  • FIG. 3 shows a data structure that can be used in certain embodiments of the present technology.
  • FIG. 4 shows a multi-field watermark payload.
  • DETAILED DESCRIPTION
  • As detailed below, certain embodiments of the present technology allow users to share content through means of projectors and cameras. The content may be imagery, but can also include audio, games, maps, text documents, spreadsheets, or any other form of content.
  • Referring to FIG. 1, an exemplary cell phone 12 includes a processor 14, a memory 16, a camera 18 and a projector 20. A selection of other elements (some of which are optional) are also depicted, such as laser pointer 22. (Since cell phones and associated technology are well known, their conventional features are not belabored. This specification focuses instead on the novel aspects.)
  • As noted, projectors are being deployed in cell phones by CKing (the N70 model, distributed by ChinaVision) and Samsung, while LG and other vendors have shown prototypes. These projectors are understood to use electronically-steerable digital micro-mirror arrays from Texas Instruments, in conjunction with LED or laser illumination. Microvision offers the PicoP Display Engine, which can be integrated into cell phones to yield projector capability, using a micro-electro-mechanical scanning minor (in conjunction with laser sources and an optical combiner). Other suitable projection technologies include 3M's liquid crystal on silicon (LCOS) and Displaytech's ferroelectric LCOS systems.
  • The memory 16 of the depicted cell phone 12 includes a variety of software instructions, and data. The software includes the phone's operating system, together with user interface software. A variety of other software modules are typically provided—some user-selectable (e.g., downloaded from a vendor's application store, such as the Apple AppStore).
  • Desirably, the software in memory 16 also includes watermark software, such as for embedding a steganographic digital watermark pattern into imagery projected by the cell phone projector 20, and/or for decoding digital watermark data conveyed in imagery captured by the cell phone camera 18. Digital watermark technology is known from Digimarc's patent filings, including U.S. Pat. Nos. 6,122,403, 6,307,949, 6,590,996, and 6,975,744, and pending application Ser. No. 12/337,029, filed Dec. 17, 2008 (published as 20100150434).
  • Turning to FIG. 2, a cell phone “A” uses its projector 20 to present an image on a display surface 24. (The display surface can be essentially anything, including a wall, a person's t-shirt, etc.) A second cell phone “B” uses its camera 18 to capture imagery from a field of view that includes some of the display surface.
  • The camera's field of view can encompass just a part of the projected image, or it can encompass just the full projected image, or it can encompass the full image and more (as depicted).
  • The watermark software in cell phone B decodes the digital watermark encoded in the captured imagery. As detailed in the cited patents, the watermark decoding performed by cell phone B may include—as a preliminary process—finding subliminal orientation signals in the captured imagery (e.g., a pattern of spatial frequency domain signals), by which geometrical distortions of the captured imagery from its originally-encoded state can be determined (e.g., scale, rotation, affine transformation). Once this geometrical distortion of the watermark is understood, the watermark decoder in cell phone B extracts a plural-bit watermark payload from the image. The watermark payload can be used by cell phone B to obtain content desired by the user. The content may be obtained from cell phone A, but this is not necessary.
  • To illustrate, consider that a user of cell phone A is viewing a humorous video clip from YouTube (“The Evolution of Dance”), and wants to share it with friends. The user activates the cell phone projector, and projects the video clip on a wall.
  • The processor in cell phone A digitally watermarks the projected video with a payload indicating the source of the video. For example, the watermark payload can comprise the YouTube index number for the video (dMH0bHeiRNg), its name (The Evolution of Dance), or its URL (youtube-dot-com/watch?v=dMH0bHeiRNg). (The-dot-convention is used in this specification to prevent the link from being rendered as a live link in electronic presentations of the patent text.)
  • If one of the viewing friends likes the video, they may use cell phone B to capture a still image, or video clip, from the projected imagery. The watermark decoder software recovers the encoded payload data—desirably (although not necessarily) as soon as the imagery is captured. Cell phone B can auto-retrieve the same content from YouTube, or it can save the payload information in memory, in a historical listing of watermarks decoded from captured content. The user can then employ this information at a later time to obtain a copy of the video clip.
  • If the watermark payload comprises the full URL, retrieval of the video clip is straightforward. If just the video title, or index number, is provided, then further processing may be required—such as searching YouTube or Google with the payload information. A set of rules stored in cell phone B may establish a protocol of different methods that are to be successively tried to obtain content.
  • For example, the first rule may be to parse the payload data to see if it appears to be a complete URL. If so, the rule may specify passing the payload to the cell phone browser for loading.
  • The second rule may be to look for data looking like a YouTube index number. This check can comprise seeing if the payload is between 10 and 12 symbols, and includes a capital letter following a lower case letter. If so, the cell phone processor can create a full URL by pre-pending the symbols “www-dot-youtube-dot-com/watch?v=” to the payload, and pass it to the cell phone browser for loading.
  • The third rule may be to check if any of the payload appears to be a word, such as by checking a dictionary database. If so, the cell phone processor can instruct the browser to search Google's web index for the payload as a text phrase. Hopefully, the desired content will be listed near the top of the Google search results, and the user can select same to load.
  • In other embodiments, the payload encoded into the projected imagery by cell phone A is an arbitrary identifier, such as a unique ID (UID). Cell phone A can write an entry to a data structure (e.g., a table) that associates the UID with information about the content—such as address information detailing where the content can be obtained. When cell phone B decodes this identifier, it can consult the same data structure—using the UID to access the corresponding address information. (The data structure may be in the memory of cell phone A, or it can be elsewhere, e.g., in a remote computer server—as depicted in FIG. 2. In the former case it may be accessed by cell phone B using technology such as a Bluetooth link. In the latter case, it may be accessed by cell phone B over the internet.)
  • An exemplary data structure is shown in FIG. 3, and serves to associate UIDs conveyed by projected watermarks with corresponding address information. Shown are links to YouTube, Flickr, Apple, Xerox, and Rockstar Games.
  • The Apple link is actually a link to a song at the Apple iTunes store. This illustrates that the content to be shared need not be visual content. The music player application on cell phone A (e.g., iTunes) may present a graphic (e.g., an album cover) or an animation whenever music is played. Cell phone A can encode the presented imagery with a watermark encoding a UID that points (through the FIG. 3 table) to a source of the music—in this case to the iTunes store.
  • Similarly, the Xerox link is a link to an Excel spreadsheet on a Xerox server. Again, cell phone A can encode projected imagery with a UID that points to a data structure record indicating where the displayed document can be found.
  • In this case, as in others, access to the document may be protected from unlimited public access, such as by an encryption key, or an access password. The watermark payload encoded by cell phone A can include a portion (e.g., a field) that allows the user of cell phone B to access the indicated content from the protected website.
  • (A variety of such protection techniques are known, so are not belabored here—except to note that certain implementations of this sharing mechanism can restore an “analog” trait of sharing that has been largely lost in other digital content systems. Specifically, cell phone A may use a payload that requires routing—such as resolving the UID into associated URL information. However that UID may need to be resolved each time in order to retrieve the content, allowing the owner of cell phone A to retain control over the material, restricting sharing so that only one person at a time can have “it,” similar to a physical object. Or, it might limit the person with cell phone B to project the content but not pass it on (e.g., because that second recipient is not granted access to the routing table), etc. Thus, there is an element of DRM that can be inherent in certain implementations of content sharing.)
  • The Rockstar Games link relates to the game Grand Theft Auto—Chinatown Wars. In particular, the user of cell phone A may have reached an unusually high level while playing the game on the phone and projecting the game display, and gained access to features with online counterparts. The encoded link information gives the user's friend access to that same special online content (or to an archive of the game as-played, or to executable game software, etc.).
  • In other arrangements, the watermark payload embedded in the projected display is a time/date stamp. Cell phone A can maintain a history file detailing all of the content it processes and/or projects, as a function of date/time. When cell phone B captures imagery projected from cell phone A, it can consult the history file (immediately, or later) to obtain information related to the content displayed by cell phone A at the date/time indicated by the decoded watermark data. (Like FIG. 3, the history file can be in table form, and can be stored on cell phone A, or remotely.)
  • While the data structures in the foregoing arrangements store pointers to corresponding content data, in other embodiments the data structure can store the corresponding content data itself. For example, whenever cell phone A projects information using the projector, it may simultaneously write the same information to a data store, where that content can be accessed by others.
  • (Such an arrangement is somewhat related to the work of Gordon Bell at Microsoft, who seeks to create a digital archive of his life—logging data from audio, video and other sensors capturing his environment. Included in Bell's archive are recordings of all telephone calls, video of daily life, captures of all TV and radio consumed, archive of all web pages visited, map data of all places visited, polysomnograms for his sleep apnea, etc., etc., etc. However, instead of logging incoming content, the projection device in such embodiment logs outgoing content.)
  • In still other embodiments, the watermark payload can include multiple fields—including one identifying the projecting cell phone (or its user). FIG. 4 shows one such multi-field watermark payload. A first field is an identifier associated with the user (e.g., by reference to a data structure that associates a numeric identifier with textual identification information); the second field is a key permitting access to online content; the third is an identifier of content (e.g., a URL or otherwise); the fourth is data indicating the date/time of projection.
  • In embodiments including a user ID (e.g., a cell phone serial number), this encoding may be static throughout the life of the phone. In such case, an optical encoder—such as a film in the projection path, patterned with a subtle pattern encoding a user ID watermark, can be employed. Additional fields of the watermark can be encoded by electronically processing the image data prior to projection.
  • It will be recognized that aspects of the technology detailed above facilitate sharing and viral distribution of content among and between groups of users. The content may—but need not—be visual; watermarked pixels can serve as a proxy for any other form of data.
  • Another usage model includes collaboration, in which cell phone B projects imagery—on top of or adjacent to the imagery projected from cell phone A—so as to create a visual collaboration. Applications include the creation of collaborative works, such as drawings, where each user—using their cell phone's UI (buttons, keys, touch-screen, proximity sensor, accelerometer, etc.)—controls a drawing application, using typical tools such as a paintbrush or eraser, to draw in the in the shared projected space. Facilitating the collaboration is that each device separately watermarks its contribution to the projected image, providing linkage to data structures that are accessible (via Bluetooth, internet, etc.) and that describe the session and the objects being drawn. Many cell phones—including A and B, as well as others, can participate in the drawing session, either actively, or passively—as an observer only.
  • A simple illustration of such collaboration is a user of cell phone A drawing a circle (e.g., using the Microsoft drawing application Visio) and projecting the drawing using the projector. The user of cell phone B, operating that phone's UI, then “grabs” a control point at the perimeter of the projected circle (e.g., using control points presented by Visio), and distorts the circle into an ellipse. (Some embodiments have the ability to both project imagery onto, and sense imagery from the same display surface 24 simultaneously, or in quickly alternating, synchronized fashion; other embodiments do not.)
  • To grab a control point of the projected circle, the user of cell phone B positions the camera so that the control point is at the center of the camera's field of view, and then operates a control on the phone's UI—like activating a mouse button. Once grabbed, the user of cell phone B operates the cell phone to indicate the position to which the edge of the circle is to be stretched. This may be done by holding the control while moving the phone so that the center of the camera's field of view is located at a position corresponding to the desired distortion of the circle (as is familiar from Visio). The user then releases the control.
  • In one particular embodiment, cell phone B communicates the new edge position of the circle to cell phone A by transmitting {x,y} position data for the point originally grabbed, and {x,y} position data for the point's ending location. This position data is expressed in terms of the frame of reference defined by the orientation signal encoded in the original projected image by cell phone A (e.g., with the upper left corner being the origin), such as a number of projected pixels to the right and down. Communication can be by Bluetooth or otherwise.
  • To facilitate such operation, the center of the field of view of the camera in cell phone B can be denoted by a cross-hair overlaid on the screen of camera B that shows the imagery being captured by the phone's image sensor. (In other embodiments, other positions can be used; use of the center of the field of view is not critical.)
  • In other arrangements, cell phone B may project a pointer spot—which may be a laser point or otherwise—to indicate a particular location to be “grabbed,” and a particular end location after stretching. The camera in cell phone A may sense these markings, and update the projected Visio drawing accordingly. (The pointer spot may have two modes, tracking and clicking. In tracking mode the pointer is visible, but no responsive action is taken. In clicking mode, the pointer momentarily signals to a responsive camera system that an action is to be taken based on the current location of the pointer spot. This can be signaled by changing the color of the spot, by modulating its amplitude with a distinctive temporal pattern, or otherwise. In still other arrangements, the pointer spot is unchanging, but the pointer mode is indicated by another data channel, such as a Bluetooth broadcast from cell phone B.
  • In still another arrangement, cell phone B decodes the watermark encoded by cell phone A in the projected circle drawing. The payload of this watermark may convey the name of the Visio file on cell phone A, or a pointer to the file. Cell phone B uses this payload data to obtain a copy of the drawing file. The user of cell phone B then manipulates the drawing copy, e.g., stretching it into an ellipse. Cell phone B projects its revised image for review by the user of cell phone A. The user of cell phone A can likewise capture the revised drawing image projected by cell phone B and decode the watermark encoded into it by cell phone B. Using this information, cell phone A can obtain a copy of the edited drawing file, e.g., from cell phone B. It can load the edited version, make a further proposed edit, and project the twice-edited version. Edits can ping-pong back and forth, with each cell phone processor running Visio and loading successively-edited versions of drawings.
  • In a variant, the drawing program is not resident on the cell phones, but rather is a cloud-based application, to which both cell phones have access. In this case the data files need not be exchanged between phones. They can be stored remotely (in the cloud) too. Or, the cloud application can support multiple users editing a single drawing file.
  • Any usage scenario that supports or requires collaboration can be facilitated in such manner. Other examples include multiple individuals having an ad-hoc jam session—creating scores and drum tracks that are played back on one or more devices; gaming, e.g., with multiple drivers in a race car game; multi-user war games where “mercenaries” can join ad-hoc groups of gamers in the high-school lunchroom, etc.
  • It should also be noted that the participation in a session need not require cell phone B to project on top of cell phone A's image at all times. Simultaneous projection may occur just when cell phone B enters the session (akin to logging-in), after which that user may participate in the session without the projector, shaking their cell phone as a maraca, strumming the guitar application from the iTunes store, etc. The session may continue even if the user is no longer in proximity of the cell phone user A, yet may continue to participate in a game, etc.
  • Collaboration may also occur with streaming content, such as where cell phone A is projecting a sporting event and cell phone B is projecting stats or historical information about the team or potentially an individual player during the game. The information may track with the individual players or event occurring.
  • Many such arrangements are enabled by the ability to project imagery from multiple vantage points that are “rectified” against other images. As noted, this can be accomplished by utilizing a common orientation signal projected by cell phone A, which provides a common origin for all devices participating in the session. This orientation signal can be provided through the use of the noted digital watermarking technologies and/or overt symbologies or explicit fiducials.
  • Note that any simultaneous (or alternating) image projections by both cell phones A and B will commonly overlap, but need not. The common reference frame established by orientation signals can be used even if the projections do not overlap.
  • Having described and illustrated the principles of the technology with reference to various implementations, it should be recognized that the technology is not so limited.
  • For example, while the specification has detailed certain information as being stored in certain locations, and certain processing taking place in certain devices, this is exemplary only. Data can be stored anywhere, and processing can take place anywhere—with information being exchanged between devices as may be required by the application.
  • While this specification frequently uses the term “cell phone,” this term is meant to be given a broad meaning and includes phones of various descriptions—including WiFi phones and others that may not—strictly speaking—use a “cell” network. The Apple iPhone is one example of a cell phone. (Details of the iPhone, including its touch interface, are provided in published patent application 20080174570.) Another is the T-Mobile G1, manufactured by HTC—one of the Android phones. Other personal digital assistant devices, which may include the functions of a computer, a music player, a projector and/or a camera, etc., are also meant to be encompassed by the term “cell phone” as used in this specification—even if “phone” functionality is not provided.
  • The watermark encoder software in cell phone A can run continuously—marking all content presented by the cell phone (whether presented on the built-in display, or projected by a projector). Alternatively, the encoder may be activated selectively, such as when the projector is activated.
  • In like fashion, the watermark decoder in cell phone B can run whenever the device is processing image or video information, or only selectively (such as when the user activates a control).
  • The watermarking technology noted above is exemplary only; a great many other watermarking technologies can be employed, including those commercialized by Philips (now Civolution) and Thomson. Examples are shown in U.S. Pat. Nos. 5,933,798, 6,577,747, 6,671,388, 6,782,116, 7,031,492 and 7,191,334. (Although a video watermark can be used, applicant prefers a still image watermark—to avoid temporal dependencies.) In still other arrangements, the projected content can be identified by deriving a “fingerprint” from the captured pixels, and identifying a corresponding record in a data structure—as detailed, e.g., in published patent documents 20070174059 (Digimarc), 20070253594 (Vobile), 20080317278 (Thomson) and 20050141707 (Philips/Gracenote).
  • In the detailed arrangements, the projected content is watermarked by cell phone A according to a stored rule set. For example, content downloaded from the web may be encoded with the URL from which it was fetched; game displays may be encoded with the game name and level number; camera images earlier captured and stored on the cell phone may be encoded with the image file names, etc. In other arrangements, the user of cell phone A is given control over the watermark payload. The user can summon a UI that presents a menu of possible payloads with which projected content can be encoded. For example, a user may selectively instruct that album art projected during playback of a song be encoded with (i) a link to the song on iTunes; (ii) a link to the song on Amazon; (iii) a link to the top-ranked music video of that song on YouTube; (iv) a link to a shared library of MP3 song data stored on cell phone A (including the song being played back and others), etc.
  • While in the detailed arrangement, cell phone A watermarks the projected content, in other arrangements the content may have been earlier watermarked. For example, most television in the US is digitally watermarked by encoding equipment at broadcasting stations, which embeds a source ID (e.g., WABC) and a timestamp. These encoders are part of a network employed by The Nielsen Company to help track television consumption. Nielsen maintains a database that details the program lineup for each channel in each geographic market and national network, by date and time. This database is fed by program guide information compiled by vendors such as Tribune Media Company and/or TV Guide. To identify a program from a watermark, cell phone B can submit the decoded source ID/time stamp information to the database, which returns data identifying the program. In like fashion, YouTube and other content distributors can similarly watermark their content before it is provided to cell phone A.
  • It is envisioned that the above processes, systems and system components can be implemented in a variety of computing environments and devices. The depicted cell phones and remote server computer are exemplary only. It is specifically contemplated that the processes and components can be implemented within devices and across multiple devices.
  • Suitable computing environments encompass a broad range, from general purpose programmable computing devices, to specialized circuitry, and arrangements including a combination of both. The processes and system components may be implemented as instructions for computing devices, including general purpose processor instructions for a variety of programmable processors, including microprocessors, digital signal processors, etc. These instructions may be implemented as software, firmware, etc. These instructions can also be converted to various forms of processor circuitry, including programmable logic devices, application specific circuits, including digital, analog and mixed analog/digital circuitry. Execution of the instructions can be distributed among processor and/or made parallel across processors within a device or across a network of devices. Transformation of content signal data may also be distributed among different processor and memory devices.
  • Each computing device includes, as necessary, one or more processors, one or more memories (including computer readable media), input devices, output devices, and communication among these components (e.g., a bus). Communication between devices can be wired, but is more typically wireless (e.g., WiFi, WiMax, Bluetooth, etc.) For software/firmware, instructions are read from computer readable media, such as optical, electronic or magnetic storage media via a communication bus, interface circuit or network and executed on one or more processors.
  • The above processing of content signals includes transforming of these signals in various physical forms. Imagery and video (forms of electromagnetic waves traveling through physical space and depicting physical scenes) are captured from physical objects using cameras or other capture equipment. While these signals are typically converted to and processed in electronic and digital form to implement the components and processes described above, they may also be captured, processed, transferred and stored in other physical forms, including electronic, optical, magnetic and electromagnetic wave forms. The content signals are transformed during processing to encode and decode watermark information, including writing and reading various data structure representations information as explained above. In turn, the data structure signals in memory are transformed for manipulation during indexing, reading, writing, loading, etc.
  • To provide a comprehensive disclosure without unduly lengthening this specification, applicant incorporates by reference the patent documents referenced above.

Claims (22)

I claim:
1. A content sharing system comprising:
first and second portable user devices, each including a processor and a memory, at least the first device including a projector, at least the second device including a camera;
instructions in the memory of the first device enabling the first device to steganographically encode image content projected by said projector with a plural-bit digital watermark payload, said payload including data identifying said image content;
instructions in the memory of the second device enabling the second device to decode a plural-bit digital watermark payload from imagery captured by the camera, and to use said payload in obtaining a copy of said image content from a network resource;
wherein a user of the first device can project image content, and a user of the second device can identify said content, and obtain a copy from the network resource.
2. The system of claim 1 in which said instructions in the memory of the first device enable the first device to write an entry to a data structure associating said data with information about how the image content can be obtained, and said instructions in the memory of the second device enable the second device to retrieve said information from said data structure.
3. The system of claim 1 in which said data comprises part or all of a uniform resource locator.
4. The system of claim 1 in which said data comprises a spreadsheet file name.
5. The system of claim 1 in which said instructions in the memory of the first device enable the first device to restrict sharing of the image content, so that only one user at a time can have it.
6. The system of claim 1 in which said instructions in the memory of the first device enable the first device to restrict distribution of the image content by the second device.
7. The system of claim 1 in which said instructions in the memory of the first device enable the first device to encode the image content with a watermark payload comprising plural fields, including at least two selected from the list: a user identifier, access key data, an identifier of the image content, and data indicating the date and time of projection.
8. The system of claim 1 in which said instructions in the memory of the first device enable the first device to encode the image content with a watermark payload that enables a user of the second device to benefit from game features that a user of the first device has earned.
9. The system of claim 1 in which said instructions in the memory of the first device enable the first device to encode the image content with a watermark payload comprising plural data fields, including at least two fields selected from the list: a user identifier field, an access key data field, an identifier of the image content data field, and a date/time of projection data field.
10. The system of claim 9 including at least three fields selected from said list.
11. The system of claim 9 including all four fields from said list.
12. A content sharing method employing first and second portable user devices, at least the first device including a projector, at least the second device including a camera, the method comprising the acts:
steganographically encoding image content with a plural-bit digital watermark payload, said payload including data identifying said image content;
the first device projecting the encoded image content on a surface, using a projector having a projection axis;
the second device capturing image data from the surface, using a camera having a camera axis;
decoding a plural-bit digital watermark payload from the captured image data; and
using the payload in obtaining a copy of the image content for the second device from a network resource;
wherein the projection axis is different than the camera axis.
13. The method of claim 12 that further includes the first device writing an entry to a data structure associating said data with information about how the image content can be obtained, and the second device retrieving retrieve said information from said data structure.
14. The method of claim 12 in which said data comprises part or all of a uniform resource locator.
15. The method of claim 12 in which said data comprises a spreadsheet file name.
16. The method of claim 12 that includes the first device restricting sharing of the image content, so that only one user at a time can have it.
17. The method of claim 12 that includes the first device restricting distribution of the image content by the second device.
18. The method of claim 12 that includes encoding the image content with a watermark payload that enables a user of the second device to benefit from game features that a user of the first device has earned.
19. The method of claim 12 that includes steganographically encoding the image content with a watermark payload comprising plural data fields, including at least two fields selected from the list: a user identifier field, an access key data field, an identifier of the image content data field, and a date/time of projection data field.
20. The method of claim 19 including at least three fields selected from said list.
21. The method of claim 19 including all four fields from said list.
22. A device including a processor, memory and projector, the memory containing software instructions enabling the device to maintain a history of image content projected by the projector.
US14/010,180 2009-06-10 2013-08-26 Content sharing methods and systems Abandoned US20130344916A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/010,180 US20130344916A1 (en) 2009-06-10 2013-08-26 Content sharing methods and systems

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US12/482,372 US8521217B2 (en) 2009-06-10 2009-06-10 Content sharing methods and systems
US14/010,180 US20130344916A1 (en) 2009-06-10 2013-08-26 Content sharing methods and systems

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/482,372 Continuation US8521217B2 (en) 2009-06-10 2009-06-10 Content sharing methods and systems

Publications (1)

Publication Number Publication Date
US20130344916A1 true US20130344916A1 (en) 2013-12-26

Family

ID=43306877

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/482,372 Expired - Fee Related US8521217B2 (en) 2009-06-10 2009-06-10 Content sharing methods and systems
US14/010,180 Abandoned US20130344916A1 (en) 2009-06-10 2013-08-26 Content sharing methods and systems

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/482,372 Expired - Fee Related US8521217B2 (en) 2009-06-10 2009-06-10 Content sharing methods and systems

Country Status (5)

Country Link
US (2) US8521217B2 (en)
JP (1) JP2012529870A (en)
KR (1) KR20120030134A (en)
CN (1) CN102460468B (en)
WO (1) WO2010144610A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130303238A1 (en) * 2012-05-10 2013-11-14 Shao Hua Huang Mini-Projector Apparatus for Combining with Portable Device
US20150332623A1 (en) * 2014-05-15 2015-11-19 Elwha Llc Unobtrusive visual messages
US20170111711A1 (en) * 2015-10-16 2017-04-20 Disney Enterprises, Inc. Device-resident content protection
CN107395882A (en) * 2017-07-14 2017-11-24 桂林电子科技大学 A kind of display control method of Novel smart mobile phone lamp
CN114257705A (en) * 2021-12-14 2022-03-29 杭州特效小哥文化传播有限公司 Virtual shooting technology specific implementation method based on unreal engine

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101510723B1 (en) * 2009-04-20 2015-04-20 삼성전자주식회사 Mobile terminal having projector and method for displaying data thereof
US9749607B2 (en) 2009-07-16 2017-08-29 Digimarc Corporation Coordinated illumination and image signal capture for enhanced signal detection
US8672763B2 (en) * 2009-11-20 2014-03-18 Sony Computer Entertainment Inc. Controller for interfacing with a computing program using position, orientation, or motion
KR20100048965A (en) * 2010-03-12 2010-05-11 블루가 (주) Apparatus for implementing a web-based user interface and method thereof
KR20120102450A (en) * 2011-03-08 2012-09-18 삼성전자주식회사 Method and apparatus for managing contents to sharing contents among devices
US9294869B2 (en) 2013-03-13 2016-03-22 Aliphcom Methods, systems and apparatus to affect RF transmission from a non-linked wireless client
US9124797B2 (en) * 2011-06-28 2015-09-01 Microsoft Technology Licensing, Llc Image enhancement via lens simulation
US10474858B2 (en) 2011-08-30 2019-11-12 Digimarc Corporation Methods of identifying barcoded items by evaluating multiple identification hypotheses, based on data from sensors including inventory sensors and ceiling-mounted cameras
US9367770B2 (en) 2011-08-30 2016-06-14 Digimarc Corporation Methods and arrangements for identifying objects
CN102333215A (en) * 2011-09-15 2012-01-25 盛乐信息技术(上海)有限公司 Handheld mobile device and method interactive with projection apparatus
KR20130031660A (en) * 2011-09-21 2013-03-29 삼성전자주식회사 Network apparatus based contents name and method for generate and authenticate contents name
JP5978308B2 (en) 2011-10-19 2016-08-24 トムソン ライセンシングThomson Licensing System and method for automatically discovering content programs
US8902158B2 (en) * 2011-10-21 2014-12-02 Disney Enterprises, Inc. Multi-user interaction with handheld projectors
US20130249811A1 (en) * 2012-03-23 2013-09-26 Microsoft Corporation Controlling a device with visible light
GB2500652B (en) 2012-03-28 2016-03-23 Canon Kk Method and device for improving configuration of communication devices in a video projection system comprising multiple wireless video projectors
CN104185824B (en) * 2012-03-31 2019-01-22 英特尔公司 The calculating unit and system of projection for showing and integrating
US9137526B2 (en) 2012-05-07 2015-09-15 Microsoft Technology Licensing, Llc Image enhancement via calibrated lens simulation
US9812137B2 (en) 2012-07-25 2017-11-07 Paypal, Inc. Data communication using audio patterns systems and methods
EP2693392A1 (en) * 2012-08-01 2014-02-05 Thomson Licensing A second screen system and method for rendering second screen information on a second screen
CN104813679A (en) * 2012-10-08 2015-07-29 英特尔公司 Method, apparatus and system of screenshot grabbing and sharing
US9123106B2 (en) * 2012-12-13 2015-09-01 Microsoft Technology Licensing, Llc Watermarking screen capture content
US9319149B2 (en) 2013-03-13 2016-04-19 Aliphcom Proximity-based control of media devices for media presentations
US11044451B2 (en) 2013-03-14 2021-06-22 Jawb Acquisition Llc Proximity-based control of media devices for media presentations
US20140342660A1 (en) * 2013-05-20 2014-11-20 Scott Fullam Media devices for audio and video projection of media presentations
US9686466B1 (en) * 2013-06-27 2017-06-20 Google Inc. Systems and methods for environment content sharing
US10424038B2 (en) 2015-03-20 2019-09-24 Digimarc Corporation Signal encoding outside of guard band region surrounding text characters, including varying encoding strength
US9635378B2 (en) 2015-03-20 2017-04-25 Digimarc Corporation Sparse modulation for robust signaling and synchronization
US20160277482A1 (en) * 2014-03-16 2016-09-22 Janet Brumbaugh Method and Apparatus for Collaborative Drawing
US9600754B2 (en) 2014-12-23 2017-03-21 Digimarc Corporation Machine-readable glass
US9754341B2 (en) 2015-03-20 2017-09-05 Digimarc Corporation Digital watermarking and data hiding with narrow-band absorption materials
US10783601B1 (en) 2015-03-20 2020-09-22 Digimarc Corporation Digital watermarking and signal encoding with activable compositions
US10158840B2 (en) 2015-06-19 2018-12-18 Amazon Technologies, Inc. Steganographic depth images
US9300678B1 (en) 2015-08-03 2016-03-29 Truepic Llc Systems and methods for authenticating photographic image data
US10212306B1 (en) * 2016-03-23 2019-02-19 Amazon Technologies, Inc. Steganographic camera communication
US10375050B2 (en) 2017-10-10 2019-08-06 Truepic Inc. Methods for authenticating photographic image data
US10872392B2 (en) 2017-11-07 2020-12-22 Digimarc Corporation Generating artistic designs encoded with robust, machine-readable data
US10896307B2 (en) 2017-11-07 2021-01-19 Digimarc Corporation Generating and reading optical codes with variable density to adapt for visual quality and reliability
US11062108B2 (en) 2017-11-07 2021-07-13 Digimarc Corporation Generating and reading optical codes with variable density to adapt for visual quality and reliability
US10609028B2 (en) * 2017-12-12 2020-03-31 Nagravision S.A. Securing digital data transmission in a communication network
US10361866B1 (en) 2018-08-13 2019-07-23 Truepic Inc. Proof of image authentication on a blockchain
US10360668B1 (en) 2018-08-13 2019-07-23 Truepic Inc. Methods for requesting and authenticating photographic image data
US11037284B1 (en) 2020-01-14 2021-06-15 Truepic Inc. Systems and methods for detecting image recapture

Citations (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020023218A1 (en) * 2000-08-15 2002-02-21 Lawandy Nabil M. Method and apparatus for reading digital watermarks with a hand-held reader device
US20020052229A1 (en) * 2000-04-07 2002-05-02 Ronald Halliburton Solitaire game played over the internet with features to extend play
US20030012548A1 (en) * 2000-12-21 2003-01-16 Levy Kenneth L. Watermark systems for media
US20030187798A1 (en) * 2001-04-16 2003-10-02 Mckinley Tyler J. Digital watermarking methods, programs and apparatus
US20030202679A1 (en) * 2002-04-29 2003-10-30 The Boeing Company Watermarks for secure distribution of digital data
US20040022444A1 (en) * 1993-11-18 2004-02-05 Rhoads Geoffrey B. Authentication using a digital watermark
US20050002543A1 (en) * 2003-05-09 2005-01-06 Cornog Katherine H. Watermarking
US20050182956A1 (en) * 1995-02-13 2005-08-18 Intertrust Technologies Corporation Trusted and secure techniques, systems and methods for item delivery and execution
US6961442B2 (en) * 2001-03-09 2005-11-01 Digimarc Corporation Watermarking a carrier on which an image will be placed or projected
US20060120562A1 (en) * 2001-06-13 2006-06-08 Brian Fudge Apparatus and method for watermarking a digital image
US20060133644A1 (en) * 2004-12-20 2006-06-22 Wells Aaron G Recorded video broadcast, streaming, download, and disk distribution with watermarking instructions
US20060190290A1 (en) * 2005-02-22 2006-08-24 Brainshield Technologies, Inc. Systems and methods for distributing electronic files
US20070003102A1 (en) * 2003-04-17 2007-01-04 Nippon Telegraph And Telephone Corporation Electronic watermark-containing moving picture transmission system, electronic watermark-containing moving picture transmission method, information processing device, communication control device, electronic watermark-containing moving picture processing program, and storage medium containing electronic watermark-containing
US20070052997A1 (en) * 2005-08-23 2007-03-08 Hull Jonathan J System and methods for portable device for mixed media system
US20070220575A1 (en) * 2006-03-03 2007-09-20 Verimatrix, Inc. Movie studio-based network distribution system and method
US20080052783A1 (en) * 2000-07-20 2008-02-28 Levy Kenneth L Using object identifiers with content distribution
US20090150165A1 (en) * 2007-12-11 2009-06-11 Sony Corporation Encoding and detecting apparatus
US20090265793A1 (en) * 2003-09-12 2009-10-22 Hank Risan Preventing unauthorized distribution of media content within a global network
US20100017614A1 (en) * 2006-06-06 2010-01-21 Sony United Kingdom Limited Encoding and detecting apparatus
US20100048242A1 (en) * 2008-08-19 2010-02-25 Rhoads Geoffrey B Methods and systems for content processing
US20100310114A1 (en) * 2009-06-09 2010-12-09 Cornog Katherine H Watermarking of motion pictures
US20110115823A1 (en) * 2007-10-05 2011-05-19 Huebner Ken J Interactive projector system and method
US8321497B1 (en) * 2001-04-17 2012-11-27 Hewlett-Packard Development Company, L.P. Data structure disposed in a computer readable memory that provides information corresponding to a location

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7010144B1 (en) 1994-10-21 2006-03-07 Digimarc Corporation Associating data with images in imaging systems
US6122403A (en) 1995-07-27 2000-09-19 Digimarc Corporation Computer system linked by using information in data objects
US7515733B2 (en) 1993-11-18 2009-04-07 Digimarc Corporation Methods and arrangements employing digital content items
US6947571B1 (en) 1999-05-19 2005-09-20 Digimarc Corporation Cell phones with optical capabilities, and related applications
US6965682B1 (en) * 1999-05-19 2005-11-15 Digimarc Corp Data transmission by watermark proxy
US7505605B2 (en) * 1996-04-25 2009-03-17 Digimarc Corporation Portable devices and methods employing digital watermarking
US8180844B1 (en) 2000-03-18 2012-05-15 Digimarc Corporation System for linking from objects to remote resources
JP2003529225A (en) 1998-01-20 2003-09-30 ディジマーク コーポレイション Multiple watermark technology
CA2247706C (en) 1998-06-23 2010-11-23 Nielsen Media Research, Inc. Use of browser history file to determine web site reach
US7406214B2 (en) 1999-05-19 2008-07-29 Digimarc Corporation Methods and devices employing optical sensors and/or steganography
AU2593101A (en) * 1999-12-28 2001-07-09 Digimarc Corporation Digital watermarks as data proxies
EP2352120B1 (en) * 2000-01-13 2016-03-30 Digimarc Corporation Network-based access to auxiliary data based on steganographic information
US8091025B2 (en) * 2000-03-24 2012-01-03 Digimarc Corporation Systems and methods for processing content objects
US7738673B2 (en) * 2000-04-19 2010-06-15 Digimarc Corporation Low visible digital watermarks
EP1329045B1 (en) * 2000-10-20 2004-12-08 Koninklijke Philips Electronics N.V. Rendering device and arrangement
US7464877B2 (en) * 2003-11-13 2008-12-16 Metrologic Instruments, Inc. Digital imaging-based bar code symbol reading system employing image cropping pattern generator and automatic cropped image processor
US20020097416A1 (en) * 2001-01-19 2002-07-25 Chang William Ho Output controller processor for universal data output
US7098931B2 (en) 2001-03-05 2006-08-29 Digimarc Corporation Image management system and methods using digital watermarks
US7061510B2 (en) * 2001-03-05 2006-06-13 Digimarc Corporation Geo-referencing of aerial imagery using embedded image identifiers and cross-referenced data sets
US20020176116A1 (en) 2001-04-12 2002-11-28 Rhoads Geoffrey B. Digital watermarks as a communication channel in documents for controlling document processing devices
US20030016825A1 (en) * 2001-07-10 2003-01-23 Eastman Kodak Company System and method for secure watermarking of a digital image sequence
US20030038927A1 (en) * 2001-08-27 2003-02-27 Alden Ray M. Image projector with integrated image stabilization for handheld devices and portable hardware
US8059815B2 (en) 2001-12-13 2011-11-15 Digimarc Corporation Transforming data files into logical storage units for auxiliary data through reversible watermarks
CN1682229A (en) * 2002-09-17 2005-10-12 默比卡有限公司 Optimised messages containing barcode information for mobile receiving device
US6996251B2 (en) * 2002-09-30 2006-02-07 Myport Technologies, Inc. Forensic communication apparatus and method
JP4140898B2 (en) * 2003-08-20 2008-08-27 日本電信電話株式会社 Information presentation device and method of using information presentation device
JP4425900B2 (en) * 2003-09-19 2010-03-03 ソフトバンクモバイル株式会社 Information communication terminal
US7500758B1 (en) * 2004-03-04 2009-03-10 Sanyo Electric Co., Ltd. Cameras and video players having image projection capabilities
JP4433960B2 (en) * 2004-09-21 2010-03-17 株式会社ニコン Portable information equipment
US7370190B2 (en) * 2005-03-03 2008-05-06 Digimarc Corporation Data processing systems and methods with enhanced bios functionality
US8570586B2 (en) * 2005-05-02 2013-10-29 Digimarc Corporation Active images through digital watermarking
US7768666B2 (en) 2005-09-21 2010-08-03 Fuji Xerox Co., Ltd. Device, device processing history storage system and device processing history storing method
JP2007213217A (en) * 2006-02-08 2007-08-23 Seiko Instruments Inc Printing device, information providing method, printing method, and printed matter
US7515734B2 (en) * 2006-03-27 2009-04-07 Eyecue Vision Technologies Ltd. Device, system and method for determining compliance with a positioning instruction by a figure in an image
JP2008014963A (en) * 2006-06-30 2008-01-24 Toshiba Corp Projection type display device and its control method
JP2008249905A (en) * 2007-03-29 2008-10-16 Brother Ind Ltd Display system and projector
US8131731B2 (en) 2007-12-27 2012-03-06 Microsoft Corporation Relevancy sorting of user's browser history
US8285256B2 (en) * 2008-07-28 2012-10-09 Embarq Holdings Company, Llc System and method for projecting information from a wireless device
US8890892B2 (en) * 2009-04-24 2014-11-18 Pixar System and method for steganographic image display

Patent Citations (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040022444A1 (en) * 1993-11-18 2004-02-05 Rhoads Geoffrey B. Authentication using a digital watermark
US20050182956A1 (en) * 1995-02-13 2005-08-18 Intertrust Technologies Corporation Trusted and secure techniques, systems and methods for item delivery and execution
US20020052229A1 (en) * 2000-04-07 2002-05-02 Ronald Halliburton Solitaire game played over the internet with features to extend play
US20080052783A1 (en) * 2000-07-20 2008-02-28 Levy Kenneth L Using object identifiers with content distribution
US20020023218A1 (en) * 2000-08-15 2002-02-21 Lawandy Nabil M. Method and apparatus for reading digital watermarks with a hand-held reader device
US20030012548A1 (en) * 2000-12-21 2003-01-16 Levy Kenneth L. Watermark systems for media
US6961442B2 (en) * 2001-03-09 2005-11-01 Digimarc Corporation Watermarking a carrier on which an image will be placed or projected
US20030187798A1 (en) * 2001-04-16 2003-10-02 Mckinley Tyler J. Digital watermarking methods, programs and apparatus
US8321497B1 (en) * 2001-04-17 2012-11-27 Hewlett-Packard Development Company, L.P. Data structure disposed in a computer readable memory that provides information corresponding to a location
US20060120562A1 (en) * 2001-06-13 2006-06-08 Brian Fudge Apparatus and method for watermarking a digital image
US20030202679A1 (en) * 2002-04-29 2003-10-30 The Boeing Company Watermarks for secure distribution of digital data
US20070003102A1 (en) * 2003-04-17 2007-01-04 Nippon Telegraph And Telephone Corporation Electronic watermark-containing moving picture transmission system, electronic watermark-containing moving picture transmission method, information processing device, communication control device, electronic watermark-containing moving picture processing program, and storage medium containing electronic watermark-containing
US20050002543A1 (en) * 2003-05-09 2005-01-06 Cornog Katherine H. Watermarking
US20090265793A1 (en) * 2003-09-12 2009-10-22 Hank Risan Preventing unauthorized distribution of media content within a global network
US20060133644A1 (en) * 2004-12-20 2006-06-22 Wells Aaron G Recorded video broadcast, streaming, download, and disk distribution with watermarking instructions
US20060190290A1 (en) * 2005-02-22 2006-08-24 Brainshield Technologies, Inc. Systems and methods for distributing electronic files
US20070052997A1 (en) * 2005-08-23 2007-03-08 Hull Jonathan J System and methods for portable device for mixed media system
US20070220575A1 (en) * 2006-03-03 2007-09-20 Verimatrix, Inc. Movie studio-based network distribution system and method
US20100017614A1 (en) * 2006-06-06 2010-01-21 Sony United Kingdom Limited Encoding and detecting apparatus
US20110115823A1 (en) * 2007-10-05 2011-05-19 Huebner Ken J Interactive projector system and method
US20090150165A1 (en) * 2007-12-11 2009-06-11 Sony Corporation Encoding and detecting apparatus
US20100048242A1 (en) * 2008-08-19 2010-02-25 Rhoads Geoffrey B Methods and systems for content processing
US20100310114A1 (en) * 2009-06-09 2010-12-09 Cornog Katherine H Watermarking of motion pictures

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130303238A1 (en) * 2012-05-10 2013-11-14 Shao Hua Huang Mini-Projector Apparatus for Combining with Portable Device
US20150332623A1 (en) * 2014-05-15 2015-11-19 Elwha Llc Unobtrusive visual messages
US20170111711A1 (en) * 2015-10-16 2017-04-20 Disney Enterprises, Inc. Device-resident content protection
US10045092B2 (en) * 2015-10-16 2018-08-07 Disney Enterprises, Inc. Device-resident content protection
CN107395882A (en) * 2017-07-14 2017-11-24 桂林电子科技大学 A kind of display control method of Novel smart mobile phone lamp
CN114257705A (en) * 2021-12-14 2022-03-29 杭州特效小哥文化传播有限公司 Virtual shooting technology specific implementation method based on unreal engine

Also Published As

Publication number Publication date
JP2012529870A (en) 2012-11-22
CN102460468B (en) 2014-11-05
CN102460468A (en) 2012-05-16
KR20120030134A (en) 2012-03-27
US8521217B2 (en) 2013-08-27
US20100317399A1 (en) 2010-12-16
WO2010144610A1 (en) 2010-12-16

Similar Documents

Publication Publication Date Title
US8521217B2 (en) Content sharing methods and systems
US9525798B2 (en) Image-related methods and systems
CN101930779B (en) Video commenting method and video player
TWI498843B (en) Portable electronic device, content recommendation method and computer-readable medium
CN107103316B (en) Method and system based on smart phone
US9240058B1 (en) Dynamic barcode generation for content location
US20110176010A1 (en) Mobile terminal, icon material management system, and icon material management method
US20070229678A1 (en) Camera for generating and sharing media keys
US9479914B2 (en) Intuitive computing methods and systems
KR20150132074A (en) Method for organising content
WO2012050672A2 (en) Image identification and sharing on mobile devices
EP3383052A1 (en) Content management system, and content management method
US9152707B2 (en) System and method for creating and providing media objects in a navigable environment
TW201503675A (en) Media file management method and system
US8699747B2 (en) Image-related methods and systems
CN103970821B (en) Display control unit and display control method
US20110016378A1 (en) System and method of automatically identifying and marking hyperimages when displayed
WO2022231703A1 (en) Integrating overlaid digital content into displayed data via processing circuitry using a computing memory and an operating system memory
KR20140136587A (en) Sound storage service system and method
WO2012140985A1 (en) Data transmission device, method for adding copyright notice, and program
JP6527650B2 (en) Content management system, content management server, and content management method
US20120079051A1 (en) System and method of storing and retrieving associated information with a digital image
JP2009026121A (en) Document-processing program, document-processing device, and document-processing system
JP2006072428A (en) Information superimposed display system
JP2008092326A (en) Portable terminal, information display method and program

Legal Events

Date Code Title Description
AS Assignment

Owner name: DIGIMARC CORPORATION, OREGON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RODRIGUEZ, TONY F.;REEL/FRAME:031112/0008

Effective date: 20130827

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION