US20060268117A1 - Method for simultaneously recording motion and still images in a digital camera - Google Patents
Method for simultaneously recording motion and still images in a digital camera Download PDFInfo
- Publication number
- US20060268117A1 US20060268117A1 US11/499,419 US49941906A US2006268117A1 US 20060268117 A1 US20060268117 A1 US 20060268117A1 US 49941906 A US49941906 A US 49941906A US 2006268117 A1 US2006268117 A1 US 2006268117A1
- Authority
- US
- United States
- Prior art keywords
- image
- motion
- resolution
- sequence
- image frames
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/4223—Cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/44029—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display for generating different versions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
- H04N21/8153—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/7921—Processing of colour television signals in connection with recording for more than one processing mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/781—Television signal recording using magnetic recording on disks or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/84—Television signal recording using optical recording
- H04N5/85—Television signal recording using optical recording on discs or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
- H04N9/8047—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding
Definitions
- the invention relates generally to the field of photography, and in particular to combine motion and still image capture. More specifically, the invention relates to a motion/still image capture system which captures image sequences including both full and reduced resolution images and stores digital image data to provide both motion video sequences and digital still pictures.
- camcorders to capture motion video images, which are viewed on a TV display, and film cameras to capture still images which are developed and optically printed to provide hardcopy prints. Carrying both types of devices is burdensome, however. Thus, there is interest in having a digital camcorder type device that captures motion images, while also allowing high quality prints to be produced from selected image frames.
- Recent advances in digital camcorders include the ability to capture both motion and still images (commonly referred to as MOST cameras), and associated audio information, such as those from JVC (GR-DV1) and Sony Corp. (DCR-PC7) which allow the capture of motion video and still imagery.
- JVC JVC
- GR-DV1 JVC
- DCR-PC7 Sony Corp.
- the GR-DV1 from JVC allows a user to capture a snapshot while recording live video. Basically, the snapshot is indicated by overlaying a white border on the particular still frame of the captured live video. See U.S. Pat. No. 5,382,974, issued Jan. 17, 1995 to Soeda et al. entitled Movie Camera Having Still Picture Photographing Function and Method of Photographing Still Picture Therewith, which shows a movie camera capable of also capturing still images.
- a high definition camcorder could store a high resolution (e.g. 1280 ⁇ 960 pixels) motion sequence for each image frame, to provide higher quality still images.
- a high frame rate e.g. 30 frames/sec
- the amount of data that would need to be processed and stored per second e.g. 1280 ⁇ 960 ⁇ 30 pixels
- the need is met according to the present invention by providing a method for simultaneously recording motion and still images, that includes the steps of: capturing a motion image sequence and accompanying audio of a scene with a digital video camera, adapted to record both motion and higher resolution still images; simultaneously capturing a still image sequence having a higher resolution and lower frame rate than the motion capture sequence; compressing the motion image sequence using interframe compression and the accompanying audio and storing the compressed motion image and audio data; and compressing the still images using intraframe coding and storing the compressed still image data.
- the present invention provides a better way of capturing, processing, and storing both motion and still images of the same event. Another advantage of this invention is that it records both still and motion images so that desired still images can later be selected for printing. Another advantage of this invention is that it uses the same image sensor and digital image processor to provide both the motion and still images. Another advantage of this invention is that the still image processing does not need to be completed within the period set by the capture frame rate, so that the processor pixel operating rate can be reduced by balancing the processor load for still and motion images.
- FIG. 1 is a flow chart showing the operation of the motion/still imaging system according to the present invention
- FIG. 2 shows the user interface employed in the motion/still imaging system of the present invention
- FIG. 3 is a block diagram illustrating a motion/still image capture system according to the present invention.
- FIG. 4 is a diagram illustrating the motion capture and processing sequence used in the present invention.
- FIG. 5 is a diagram illustrating the data structure for storing the motion sequences and still images.
- a motion/still camera 12 is operated in a motion/still capture mode, to alternately capture a series of both full resolution and reduced resolution images of a subject 14 while continuously capturing a digital audio signal.
- a full resolution image contains at least four times as many pixels as a reduced resolution image.
- the user can change the camera mode using user controls 66 (see FIG. 3 ) to capture only reduced resolution motion images, or only a single full resolution still image. Both the full and reduced resolution images are digitized 16 in the camera.
- the reduced resolution images, and a similar sized low resolution image derived from the full resolution images, are compressed 18 using an interframe compression algorithm operating at a relatively high compression ratio, while the full resolution images 20 are compressed using only intraframe compression at a relatively low compression ratio, to provide high image quality.
- the high resolution image compression can either use as an input the complete full resolution image, or can alternatively compress the difference image (e.g. the residual image) obtained by decompressing and subtracting the low resolution image to be stored as part of the compressed low resolution sequence from the full resolution image of the same image frame.
- Compression of the motion sequence is necessary to lower the bandwidth and storage requirements.
- an NTSC format video signal with a frame rate of 29.97 Hz when digitized will result in an uncompressed bit rate of about 168 Mb/s.
- MPEG (Moving Picture Expert Group) compression of an NTSC video signal can result in a bit rate of 3 to 6 Mb/s with a quality comparable to analog cable TV and far superior to VHS video tape.
- the full resolution images used to provide high quality still images are obtained much less frequently than the motion images, and have higher resolution and less aggressive compression.
- a regular sequence of high resolution still image frames and low resolution compressed audio/video frames is generated 22. Such a sequence is created whenever the user presses the record button while the camera 12 is in the combination motion/still (MOST) mode.
- the camera 12 takes a fixed number of images per second (e.g. 24 or 30 frames per second) to provide the motion sequence.
- a relatively small number of these images e.g. 2 frames per second, or every 12 th or 15 th image
- the user can set the frequency of full resolution images using user controls 66 , in order to record more high resolution images per second for important but short events, or alternatively fewer high resolution images per second, to reduce the amount of still image related data that must be recorded, in order to increase the recording time.
- the full and reduced resolution images can be created using the image sensor described in commonly-assigned U.S. Pat. No. 5,440,343 issued Aug. 8, 1995 to Parulski et al., entitled Motion/Still Electronic Image Sensing Apparatus, the disclosure of which is incorporated herein.
- the image sensor can always read out a full resolution image using a relatively high speed clock, and the reduced resolution images can be obtained by averaging or subsampling (e.g. decimating the image 2:1 both vertically and horizontally) this full resolution image sequence.
- the low resolution video data and high resolution image data can be stored 24 on a digital storage medium, such as CD ROM medium or a DVD (Digital Versatile Disk) medium 26 .
- the data can be stored on digital videotape, a magnetic hard drive, or Flash EPROM memory, or any other digital storage device.
- the data can be stored on an image server through a wireless or wired network link.
- the stored data may also include metadata, such as user-input text information and camera-generated information such as time, date, camera model and serial number, lens settings, etc.
- the structure of the image files that store the low resolution motion video and high resolution still image data are described below.
- the display and printing of these digital image files 28 are carried out at a user's video player terminal (which may utilize the digital camera 12 for image playback) or computer, and are enabled by an image processing sub-system in the terminal or computer that decompresses the image files.
- a user's video player terminal which may utilize the digital camera 12 for image playback
- an image processing sub-system in the terminal or computer that decompresses the image files.
- the user can view and browse the low resolution video sequences, and selectively print any associated high resolution still frames.
- a user interface of the terminal or computer is depicted in FIG. 2 .
- the user interface 30 is displayed on a CRT 31 driven by the terminal or computer, which may be, for example, a personal computer (PC) 33 , having an operating system 37 , such as the well-known Windows 98TM, or Windows 2000TM operating systems from Microsoft, Inc., Redmond, Oreg., and application software 39 for generating the graphical user interface and performing the image processing, decoding and display functions described herein.
- the PC 33 is connected to operator interfaces such as a keyboard 45 and a mouse 35 .
- the basic features of the interface display 30 include an array of index images 32 representing each motion sequence.
- an operator can double click on one of the index images 32 to display the associated audiovisual segment, which may be, for example, an MPEG-2 compliant audio/video file, in window 34 .
- the MPEG-2 video compression is defined in “Generic coding of moving pictures and associated audio information: Video,” ISO/IEC 13818-2, MPEG-2 Video International Standard, 1996. Alternatively, other types of MPEG compression, such as MPEG-1 or MPEG-4, may be used.
- the audio portion of the MPEG segment is played on the stereo speakers 36 .
- the operator can drag and drop any one of the index images into a start window 38 and another one later in the sequence into a stop window 40 .
- the MPEG sequences associated with the start and stop sequences, and all sequences in between, will be played in window 34 .
- the operator can single click on the print button 44 to initiate a printing operation.
- the print button is depressed, the image frame corresponding to the last high resolution image is displayed in window 34 .
- the user can skip back to the previous high resolution image by single clinking on the back arrow 41 , or can rapidly move to earlier high resolution images by “clicking and holding” back arrow 41 .
- the user can skip forward to the next high resolution image by single clicking on the forward arrow 43 , or can rapidly move to later high resolution images by “clicking and holding” back arrow 41 .
- a print is produced from the high resolution still image data for this image frame on a color printer 47 such as an ink jet or laser printer, that is connected to the user's terminal or personal computer 33 .
- the architecture of the digital motion/still camera 12 is illustrated in FIG. 3 .
- the digital camera 12 produces digital image files that are recorded using a digital recorder 48 .
- the camera is powered by batteries 80 which connect to power supply 82 , which supplies power to the camera circuits depicted in FIG. 3 .
- the digital camera 12 includes a zoom lens 51 having zoom and focus motor drives 53 and an adjustable aperture (not shown).
- the user composes the scene using the electronic viewfinder 72 and the zoom lens control buttons (not shown) of the user controls 66 , and then depresses a record button (not shown) to begin capture of a motion/still image sequence.
- the zoom lens 51 focuses light from a subject 14 (see FIG.
- an image sensor 50 for example, a single-chip interline color CCD image sensor using the well-known Bayer color filter pattern.
- the image sensor may be an interline format sensor having 1280 columns ⁇ 960 rows of active pixels.
- the image sensor 50 is controlled by timing generator/clock drivers 70 .
- the zoom and focus motors 53 and the clock drivers 70 are controlled by control signals supplied by a control microprocessor 68 .
- the analog output signal from the image sensor 50 is amplified and converted to digital data by the analog signal processing (ASP) and analog-to-digital (A/D) converter circuit 52 .
- the camera 12 also includes a microphone 56 and an audio A/D converter 58 for providing a digital audio signal to digital processor 68 .
- the digital data from ASP and A/D 52 includes both full resolution image frames that are used to produce both high resolution still image data and a low resolution motion image data, and reduced resolution image frames that are only used to provide low resolution motion image data.
- the image sensor 50 can use the invention described in U.S. Pat. No. 5,440,343 to provide full resolution (e.g. 1280 ⁇ 960 pixel) images and reduced resolution (e.g. 640 ⁇ 480 pixel) images by summing and dumping appropriate color pixels.
- the sensor can provide only full resolution (e.g. 1280 ⁇ 960 pixel) images, and a 2:1 subsampling circuit 54 can be used to produce the reduced resolution image by appropriately averaging the digital sensor pixel values.
- the ASP and A/D 52 is coupled to a full resolution buffer memory 60 which stores a full resolution (e.g. 1280 ⁇ 960 pixel) still image.
- the 2:1 subsampling circuit 54 is coupled to a multi-frame reduced resolution buffer memory 62 , which can store multiple reduced resolution images, such as buffer memory that can store four 640 ⁇ 480 pixel images.
- the outputs of the full resolution buffer memory 60 and the multi-frame reduced resolution buffer memory 62 are coupled to a multiplexer switch 64 which provides an input to control microprocessor 68 .
- the digital audio data from audio A/D 58 is also input to control microprocessor 68 .
- the processed image and audio data is coupled to a digital recorder 48 which stores the digital image files.
- the digital recorder can use write-once or erasable CD or DVD optical disks. Alternatively, the digital recorder can use other digital storage technologies, such as magnetic hard drives, magnetic tape, optical tape, or solid-state memory.
- the control microprocessor 68 alternates between processing one full resolution image from full resolution buffer memory 60 , followed by several reduced resolution images from multi-frame reduced resolution buffer memory 62 .
- the processor spends a longer period of time processing a full resolution image than it does processing a reduced resolution image, while the time period between each sensor exposure must remain constant, in order to prevent motion artifacts. Therefore, the arrangement of the two buffer memories 60 and 62 allows the processing load to be better balanced by allowing the control microprocessor 68 to spend a longer period of time processing the full resolution images.
- the control microprocessor 68 For each full and reduced resolution image frame, the control microprocessor 68 performs color interpolation followed by color and tone correction, in order to produce rendered sRGB image data. For full resolution frames, the control microprocessor 68 creates both full resolution (e.g. 1280 ⁇ 960 pixel) sRGB image data, and low resolution (e.g. 640 ⁇ 480 pixel) sRGB image data. For reduced resolution frames, the digital processor creates only low resolution (e.g. 640 ⁇ 480 pixel) sRGB data. The control microprocessor 68 also creates, from the low resolution image data of each full and reduced resolution image frame, a “thumbnail” size image, which can be created as described in commonly-assigned U.S. Pat. No.
- This thumbnail image has 160 ⁇ 120 pixels and is displayed on electronic viewfinder 72 as the image sequences are captured.
- the digital processor 66 can also provide a video output signal 74 , as either a digital or analog video signal, which is encoded for display on a standard TV display (not shown), such as an NTSC video display.
- the digital processor also compresses the digital audio signal from audio A/D 52 , in order to provide an MPEG compressed audio stream.
- the rendered sRGB low resolution image data from both the full and reduced resolution frames is then compressed, processed and stored, along with the compressed audio data, as an MPEG-2 bitstream.
- the processing may include conversion form RGB data to alternate color spaces, such as YUV, YIQ, or Y, Cb, Cr as described in chapter 3 of “Video Demystified” by Keith Jack, published by HighText Interactive Inc., SanDiego, Calif. copyright 1996.
- frames are designated I, P or B. I indicating that the frame is intra-coded (the encoding is not dependent on any other frame); P indicating the frame is predicted from the previous frame; and B indicating that the frame is predicted from both the previous and future frames.
- the low resolution image frames derived by subsampling the full resolution image frames are preferably compressed as I frames. This is because each I frame can be decoded as a low resolution image, so that the full resolution image data can be stored as the difference between this I frame low resolution image and the full resolution image.
- the rendered sRGB full resolution image data from the full resolution frames is also compressed and stored to provide high resolution still image data.
- the difference (residual) between the sRGB full resolution image data, and the upsampled low resolution I frame image decompressed from the MPEG-2 bitstream is computed, and then compressed and stored as a complete still image file.
- the residual still image file and the corresponding MPEG-2 I frame are both decompressed and combined.
- the full resolution still image data is JPEG compressed and stored as a complete still image file.
- the MPEG-2 and still image files can store metadata, such as the date and time the picture was captured, the lens f/number and other camera settings, and image captions or comments that can be selected or entered by the camera user.
- the motion capture and processing sequence used in the digital camera 12 of the present invention will now be described with reference to FIG. 4 , and the structure of the digital files stored by the digital recorder 48 of the present invention will now be described with reference to FIG. 5 .
- the capture sequence shown in FIG. 4 shows that a new image is captured every 1/30 second, and that the capture sequence has provided one high resolution frame 102 , followed by four low resolution frames 104 , so that a high resolution frame is captured every 1 ⁇ 6 of a second.
- the digital camera 12 can include user controls 66 to allow the user to set this ratio, and to set the capture sequence frame rate to a value other than 30 frames per second.
- the processing time for each video frame is equal to one frame period.
- the processing time for the full resolution frames is set to be substantially longer than the processing time for the reduced resolution frames.
- the processing time for each full resolution frame 112 may be 1/12 second, which is four times as long as the 1/48 second processing time for each reduced resolution frame 114 .
- the control microprocessor 68 is allocated more time to create and compress the sRGB still images for the full resolution frames as well as create and MPEG-2 compress the low resolution image data.
- the digital processor needs less time, since it is only processing and MPEG-2 compressing the low resolution image data.
- the stored image files for each captured image sequence include an MPEG-2 sequence bitstream 200 and a number of high resolution compressed image files 210 which are used to provide high resolution still images.
- Pointers 220 relate each high resolution compressed image file to a particular I frame 202 from the MPEG-2 motion sequence.
- the pointers 220 may be provided by metadata in the MPEG-2 bitstream that provides an identifier of the appropriate high resolution compressed image file 210 associated with each I frame 202 .
- the pointers 220 may be provided by comparing the exact time recorded in the metadata of both the MPEG-2 bitstream for each I frame 202 and also recorded in each high resolution compressed image file 210 , or by using a separate synchronization file.
- the MPEG-2 frames corresponding to the reduced resolution frames 104 are compressed either as B frames 204 or as P frames 206 , rather than as I frames.
- I indicates that the frame is intra-coded
- P indicates the frame is predicted from the previous frame
- B indicates that the frame is predicted from both the previous and future frames.
Abstract
Description
- This application is a continuation of U.S. patent application Ser. No. 09/685,998, filed Oct. 11, 2000, entitled “A DIGITAL CAMERA FOR CAPTURING A SEQUENCE OF FULL AND REDUCED RESOLUTION DIGITAL IMAGES AND STORING MOTION AND STILL DIGITAL IMAGE DATA” by Loui et al., the disclosure of which is incorporated herein by reference.
- The invention relates generally to the field of photography, and in particular to combine motion and still image capture. More specifically, the invention relates to a motion/still image capture system which captures image sequences including both full and reduced resolution images and stores digital image data to provide both motion video sequences and digital still pictures.
- Currently, it is common for consumers to use camcorders to capture motion video images, which are viewed on a TV display, and film cameras to capture still images which are developed and optically printed to provide hardcopy prints. Carrying both types of devices is burdensome, however. Thus, there is interest in having a digital camcorder type device that captures motion images, while also allowing high quality prints to be produced from selected image frames.
- Recent advances in digital camcorders include the ability to capture both motion and still images (commonly referred to as MOST cameras), and associated audio information, such as those from JVC (GR-DV1) and Sony Corp. (DCR-PC7) which allow the capture of motion video and still imagery. For example, the GR-DV1 from JVC allows a user to capture a snapshot while recording live video. Basically, the snapshot is indicated by overlaying a white border on the particular still frame of the captured live video. See U.S. Pat. No. 5,382,974, issued Jan. 17, 1995 to Soeda et al. entitled Movie Camera Having Still Picture Photographing Function and Method of Photographing Still Picture Therewith, which shows a movie camera capable of also capturing still images. Although these cameras allow one to capture motion and still images, they do not provide adequate still image quality. Furthermore, the user must decide before taking the picture whether a still or motion type image is desired. Often, the user would like to have both a motion video sequence and a still image of the same event (e.g. their daughter scoring the winning soccer goal). This is difficult to do with these prior art systems, where the user must press a special button to obtain a “still” image, rather than deciding at a later time what images they would like to have as high resolution prints.
- A high definition camcorder could store a high resolution (e.g. 1280×960 pixels) motion sequence for each image frame, to provide higher quality still images. However, to produce good motion rendition of high speed objects, a high frame rate (e.g. 30 frames/sec) is required. The amount of data that would need to be processed and stored per second (e.g. 1280×960×30 pixels) would be excessive, requiring a high cost, power-hungry design having a limited recording time.
- There is a need therefore for a digital motion/still camera design that reduces the processing and storage requirements, while providing both good motion rendition and the ability to obtain high resolution prints from any desired scene after it has been captured.
- The need is met according to the present invention by providing a method for simultaneously recording motion and still images, that includes the steps of: capturing a motion image sequence and accompanying audio of a scene with a digital video camera, adapted to record both motion and higher resolution still images; simultaneously capturing a still image sequence having a higher resolution and lower frame rate than the motion capture sequence; compressing the motion image sequence using interframe compression and the accompanying audio and storing the compressed motion image and audio data; and compressing the still images using intraframe coding and storing the compressed still image data.
- The present invention provides a better way of capturing, processing, and storing both motion and still images of the same event. Another advantage of this invention is that it records both still and motion images so that desired still images can later be selected for printing. Another advantage of this invention is that it uses the same image sensor and digital image processor to provide both the motion and still images. Another advantage of this invention is that the still image processing does not need to be completed within the period set by the capture frame rate, so that the processor pixel operating rate can be reduced by balancing the processor load for still and motion images.
-
FIG. 1 is a flow chart showing the operation of the motion/still imaging system according to the present invention; -
FIG. 2 shows the user interface employed in the motion/still imaging system of the present invention; -
FIG. 3 is a block diagram illustrating a motion/still image capture system according to the present invention; -
FIG. 4 is a diagram illustrating the motion capture and processing sequence used in the present invention; and -
FIG. 5 is a diagram illustrating the data structure for storing the motion sequences and still images. - To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures.
- Referring to
FIG. 1 , the operation of the system of the present invention will be described. In acapture step 10, a motion/stillcamera 12 is operated in a motion/still capture mode, to alternately capture a series of both full resolution and reduced resolution images of asubject 14 while continuously capturing a digital audio signal. According to the present invention, a full resolution image contains at least four times as many pixels as a reduced resolution image. Alternatively, the user can change the camera mode using user controls 66 (seeFIG. 3 ) to capture only reduced resolution motion images, or only a single full resolution still image. Both the full and reduced resolution images are digitized 16 in the camera. The reduced resolution images, and a similar sized low resolution image derived from the full resolution images, are compressed 18 using an interframe compression algorithm operating at a relatively high compression ratio, while the full resolution images 20 are compressed using only intraframe compression at a relatively low compression ratio, to provide high image quality. The high resolution image compression can either use as an input the complete full resolution image, or can alternatively compress the difference image (e.g. the residual image) obtained by decompressing and subtracting the low resolution image to be stored as part of the compressed low resolution sequence from the full resolution image of the same image frame. - Compression of the motion sequence is necessary to lower the bandwidth and storage requirements. For instance, an NTSC format video signal with a frame rate of 29.97 Hz when digitized will result in an uncompressed bit rate of about 168 Mb/s. MPEG (Moving Picture Expert Group) compression of an NTSC video signal can result in a bit rate of 3 to 6 Mb/s with a quality comparable to analog cable TV and far superior to VHS video tape. The full resolution images used to provide high quality still images are obtained much less frequently than the motion images, and have higher resolution and less aggressive compression.
- A regular sequence of high resolution still image frames and low resolution compressed audio/video frames is generated 22. Such a sequence is created whenever the user presses the record button while the
camera 12 is in the combination motion/still (MOST) mode. Thecamera 12 takes a fixed number of images per second (e.g. 24 or 30 frames per second) to provide the motion sequence. A relatively small number of these images (e.g. 2 frames per second, or every 12th or 15th image) are normally full resolution images, while the others are reduced resolution images. The user can set the frequency of full resolution images usinguser controls 66, in order to record more high resolution images per second for important but short events, or alternatively fewer high resolution images per second, to reduce the amount of still image related data that must be recorded, in order to increase the recording time. - The full and reduced resolution images can be created using the image sensor described in commonly-assigned U.S. Pat. No. 5,440,343 issued Aug. 8, 1995 to Parulski et al., entitled Motion/Still Electronic Image Sensing Apparatus, the disclosure of which is incorporated herein. Alternatively, the image sensor can always read out a full resolution image using a relatively high speed clock, and the reduced resolution images can be obtained by averaging or subsampling (e.g. decimating the image 2:1 both vertically and horizontally) this full resolution image sequence.
- The low resolution video data and high resolution image data can be stored 24 on a digital storage medium, such as CD ROM medium or a DVD (Digital Versatile Disk)
medium 26. Alternatively, the data can be stored on digital videotape, a magnetic hard drive, or Flash EPROM memory, or any other digital storage device. Alternatively, the data can be stored on an image server through a wireless or wired network link. The stored data may also include metadata, such as user-input text information and camera-generated information such as time, date, camera model and serial number, lens settings, etc. - The structure of the image files that store the low resolution motion video and high resolution still image data are described below. The display and printing of these
digital image files 28 are carried out at a user's video player terminal (which may utilize thedigital camera 12 for image playback) or computer, and are enabled by an image processing sub-system in the terminal or computer that decompresses the image files. Through the terminal or computer, the user can view and browse the low resolution video sequences, and selectively print any associated high resolution still frames. - A user interface of the terminal or computer is depicted in
FIG. 2 . Theuser interface 30 is displayed on aCRT 31 driven by the terminal or computer, which may be, for example, a personal computer (PC) 33, having anoperating system 37, such as the well-known Windows 98™, or Windows 2000™ operating systems from Microsoft, Inc., Redmond, Oreg., andapplication software 39 for generating the graphical user interface and performing the image processing, decoding and display functions described herein. The PC 33 is connected to operator interfaces such as akeyboard 45 and amouse 35. The basic features of theinterface display 30 include an array ofindex images 32 representing each motion sequence. Using amouse 35, an operator can double click on one of theindex images 32 to display the associated audiovisual segment, which may be, for example, an MPEG-2 compliant audio/video file, inwindow 34. The MPEG-2 video compression is defined in “Generic coding of moving pictures and associated audio information: Video,” ISO/IEC 13818-2, MPEG-2 Video International Standard, 1996. Alternatively, other types of MPEG compression, such as MPEG-1 or MPEG-4, may be used. The audio portion of the MPEG segment is played on thestereo speakers 36. Using themouse 35, the operator can drag and drop any one of the index images into astart window 38 and another one later in the sequence into astop window 40. When the operator clicks on the “PLAY”button 42, the MPEG sequences associated with the start and stop sequences, and all sequences in between, will be played inwindow 34. While any sequence is playing, the operator can single click on theprint button 44 to initiate a printing operation. When the print button is depressed, the image frame corresponding to the last high resolution image is displayed inwindow 34. The user can skip back to the previous high resolution image by single clinking on theback arrow 41, or can rapidly move to earlier high resolution images by “clicking and holding” backarrow 41. Similarly, the user can skip forward to the next high resolution image by single clicking on theforward arrow 43, or can rapidly move to later high resolution images by “clicking and holding” backarrow 41. When the user double-clicks on theprint button 44, a print is produced from the high resolution still image data for this image frame on acolor printer 47 such as an ink jet or laser printer, that is connected to the user's terminal or personal computer 33. - The architecture of the digital motion/still
camera 12 is illustrated inFIG. 3 . Thedigital camera 12 produces digital image files that are recorded using adigital recorder 48. The camera is powered bybatteries 80 which connect topower supply 82, which supplies power to the camera circuits depicted inFIG. 3 . Thedigital camera 12 includes azoom lens 51 having zoom and focus motor drives 53 and an adjustable aperture (not shown). The user composes the scene using theelectronic viewfinder 72 and the zoom lens control buttons (not shown) of the user controls 66, and then depresses a record button (not shown) to begin capture of a motion/still image sequence. Thezoom lens 51 focuses light from a subject 14 (seeFIG. 1 ) on animage sensor 50, for example, a single-chip interline color CCD image sensor using the well-known Bayer color filter pattern. The image sensor may be an interline format sensor having 1280 columns×960 rows of active pixels. Theimage sensor 50 is controlled by timing generator/clock drivers 70. The zoom and focusmotors 53 and theclock drivers 70 are controlled by control signals supplied by acontrol microprocessor 68. The analog output signal from theimage sensor 50 is amplified and converted to digital data by the analog signal processing (ASP) and analog-to-digital (A/D)converter circuit 52. Thecamera 12 also includes amicrophone 56 and an audio A/D converter 58 for providing a digital audio signal todigital processor 68. - The digital data from ASP and A/
D 52 includes both full resolution image frames that are used to produce both high resolution still image data and a low resolution motion image data, and reduced resolution image frames that are only used to provide low resolution motion image data. As described earlier, theimage sensor 50 can use the invention described in U.S. Pat. No. 5,440,343 to provide full resolution (e.g. 1280×960 pixel) images and reduced resolution (e.g. 640×480 pixel) images by summing and dumping appropriate color pixels. Alternatively, the sensor can provide only full resolution (e.g. 1280×960 pixel) images, and a 2:1subsampling circuit 54 can be used to produce the reduced resolution image by appropriately averaging the digital sensor pixel values. The ASP and A/D 52 is coupled to a fullresolution buffer memory 60 which stores a full resolution (e.g. 1280×960 pixel) still image. The 2:1subsampling circuit 54 is coupled to a multi-frame reducedresolution buffer memory 62, which can store multiple reduced resolution images, such as buffer memory that can store four 640×480 pixel images. - The outputs of the full
resolution buffer memory 60 and the multi-frame reducedresolution buffer memory 62 are coupled to amultiplexer switch 64 which provides an input to controlmicroprocessor 68. The digital audio data from audio A/D 58 is also input to controlmicroprocessor 68. The processed image and audio data is coupled to adigital recorder 48 which stores the digital image files. The digital recorder can use write-once or erasable CD or DVD optical disks. Alternatively, the digital recorder can use other digital storage technologies, such as magnetic hard drives, magnetic tape, optical tape, or solid-state memory. - The
control microprocessor 68 alternates between processing one full resolution image from fullresolution buffer memory 60, followed by several reduced resolution images from multi-frame reducedresolution buffer memory 62. As will be described later in reference toFIG. 4 , since the full resolution images have more pixel data (e.g. 4 times as many pixels) than the reduced resolution images, the processor spends a longer period of time processing a full resolution image than it does processing a reduced resolution image, while the time period between each sensor exposure must remain constant, in order to prevent motion artifacts. Therefore, the arrangement of the twobuffer memories control microprocessor 68 to spend a longer period of time processing the full resolution images. - For each full and reduced resolution image frame, the
control microprocessor 68 performs color interpolation followed by color and tone correction, in order to produce rendered sRGB image data. For full resolution frames, thecontrol microprocessor 68 creates both full resolution (e.g. 1280×960 pixel) sRGB image data, and low resolution (e.g. 640×480 pixel) sRGB image data. For reduced resolution frames, the digital processor creates only low resolution (e.g. 640×480 pixel) sRGB data. Thecontrol microprocessor 68 also creates, from the low resolution image data of each full and reduced resolution image frame, a “thumbnail” size image, which can be created as described in commonly-assigned U.S. Pat. No. 5,164,831 issued Nov. 17, 1992 to Kuchta et al., entitled Electronic Still Camera Providing Multi-Format Storage of Full and Reduced Resolution Images, the disclosure of which is herein incorporated by reference. This thumbnail image has 160×120 pixels and is displayed onelectronic viewfinder 72 as the image sequences are captured. Thedigital processor 66 can also provide a video output signal 74, as either a digital or analog video signal, which is encoded for display on a standard TV display (not shown), such as an NTSC video display. The digital processor also compresses the digital audio signal from audio A/D 52, in order to provide an MPEG compressed audio stream. - The rendered sRGB low resolution image data from both the full and reduced resolution frames is then compressed, processed and stored, along with the compressed audio data, as an MPEG-2 bitstream. The processing may include conversion form RGB data to alternate color spaces, such as YUV, YIQ, or Y, Cb, Cr as described in chapter 3 of “Video Demystified” by Keith Jack, published by HighText Interactive Inc., SanDiego, Calif. copyright 1996. In the MPEG-2 standard, frames are designated I, P or B. I indicating that the frame is intra-coded (the encoding is not dependent on any other frame); P indicating the frame is predicted from the previous frame; and B indicating that the frame is predicted from both the previous and future frames. In one embodiment of the present invention, the low resolution image frames derived by subsampling the full resolution image frames are preferably compressed as I frames. This is because each I frame can be decoded as a low resolution image, so that the full resolution image data can be stored as the difference between this I frame low resolution image and the full resolution image.
- The rendered sRGB full resolution image data from the full resolution frames is also compressed and stored to provide high resolution still image data. In one embodiment, the difference (residual) between the sRGB full resolution image data, and the upsampled low resolution I frame image decompressed from the MPEG-2 bitstream is computed, and then compressed and stored as a complete still image file. To recover the full resolution still image data, the residual still image file and the corresponding MPEG-2 I frame are both decompressed and combined. In an second embodiment, the full resolution still image data is JPEG compressed and stored as a complete still image file. The MPEG-2 and still image files can store metadata, such as the date and time the picture was captured, the lens f/number and other camera settings, and image captions or comments that can be selected or entered by the camera user.
- The motion capture and processing sequence used in the
digital camera 12 of the present invention will now be described with reference toFIG. 4 , and the structure of the digital files stored by thedigital recorder 48 of the present invention will now be described with reference toFIG. 5 . The capture sequence shown inFIG. 4 shows that a new image is captured every 1/30 second, and that the capture sequence has provided onehigh resolution frame 102, followed by four low resolution frames 104, so that a high resolution frame is captured every ⅙ of a second. Thus, there are 4 low resolution frames in between each full resolution frame. Alternatively, other ratios of low to full resolution frames can be used, and thedigital camera 12 can includeuser controls 66 to allow the user to set this ratio, and to set the capture sequence frame rate to a value other than 30 frames per second. - In conventional camcorders, the processing time for each video frame is equal to one frame period. In the present invention, however, the processing time for the full resolution frames is set to be substantially longer than the processing time for the reduced resolution frames. As shown in
FIG. 4 , the processing time for eachfull resolution frame 112 may be 1/12 second, which is four times as long as the 1/48 second processing time for each reducedresolution frame 114. Thus, thecontrol microprocessor 68 is allocated more time to create and compress the sRGB still images for the full resolution frames as well as create and MPEG-2 compress the low resolution image data. For the reduced resolution frames, the digital processor needs less time, since it is only processing and MPEG-2 compressing the low resolution image data. - As shown in
FIG. 5 , the stored image files for each captured image sequence include an MPEG-2sequence bitstream 200 and a number of high resolution compressed image files 210 which are used to provide high resolution still images.Pointers 220 relate each high resolution compressed image file to aparticular I frame 202 from the MPEG-2 motion sequence. Thepointers 220 may be provided by metadata in the MPEG-2 bitstream that provides an identifier of the appropriate high resolutioncompressed image file 210 associated with eachI frame 202. Alternately, thepointers 220 may be provided by comparing the exact time recorded in the metadata of both the MPEG-2 bitstream for eachI frame 202 and also recorded in each high resolutioncompressed image file 210, or by using a separate synchronization file. - The MPEG-2 frames corresponding to the reduced resolution frames 104 (see
FIG. 4 ) are compressed either as B frames 204 or as P frames 206, rather than as I frames. As stated earlier, I indicates that the frame is intra-coded, P indicates the frame is predicted from the previous frame; and B indicates that the frame is predicted from both the previous and future frames. - The invention has been described with reference to a preferred embodiment. However, it will be appreciated that variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope of the invention.
-
- 10 capture step x
- 12 motion/still camera x
- 14 photographic subject x
- 16 digitize step x
- 18 compress video step x
- 20 full resolution image x
- 22 generate sequence x
- 24 storage step x
- 26 writable medium x
- 28 display, review and print step x
- 30 user interface display x
- 31 CRTx
- 32 array of index images x
- 33 personal computer x
- 34 playback window x
- 35 mouse x
- 36 stereo speakers x
- 37 operating system x
- 38 start window x
- 39 application software x
- 40 stop window x
- 41 back arrow x
- 42 play button x
- 43 forward arrow x
- 44 print button x
- 45 keyboard x
- 47 color printer x
- 48 digital recorder x
- 50 image sensor x
- 51 zoom lens x
- 52 video A/D converter x
- 53 zoom and focus motor drives x
- 54 2:1 subsampler x
- 56 microphone x
- 58 audio A/D converter x
- 60 full resolution buffer memory x
- 62 reduced resolution buffer memory x
- 64 multiplexer switch x
- 66 user controls x
- 68 control microprocessor x
- 70 timing circuit x
- 72 electronic viewfinder x
- 74 video output signal x
- 80 batteries x
- 82 power supply x
- 102 high resolution frame x
- 104 low resolution frame x
- 112 processing time for high resolution frame x
- 114 processing time for low resolution frame x
- 200 MPEG-2 bitstream x
- 202 I frame x
- 204 B frame x
- 206 P frame x
- 210 high resolution compressed image files x
- 220 pointer x
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/499,419 US20060268117A1 (en) | 1997-05-28 | 2006-08-04 | Method for simultaneously recording motion and still images in a digital camera |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US86440397A | 1997-05-28 | 1997-05-28 | |
US09/606,513 US6937273B1 (en) | 1997-05-28 | 2000-06-29 | Integrated motion-still capture system with indexing capability |
US09/685,998 US7110025B1 (en) | 1997-05-28 | 2000-10-11 | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
US11/499,419 US20060268117A1 (en) | 1997-05-28 | 2006-08-04 | Method for simultaneously recording motion and still images in a digital camera |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/685,998 Continuation US7110025B1 (en) | 1997-05-28 | 2000-10-11 | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060268117A1 true US20060268117A1 (en) | 2006-11-30 |
Family
ID=36974523
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/685,998 Expired - Lifetime US7110025B1 (en) | 1997-05-28 | 2000-10-11 | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
US11/499,419 Abandoned US20060268117A1 (en) | 1997-05-28 | 2006-08-04 | Method for simultaneously recording motion and still images in a digital camera |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/685,998 Expired - Lifetime US7110025B1 (en) | 1997-05-28 | 2000-10-11 | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
Country Status (1)
Country | Link |
---|---|
US (2) | US7110025B1 (en) |
Cited By (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050093988A1 (en) * | 2003-11-03 | 2005-05-05 | Haas William R. | Digital camera with automatic mode detection |
US20060051070A1 (en) * | 2004-09-09 | 2006-03-09 | Fuji Photo Film Co., Ltd. | Image pickup apparatus and image playback method |
US20060119714A1 (en) * | 2004-11-17 | 2006-06-08 | Sony Corporation | Data processor and data processing method |
US20060216001A1 (en) * | 2005-03-24 | 2006-09-28 | Samsung Electronics Co., Ltd. | Device and method for taking picture while recording moving picture |
US20060264733A1 (en) * | 2005-04-28 | 2006-11-23 | Canon Kabushiki Kaisha | Image sensing apparatus, method thereof, storage medium and computer program |
US20070064111A1 (en) * | 2005-09-16 | 2007-03-22 | Kabushiki Kaisha Toshiba | Digital camera and image information transmission method |
US20070139536A1 (en) * | 2005-12-16 | 2007-06-21 | Canon Kabushiki Kaisha | Image pickup apparatus and reproducing apparatus |
US20070274682A1 (en) * | 2006-05-25 | 2007-11-29 | Hitachi, Ltd. | Image processing apparatus |
US20080084569A1 (en) * | 2006-10-09 | 2008-04-10 | Samsung Electronics Co., Ltd. | Method and apparatus for photographing an object to produce still image while recording moving picture |
US20080186399A1 (en) * | 2007-02-01 | 2008-08-07 | Pentax Corporation | Photographing apparatus |
US20080266411A1 (en) * | 2007-04-25 | 2008-10-30 | Microsoft Corporation | Multiple resolution capture in real time communications |
US20090033754A1 (en) * | 2007-08-02 | 2009-02-05 | Hiroki Yoshikawa | Signal processing circuit and image shooting apparatus |
US20090175547A1 (en) * | 2008-01-08 | 2009-07-09 | Kabushiki Kaisha Toshiba | Image processing apparatus and image processing method |
US20090213237A1 (en) * | 2008-02-27 | 2009-08-27 | Canon Kabushiki Kaisha | Image capturing apparatus and image capturing apparatus control method |
US20100020210A1 (en) * | 2008-07-24 | 2010-01-28 | Sanyo Electric Co. Ltd. | Image Sensing Device And Image Processing Device |
US7782365B2 (en) | 2005-06-02 | 2010-08-24 | Searete Llc | Enhanced video/still image correlation |
EP2242021A1 (en) * | 2009-04-17 | 2010-10-20 | Sony Corporation | Generation of simulated long exposure images in response to multiple short exposures |
US20100295966A1 (en) * | 2009-05-19 | 2010-11-25 | John Furlan | Digital video camera with high resolution imaging system |
US7872675B2 (en) * | 2005-06-02 | 2011-01-18 | The Invention Science Fund I, Llc | Saved-image management |
US7876357B2 (en) | 2005-01-31 | 2011-01-25 | The Invention Science Fund I, Llc | Estimating shared image device operational capabilities or resources |
US7920169B2 (en) | 2005-01-31 | 2011-04-05 | Invention Science Fund I, Llc | Proximity of shared image devices |
CN102484712A (en) * | 2009-09-10 | 2012-05-30 | 苹果公司 | Video Editing And Reformatting For Digital Video Recorder |
US8253821B2 (en) | 2005-10-31 | 2012-08-28 | The Invention Science Fund I, Llc | Degradation/preservation management of captured data |
US8350946B2 (en) | 2005-01-31 | 2013-01-08 | The Invention Science Fund I, Llc | Viewfinder for shared image device |
US20130083211A1 (en) * | 2011-10-04 | 2013-04-04 | Keiji Kunishige | Imaging device and imaging method |
US8606383B2 (en) | 2005-01-31 | 2013-12-10 | The Invention Science Fund I, Llc | Audio sharing |
US20140078343A1 (en) * | 2012-09-20 | 2014-03-20 | Htc Corporation | Methods for generating video and multiple still images simultaneously and apparatuses using the same |
US8681225B2 (en) | 2005-06-02 | 2014-03-25 | Royce A. Levien | Storage access technique for captured data |
US8902320B2 (en) | 2005-01-31 | 2014-12-02 | The Invention Science Fund I, Llc | Shared image device synchronization or designation |
US8964054B2 (en) | 2006-08-18 | 2015-02-24 | The Invention Science Fund I, Llc | Capturing selected image objects |
US9001215B2 (en) | 2005-06-02 | 2015-04-07 | The Invention Science Fund I, Llc | Estimating shared image device operational capabilities or resources |
US9041826B2 (en) | 2005-06-02 | 2015-05-26 | The Invention Science Fund I, Llc | Capturing selected image objects |
US9082456B2 (en) | 2005-01-31 | 2015-07-14 | The Invention Science Fund I Llc | Shared image device designation |
US9124729B2 (en) | 2005-01-31 | 2015-09-01 | The Invention Science Fund I, Llc | Shared image device synchronization or designation |
US9191611B2 (en) | 2005-06-02 | 2015-11-17 | Invention Science Fund I, Llc | Conditional alteration of a saved image |
US9325781B2 (en) | 2005-01-31 | 2016-04-26 | Invention Science Fund I, Llc | Audio sharing |
US9451200B2 (en) | 2005-06-02 | 2016-09-20 | Invention Science Fund I, Llc | Storage access technique for captured data |
AU2014277749B2 (en) * | 2009-09-10 | 2016-10-06 | Apple Inc. | Video editing and reformatting for digital video recorder |
US9489717B2 (en) | 2005-01-31 | 2016-11-08 | Invention Science Fund I, Llc | Shared image device |
US9819490B2 (en) | 2005-05-04 | 2017-11-14 | Invention Science Fund I, Llc | Regional proximity for shared image device(s) |
US9894237B2 (en) | 2015-05-29 | 2018-02-13 | Canon Kabushiki Kaisha | Image pickup device and imaging apparatus |
US9910341B2 (en) | 2005-01-31 | 2018-03-06 | The Invention Science Fund I, Llc | Shared image device designation |
US10003762B2 (en) | 2005-04-26 | 2018-06-19 | Invention Science Fund I, Llc | Shared image devices |
GB2575187A (en) * | 2015-05-29 | 2020-01-01 | Canon Kk | Image pickup device and imaging apparatus |
US11423552B2 (en) * | 2017-04-13 | 2022-08-23 | Canon Kabushiki Kaisha | Information processing apparatus, system, method, and storage medium to compare images |
Families Citing this family (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3678164B2 (en) * | 2001-04-13 | 2005-08-03 | ソニー株式会社 | Data transfer system, data transfer device, data recording device, and data transfer method |
JP2002354327A (en) * | 2001-05-30 | 2002-12-06 | Minolta Co Ltd | Image-photographing device, operation device and image- photographing system thereof |
JP4362265B2 (en) * | 2002-04-05 | 2009-11-11 | ソニー株式会社 | Video content editing support system, recording device, editor terminal device, computer program, recording medium, video content editing support method |
KR100502710B1 (en) * | 2002-05-24 | 2005-07-20 | 주식회사 아이큐브 | Optical disk regenerative apparatus |
US7312821B2 (en) * | 2003-06-03 | 2007-12-25 | Hewlett-Packard Development Company, L.P. | Time-sliced still image generation |
US20050081138A1 (en) * | 2003-09-25 | 2005-04-14 | Voss James S. | Systems and methods for associating an image with a video file in which the image is embedded |
JP3926316B2 (en) * | 2003-10-31 | 2007-06-06 | 松下電器産業株式会社 | Imaging device |
US20050168589A1 (en) * | 2004-01-30 | 2005-08-04 | D. Amnon Silverstein | Method and system for processing an image with an image-capturing device |
JP2005244502A (en) * | 2004-02-25 | 2005-09-08 | Pioneer Electronic Corp | Optical disk recording apparatus, optical disk reproducing apparatus, and multilayer type optical disk |
KR101110009B1 (en) * | 2004-02-27 | 2012-02-06 | 교세라 가부시키가이샤 | Imaging device and image generation method of imaging device |
DE102004011147B3 (en) * | 2004-03-08 | 2005-11-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Image pickup device with multiple image capture modes |
JP4039386B2 (en) * | 2004-04-21 | 2008-01-30 | コニカミノルタオプト株式会社 | Imaging sensor and imaging apparatus |
JP4221669B2 (en) * | 2004-09-06 | 2009-02-12 | ソニー株式会社 | Recording apparatus and method, recording medium, and program |
US7474359B2 (en) | 2004-12-06 | 2009-01-06 | At&T Intellectual Properties I, L.P. | System and method of displaying a video stream |
US20060221197A1 (en) * | 2005-03-30 | 2006-10-05 | Jung Edward K | Image transformation estimator of an imaging device |
US20060170956A1 (en) | 2005-01-31 | 2006-08-03 | Jung Edward K | Shared image devices |
JP4148228B2 (en) * | 2005-02-10 | 2008-09-10 | ソニー株式会社 | Image recording apparatus, image reproduction control apparatus, image recording / reproduction control apparatus, processing method of these apparatuses, and program causing computer to execute the method |
JP2006253768A (en) * | 2005-03-08 | 2006-09-21 | Uniden Corp | Digital camera |
JP4035543B2 (en) * | 2005-04-04 | 2008-01-23 | キヤノン株式会社 | Imaging device |
JP4306638B2 (en) * | 2005-04-14 | 2009-08-05 | ソニー株式会社 | Image processing system, imaging apparatus, imaging method, image reproducing apparatus, and image reproducing method |
US9942511B2 (en) | 2005-10-31 | 2018-04-10 | Invention Science Fund I, Llc | Preservation/degradation of video/audio aspects of a data stream |
US9621749B2 (en) | 2005-06-02 | 2017-04-11 | Invention Science Fund I, Llc | Capturing selected image objects |
US20070222865A1 (en) | 2006-03-15 | 2007-09-27 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Enhanced video/still image correlation |
US20070008326A1 (en) * | 2005-06-02 | 2007-01-11 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Dual mode image capture technique |
US8054849B2 (en) | 2005-05-27 | 2011-11-08 | At&T Intellectual Property I, L.P. | System and method of managing video content streams |
JP4794911B2 (en) | 2005-05-31 | 2011-10-19 | キヤノン株式会社 | Image processing device |
US20070127909A1 (en) | 2005-08-25 | 2007-06-07 | Craig Mowry | System and apparatus for increasing quality and efficiency of film capture and methods of use thereof |
JP4537266B2 (en) * | 2005-06-16 | 2010-09-01 | キヤノン株式会社 | Recording apparatus and reproducing apparatus |
JP4574489B2 (en) * | 2005-08-12 | 2010-11-04 | 富士フイルム株式会社 | Imaging apparatus, imaging method, and program |
EP1938136A2 (en) * | 2005-10-16 | 2008-07-02 | Mediapod LLC | Apparatus, system and method for increasing quality of digital image capture |
US7889934B2 (en) * | 2005-11-14 | 2011-02-15 | Mediatek Inc. | Image processing apparatus and processing method thereof |
US7805008B2 (en) * | 2005-11-14 | 2010-09-28 | Intel Corporation | Structural content filtration of hypotheses in a cognitive control framework |
US7925136B2 (en) * | 2006-05-25 | 2011-04-12 | Qualcomm Incorporated | Method and apparatus for recording information in battery operated devices |
US8743227B2 (en) * | 2007-05-02 | 2014-06-03 | Canon Kabushiki Kaisha | Imaging apparatus and control method for reducing a load of writing image data on a recording medium |
JP5230483B2 (en) * | 2008-03-18 | 2013-07-10 | キヤノン株式会社 | Imaging apparatus and control method thereof |
JP5025557B2 (en) * | 2008-05-02 | 2012-09-12 | キヤノン株式会社 | Image photographing apparatus, control method therefor, and program |
JP5224925B2 (en) * | 2008-06-18 | 2013-07-03 | キヤノン株式会社 | Imaging device |
JP5268500B2 (en) * | 2008-08-28 | 2013-08-21 | キヤノン株式会社 | Image recording apparatus, image reproducing apparatus, and image processing apparatus and method |
JP5294767B2 (en) * | 2008-09-16 | 2013-09-18 | キヤノン株式会社 | Movie playback device, movie playback method, program, and recording medium |
JP5251684B2 (en) * | 2009-04-01 | 2013-07-31 | 富士通セミコンダクター株式会社 | Image processing device |
US8218068B2 (en) | 2009-04-01 | 2012-07-10 | Omnivision Technologies, Inc. | Exposing pixel groups in producing digital images |
WO2010123923A1 (en) | 2009-04-23 | 2010-10-28 | Zoran Corporation | Multiple exposure high dynamic range image capture |
JP5553673B2 (en) * | 2009-05-11 | 2014-07-16 | キヤノン株式会社 | Imaging apparatus and display control method |
US8554061B2 (en) * | 2009-09-10 | 2013-10-08 | Apple Inc. | Video format for digital video recorder |
US8462036B2 (en) * | 2010-12-09 | 2013-06-11 | Qualcomm, Incorporated | Digital-to-analog converter with non-uniform resolution |
US8933985B1 (en) * | 2011-06-06 | 2015-01-13 | Qualcomm Technologies, Inc. | Method, apparatus, and manufacture for on-camera HDR panorama |
US8687086B1 (en) | 2012-03-30 | 2014-04-01 | Gopro, Inc. | On-chip image sensor data compression |
US9568985B2 (en) | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
US9344626B2 (en) | 2013-11-18 | 2016-05-17 | Apple Inc. | Modeless video and still frame capture using interleaved frames of video and still resolutions |
EP2890131A1 (en) * | 2013-12-31 | 2015-07-01 | Patents Factory Ltd. Sp. z o.o. | Video coding with different spatial resolutions for intra-coded frames and inter-coded frames |
US20150215530A1 (en) * | 2014-01-27 | 2015-07-30 | Microsoft Corporation | Universal capture |
JP6261372B2 (en) * | 2014-02-20 | 2018-01-17 | オリンパス株式会社 | Solid-state imaging device and imaging system |
US9992443B2 (en) * | 2014-05-30 | 2018-06-05 | Apple Inc. | System and methods for time lapse video acquisition and compression |
US11495102B2 (en) * | 2014-08-04 | 2022-11-08 | LiveView Technologies, LLC | Devices, systems, and methods for remote video retrieval |
JP6520035B2 (en) * | 2014-09-30 | 2019-05-29 | 株式会社ニコン | Electronics |
US9426409B2 (en) | 2014-09-30 | 2016-08-23 | Apple Inc. | Time-lapse video capture with optimal image stabilization |
US10674196B2 (en) * | 2015-06-15 | 2020-06-02 | Piksel, Inc. | Providing extracted segment from streamed content |
US10319317B2 (en) * | 2015-08-31 | 2019-06-11 | Sharp Kabushiki Kaisha | Display control device, display device, method for controlling display control device, and storage medium |
US10313594B2 (en) * | 2017-01-05 | 2019-06-04 | Qualcomm Incorporated | Dynamically configuring memory bandwidth for image generation |
US10893206B1 (en) * | 2017-12-11 | 2021-01-12 | Alarm.Com Incorporated | User experience with digital zoom in video from a camera |
CN109309871B (en) * | 2018-08-07 | 2019-05-28 | 贵州点点云数字技术有限公司 | Key frame movement range detection system |
JP7337526B2 (en) * | 2019-03-26 | 2023-09-04 | キヤノン株式会社 | Image processing device, imaging device, image processing method, and program |
KR20210078218A (en) * | 2019-12-18 | 2021-06-28 | 삼성전자주식회사 | Electronic apparatus and method of controlling the same |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5164831A (en) * | 1990-03-15 | 1992-11-17 | Eastman Kodak Company | Electronic still camera providing multi-format storage of full and reduced resolution images |
US5382974A (en) * | 1991-04-18 | 1995-01-17 | Fuji Photo Film Company, Limited | Movie camera having still picture photographing function and method of photographing still picture therewith |
US5440343A (en) * | 1994-02-28 | 1995-08-08 | Eastman Kodak Company | Motion/still electronic image sensing apparatus |
US5937136A (en) * | 1996-04-01 | 1999-08-10 | Olympus Optical Co., Ltd. | Video data edit/reproduction apparatus for video data which mixedly includes moving and still images |
US5982984A (en) * | 1995-01-31 | 1999-11-09 | Fuji Photo Film Co., Ltd. | Digital image data recording and reproducing apparatus and method for processing a high quality image stored in multiple frames on a recording medium |
US6005679A (en) * | 1994-08-22 | 1999-12-21 | Fuji Photo Film Co., Ltd. | Image data filing system for quickly retrieving an area of interest of an image from a reduced amount of image data |
US6005613A (en) * | 1996-09-12 | 1999-12-21 | Eastman Kodak Company | Multi-mode digital camera with computer interface using data packets combining image and mode data |
US6038257A (en) * | 1997-03-12 | 2000-03-14 | Telefonaktiebolaget L M Ericsson | Motion and still video picture transmission and display |
US6061497A (en) * | 1990-02-27 | 2000-05-09 | Sony Corporation | Video signal recording apparatus |
US6208691B1 (en) * | 1997-03-28 | 2001-03-27 | Philips Electronics North America Corp. | Method for seamless splicing in a video encoder |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3372289B2 (en) * | 1993-04-28 | 2003-01-27 | 富士写真フイルム株式会社 | Digital camera |
US5929916A (en) * | 1995-12-26 | 1999-07-27 | Legall; Didier J. | Variable bit rate encoding |
US6101276A (en) * | 1996-06-21 | 2000-08-08 | Compaq Computer Corporation | Method and apparatus for performing two pass quality video compression through pipelining and buffer management |
JP3224514B2 (en) * | 1996-08-21 | 2001-10-29 | シャープ株式会社 | Video encoding device and video decoding device |
US6104752A (en) * | 1996-10-01 | 2000-08-15 | Victor Company Of Japan, Ltd. | Apparatus and method of decoding high efficiency coded picture data with picture size resizing |
-
2000
- 2000-10-11 US US09/685,998 patent/US7110025B1/en not_active Expired - Lifetime
-
2006
- 2006-08-04 US US11/499,419 patent/US20060268117A1/en not_active Abandoned
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6061497A (en) * | 1990-02-27 | 2000-05-09 | Sony Corporation | Video signal recording apparatus |
US5164831A (en) * | 1990-03-15 | 1992-11-17 | Eastman Kodak Company | Electronic still camera providing multi-format storage of full and reduced resolution images |
US5382974A (en) * | 1991-04-18 | 1995-01-17 | Fuji Photo Film Company, Limited | Movie camera having still picture photographing function and method of photographing still picture therewith |
US5440343A (en) * | 1994-02-28 | 1995-08-08 | Eastman Kodak Company | Motion/still electronic image sensing apparatus |
US6005679A (en) * | 1994-08-22 | 1999-12-21 | Fuji Photo Film Co., Ltd. | Image data filing system for quickly retrieving an area of interest of an image from a reduced amount of image data |
US5982984A (en) * | 1995-01-31 | 1999-11-09 | Fuji Photo Film Co., Ltd. | Digital image data recording and reproducing apparatus and method for processing a high quality image stored in multiple frames on a recording medium |
US5937136A (en) * | 1996-04-01 | 1999-08-10 | Olympus Optical Co., Ltd. | Video data edit/reproduction apparatus for video data which mixedly includes moving and still images |
US6005613A (en) * | 1996-09-12 | 1999-12-21 | Eastman Kodak Company | Multi-mode digital camera with computer interface using data packets combining image and mode data |
US6038257A (en) * | 1997-03-12 | 2000-03-14 | Telefonaktiebolaget L M Ericsson | Motion and still video picture transmission and display |
US6208691B1 (en) * | 1997-03-28 | 2001-03-27 | Philips Electronics North America Corp. | Method for seamless splicing in a video encoder |
Cited By (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050093988A1 (en) * | 2003-11-03 | 2005-05-05 | Haas William R. | Digital camera with automatic mode detection |
US20060051070A1 (en) * | 2004-09-09 | 2006-03-09 | Fuji Photo Film Co., Ltd. | Image pickup apparatus and image playback method |
US20060119714A1 (en) * | 2004-11-17 | 2006-06-08 | Sony Corporation | Data processor and data processing method |
US8902320B2 (en) | 2005-01-31 | 2014-12-02 | The Invention Science Fund I, Llc | Shared image device synchronization or designation |
US8606383B2 (en) | 2005-01-31 | 2013-12-10 | The Invention Science Fund I, Llc | Audio sharing |
US7920169B2 (en) | 2005-01-31 | 2011-04-05 | Invention Science Fund I, Llc | Proximity of shared image devices |
US9910341B2 (en) | 2005-01-31 | 2018-03-06 | The Invention Science Fund I, Llc | Shared image device designation |
US8350946B2 (en) | 2005-01-31 | 2013-01-08 | The Invention Science Fund I, Llc | Viewfinder for shared image device |
US9489717B2 (en) | 2005-01-31 | 2016-11-08 | Invention Science Fund I, Llc | Shared image device |
US9325781B2 (en) | 2005-01-31 | 2016-04-26 | Invention Science Fund I, Llc | Audio sharing |
US9124729B2 (en) | 2005-01-31 | 2015-09-01 | The Invention Science Fund I, Llc | Shared image device synchronization or designation |
US9082456B2 (en) | 2005-01-31 | 2015-07-14 | The Invention Science Fund I Llc | Shared image device designation |
US7876357B2 (en) | 2005-01-31 | 2011-01-25 | The Invention Science Fund I, Llc | Estimating shared image device operational capabilities or resources |
US20060216001A1 (en) * | 2005-03-24 | 2006-09-28 | Samsung Electronics Co., Ltd. | Device and method for taking picture while recording moving picture |
US7667741B2 (en) * | 2005-03-24 | 2010-02-23 | Samsung Electronics Co., Ltd | Device and method for taking picture while recording moving picture |
US10003762B2 (en) | 2005-04-26 | 2018-06-19 | Invention Science Fund I, Llc | Shared image devices |
US20060264733A1 (en) * | 2005-04-28 | 2006-11-23 | Canon Kabushiki Kaisha | Image sensing apparatus, method thereof, storage medium and computer program |
US8130279B2 (en) * | 2005-04-28 | 2012-03-06 | Canon Kabushiki Kaisha | Image sensing apparatus sensing moving and still images, method thereof, storage medium and computer program |
US9819490B2 (en) | 2005-05-04 | 2017-11-14 | Invention Science Fund I, Llc | Regional proximity for shared image device(s) |
US8681225B2 (en) | 2005-06-02 | 2014-03-25 | Royce A. Levien | Storage access technique for captured data |
US9191611B2 (en) | 2005-06-02 | 2015-11-17 | Invention Science Fund I, Llc | Conditional alteration of a saved image |
US9001215B2 (en) | 2005-06-02 | 2015-04-07 | The Invention Science Fund I, Llc | Estimating shared image device operational capabilities or resources |
US7872675B2 (en) * | 2005-06-02 | 2011-01-18 | The Invention Science Fund I, Llc | Saved-image management |
US9967424B2 (en) | 2005-06-02 | 2018-05-08 | Invention Science Fund I, Llc | Data storage usage protocol |
US9451200B2 (en) | 2005-06-02 | 2016-09-20 | Invention Science Fund I, Llc | Storage access technique for captured data |
US7782365B2 (en) | 2005-06-02 | 2010-08-24 | Searete Llc | Enhanced video/still image correlation |
US9041826B2 (en) | 2005-06-02 | 2015-05-26 | The Invention Science Fund I, Llc | Capturing selected image objects |
US20070064111A1 (en) * | 2005-09-16 | 2007-03-22 | Kabushiki Kaisha Toshiba | Digital camera and image information transmission method |
US8253821B2 (en) | 2005-10-31 | 2012-08-28 | The Invention Science Fund I, Llc | Degradation/preservation management of captured data |
US8520098B2 (en) * | 2005-12-16 | 2013-08-27 | Canon Kabushiki Kaisha | Image pickup apparatus and reproducing apparatus |
US20070139536A1 (en) * | 2005-12-16 | 2007-06-21 | Canon Kabushiki Kaisha | Image pickup apparatus and reproducing apparatus |
US20070274682A1 (en) * | 2006-05-25 | 2007-11-29 | Hitachi, Ltd. | Image processing apparatus |
US8964054B2 (en) | 2006-08-18 | 2015-02-24 | The Invention Science Fund I, Llc | Capturing selected image objects |
US20080084569A1 (en) * | 2006-10-09 | 2008-04-10 | Samsung Electronics Co., Ltd. | Method and apparatus for photographing an object to produce still image while recording moving picture |
US7847827B2 (en) * | 2006-10-09 | 2010-12-07 | Samsung Electronics Co., Ltd | Method and apparatus for photographing an object to produce still image while recording moving picture |
US9253399B2 (en) | 2007-02-01 | 2016-02-02 | Ricoh Imaging Company, Ltd. | Photographing apparatus where an image is obtained by an intermittent photographing operation |
US20080186399A1 (en) * | 2007-02-01 | 2008-08-07 | Pentax Corporation | Photographing apparatus |
US8988540B2 (en) * | 2007-02-01 | 2015-03-24 | Pentax Ricoh Imaging Company, Ltd. | Photographing apparatus where an image is obtained by an intermittent photographing operation |
US20080266411A1 (en) * | 2007-04-25 | 2008-10-30 | Microsoft Corporation | Multiple resolution capture in real time communications |
US8031222B2 (en) * | 2007-04-25 | 2011-10-04 | Microsoft Corporation | Multiple resolution capture in real time communications |
US20090033754A1 (en) * | 2007-08-02 | 2009-02-05 | Hiroki Yoshikawa | Signal processing circuit and image shooting apparatus |
US20090175547A1 (en) * | 2008-01-08 | 2009-07-09 | Kabushiki Kaisha Toshiba | Image processing apparatus and image processing method |
US20090213237A1 (en) * | 2008-02-27 | 2009-08-27 | Canon Kabushiki Kaisha | Image capturing apparatus and image capturing apparatus control method |
US8525893B2 (en) * | 2008-02-27 | 2013-09-03 | Canon Kabushiki Kaisha | Image capturing apparatus with different shooting modes and image capturing apparatus control method thereof |
US20100020210A1 (en) * | 2008-07-24 | 2010-01-28 | Sanyo Electric Co. Ltd. | Image Sensing Device And Image Processing Device |
EP2242021A1 (en) * | 2009-04-17 | 2010-10-20 | Sony Corporation | Generation of simulated long exposure images in response to multiple short exposures |
US20100295966A1 (en) * | 2009-05-19 | 2010-11-25 | John Furlan | Digital video camera with high resolution imaging system |
CN102484712A (en) * | 2009-09-10 | 2012-05-30 | 苹果公司 | Video Editing And Reformatting For Digital Video Recorder |
US9215402B2 (en) | 2009-09-10 | 2015-12-15 | Apple Inc. | Video format for digital video recorder |
AU2014277749B2 (en) * | 2009-09-10 | 2016-10-06 | Apple Inc. | Video editing and reformatting for digital video recorder |
US20130083211A1 (en) * | 2011-10-04 | 2013-04-04 | Keiji Kunishige | Imaging device and imaging method |
US9277125B2 (en) * | 2011-10-04 | 2016-03-01 | Olympus Corporation | Imaging device and imaging method |
US20150103198A1 (en) * | 2011-10-04 | 2015-04-16 | Olympus Imaging Corp. | Imaging device and imaging method |
US8957982B2 (en) * | 2011-10-04 | 2015-02-17 | Olympus Imaging Corp. | Imaging device and imaging method |
US20140078343A1 (en) * | 2012-09-20 | 2014-03-20 | Htc Corporation | Methods for generating video and multiple still images simultaneously and apparatuses using the same |
TWI510085B (en) * | 2012-09-20 | 2015-11-21 | Htc Corp | Methods for generating video and multiple still images in parallel and apparatuses using the same |
EP2712169A1 (en) * | 2012-09-20 | 2014-03-26 | HTC Corporation | Methods for generating video and multiple still images simultaneously and apparatuses using the same |
US10003715B2 (en) | 2015-05-29 | 2018-06-19 | Canon Kabushiki Kaisha | Image pickup device and imaging apparatus |
US9894237B2 (en) | 2015-05-29 | 2018-02-13 | Canon Kabushiki Kaisha | Image pickup device and imaging apparatus |
GB2540258B (en) * | 2015-05-29 | 2019-12-04 | Canon Kk | Image pickup device and imaging apparatus |
GB2575187A (en) * | 2015-05-29 | 2020-01-01 | Canon Kk | Image pickup device and imaging apparatus |
GB2576261A (en) * | 2015-05-29 | 2020-02-12 | Canon Kk | Image pickup device and imaging apparatus |
GB2576261B (en) * | 2015-05-29 | 2020-04-15 | Canon Kk | Image pickup device and imaging apparatus |
GB2575187B (en) * | 2015-05-29 | 2020-04-15 | Canon Kk | Image pickup device and imaging apparatus |
US11423552B2 (en) * | 2017-04-13 | 2022-08-23 | Canon Kabushiki Kaisha | Information processing apparatus, system, method, and storage medium to compare images |
Also Published As
Publication number | Publication date |
---|---|
US7110025B1 (en) | 2006-09-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7110025B1 (en) | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data | |
US10349030B2 (en) | Video recording and reproducing method, and video reproducing apparatus and method including thumbnails for moving pictures and still pictures | |
US6937273B1 (en) | Integrated motion-still capture system with indexing capability | |
EP0472699B1 (en) | Electronic still camera providing multi-format storage of full and reduced resolution images | |
US7319480B2 (en) | Method and apparatus for compressing motion image files to provide an improved image navigation display | |
US20070065139A1 (en) | Image pickup device and image recording apparatus | |
JPH11164245A (en) | Video recording device, video reproducing device and video recording and reproducing device | |
JP3814565B2 (en) | Recording device | |
JP3905450B2 (en) | Digital still camera | |
JP2006211426A (en) | Image sensing device and its image generating method | |
JP2007067708A (en) | Imaging apparatus and method of forming image by it | |
JP3696678B2 (en) | Digital image data recording apparatus and method, and digital image data reproducing apparatus and method | |
JP3902824B2 (en) | Image processing apparatus and method | |
JP4387264B2 (en) | Imaging apparatus and image generation method thereof | |
JP3253538B2 (en) | Image processing apparatus and image processing method thereof | |
US20090040382A1 (en) | Camera apparatus and still image generating method of camera apparatus | |
JPH07255030A (en) | Recording and reproducing device for compressed image | |
JPH06276476A (en) | Electronic still camera device | |
JP2004186905A (en) | Imaging device | |
JP2002320189A (en) | Digital camera, method for reproducing dynamic image and method for recording dynamic image | |
JP2004140603A (en) | Image recording and reproducing apparatus | |
JP2005117115A (en) | Electronic camera, and apparatus and method of editing image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: EASTMAN KODAK COMPANY, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK REALTY, INC., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK IMAGING NETWORK, INC., CALIFORNIA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: LASER-PACIFIC MEDIA CORPORATION, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: CREO MANUFACTURING AMERICA LLC, WYOMING Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: QUALEX INC., NORTH CAROLINA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK AVIATION LEASING LLC, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK PORTUGUESA LIMITED, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC., Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK AMERICAS, LTD., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK PHILIPPINES, LTD., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: PAKON, INC., INDIANA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: NPEC INC., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: FPC INC., CALIFORNIA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK (NEAR EAST), INC., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 |
|
AS | Assignment |
Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:064599/0304 Effective date: 20230728 |