WO2009124181A3 - Gesture based control using three-dimensional information extracted over an extended depth of field - Google Patents

Gesture based control using three-dimensional information extracted over an extended depth of field Download PDF

Info

Publication number
WO2009124181A3
WO2009124181A3 PCT/US2009/039285 US2009039285W WO2009124181A3 WO 2009124181 A3 WO2009124181 A3 WO 2009124181A3 US 2009039285 W US2009039285 W US 2009039285W WO 2009124181 A3 WO2009124181 A3 WO 2009124181A3
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
field
processor
optical detectors
information extracted
Prior art date
Application number
PCT/US2009/039285
Other languages
French (fr)
Other versions
WO2009124181A2 (en
Inventor
Pierre St. Hilaire
John S. Underkoffler
Original Assignee
Oblong Industries, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/109,263 external-priority patent/US8407725B2/en
Application filed by Oblong Industries, Inc. filed Critical Oblong Industries, Inc.
Priority to JP2011503166A priority Critical patent/JP5697590B2/en
Priority to EP09728557.1A priority patent/EP2266016A4/en
Priority to CN200980120542.XA priority patent/CN102047203B/en
Publication of WO2009124181A2 publication Critical patent/WO2009124181A2/en
Publication of WO2009124181A3 publication Critical patent/WO2009124181A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/50—Optics for phase object visualisation
    • G02B27/52—Phase contrast optics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language

Abstract

Systems and methods are described for gesture-based control using three-dimensional information extracted over an extended depth of field. The system comprises a plurality of optical detectors coupled to at least one processor. The optical detectors image a body. At least two optical detectors of the plurality of optical detectors comprise wavefront coding cameras. The processor automatically detects a gesture of the body, wherein the gesture comprises an instantaneous state of the body. The detecting comprises aggregating gesture data of the gesture at an instant in time. The gesture data includes focus-resolved data of the body within a depth of field of the imaging system. The processor translates the gesture to a gesture signal, and uses the gesture signal to control a component coupled to the processor.
PCT/US2009/039285 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field WO2009124181A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2011503166A JP5697590B2 (en) 2008-04-02 2009-04-02 Gesture-based control using 3D information extracted from extended subject depth
EP09728557.1A EP2266016A4 (en) 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field
CN200980120542.XA CN102047203B (en) 2008-04-02 2009-04-02 Use the control based on attitude that the three-dimensional information extracted in the depth of field of extension is carried out

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US4189208P 2008-04-02 2008-04-02
US61/041,892 2008-04-02
US12/109,263 US8407725B2 (en) 2007-04-24 2008-04-24 Proteins, pools, and slawx in processing environments
US12/109,263 2008-04-24
US10524308P 2008-10-14 2008-10-14
US10525308P 2008-10-14 2008-10-14
US61/105,253 2008-10-14
US61/105,243 2008-10-14

Publications (2)

Publication Number Publication Date
WO2009124181A2 WO2009124181A2 (en) 2009-10-08
WO2009124181A3 true WO2009124181A3 (en) 2009-12-30

Family

ID=41136111

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/039285 WO2009124181A2 (en) 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field

Country Status (5)

Country Link
EP (1) EP2266016A4 (en)
JP (1) JP5697590B2 (en)
KR (1) KR101550478B1 (en)
CN (1) CN102047203B (en)
WO (1) WO2009124181A2 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011059404A2 (en) * 2009-11-12 2011-05-19 Nanyang Polytechnic Method and system for interactive gesture-based control
US9171200B2 (en) 2011-03-04 2015-10-27 Hewlett-Packard Development Company, L.P. Gestural interaction identification
CN103135755B (en) * 2011-12-02 2016-04-06 深圳泰山在线科技有限公司 Interactive system and method
JP5917125B2 (en) * 2011-12-16 2016-05-11 キヤノン株式会社 Image processing apparatus, image processing method, imaging apparatus, and display apparatus
TWI451344B (en) * 2012-08-27 2014-09-01 Pixart Imaging Inc Gesture recognition system and method
CN104007819B (en) * 2014-05-06 2017-05-24 清华大学 Gesture recognition method and device and Leap Motion system
WO2018218063A1 (en) 2017-05-24 2018-11-29 The Trustees Of Columbia University In The City Of New York Broadband achromatic flat optical components by dispersion-engineered dielectric metasurfaces
CN107515454B (en) * 2017-08-29 2019-12-20 宁夏巨能机器人股份有限公司 Automatic focal length adjusting device for 3D visual positioning and adjusting method thereof
CA3074566A1 (en) 2017-08-31 2019-03-07 Metalenz, Inc. Transmissive metasurface lens integration
CN110609039B (en) * 2019-09-23 2021-09-28 上海御微半导体技术有限公司 Optical detection device and method thereof
US11927769B2 (en) 2022-03-31 2024-03-12 Metalenz, Inc. Polarization sorting metasurface microlens array device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system
US20060208169A1 (en) * 1992-05-05 2006-09-21 Breed David S Vehicular restraint system control system and method using multiple optical imagers
US20070139541A1 (en) * 2001-07-06 2007-06-21 Himanshu Amin Imaging system and methodology

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7218448B1 (en) * 1997-03-17 2007-05-15 The Regents Of The University Of Colorado Extended depth of field optical systems
JP2000275582A (en) * 1999-03-24 2000-10-06 Olympus Optical Co Ltd Depth-of-field enlarging system
SE0000850D0 (en) * 2000-03-13 2000-03-13 Pink Solution Ab Recognition arrangement
US7227526B2 (en) * 2000-07-24 2007-06-05 Gesturetek, Inc. Video-based image control system
US6842297B2 (en) 2001-08-31 2005-01-11 Cdm Optics, Inc. Wavefront coding optics
EP2328006B1 (en) * 2005-09-19 2014-08-06 OmniVision CDM Optics, Inc. Task-based imaging systems
JP2008070319A (en) 2006-09-15 2008-03-27 Canon Inc Object measurement device and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060208169A1 (en) * 1992-05-05 2006-09-21 Breed David S Vehicular restraint system control system and method using multiple optical imagers
US20070139541A1 (en) * 2001-07-06 2007-06-21 Himanshu Amin Imaging system and methodology
US20060187196A1 (en) * 2005-02-08 2006-08-24 Underkoffler John S System and method for gesture based control system

Also Published As

Publication number Publication date
KR101550478B1 (en) 2015-09-04
EP2266016A4 (en) 2014-10-29
KR20100136993A (en) 2010-12-29
CN102047203A (en) 2011-05-04
WO2009124181A2 (en) 2009-10-08
JP2011523112A (en) 2011-08-04
EP2266016A2 (en) 2010-12-29
JP5697590B2 (en) 2015-04-08
CN102047203B (en) 2016-08-17

Similar Documents

Publication Publication Date Title
WO2009124181A3 (en) Gesture based control using three-dimensional information extracted over an extended depth of field
WO2012033658A3 (en) A 3-d camera
WO2009007917A3 (en) Object motion capturing system and method
WO2011119337A3 (en) System and method for data capture, storage, and retrieval
WO2011026077A3 (en) Combination localization system
WO2012088285A3 (en) Three-dimensional tracking of a user control device in a volume
WO2014140827A3 (en) Proximity sensor and image sensor based gesture detection
WO2012145429A3 (en) Virtual keyboards and methods of providing the same
WO2010093115A3 (en) Broadcast receiver and 3d subtitle data processing method thereof
WO2013177125A3 (en) System and method for managing spatiotemporal uncertainty
WO2011074891A3 (en) Method and system for controlling output of a mobile device
GB201220073D0 (en) Techniques for configuring contacts of a connector
EP2693284A3 (en) Systems and method for haptic remote control gaming
MX339520B (en) A toy construction system for augmented reality.
WO2012170953A3 (en) Systems and methods for intelligent monitoring of thoroughfares using thermal imaging
WO2011059857A3 (en) Methods and systems for determining and tracking extremities of a target
WO2013059758A3 (en) Generating a depth map
EP2450831A3 (en) Method and system for detecting multi-view human face
WO2010128321A3 (en) Entertainment device, system, and method
WO2010062117A3 (en) Immersive display system for interacting with three-dimensional content
WO2013009815A3 (en) Methods and systems for social overlay visualization
WO2012058381A3 (en) Apparatus, systems and methods for measuring blood pressure within at least one vessel
MY165967A (en) Moving-body-detecting device and moving-body-detecting system
EP2670147A3 (en) Abnormality diagnosis device and method, imager including the abnormality diagnosis device, mobile vehicle control system and mobile vehicle
EP2592820A4 (en) Product imaging device, product imaging method, image conversion device, image processing device, image processing system, program, and information recording medium

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980120542.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09728557

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2011503166

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 7724/DELNP/2010

Country of ref document: IN

ENP Entry into the national phase

Ref document number: 20107024659

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2009728557

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE