WO2008126069A3 - An apparatus system and method for human-machine-interface - Google Patents

An apparatus system and method for human-machine-interface Download PDF

Info

Publication number
WO2008126069A3
WO2008126069A3 PCT/IL2007/000475 IL2007000475W WO2008126069A3 WO 2008126069 A3 WO2008126069 A3 WO 2008126069A3 IL 2007000475 W IL2007000475 W IL 2007000475W WO 2008126069 A3 WO2008126069 A3 WO 2008126069A3
Authority
WO
WIPO (PCT)
Prior art keywords
module
hmi
scoring
human
interface
Prior art date
Application number
PCT/IL2007/000475
Other languages
French (fr)
Other versions
WO2008126069A2 (en
Inventor
Dor Givon
Original Assignee
Xtr Extreme Reality
Dor Givon
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xtr Extreme Reality, Dor Givon filed Critical Xtr Extreme Reality
Priority to EP07736215A priority Critical patent/EP2147393A4/en
Priority to US12/517,210 priority patent/US8432390B2/en
Priority to CA2684020A priority patent/CA2684020C/en
Priority to KR1020097023103A priority patent/KR101379074B1/en
Priority to PCT/IL2007/000475 priority patent/WO2008126069A2/en
Priority to JP2010502633A priority patent/JP5147933B2/en
Publication of WO2008126069A2 publication Critical patent/WO2008126069A2/en
Publication of WO2008126069A3 publication Critical patent/WO2008126069A3/en
Priority to IL201514A priority patent/IL201514A/en
Priority to US13/355,643 priority patent/US8928654B2/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

There is provided a 3D human machine interface ('3D HMI'), which 3D HMI may include (1) an image acquisition assembly, (2) an initializing module, (3) an image segmentation module, (4) a segmented data processing module, (5) a scoring module, (6) a projection module, (7) a fitting module,(8) a scoring and error detection module, (9) a recovery module, (10) a three dimensional correlation module, (11) a three dimensional skeleton prediction module, (12) an output module and a (13) depth extraction module.
PCT/IL2007/000475 2004-07-30 2007-04-15 An apparatus system and method for human-machine-interface WO2008126069A2 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
EP07736215A EP2147393A4 (en) 2007-04-15 2007-04-15 An apparatus system and method for human-machine-interface
US12/517,210 US8432390B2 (en) 2004-07-30 2007-04-15 Apparatus system and method for human-machine interface
CA2684020A CA2684020C (en) 2007-04-15 2007-04-15 An apparatus system and method for human-machine-interface
KR1020097023103A KR101379074B1 (en) 2007-04-15 2007-04-15 An apparatus system and method for human-machine-interface
PCT/IL2007/000475 WO2008126069A2 (en) 2007-04-15 2007-04-15 An apparatus system and method for human-machine-interface
JP2010502633A JP5147933B2 (en) 2007-04-15 2007-04-15 Man-machine interface device system and method
IL201514A IL201514A (en) 2007-04-15 2009-10-14 Apparatus, system and method for human-machine-interface
US13/355,643 US8928654B2 (en) 2004-07-30 2012-01-23 Methods, systems, devices and associated processing logic for generating stereoscopic images and video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IL2007/000475 WO2008126069A2 (en) 2007-04-15 2007-04-15 An apparatus system and method for human-machine-interface

Related Child Applications (4)

Application Number Title Priority Date Filing Date
US11/572,958 Continuation-In-Part US8114172B2 (en) 2004-07-30 2005-07-31 System and method for 3D space-dimension based image processing
PCT/IL2005/000813 Continuation-In-Part WO2006011153A2 (en) 2004-07-30 2005-07-31 A system and method for 3d space-dimension based image processing
US57295807A Continuation-In-Part 2004-07-30 2007-01-30
US12/517,210 A-371-Of-International US8432390B2 (en) 2004-07-30 2007-04-15 Apparatus system and method for human-machine interface

Publications (2)

Publication Number Publication Date
WO2008126069A2 WO2008126069A2 (en) 2008-10-23
WO2008126069A3 true WO2008126069A3 (en) 2009-04-23

Family

ID=39864447

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2007/000475 WO2008126069A2 (en) 2004-07-30 2007-04-15 An apparatus system and method for human-machine-interface

Country Status (6)

Country Link
EP (1) EP2147393A4 (en)
JP (1) JP5147933B2 (en)
KR (1) KR101379074B1 (en)
CA (1) CA2684020C (en)
IL (1) IL201514A (en)
WO (1) WO2008126069A2 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8615108B1 (en) 2013-01-30 2013-12-24 Imimtek, Inc. Systems and methods for initializing motion tracking of human hands
US8655021B2 (en) 2012-06-25 2014-02-18 Imimtek, Inc. Systems and methods for tracking human hands by performing parts based template matching using images from multiple viewpoints
US8830312B2 (en) 2012-06-25 2014-09-09 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching within bounded regions
US9092665B2 (en) 2013-01-30 2015-07-28 Aquifi, Inc Systems and methods for initializing motion tracking of human hands
US9298266B2 (en) 2013-04-02 2016-03-29 Aquifi, Inc. Systems and methods for implementing three-dimensional (3D) gesture based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
US9310891B2 (en) 2012-09-04 2016-04-12 Aquifi, Inc. Method and system enabling natural user interface gestures with user wearable glasses
US9504920B2 (en) 2011-04-25 2016-11-29 Aquifi, Inc. Method and system to create three-dimensional mapping in a two-dimensional game
US9507417B2 (en) 2014-01-07 2016-11-29 Aquifi, Inc. Systems and methods for implementing head tracking based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
US9600078B2 (en) 2012-02-03 2017-03-21 Aquifi, Inc. Method and system enabling natural user interface gestures with an electronic system

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101238608B1 (en) 2004-07-30 2013-02-28 익스트림 리얼리티 엘티디. A system and method for 3D space-dimension based image processing
US8928654B2 (en) 2004-07-30 2015-01-06 Extreme Reality Ltd. Methods, systems, devices and associated processing logic for generating stereoscopic images and video
US8872899B2 (en) * 2004-07-30 2014-10-28 Extreme Reality Ltd. Method circuit and system for human to machine interfacing by hand gestures
US9046962B2 (en) 2005-10-31 2015-06-02 Extreme Reality Ltd. Methods, systems, apparatuses, circuits and associated computer executable code for detecting motion, position and/or orientation of objects within a defined spatial region
US20070285554A1 (en) 2005-10-31 2007-12-13 Dor Givon Apparatus method and system for imaging
US8878779B2 (en) 2009-09-21 2014-11-04 Extreme Reality Ltd. Methods circuits device systems and associated computer executable code for facilitating interfacing with a computing platform display screen
CA2774867A1 (en) 2009-09-21 2011-03-24 Extreme Reality Ltd. Methods circuits apparatus and systems for human machine interfacing with an electronic appliance
US9857868B2 (en) 2011-03-19 2018-01-02 The Board Of Trustees Of The Leland Stanford Junior University Method and system for ergonomic touch-free interface
US9798388B1 (en) 2013-07-31 2017-10-24 Aquifi, Inc. Vibrotactile system to augment 3D input systems
US9619105B1 (en) 2014-01-30 2017-04-11 Aquifi, Inc. Systems and methods for gesture based interaction with viewpoint dependent user interfaces
CN108144292A (en) * 2018-01-30 2018-06-12 河南三阳光电有限公司 Bore hole 3D interactive game making apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040155962A1 (en) * 2003-02-11 2004-08-12 Marks Richard L. Method and apparatus for real time motion capture
US6833843B2 (en) * 2001-12-03 2004-12-21 Tempest Microsystems Panoramic imaging and display system with canonical magnifier

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3481430B2 (en) * 1997-09-11 2003-12-22 富士通株式会社 Mobile tracking device
JP3800905B2 (en) * 1999-07-27 2006-07-26 松下電工株式会社 Image feature tracking processing method, image feature tracking processing device, and three-dimensional data creation method
JP2001236505A (en) * 2000-02-22 2001-08-31 Atsushi Kuroda Method, device and system for estimating coordinate
JP2002259474A (en) * 2001-03-05 2002-09-13 Oojisu Soken:Kk Method and device for generating human body model, computer program and recording medium
JP2003256850A (en) * 2001-12-27 2003-09-12 Sanyo Electric Co Ltd Movement recognizing device and image processor and its program
JPWO2004094943A1 (en) * 2003-04-22 2006-07-13 博 有澤 Motion capture method, motion capture device, and motion capture marker
JP4481663B2 (en) * 2004-01-15 2010-06-16 キヤノン株式会社 Motion recognition device, motion recognition method, device control device, and computer program
US7308112B2 (en) * 2004-05-14 2007-12-11 Honda Motor Co., Ltd. Sign based human-machine interaction
KR101238608B1 (en) * 2004-07-30 2013-02-28 익스트림 리얼리티 엘티디. A system and method for 3D space-dimension based image processing
JP4686595B2 (en) * 2005-03-17 2011-05-25 本田技研工業株式会社 Pose estimation based on critical point analysis

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6833843B2 (en) * 2001-12-03 2004-12-21 Tempest Microsystems Panoramic imaging and display system with canonical magnifier
US20040155962A1 (en) * 2003-02-11 2004-08-12 Marks Richard L. Method and apparatus for real time motion capture

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9504920B2 (en) 2011-04-25 2016-11-29 Aquifi, Inc. Method and system to create three-dimensional mapping in a two-dimensional game
US9600078B2 (en) 2012-02-03 2017-03-21 Aquifi, Inc. Method and system enabling natural user interface gestures with an electronic system
US9111135B2 (en) 2012-06-25 2015-08-18 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera
US8934675B2 (en) 2012-06-25 2015-01-13 Aquifi, Inc. Systems and methods for tracking human hands by performing parts based template matching using images from multiple viewpoints
US9098739B2 (en) 2012-06-25 2015-08-04 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching
US8830312B2 (en) 2012-06-25 2014-09-09 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching within bounded regions
US8655021B2 (en) 2012-06-25 2014-02-18 Imimtek, Inc. Systems and methods for tracking human hands by performing parts based template matching using images from multiple viewpoints
US9310891B2 (en) 2012-09-04 2016-04-12 Aquifi, Inc. Method and system enabling natural user interface gestures with user wearable glasses
US9092665B2 (en) 2013-01-30 2015-07-28 Aquifi, Inc Systems and methods for initializing motion tracking of human hands
US8615108B1 (en) 2013-01-30 2013-12-24 Imimtek, Inc. Systems and methods for initializing motion tracking of human hands
US9129155B2 (en) 2013-01-30 2015-09-08 Aquifi, Inc. Systems and methods for initializing motion tracking of human hands using template matching within bounded regions determined using a depth map
US9298266B2 (en) 2013-04-02 2016-03-29 Aquifi, Inc. Systems and methods for implementing three-dimensional (3D) gesture based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
US9507417B2 (en) 2014-01-07 2016-11-29 Aquifi, Inc. Systems and methods for implementing head tracking based graphical user interfaces (GUI) that incorporate gesture reactive interface objects

Also Published As

Publication number Publication date
IL201514A0 (en) 2010-05-31
CA2684020A1 (en) 2008-10-23
JP5147933B2 (en) 2013-02-20
EP2147393A2 (en) 2010-01-27
KR20100016240A (en) 2010-02-12
KR101379074B1 (en) 2014-03-28
JP2010524113A (en) 2010-07-15
WO2008126069A2 (en) 2008-10-23
IL201514A (en) 2015-02-26
CA2684020C (en) 2016-08-09
EP2147393A4 (en) 2012-12-05

Similar Documents

Publication Publication Date Title
WO2008126069A3 (en) An apparatus system and method for human-machine-interface
KR101940718B1 (en) Apparatus and method for extracting person domain based on RGB-Depth image
US9626803B2 (en) Method and apparatus for image processing in augmented reality systems
TW200725429A (en) Object tracking systems and methods
WO2008100248A3 (en) Feature matching method
KR102009292B1 (en) Apparatus and method for reconstructing three dimensional face based on multiple cameras
WO2008021245A3 (en) Image segmentation for drr generation and image registration
WO2006034256A3 (en) System, method, and apparatus for generating a three-dimensional representation from one or more two-dimensional images
WO2010079921A3 (en) Video signal processing method and apparatus using depth information
WO2008098014A3 (en) System and methods for indel identification using short read sequencing
WO2006138525A3 (en) System and method for recognition in 2d images using 3d class models
WO2009018538A3 (en) System and method of three-dimensional pose estimation
WO2009108256A3 (en) Pattern classification system and method for collective learning
WO2011154558A2 (en) Monocular 3d pose estimation and tracking by detection
WO2006083297A3 (en) Method and apparatus for aligning video to three-dimensional point clouds
WO2006105054A3 (en) Method and system for improving video metadata through the use of frame-to-frame correspondences
TW200606556A (en) System and method for efficiently performing a depth map recovery procedure
GB2471036A (en) Object matching for tracking, indexing, and search
KR20150082379A (en) Fast initialization for monocular visual slam
EP1933226A3 (en) Information input device and method and medium for inputting information in 3D space
SE0402048D0 (en) 3D object recognition
WO2012095756A3 (en) Method circuit and system for human to machine interfacing by hand gestures
WO2007025300A3 (en) Capturing and processing facial motion data
WO2009047366A3 (en) Methods and systems for processing of video data
WO2011021822A3 (en) Method and apparatus for processing signal for three-dimensional reproduction of additional data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07736215

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 12517210

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2010502633

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 201514

Country of ref document: IL

Ref document number: 2684020

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20097023103

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2007736215

Country of ref document: EP