US8401248B1 - Method and system for measuring emotional and attentional response to dynamic digital media content - Google Patents
Method and system for measuring emotional and attentional response to dynamic digital media content Download PDFInfo
- Publication number
- US8401248B1 US8401248B1 US12/317,917 US31791708A US8401248B1 US 8401248 B1 US8401248 B1 US 8401248B1 US 31791708 A US31791708 A US 31791708A US 8401248 B1 US8401248 B1 US 8401248B1
- Authority
- US
- United States
- Prior art keywords
- emotion
- facial
- gaze
- faces
- estimating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/176—Dynamic expression
Abstract
Description
Claims (32)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/317,917 US8401248B1 (en) | 2008-12-30 | 2008-12-30 | Method and system for measuring emotional and attentional response to dynamic digital media content |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/317,917 US8401248B1 (en) | 2008-12-30 | 2008-12-30 | Method and system for measuring emotional and attentional response to dynamic digital media content |
Publications (1)
Publication Number | Publication Date |
---|---|
US8401248B1 true US8401248B1 (en) | 2013-03-19 |
Family
ID=47844777
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/317,917 Active 2031-12-27 US8401248B1 (en) | 2008-12-30 | 2008-12-30 | Method and system for measuring emotional and attentional response to dynamic digital media content |
Country Status (1)
Country | Link |
---|---|
US (1) | US8401248B1 (en) |
Cited By (139)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100208051A1 (en) * | 2009-02-13 | 2010-08-19 | Shingo Tsurumi | Information processing apparatus and information processing method |
US20120033853A1 (en) * | 2010-08-06 | 2012-02-09 | Canon Kabushiki Kaisha | Information processing apparatus, information processing method, and storage medium |
US20120101735A1 (en) * | 2010-10-21 | 2012-04-26 | Samsung Electronics Co., Ltd. | Method and apparatus for recognizing an emotion of an individual based on facial action units |
US20120194504A1 (en) * | 2011-01-28 | 2012-08-02 | Honeywell International Inc. | Rendering-based landmark localization from 3d range images |
US20120230545A1 (en) * | 2009-11-30 | 2012-09-13 | Tong Zhang | Face Recognition Apparatus and Methods |
US20120269392A1 (en) * | 2011-04-25 | 2012-10-25 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
US20120290511A1 (en) * | 2011-05-11 | 2012-11-15 | Affectivon Ltd. | Database of affective response and attention levels |
US20120294478A1 (en) * | 2011-05-20 | 2012-11-22 | Eye-Com Corporation | Systems and methods for identifying gaze tracking scene reference locations |
US20130050268A1 (en) * | 2011-08-24 | 2013-02-28 | Maura C. Lohrenz | System and method for determining distracting features in a visual display |
US20130102854A1 (en) * | 2010-06-07 | 2013-04-25 | Affectiva, Inc. | Mental state evaluation learning for advertising |
US20130151333A1 (en) * | 2011-12-07 | 2013-06-13 | Affectiva, Inc. | Affect based evaluation of advertisement effectiveness |
US20130235073A1 (en) * | 2012-03-09 | 2013-09-12 | International Business Machines Corporation | Automatically modifying presentation of mobile-device content |
US20140016860A1 (en) * | 2010-06-07 | 2014-01-16 | Affectiva, Inc. | Facial analysis to detect asymmetric expressions |
US20140047316A1 (en) * | 2012-08-10 | 2014-02-13 | Vimbli, Inc. | Method and system to create a personal priority graph |
US20140058828A1 (en) * | 2010-06-07 | 2014-02-27 | Affectiva, Inc. | Optimizing media based on mental state analysis |
US20140242560A1 (en) * | 2013-02-15 | 2014-08-28 | Emotient | Facial expression training using feedback from automatic facial expression recognition |
US20140315168A1 (en) * | 2013-02-12 | 2014-10-23 | Emotient | Facial expression measurement for assessment, monitoring, and treatment evaluation of affective and neurological disorders |
US20150020086A1 (en) * | 2013-07-11 | 2015-01-15 | Samsung Electronics Co., Ltd. | Systems and methods for obtaining user feedback to media content |
US20150023603A1 (en) * | 2013-07-17 | 2015-01-22 | Machine Perception Technologies Inc. | Head-pose invariant recognition of facial expressions |
US20150193889A1 (en) * | 2014-01-09 | 2015-07-09 | Adobe Systems Incorporated | Digital content publishing guidance based on trending emotions |
US20150206000A1 (en) * | 2010-06-07 | 2015-07-23 | Affectiva, Inc. | Background analysis of mental state expressions |
US20150206032A1 (en) * | 2014-01-23 | 2015-07-23 | Samsung Electronics Co., Ltd. | Method of learning a parameter to estimate posture of an articulated object and method of estimating posture of an articulated object |
US9106958B2 (en) | 2011-02-27 | 2015-08-11 | Affectiva, Inc. | Video recommendation based on affect |
CN104992453A (en) * | 2015-07-14 | 2015-10-21 | 国家电网公司 | Target tracking method under complicated background based on extreme learning machine |
CN105045115A (en) * | 2015-05-29 | 2015-11-11 | 四川长虹电器股份有限公司 | Control method and intelligent household equipment |
US20150324632A1 (en) * | 2013-07-17 | 2015-11-12 | Emotient, Inc. | Head-pose invariant recognition of facial attributes |
US9204836B2 (en) | 2010-06-07 | 2015-12-08 | Affectiva, Inc. | Sporadic collection of mobile affect data |
US20150362989A1 (en) * | 2014-06-17 | 2015-12-17 | Amazon Technologies, Inc. | Dynamic template selection for object detection and tracking |
JP2016001447A (en) * | 2014-06-12 | 2016-01-07 | キヤノン株式会社 | Image recognition system, image recognition device, image recognition method and computer program |
US9247903B2 (en) | 2010-06-07 | 2016-02-02 | Affectiva, Inc. | Using affect within a gaming context |
US20160109941A1 (en) * | 2014-10-15 | 2016-04-21 | Wipro Limited | System and method for recommending content to a user based on user's interest |
EP3011522A1 (en) * | 2013-06-21 | 2016-04-27 | Sony Corporation | Information processing system, method and non-transitory computer-readable medium |
US20160191995A1 (en) * | 2011-09-30 | 2016-06-30 | Affectiva, Inc. | Image analysis for attendance query evaluation |
US20160217322A1 (en) * | 2013-09-27 | 2016-07-28 | Korea University Research And Business Foundation | System and method for inspecting emotion recognition capability using multisensory information, and system and method for training emotion recognition using multisensory information |
US9426538B2 (en) | 2013-11-20 | 2016-08-23 | At&T Intellectual Property I, Lp | Method and apparatus for presenting advertising in content having an emotional context |
US9503786B2 (en) | 2010-06-07 | 2016-11-22 | Affectiva, Inc. | Video recommendation using affect |
US20160379414A1 (en) * | 2015-05-11 | 2016-12-29 | The United States Of America As Represented By The Secretary Of The Navy | Augmented reality visualization system |
EP3115956A1 (en) * | 2015-07-09 | 2017-01-11 | Fujitsu Limited | Interest degree determination device, interest degree determination method, and interest degree determination program |
US9646046B2 (en) | 2010-06-07 | 2017-05-09 | Affectiva, Inc. | Mental state data tagging for data collected from multiple sources |
US9642536B2 (en) | 2010-06-07 | 2017-05-09 | Affectiva, Inc. | Mental state analysis using heart rate collection based on video imagery |
DE102015222388A1 (en) | 2015-11-13 | 2017-05-18 | Bayerische Motoren Werke Aktiengesellschaft | Device and method for controlling a display device in a motor vehicle |
US20170140214A1 (en) * | 2015-11-16 | 2017-05-18 | Facebook, Inc. | Systems and methods for dynamically generating emojis based on image analysis of facial features |
US9723992B2 (en) | 2010-06-07 | 2017-08-08 | Affectiva, Inc. | Mental state analysis using blink rate |
US20170330038A1 (en) * | 2016-05-13 | 2017-11-16 | Canon Kabushiki Kaisha | Method, system and apparatus for selecting a video frame |
WO2017216758A1 (en) * | 2016-06-15 | 2017-12-21 | Hau Stephan | Computer-based micro-expression analysis |
US9934425B2 (en) | 2010-06-07 | 2018-04-03 | Affectiva, Inc. | Collection of affect data from multiple mobile devices |
US9959549B2 (en) | 2010-06-07 | 2018-05-01 | Affectiva, Inc. | Mental state analysis for norm generation |
US9986289B2 (en) * | 2015-03-02 | 2018-05-29 | The Nielsen Company (Us), Llc | Methods and apparatus to count people |
US20180182141A1 (en) * | 2016-12-22 | 2018-06-28 | Facebook, Inc. | Dynamic mask application |
US10074024B2 (en) | 2010-06-07 | 2018-09-11 | Affectiva, Inc. | Mental state analysis using blink rate for vehicles |
US20180308180A1 (en) * | 2016-10-30 | 2018-10-25 | B.Z.W Ltd. | Systems Methods Devices Circuits and Computer Executable Code for Impression Measurement and Evaluation |
US10111611B2 (en) | 2010-06-07 | 2018-10-30 | Affectiva, Inc. | Personal emotional profile generation |
US10143414B2 (en) | 2010-06-07 | 2018-12-04 | Affectiva, Inc. | Sporadic collection with mobile affect data |
US20190005360A1 (en) * | 2017-07-01 | 2019-01-03 | Algolux Inc. | Method and apparatus for joint image processing and perception |
US20190034706A1 (en) * | 2010-06-07 | 2019-01-31 | Affectiva, Inc. | Facial tracking with classifiers for query evaluation |
US10204625B2 (en) | 2010-06-07 | 2019-02-12 | Affectiva, Inc. | Audio analysis learning using video data |
US10262331B1 (en) | 2016-01-29 | 2019-04-16 | Videomining Corporation | Cross-channel in-store shopper behavior analysis |
US20190122403A1 (en) * | 2017-10-23 | 2019-04-25 | Paypal, Inc. | System and method for generating emoji mashups with machine learning |
CN109685831A (en) * | 2018-12-20 | 2019-04-26 | 山东大学 | Method for tracking target and system based on residual error layering attention and correlation filter |
US10289898B2 (en) | 2010-06-07 | 2019-05-14 | Affectiva, Inc. | Video recommendation via affect |
US10320938B2 (en) | 2016-02-02 | 2019-06-11 | International Business Machines Corporation | Monitoring and maintaining social group cohesiveness |
US10354261B2 (en) * | 2014-04-16 | 2019-07-16 | 2020 Ip Llc | Systems and methods for virtual environment construction for behavioral research |
US10354262B1 (en) | 2016-06-02 | 2019-07-16 | Videomining Corporation | Brand-switching analysis using longitudinal tracking of at-shelf shopper behavior |
US10380647B2 (en) * | 2010-12-20 | 2019-08-13 | Excalibur Ip, Llc | Selection and/or modification of a portion of online content based on an emotional state of a user |
US10380413B2 (en) * | 2017-07-13 | 2019-08-13 | Robert Bosch Gmbh | System and method for pose-invariant face alignment |
US10387896B1 (en) | 2016-04-27 | 2019-08-20 | Videomining Corporation | At-shelf brand strength tracking and decision analytics |
US10401860B2 (en) | 2010-06-07 | 2019-09-03 | Affectiva, Inc. | Image analysis for two-sided data hub |
US10474875B2 (en) | 2010-06-07 | 2019-11-12 | Affectiva, Inc. | Image analysis using a semiconductor processor for facial evaluation |
US10482333B1 (en) | 2017-01-04 | 2019-11-19 | Affectiva, Inc. | Mental state analysis using blink rate within vehicles |
US10517521B2 (en) | 2010-06-07 | 2019-12-31 | Affectiva, Inc. | Mental state mood analysis using heart rate collection based on video imagery |
US10546586B2 (en) | 2016-09-07 | 2020-01-28 | International Business Machines Corporation | Conversation path rerouting in a dialog system based on user sentiment |
US10592757B2 (en) | 2010-06-07 | 2020-03-17 | Affectiva, Inc. | Vehicular cognitive data collection using multiple devices |
US10614289B2 (en) | 2010-06-07 | 2020-04-07 | Affectiva, Inc. | Facial tracking with classifiers |
US10628985B2 (en) | 2017-12-01 | 2020-04-21 | Affectiva, Inc. | Avatar image animation using translation vectors |
US10627817B2 (en) | 2010-06-07 | 2020-04-21 | Affectiva, Inc. | Vehicle manipulation using occupant image analysis |
US10628741B2 (en) | 2010-06-07 | 2020-04-21 | Affectiva, Inc. | Multimodal machine learning for emotion metrics |
EP3548996A4 (en) * | 2017-01-19 | 2020-07-15 | Hewlett-Packard Development Company, L.P. | Eye gaze angle feedback in a remote meeting |
US10779761B2 (en) | 2010-06-07 | 2020-09-22 | Affectiva, Inc. | Sporadic collection of affect data within a vehicle |
US10796341B2 (en) | 2014-03-11 | 2020-10-06 | Realeyes Oü | Method of generating web-based advertising inventory and targeting web-based advertisements |
US10796176B2 (en) | 2010-06-07 | 2020-10-06 | Affectiva, Inc. | Personal emotional profile generation for vehicle manipulation |
US10799168B2 (en) | 2010-06-07 | 2020-10-13 | Affectiva, Inc. | Individual data sharing across a social network |
US10843078B2 (en) | 2010-06-07 | 2020-11-24 | Affectiva, Inc. | Affect usage within a gaming context |
US10868999B2 (en) | 2016-02-03 | 2020-12-15 | Hewlett-Packard Development Company, L.P. | Eye gaze angle feedback in a remote meeting |
US10869626B2 (en) | 2010-06-07 | 2020-12-22 | Affectiva, Inc. | Image analysis for emotional metric evaluation |
US10878593B2 (en) * | 2016-12-15 | 2020-12-29 | Tencent Technology (Shenzhen) Company Limited | Pupil localizing method and system |
US10897650B2 (en) | 2010-06-07 | 2021-01-19 | Affectiva, Inc. | Vehicle content recommendation using cognitive states |
US10911829B2 (en) | 2010-06-07 | 2021-02-02 | Affectiva, Inc. | Vehicle video recommendation via affect |
US10922566B2 (en) | 2017-05-09 | 2021-02-16 | Affectiva, Inc. | Cognitive state evaluation for vehicle navigation |
US10922567B2 (en) | 2010-06-07 | 2021-02-16 | Affectiva, Inc. | Cognitive state based vehicle manipulation using near-infrared image processing |
US10963893B1 (en) | 2016-02-23 | 2021-03-30 | Videomining Corporation | Personalized decision tree based on in-store behavior analysis |
WO2021085231A1 (en) * | 2019-10-30 | 2021-05-06 | 株式会社島津製作所 | Emotion estimation method and emotion estimation system |
CN112819863A (en) * | 2021-04-16 | 2021-05-18 | 北京万里红科技股份有限公司 | Snapshot target tracking method and computing device in remote iris recognition |
US11017250B2 (en) | 2010-06-07 | 2021-05-25 | Affectiva, Inc. | Vehicle manipulation using convolutional image processing |
CN112989914A (en) * | 2019-12-16 | 2021-06-18 | 辉达公司 | Gaze-determining machine learning system with adaptive weighted input |
CN113016190A (en) * | 2018-10-01 | 2021-06-22 | 杜比实验室特许公司 | Authoring intent extensibility via physiological monitoring |
CN113052064A (en) * | 2021-03-23 | 2021-06-29 | 北京思图场景数据科技服务有限公司 | Attention detection method based on face orientation, facial expression and pupil tracking |
US11056225B2 (en) | 2010-06-07 | 2021-07-06 | Affectiva, Inc. | Analytics for livestreaming based on image analysis within a shared digital environment |
US11067405B2 (en) | 2010-06-07 | 2021-07-20 | Affectiva, Inc. | Cognitive state vehicle navigation based on image processing |
US11068751B2 (en) * | 2017-03-21 | 2021-07-20 | Nec Corporation | Image processing device, image processing method, and storage medium |
US11073899B2 (en) | 2010-06-07 | 2021-07-27 | Affectiva, Inc. | Multidevice multimodal emotion services monitoring |
WO2021151290A1 (en) * | 2020-07-30 | 2021-08-05 | 平安科技(深圳)有限公司 | Facial information identification and monitoring method and apparatus based on machine learning |
US11151610B2 (en) | 2010-06-07 | 2021-10-19 | Affectiva, Inc. | Autonomous vehicle control using heart rate collection based on video imagery |
US11164105B2 (en) | 2017-11-13 | 2021-11-02 | International Business Machines Corporation | Intelligent recommendations implemented by modelling user profile through deep learning of multimodal user data |
US20210343201A1 (en) * | 2020-05-01 | 2021-11-04 | AWL, Inc. | Signage control system and non-transitory computer-readable recording medium for recording signage control program |
US11182597B2 (en) * | 2018-01-19 | 2021-11-23 | Board Of Regents, The University Of Texas Systems | Systems and methods for evaluating individual, group, and crowd emotion engagement and attention |
CN113924542A (en) * | 2019-06-14 | 2022-01-11 | 惠普发展公司, 有限责任合伙企业 | Headset signal for determining emotional state |
US11227307B2 (en) | 2017-03-21 | 2022-01-18 | Kellogg Company | Media content tracking of users' gazing at screens |
US11232290B2 (en) | 2010-06-07 | 2022-01-25 | Affectiva, Inc. | Image analysis using sub-sectional component evaluation to augment classifier usage |
US11275431B2 (en) * | 2015-10-08 | 2022-03-15 | Panasonic Intellectual Property Corporation Of America | Information presenting apparatus and control method therefor |
US11292477B2 (en) | 2010-06-07 | 2022-04-05 | Affectiva, Inc. | Vehicle manipulation using cognitive state engineering |
US11295114B2 (en) * | 2014-04-28 | 2022-04-05 | Microsoft Technology Licensing, Llc | Creation of representative content based on facial analysis |
US11318949B2 (en) | 2010-06-07 | 2022-05-03 | Affectiva, Inc. | In-vehicle drowsiness analysis using blink rate |
US20220139108A1 (en) * | 2019-10-25 | 2022-05-05 | Adobe Inc. | Classification of subjects within a digital image |
US11330012B2 (en) * | 2010-11-29 | 2022-05-10 | Biocatch Ltd. | System, method, and device of authenticating a user based on selfie image or selfie video |
US11354683B1 (en) | 2015-12-30 | 2022-06-07 | Videomining Corporation | Method and system for creating anonymous shopper panel using multi-modal sensor fusion |
US11393133B2 (en) | 2010-06-07 | 2022-07-19 | Affectiva, Inc. | Emoji manipulation using machine learning |
US11410438B2 (en) | 2010-06-07 | 2022-08-09 | Affectiva, Inc. | Image analysis using a semiconductor processor for facial evaluation in vehicles |
US11430561B2 (en) | 2010-06-07 | 2022-08-30 | Affectiva, Inc. | Remote computing analysis for cognitive state data metrics |
US11430260B2 (en) | 2010-06-07 | 2022-08-30 | Affectiva, Inc. | Electronic display viewing verification |
US11430256B2 (en) | 2014-04-29 | 2022-08-30 | Microsoft Technology Licensing, Llc | Image scoring and identification based on facial feature descriptors |
US11465640B2 (en) | 2010-06-07 | 2022-10-11 | Affectiva, Inc. | Directed control transfer for autonomous vehicles |
US11484685B2 (en) | 2010-06-07 | 2022-11-01 | Affectiva, Inc. | Robotic control using profiles |
US11511757B2 (en) | 2010-06-07 | 2022-11-29 | Affectiva, Inc. | Vehicle manipulation with crowdsourcing |
US20220383338A1 (en) * | 2021-05-27 | 2022-12-01 | International Business Machines Corporation | Dynamic presenter feedback in multiuser content delivery systems |
US11587357B2 (en) | 2010-06-07 | 2023-02-21 | Affectiva, Inc. | Vehicular cognitive data collection with multiple devices |
US11604511B2 (en) | 2020-11-14 | 2023-03-14 | Facense Ltd. | Robust photosensor-based facial expression detector |
US11657288B2 (en) | 2010-06-07 | 2023-05-23 | Affectiva, Inc. | Convolutional computing using multilayered analysis engine |
US11700420B2 (en) | 2010-06-07 | 2023-07-11 | Affectiva, Inc. | Media manipulation using cognitive state metric analysis |
US11704574B2 (en) | 2010-06-07 | 2023-07-18 | Affectiva, Inc. | Multimodal machine learning for vehicle manipulation |
EP4213105A1 (en) | 2022-01-18 | 2023-07-19 | E-Con Systems India Private Limited | Gaze estimation system and method thereof |
US11707216B2 (en) * | 2016-07-21 | 2023-07-25 | Comcast Cable Communications, Llc | Recommendations based on biometric feedback from wearable device |
US20230290109A1 (en) * | 2022-03-14 | 2023-09-14 | Disney Enterprises, Inc. | Behavior-based computer vision model for content selection |
US11769056B2 (en) | 2019-12-30 | 2023-09-26 | Affectiva, Inc. | Synthetic data for neural network training using vectors |
US11785064B2 (en) | 2021-05-27 | 2023-10-10 | International Business Machines Corporation | Individual user content control in multiuser content delivery systems |
US20230360079A1 (en) * | 2022-01-18 | 2023-11-09 | e-con Systems India Private Limited | Gaze estimation system and method thereof |
US11823055B2 (en) | 2019-03-31 | 2023-11-21 | Affectiva, Inc. | Vehicular in-cabin sensing using machine learning |
US11887383B2 (en) | 2019-03-31 | 2024-01-30 | Affectiva, Inc. | Vehicle interior object management |
US11887352B2 (en) | 2010-06-07 | 2024-01-30 | Affectiva, Inc. | Live streaming analytics within a shared digital environment |
US11935281B2 (en) | 2010-06-07 | 2024-03-19 | Affectiva, Inc. | Vehicular in-cabin facial tracking using machine learning |
Citations (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5774591A (en) | 1995-12-15 | 1998-06-30 | Xerox Corporation | Apparatus and method for recognizing facial expressions and facial gestures in a sequence of images |
US5797046A (en) | 1994-03-23 | 1998-08-18 | Canon Kabushiki Kaisha | Visual axis controllable optical apparatus including a visual axis detecting device for detecting a visual axis |
US5818954A (en) | 1988-07-14 | 1998-10-06 | Atr Communication Systems Research Laboratories | Method of detecting eye fixation using image processing |
US6072496A (en) | 1998-06-08 | 2000-06-06 | Microsoft Corporation | Method and system for capturing and representing 3D geometry, color and shading of facial expressions and other animated objects |
US6154559A (en) | 1998-10-01 | 2000-11-28 | Mitsubishi Electric Information Technology Center America, Inc. (Ita) | System for classifying an individual's gaze direction |
US6246779B1 (en) | 1997-12-12 | 2001-06-12 | Kabushiki Kaisha Toshiba | Gaze position detection apparatus and method |
US20030032890A1 (en) | 2001-07-12 | 2003-02-13 | Hazlett Richard L. | Continuous emotional response analysis with facial EMG |
US20030123754A1 (en) * | 2001-12-31 | 2003-07-03 | Microsoft Corporation | Machine vision system and method for estimating and tracking facial pose |
US20030156304A1 (en) | 2002-02-19 | 2003-08-21 | Eastman Kodak Company | Method for providing affective information in an imaging system |
US20050073136A1 (en) | 2002-10-15 | 2005-04-07 | Volvo Technology Corporation | Method and arrangement for interpreting a subjects head and eye activity |
US6879709B2 (en) | 2002-01-17 | 2005-04-12 | International Business Machines Corporation | System and method for automatically detecting neutral expressionless faces in digital images |
US7043056B2 (en) | 2000-07-24 | 2006-05-09 | Seeing Machines Pty Ltd | Facial image processing system |
US7046924B2 (en) | 2002-11-25 | 2006-05-16 | Eastman Kodak Company | Method and computer program product for determining an area of importance in an image using eye monitoring information |
US20060206371A1 (en) * | 2001-09-07 | 2006-09-14 | Hill Daniel A | Method of facial coding monitoring for the purpose of gauging the impact and appeal of commercially-related stimuli |
US7120880B1 (en) | 1999-02-25 | 2006-10-10 | International Business Machines Corporation | Method and system for real-time determination of a subject's interest level to media content |
US7197165B2 (en) | 2002-02-04 | 2007-03-27 | Canon Kabushiki Kaisha | Eye tracking using image data |
US20070094172A1 (en) | 2005-07-22 | 2007-04-26 | Thaler Stephen L | Neural network based rating system |
US7233684B2 (en) | 2002-11-25 | 2007-06-19 | Eastman Kodak Company | Imaging method and system using affective information |
US20070265507A1 (en) | 2006-03-13 | 2007-11-15 | Imotions Emotion Technology Aps | Visual attention and emotional response detection and display system |
US20080068397A1 (en) * | 2006-09-14 | 2008-03-20 | Carey James E | Emotion-Based Digital Video Alteration |
-
2008
- 2008-12-30 US US12/317,917 patent/US8401248B1/en active Active
Patent Citations (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5818954A (en) | 1988-07-14 | 1998-10-06 | Atr Communication Systems Research Laboratories | Method of detecting eye fixation using image processing |
US5797046A (en) | 1994-03-23 | 1998-08-18 | Canon Kabushiki Kaisha | Visual axis controllable optical apparatus including a visual axis detecting device for detecting a visual axis |
US5774591A (en) | 1995-12-15 | 1998-06-30 | Xerox Corporation | Apparatus and method for recognizing facial expressions and facial gestures in a sequence of images |
US6246779B1 (en) | 1997-12-12 | 2001-06-12 | Kabushiki Kaisha Toshiba | Gaze position detection apparatus and method |
US6072496A (en) | 1998-06-08 | 2000-06-06 | Microsoft Corporation | Method and system for capturing and representing 3D geometry, color and shading of facial expressions and other animated objects |
US6154559A (en) | 1998-10-01 | 2000-11-28 | Mitsubishi Electric Information Technology Center America, Inc. (Ita) | System for classifying an individual's gaze direction |
US7120880B1 (en) | 1999-02-25 | 2006-10-10 | International Business Machines Corporation | Method and system for real-time determination of a subject's interest level to media content |
US7043056B2 (en) | 2000-07-24 | 2006-05-09 | Seeing Machines Pty Ltd | Facial image processing system |
US20030032890A1 (en) | 2001-07-12 | 2003-02-13 | Hazlett Richard L. | Continuous emotional response analysis with facial EMG |
US20060206371A1 (en) * | 2001-09-07 | 2006-09-14 | Hill Daniel A | Method of facial coding monitoring for the purpose of gauging the impact and appeal of commercially-related stimuli |
US7113916B1 (en) | 2001-09-07 | 2006-09-26 | Hill Daniel A | Method of facial coding monitoring for the purpose of gauging the impact and appeal of commercially-related stimuli |
US20030123754A1 (en) * | 2001-12-31 | 2003-07-03 | Microsoft Corporation | Machine vision system and method for estimating and tracking facial pose |
US6879709B2 (en) | 2002-01-17 | 2005-04-12 | International Business Machines Corporation | System and method for automatically detecting neutral expressionless faces in digital images |
US7197165B2 (en) | 2002-02-04 | 2007-03-27 | Canon Kabushiki Kaisha | Eye tracking using image data |
US20030156304A1 (en) | 2002-02-19 | 2003-08-21 | Eastman Kodak Company | Method for providing affective information in an imaging system |
US20050073136A1 (en) | 2002-10-15 | 2005-04-07 | Volvo Technology Corporation | Method and arrangement for interpreting a subjects head and eye activity |
US7046924B2 (en) | 2002-11-25 | 2006-05-16 | Eastman Kodak Company | Method and computer program product for determining an area of importance in an image using eye monitoring information |
US7233684B2 (en) | 2002-11-25 | 2007-06-19 | Eastman Kodak Company | Imaging method and system using affective information |
US20070094172A1 (en) | 2005-07-22 | 2007-04-26 | Thaler Stephen L | Neural network based rating system |
US20070265507A1 (en) | 2006-03-13 | 2007-11-15 | Imotions Emotion Technology Aps | Visual attention and emotional response detection and display system |
US20080068397A1 (en) * | 2006-09-14 | 2008-03-20 | Carey James E | Emotion-Based Digital Video Alteration |
Non-Patent Citations (4)
Title |
---|
M. S. Bartlett, et al., "Measuring facial expressions by computer image analysis," Psychophysiology, Mar. 1999; 36(2):253-263. |
M. Yeasin, et al., "Recognition of facial expressions and measurement of levels of interest from video," IEEE Transactions on Multimedia, Jun. 2006, 8(3):500-508. |
Y. Zhang, et al., "Active and dynamic information fusion for facial expression understanding from image sequences," IEEE Transactions on Pattern Analysis and Machine Intelligence, May 2005; 27(5):699-714. |
Y-L. Tian, et al., "Recognizing action units for facial expression analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Feb. 2001; 23(2):97-115. |
Cited By (194)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100208051A1 (en) * | 2009-02-13 | 2010-08-19 | Shingo Tsurumi | Information processing apparatus and information processing method |
US8659649B2 (en) * | 2009-02-13 | 2014-02-25 | Sony Corporation | Information processing apparatus and information processing method |
US20120230545A1 (en) * | 2009-11-30 | 2012-09-13 | Tong Zhang | Face Recognition Apparatus and Methods |
US8818034B2 (en) * | 2009-11-30 | 2014-08-26 | Hewlett-Packard Development Company, L.P. | Face recognition apparatus and methods |
US11151610B2 (en) | 2010-06-07 | 2021-10-19 | Affectiva, Inc. | Autonomous vehicle control using heart rate collection based on video imagery |
US11232290B2 (en) | 2010-06-07 | 2022-01-25 | Affectiva, Inc. | Image analysis using sub-sectional component evaluation to augment classifier usage |
US10796176B2 (en) | 2010-06-07 | 2020-10-06 | Affectiva, Inc. | Personal emotional profile generation for vehicle manipulation |
US10799168B2 (en) | 2010-06-07 | 2020-10-13 | Affectiva, Inc. | Individual data sharing across a social network |
US10843078B2 (en) | 2010-06-07 | 2020-11-24 | Affectiva, Inc. | Affect usage within a gaming context |
US20130102854A1 (en) * | 2010-06-07 | 2013-04-25 | Affectiva, Inc. | Mental state evaluation learning for advertising |
US10628741B2 (en) | 2010-06-07 | 2020-04-21 | Affectiva, Inc. | Multimodal machine learning for emotion metrics |
US10627817B2 (en) | 2010-06-07 | 2020-04-21 | Affectiva, Inc. | Vehicle manipulation using occupant image analysis |
US10867197B2 (en) | 2010-06-07 | 2020-12-15 | Affectiva, Inc. | Drowsiness mental state analysis using blink rate |
US20140016860A1 (en) * | 2010-06-07 | 2014-01-16 | Affectiva, Inc. | Facial analysis to detect asymmetric expressions |
US10614289B2 (en) | 2010-06-07 | 2020-04-07 | Affectiva, Inc. | Facial tracking with classifiers |
US11587357B2 (en) | 2010-06-07 | 2023-02-21 | Affectiva, Inc. | Vehicular cognitive data collection with multiple devices |
US10869626B2 (en) | 2010-06-07 | 2020-12-22 | Affectiva, Inc. | Image analysis for emotional metric evaluation |
US20140058828A1 (en) * | 2010-06-07 | 2014-02-27 | Affectiva, Inc. | Optimizing media based on mental state analysis |
US10573313B2 (en) | 2010-06-07 | 2020-02-25 | Affectiva, Inc. | Audio analysis learning with video data |
US10517521B2 (en) | 2010-06-07 | 2019-12-31 | Affectiva, Inc. | Mental state mood analysis using heart rate collection based on video imagery |
US10897650B2 (en) | 2010-06-07 | 2021-01-19 | Affectiva, Inc. | Vehicle content recommendation using cognitive states |
US10474875B2 (en) | 2010-06-07 | 2019-11-12 | Affectiva, Inc. | Image analysis using a semiconductor processor for facial evaluation |
US10401860B2 (en) | 2010-06-07 | 2019-09-03 | Affectiva, Inc. | Image analysis for two-sided data hub |
US10911829B2 (en) | 2010-06-07 | 2021-02-02 | Affectiva, Inc. | Vehicle video recommendation via affect |
US11511757B2 (en) | 2010-06-07 | 2022-11-29 | Affectiva, Inc. | Vehicle manipulation with crowdsourcing |
US10922567B2 (en) | 2010-06-07 | 2021-02-16 | Affectiva, Inc. | Cognitive state based vehicle manipulation using near-infrared image processing |
US11017250B2 (en) | 2010-06-07 | 2021-05-25 | Affectiva, Inc. | Vehicle manipulation using convolutional image processing |
US11056225B2 (en) | 2010-06-07 | 2021-07-06 | Affectiva, Inc. | Analytics for livestreaming based on image analysis within a shared digital environment |
US11067405B2 (en) | 2010-06-07 | 2021-07-20 | Affectiva, Inc. | Cognitive state vehicle navigation based on image processing |
US20150206000A1 (en) * | 2010-06-07 | 2015-07-23 | Affectiva, Inc. | Background analysis of mental state expressions |
US11073899B2 (en) | 2010-06-07 | 2021-07-27 | Affectiva, Inc. | Multidevice multimodal emotion services monitoring |
US10289898B2 (en) | 2010-06-07 | 2019-05-14 | Affectiva, Inc. | Video recommendation via affect |
US10779761B2 (en) | 2010-06-07 | 2020-09-22 | Affectiva, Inc. | Sporadic collection of affect data within a vehicle |
US11935281B2 (en) | 2010-06-07 | 2024-03-19 | Affectiva, Inc. | Vehicular in-cabin facial tracking using machine learning |
US11657288B2 (en) | 2010-06-07 | 2023-05-23 | Affectiva, Inc. | Convolutional computing using multilayered analysis engine |
US11887352B2 (en) | 2010-06-07 | 2024-01-30 | Affectiva, Inc. | Live streaming analytics within a shared digital environment |
US10204625B2 (en) | 2010-06-07 | 2019-02-12 | Affectiva, Inc. | Audio analysis learning using video data |
US9204836B2 (en) | 2010-06-07 | 2015-12-08 | Affectiva, Inc. | Sporadic collection of mobile affect data |
US20190034706A1 (en) * | 2010-06-07 | 2019-01-31 | Affectiva, Inc. | Facial tracking with classifiers for query evaluation |
US10143414B2 (en) | 2010-06-07 | 2018-12-04 | Affectiva, Inc. | Sporadic collection with mobile affect data |
US10111611B2 (en) | 2010-06-07 | 2018-10-30 | Affectiva, Inc. | Personal emotional profile generation |
US9247903B2 (en) | 2010-06-07 | 2016-02-02 | Affectiva, Inc. | Using affect within a gaming context |
US11318949B2 (en) | 2010-06-07 | 2022-05-03 | Affectiva, Inc. | In-vehicle drowsiness analysis using blink rate |
US11393133B2 (en) | 2010-06-07 | 2022-07-19 | Affectiva, Inc. | Emoji manipulation using machine learning |
US10108852B2 (en) * | 2010-06-07 | 2018-10-23 | Affectiva, Inc. | Facial analysis to detect asymmetric expressions |
US10074024B2 (en) | 2010-06-07 | 2018-09-11 | Affectiva, Inc. | Mental state analysis using blink rate for vehicles |
US11410438B2 (en) | 2010-06-07 | 2022-08-09 | Affectiva, Inc. | Image analysis using a semiconductor processor for facial evaluation in vehicles |
US11430561B2 (en) | 2010-06-07 | 2022-08-30 | Affectiva, Inc. | Remote computing analysis for cognitive state data metrics |
US11430260B2 (en) | 2010-06-07 | 2022-08-30 | Affectiva, Inc. | Electronic display viewing verification |
US9959549B2 (en) | 2010-06-07 | 2018-05-01 | Affectiva, Inc. | Mental state analysis for norm generation |
US9503786B2 (en) | 2010-06-07 | 2016-11-22 | Affectiva, Inc. | Video recommendation using affect |
US11704574B2 (en) | 2010-06-07 | 2023-07-18 | Affectiva, Inc. | Multimodal machine learning for vehicle manipulation |
US11700420B2 (en) | 2010-06-07 | 2023-07-11 | Affectiva, Inc. | Media manipulation using cognitive state metric analysis |
US9934425B2 (en) | 2010-06-07 | 2018-04-03 | Affectiva, Inc. | Collection of affect data from multiple mobile devices |
US9646046B2 (en) | 2010-06-07 | 2017-05-09 | Affectiva, Inc. | Mental state data tagging for data collected from multiple sources |
US9642536B2 (en) | 2010-06-07 | 2017-05-09 | Affectiva, Inc. | Mental state analysis using heart rate collection based on video imagery |
US11292477B2 (en) | 2010-06-07 | 2022-04-05 | Affectiva, Inc. | Vehicle manipulation using cognitive state engineering |
US10592757B2 (en) | 2010-06-07 | 2020-03-17 | Affectiva, Inc. | Vehicular cognitive data collection using multiple devices |
US11465640B2 (en) | 2010-06-07 | 2022-10-11 | Affectiva, Inc. | Directed control transfer for autonomous vehicles |
US11484685B2 (en) | 2010-06-07 | 2022-11-01 | Affectiva, Inc. | Robotic control using profiles |
US9723992B2 (en) | 2010-06-07 | 2017-08-08 | Affectiva, Inc. | Mental state analysis using blink rate |
US8761459B2 (en) * | 2010-08-06 | 2014-06-24 | Canon Kabushiki Kaisha | Estimating gaze direction |
US20120033853A1 (en) * | 2010-08-06 | 2012-02-09 | Canon Kabushiki Kaisha | Information processing apparatus, information processing method, and storage medium |
US8879854B2 (en) * | 2010-10-21 | 2014-11-04 | Samsung Electronics Co., Ltd | Method and apparatus for recognizing an emotion of an individual based on facial action units |
US20120101735A1 (en) * | 2010-10-21 | 2012-04-26 | Samsung Electronics Co., Ltd. | Method and apparatus for recognizing an emotion of an individual based on facial action units |
US11330012B2 (en) * | 2010-11-29 | 2022-05-10 | Biocatch Ltd. | System, method, and device of authenticating a user based on selfie image or selfie video |
US10380647B2 (en) * | 2010-12-20 | 2019-08-13 | Excalibur Ip, Llc | Selection and/or modification of a portion of online content based on an emotional state of a user |
US20120194504A1 (en) * | 2011-01-28 | 2012-08-02 | Honeywell International Inc. | Rendering-based landmark localization from 3d range images |
US8682041B2 (en) * | 2011-01-28 | 2014-03-25 | Honeywell International Inc. | Rendering-based landmark localization from 3D range images |
US9106958B2 (en) | 2011-02-27 | 2015-08-11 | Affectiva, Inc. | Video recommendation based on affect |
US9245199B2 (en) * | 2011-04-25 | 2016-01-26 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
US20120269392A1 (en) * | 2011-04-25 | 2012-10-25 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
US9183509B2 (en) * | 2011-05-11 | 2015-11-10 | Ari M. Frank | Database of affective response and attention levels |
US20120290511A1 (en) * | 2011-05-11 | 2012-11-15 | Affectivon Ltd. | Database of affective response and attention levels |
US8885877B2 (en) * | 2011-05-20 | 2014-11-11 | Eyefluence, Inc. | Systems and methods for identifying gaze tracking scene reference locations |
US9405365B2 (en) * | 2011-05-20 | 2016-08-02 | Eyefluence, Inc. | Systems and methods for identifying gaze tracking scene reference locations |
US20150169050A1 (en) * | 2011-05-20 | 2015-06-18 | Eyefluence, Inc. | Systems and methods for identifying gaze tracking scene reference locations |
US20120294478A1 (en) * | 2011-05-20 | 2012-11-22 | Eye-Com Corporation | Systems and methods for identifying gaze tracking scene reference locations |
US9442565B2 (en) * | 2011-08-24 | 2016-09-13 | The United States Of America, As Represented By The Secretary Of The Navy | System and method for determining distracting features in a visual display |
US20130050268A1 (en) * | 2011-08-24 | 2013-02-28 | Maura C. Lohrenz | System and method for determining distracting features in a visual display |
US20160191995A1 (en) * | 2011-09-30 | 2016-06-30 | Affectiva, Inc. | Image analysis for attendance query evaluation |
US20130151333A1 (en) * | 2011-12-07 | 2013-06-13 | Affectiva, Inc. | Affect based evaluation of advertisement effectiveness |
US20130235073A1 (en) * | 2012-03-09 | 2013-09-12 | International Business Machines Corporation | Automatically modifying presentation of mobile-device content |
US8619095B2 (en) * | 2012-03-09 | 2013-12-31 | International Business Machines Corporation | Automatically modifying presentation of mobile-device content |
US8638344B2 (en) * | 2012-03-09 | 2014-01-28 | International Business Machines Corporation | Automatically modifying presentation of mobile-device content |
US20140047316A1 (en) * | 2012-08-10 | 2014-02-13 | Vimbli, Inc. | Method and system to create a personal priority graph |
US20140315168A1 (en) * | 2013-02-12 | 2014-10-23 | Emotient | Facial expression measurement for assessment, monitoring, and treatment evaluation of affective and neurological disorders |
US20140242560A1 (en) * | 2013-02-15 | 2014-08-28 | Emotient | Facial expression training using feedback from automatic facial expression recognition |
EP3011522A1 (en) * | 2013-06-21 | 2016-04-27 | Sony Corporation | Information processing system, method and non-transitory computer-readable medium |
US20150020086A1 (en) * | 2013-07-11 | 2015-01-15 | Samsung Electronics Co., Ltd. | Systems and methods for obtaining user feedback to media content |
US9104907B2 (en) * | 2013-07-17 | 2015-08-11 | Emotient, Inc. | Head-pose invariant recognition of facial expressions |
US20150324632A1 (en) * | 2013-07-17 | 2015-11-12 | Emotient, Inc. | Head-pose invariant recognition of facial attributes |
US9852327B2 (en) | 2013-07-17 | 2017-12-26 | Emotient, Inc. | Head-pose invariant recognition of facial attributes |
US20150023603A1 (en) * | 2013-07-17 | 2015-01-22 | Machine Perception Technologies Inc. | Head-pose invariant recognition of facial expressions |
US9547808B2 (en) * | 2013-07-17 | 2017-01-17 | Emotient, Inc. | Head-pose invariant recognition of facial attributes |
US9934426B2 (en) * | 2013-09-27 | 2018-04-03 | Korea University Research And Business Foundation | System and method for inspecting emotion recognition capability using multisensory information, and system and method for training emotion recognition using multisensory information |
US20160217322A1 (en) * | 2013-09-27 | 2016-07-28 | Korea University Research And Business Foundation | System and method for inspecting emotion recognition capability using multisensory information, and system and method for training emotion recognition using multisensory information |
US9426538B2 (en) | 2013-11-20 | 2016-08-23 | At&T Intellectual Property I, Lp | Method and apparatus for presenting advertising in content having an emotional context |
US10887666B2 (en) | 2013-11-20 | 2021-01-05 | At&T Intellectual Property I, L.P. | Device, method and machine-readable storage medium for presenting advertising related to emotional context of received content |
US10194214B2 (en) | 2013-11-20 | 2019-01-29 | At&T Intellectual Property I, L.P. | Device, method and machine-readable storage medium for presenting advertising related to emotional context of received content |
US20150193889A1 (en) * | 2014-01-09 | 2015-07-09 | Adobe Systems Incorporated | Digital content publishing guidance based on trending emotions |
US9460368B2 (en) * | 2014-01-23 | 2016-10-04 | Samsung Electronics Co., Ltd. | Method of learning a parameter to estimate posture of an articulated object and method of estimating posture of an articulated object |
US20150206032A1 (en) * | 2014-01-23 | 2015-07-23 | Samsung Electronics Co., Ltd. | Method of learning a parameter to estimate posture of an articulated object and method of estimating posture of an articulated object |
US10796341B2 (en) | 2014-03-11 | 2020-10-06 | Realeyes Oü | Method of generating web-based advertising inventory and targeting web-based advertisements |
US10354261B2 (en) * | 2014-04-16 | 2019-07-16 | 2020 Ip Llc | Systems and methods for virtual environment construction for behavioral research |
US10600066B2 (en) * | 2014-04-16 | 2020-03-24 | 20/20 Ip, Llc | Systems and methods for virtual environment construction for behavioral research |
US11295114B2 (en) * | 2014-04-28 | 2022-04-05 | Microsoft Technology Licensing, Llc | Creation of representative content based on facial analysis |
US11430256B2 (en) | 2014-04-29 | 2022-08-30 | Microsoft Technology Licensing, Llc | Image scoring and identification based on facial feature descriptors |
JP2016001447A (en) * | 2014-06-12 | 2016-01-07 | キヤノン株式会社 | Image recognition system, image recognition device, image recognition method and computer program |
US20150362989A1 (en) * | 2014-06-17 | 2015-12-17 | Amazon Technologies, Inc. | Dynamic template selection for object detection and tracking |
US9671862B2 (en) * | 2014-10-15 | 2017-06-06 | Wipro Limited | System and method for recommending content to a user based on user's interest |
US20160109941A1 (en) * | 2014-10-15 | 2016-04-21 | Wipro Limited | System and method for recommending content to a user based on user's interest |
US10506285B2 (en) | 2015-03-02 | 2019-12-10 | The Nielsen Company (Us), Llc | Method and apparatus to count people |
US9986289B2 (en) * | 2015-03-02 | 2018-05-29 | The Nielsen Company (Us), Llc | Methods and apparatus to count people |
US10827218B2 (en) | 2015-03-02 | 2020-11-03 | The Nielsen Company (Us), Llc | Methods and apparatus to count people |
US11303960B2 (en) | 2015-03-02 | 2022-04-12 | The Nielsen Company (Us), Llc | Methods and apparatus to count people |
US11558665B2 (en) | 2015-03-02 | 2023-01-17 | The Nielsen Company (Us), Llc | Methods and apparatus to count people |
US10114127B2 (en) * | 2015-05-11 | 2018-10-30 | The United States Of America, As Represented By The Secretary Of The Navy | Augmented reality visualization system |
US20160379414A1 (en) * | 2015-05-11 | 2016-12-29 | The United States Of America As Represented By The Secretary Of The Navy | Augmented reality visualization system |
CN105045115B (en) * | 2015-05-29 | 2018-08-07 | 四川长虹电器股份有限公司 | A kind of control method and smart home device |
CN105045115A (en) * | 2015-05-29 | 2015-11-11 | 四川长虹电器股份有限公司 | Control method and intelligent household equipment |
EP3115956A1 (en) * | 2015-07-09 | 2017-01-11 | Fujitsu Limited | Interest degree determination device, interest degree determination method, and interest degree determination program |
US10395101B2 (en) | 2015-07-09 | 2019-08-27 | Fujitsu Limited | Interest degree determination device, interest Degree determination method, and non-transitory computer-readable recording medium |
CN104992453A (en) * | 2015-07-14 | 2015-10-21 | 国家电网公司 | Target tracking method under complicated background based on extreme learning machine |
CN104992453B (en) * | 2015-07-14 | 2018-10-23 | 国家电网公司 | Target in complex environment tracking based on extreme learning machine |
US11275431B2 (en) * | 2015-10-08 | 2022-03-15 | Panasonic Intellectual Property Corporation Of America | Information presenting apparatus and control method therefor |
US11623516B2 (en) | 2015-11-13 | 2023-04-11 | Bayerische Motoren Werke Aktiengesellschaft | Device and method for controlling a display device in a motor vehicle |
DE102015222388A1 (en) | 2015-11-13 | 2017-05-18 | Bayerische Motoren Werke Aktiengesellschaft | Device and method for controlling a display device in a motor vehicle |
WO2017080788A2 (en) | 2015-11-13 | 2017-05-18 | Bayerische Motoren Werke Aktiengesellschaft | Device and method for controlling a display device in a motor vehicle |
US10025972B2 (en) * | 2015-11-16 | 2018-07-17 | Facebook, Inc. | Systems and methods for dynamically generating emojis based on image analysis of facial features |
US20170140214A1 (en) * | 2015-11-16 | 2017-05-18 | Facebook, Inc. | Systems and methods for dynamically generating emojis based on image analysis of facial features |
US11354683B1 (en) | 2015-12-30 | 2022-06-07 | Videomining Corporation | Method and system for creating anonymous shopper panel using multi-modal sensor fusion |
US10262331B1 (en) | 2016-01-29 | 2019-04-16 | Videomining Corporation | Cross-channel in-store shopper behavior analysis |
US10320938B2 (en) | 2016-02-02 | 2019-06-11 | International Business Machines Corporation | Monitoring and maintaining social group cohesiveness |
US10868999B2 (en) | 2016-02-03 | 2020-12-15 | Hewlett-Packard Development Company, L.P. | Eye gaze angle feedback in a remote meeting |
US10963893B1 (en) | 2016-02-23 | 2021-03-30 | Videomining Corporation | Personalized decision tree based on in-store behavior analysis |
US10387896B1 (en) | 2016-04-27 | 2019-08-20 | Videomining Corporation | At-shelf brand strength tracking and decision analytics |
US20170330038A1 (en) * | 2016-05-13 | 2017-11-16 | Canon Kabushiki Kaisha | Method, system and apparatus for selecting a video frame |
US10372994B2 (en) * | 2016-05-13 | 2019-08-06 | Canon Kabushiki Kaisha | Method, system and apparatus for selecting a video frame |
US10354262B1 (en) | 2016-06-02 | 2019-07-16 | Videomining Corporation | Brand-switching analysis using longitudinal tracking of at-shelf shopper behavior |
WO2017216758A1 (en) * | 2016-06-15 | 2017-12-21 | Hau Stephan | Computer-based micro-expression analysis |
US11707216B2 (en) * | 2016-07-21 | 2023-07-25 | Comcast Cable Communications, Llc | Recommendations based on biometric feedback from wearable device |
US10546586B2 (en) | 2016-09-07 | 2020-01-28 | International Business Machines Corporation | Conversation path rerouting in a dialog system based on user sentiment |
US20180308180A1 (en) * | 2016-10-30 | 2018-10-25 | B.Z.W Ltd. | Systems Methods Devices Circuits and Computer Executable Code for Impression Measurement and Evaluation |
US10878593B2 (en) * | 2016-12-15 | 2020-12-29 | Tencent Technology (Shenzhen) Company Limited | Pupil localizing method and system |
US11443460B2 (en) | 2016-12-22 | 2022-09-13 | Meta Platforms, Inc. | Dynamic mask application |
US20180182141A1 (en) * | 2016-12-22 | 2018-06-28 | Facebook, Inc. | Dynamic mask application |
US10636175B2 (en) * | 2016-12-22 | 2020-04-28 | Facebook, Inc. | Dynamic mask application |
US10482333B1 (en) | 2017-01-04 | 2019-11-19 | Affectiva, Inc. | Mental state analysis using blink rate within vehicles |
EP3548996A4 (en) * | 2017-01-19 | 2020-07-15 | Hewlett-Packard Development Company, L.P. | Eye gaze angle feedback in a remote meeting |
US11068751B2 (en) * | 2017-03-21 | 2021-07-20 | Nec Corporation | Image processing device, image processing method, and storage medium |
US11227307B2 (en) | 2017-03-21 | 2022-01-18 | Kellogg Company | Media content tracking of users' gazing at screens |
US10922566B2 (en) | 2017-05-09 | 2021-02-16 | Affectiva, Inc. | Cognitive state evaluation for vehicle navigation |
US11295176B2 (en) | 2017-07-01 | 2022-04-05 | Algolux Inc. | System and method for joint image refinement and perception |
US11790272B2 (en) | 2017-07-01 | 2023-10-17 | Torc Cnd Robotics, Inc. | System and method for end-to-end-differentiable joint image refinement and perception |
US11783231B2 (en) | 2017-07-01 | 2023-10-10 | Torc Cnd Robotics, Inc. | System and method for joint image refinement and perception |
US20190005360A1 (en) * | 2017-07-01 | 2019-01-03 | Algolux Inc. | Method and apparatus for joint image processing and perception |
US11809975B2 (en) | 2017-07-01 | 2023-11-07 | Torc Cnd Robotics, Inc. | System and method for end-to-end-differentiable joint image refinement and perception |
US10713537B2 (en) * | 2017-07-01 | 2020-07-14 | Algolux Inc. | Method and apparatus for joint image processing and perception |
US10380413B2 (en) * | 2017-07-13 | 2019-08-13 | Robert Bosch Gmbh | System and method for pose-invariant face alignment |
US10593087B2 (en) * | 2017-10-23 | 2020-03-17 | Paypal, Inc. | System and method for generating emoji mashups with machine learning |
US11783113B2 (en) | 2017-10-23 | 2023-10-10 | Paypal, Inc. | System and method for generating emoji mashups with machine learning |
US11423596B2 (en) | 2017-10-23 | 2022-08-23 | Paypal, Inc. | System and method for generating emoji mashups with machine learning |
US20190122403A1 (en) * | 2017-10-23 | 2019-04-25 | Paypal, Inc. | System and method for generating emoji mashups with machine learning |
US11164105B2 (en) | 2017-11-13 | 2021-11-02 | International Business Machines Corporation | Intelligent recommendations implemented by modelling user profile through deep learning of multimodal user data |
US10628985B2 (en) | 2017-12-01 | 2020-04-21 | Affectiva, Inc. | Avatar image animation using translation vectors |
US11182597B2 (en) * | 2018-01-19 | 2021-11-23 | Board Of Regents, The University Of Texas Systems | Systems and methods for evaluating individual, group, and crowd emotion engagement and attention |
CN113016190B (en) * | 2018-10-01 | 2023-06-13 | 杜比实验室特许公司 | Authoring intent extensibility via physiological monitoring |
CN113016190A (en) * | 2018-10-01 | 2021-06-22 | 杜比实验室特许公司 | Authoring intent extensibility via physiological monitoring |
US11678014B2 (en) | 2018-10-01 | 2023-06-13 | Dolby Laboratories Licensing Corporation | Creative intent scalability via physiological monitoring |
CN109685831B (en) * | 2018-12-20 | 2020-08-25 | 山东大学 | Target tracking method and system based on residual layered attention and correlation filter |
CN109685831A (en) * | 2018-12-20 | 2019-04-26 | 山东大学 | Method for tracking target and system based on residual error layering attention and correlation filter |
US11887383B2 (en) | 2019-03-31 | 2024-01-30 | Affectiva, Inc. | Vehicle interior object management |
US11823055B2 (en) | 2019-03-31 | 2023-11-21 | Affectiva, Inc. | Vehicular in-cabin sensing using machine learning |
CN113924542A (en) * | 2019-06-14 | 2022-01-11 | 惠普发展公司, 有限责任合伙企业 | Headset signal for determining emotional state |
US20220139108A1 (en) * | 2019-10-25 | 2022-05-05 | Adobe Inc. | Classification of subjects within a digital image |
US11657649B2 (en) * | 2019-10-25 | 2023-05-23 | Adobe Inc. | Classification of subjects within a digital image |
WO2021085231A1 (en) * | 2019-10-30 | 2021-05-06 | 株式会社島津製作所 | Emotion estimation method and emotion estimation system |
JPWO2021085231A1 (en) * | 2019-10-30 | 2021-05-06 | ||
CN112989914A (en) * | 2019-12-16 | 2021-06-18 | 辉达公司 | Gaze-determining machine learning system with adaptive weighted input |
US11769056B2 (en) | 2019-12-30 | 2023-09-26 | Affectiva, Inc. | Synthetic data for neural network training using vectors |
US20210343201A1 (en) * | 2020-05-01 | 2021-11-04 | AWL, Inc. | Signage control system and non-transitory computer-readable recording medium for recording signage control program |
US11682037B2 (en) * | 2020-05-01 | 2023-06-20 | AWL, Inc. | Signage control system and non-transitory computer-readable recording medium for recording signage control program |
WO2021151290A1 (en) * | 2020-07-30 | 2021-08-05 | 平安科技(深圳)有限公司 | Facial information identification and monitoring method and apparatus based on machine learning |
US11604511B2 (en) | 2020-11-14 | 2023-03-14 | Facense Ltd. | Robust photosensor-based facial expression detector |
CN113052064A (en) * | 2021-03-23 | 2021-06-29 | 北京思图场景数据科技服务有限公司 | Attention detection method based on face orientation, facial expression and pupil tracking |
CN113052064B (en) * | 2021-03-23 | 2024-04-02 | 北京思图场景数据科技服务有限公司 | Attention detection method based on face orientation, facial expression and pupil tracking |
CN112819863A (en) * | 2021-04-16 | 2021-05-18 | 北京万里红科技股份有限公司 | Snapshot target tracking method and computing device in remote iris recognition |
CN112819863B (en) * | 2021-04-16 | 2021-08-03 | 北京万里红科技股份有限公司 | Snapshot target tracking method and computing device in remote iris recognition |
US20220383338A1 (en) * | 2021-05-27 | 2022-12-01 | International Business Machines Corporation | Dynamic presenter feedback in multiuser content delivery systems |
US11785064B2 (en) | 2021-05-27 | 2023-10-10 | International Business Machines Corporation | Individual user content control in multiuser content delivery systems |
US20230360079A1 (en) * | 2022-01-18 | 2023-11-09 | e-con Systems India Private Limited | Gaze estimation system and method thereof |
EP4213105A1 (en) | 2022-01-18 | 2023-07-19 | E-Con Systems India Private Limited | Gaze estimation system and method thereof |
US20230290109A1 (en) * | 2022-03-14 | 2023-09-14 | Disney Enterprises, Inc. | Behavior-based computer vision model for content selection |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8401248B1 (en) | Method and system for measuring emotional and attentional response to dynamic digital media content | |
US8462996B2 (en) | Method and system for measuring human response to visual stimulus based on changes in facial expression | |
US8219438B1 (en) | Method and system for measuring shopper response to products based on behavior and facial expression | |
Ben-Shabat et al. | The ikea asm dataset: Understanding people assembling furniture through actions, objects and pose | |
Shreve et al. | Macro-and micro-expression spotting in long videos using spatio-temporal strain | |
US7742623B1 (en) | Method and system for estimating gaze target, gaze sequence, and gaze map from video | |
Liciotti et al. | Person re-identification dataset with rgb-d camera in a top-view configuration | |
US7848548B1 (en) | Method and system for robust demographic classification using pose independent model from sequence of face images | |
CN105809144B (en) | A kind of gesture recognition system and method using movement cutting | |
CN110837784B (en) | Examination room peeping and cheating detection system based on human head characteristics | |
US8254633B1 (en) | Method and system for finding correspondence between face camera views and behavior camera views | |
Schwarz et al. | Manifold learning for tof-based human body tracking and activity recognition. | |
CN103677274B (en) | A kind of interaction method and system based on active vision | |
Shreve et al. | Automatic expression spotting in videos | |
Irani et al. | Thermal super-pixels for bimodal stress recognition | |
Arigbabu et al. | Integration of multiple soft biometrics for human identification | |
Eweiwi et al. | Temporal key poses for human action recognition | |
Vishwakarma et al. | A proposed unified framework for the recognition of human activity by exploiting the characteristics of action dynamics | |
Gerke et al. | Soccer player recognition using spatial constellation features and jersey number recognition | |
Marcos-Ramiro et al. | Body communicative cue extraction for conversational analysis | |
Tong et al. | Automatic player labeling, tracking and field registration and trajectory mapping in broadcast soccer video | |
Yan et al. | Measuring dynamic micro-expressions via feature extraction methods | |
Pala et al. | Enhanced skeleton and face 3D data for person re-identification from depth cameras | |
Marcos-Ramiro et al. | Let your body speak: Communicative cue extraction on natural interaction using RGBD data | |
Holte et al. | View invariant gesture recognition using the CSEM SwissRanger SR-2 camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: VIDEOMINING CORPORATION, PENNSYLVANIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MOON, HANKYU;SHARMA, RAJEEV;JUNG, NAMSOON;SIGNING DATES FROM 20090602 TO 20090917;REEL/FRAME:024078/0377 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: 9051147 CANADA INC., CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VIDEOMINING CORPORATION;REEL/FRAME:034881/0593 Effective date: 20150116 |
|
AS | Assignment |
Owner name: HSBC BANK CANADA, CANADA Free format text: SECURITY INTEREST;ASSIGNOR:CANADA INC.;REEL/FRAME:035387/0176 Effective date: 20150407 |
|
RF | Reissue application filed |
Effective date: 20150319 |
|
RF | Reissue application filed |
Effective date: 20150319 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: AVIGILON PATENT HOLDING 1 CORPORATION, BRITISH COL Free format text: CHANGE OF NAME;ASSIGNOR:9051147 CANADA INC.;REEL/FRAME:040886/0579 Effective date: 20151120 |
|
AS | Assignment |
Owner name: AVIGILON PATENT HOLDING 1 CORPORATION, CANADA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:HSBC BANK CANADA;REEL/FRAME:046895/0803 Effective date: 20180813 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
AS | Assignment |
Owner name: MOTOROLA SOLUTIONS, INC., ILLINOIS Free format text: NUNC PRO TUNC ASSIGNMENT;ASSIGNOR:AVIGILON PATENT HOLDING 1 CORPORATION;REEL/FRAME:062034/0176 Effective date: 20220411 |