WO2010036605A1 - System for tracking human-digital media interaction - Google Patents
System for tracking human-digital media interaction Download PDFInfo
- Publication number
- WO2010036605A1 WO2010036605A1 PCT/US2009/057664 US2009057664W WO2010036605A1 WO 2010036605 A1 WO2010036605 A1 WO 2010036605A1 US 2009057664 W US2009057664 W US 2009057664W WO 2010036605 A1 WO2010036605 A1 WO 2010036605A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- computing device
- software program
- interactive software
- cognitive
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/435—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/22—Games, e.g. card games
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
Definitions
- Some example embodiments of the present invention are generally related to computer-implemented systems and methods for tracking human interaction with digital media, and more particularly to systems and methods for measuring and enhancing cognitive performance based on such interactions.
- Digital media including interactive software and accompanying hardware, has become the preferred form of communication and entertainment for many people. People log in, make phone calls, and interact with digitally-based media on a daily basis. Digital media has become the dominant mode by which people seek entertainment, communicate and gain information about the world. Many people choose to read materials hosted online instead of paper-based documents like newspapers and book. E-mail has become more popular than the postal service for letter- writing. Cell phones have replaced the ground-line phone as the preferred means of quick communication. Video games have become a mainstream entertainment medium, expanding beyond the demographic of children and young adults. So called “casual" video games, often available on mobile phones or free on the Internet, are used extensively by an older demographic of users than traditional video games. Digital video and music, which are seemingly passive experiences, are delivered and consumed via on-demand digital access and distribution.
- Figure 1 depicts an exemplary system for tracking human-digital media interaction, according to one exemplary embodiment of the present invention
- Figure 2 depicts an exemplary record storing user behavior information, according to one exemplary embodiment of the present invention
- Figure 3 depicts an exemplary record storing the user's activity history, according to one exemplary embodiment of the present invention
- Figure 4 depicts an exemplary representation of an interactive software program - cognitive task - brain area mapping, according to one exemplary embodiment of the present invention
- Figure 5 depicts an exemplary system for tracking human-digital media interaction across multiple computing devices, according to one exemplary embodiment of the present invention
- Figure 6 is a flowchart depicting an example procedure for tracking human- digital media interaction, according to one exemplary embodiment of the present invention.
- Figure 7 is a flowchart depicting an example procedure for storing and analyzing user behavior information generated from tracking human-digital media interaction, according to one exemplary embodiment of the present invention
- Figure 8 depicts an exemplary screenshot from an exemplary system for viewing analyses and recommendations based on a user's activity history, according to one exemplary embodiment of the present invention.
- the data produced by monitoring the individual's interaction with various forms of digital media across various computing devices may be aggregated and analyzed.
- the data may be analyzed in view of the cognitive tasks associated with the digital media interacted with by the user, as well as the areas of the human brain stimulated by those cognitive tasks. This may allow for the evaluation of the cognitive functions of the individual, e.g., overall cognitive health, evaluating activitiy in certain areas of the brain, improvements and declines in the performance of specific cognitive tasks, etc., and of patterns in the individual's usage of digital media, e.g., cognitive tasks the individual performs the most, cognitive tasks, and areas of the brain, the individual has neglected, etc.
- the individual may receive recommendations for other types of digital media to interact with based on the data, individualized plans for improving cognitive functions and stimulating certain brain areas, etc.
- Some example embodiments include systems and methods that can be configured and executed to track human-digital media interactions.
- One exemplary embodiment may provide a system including a database that may store information regarding a user's activity history for various different cognitive tasks, and a computing device that may receive user behavior information indicating usage by a user of an interactive software program, the interactive software program associated with at least one of the cognitive tasks. The computing device may, in response to the receipt of user behavior information indicating usage by the user of the interactive software program, update the database information regarding the user's activity history for the at least one of the cognitive tasks.
- Another exemplary embodiment may provide a system including a computing device that may execute an interactive software program configured to be used by a user and a storage device accessible to the computing device, the storage device storing data associating the interactive software program with at least one cognitive task.
- the computing device may, responsive to the user's use of the interactive software program, generate user behavior information for the user indicating the user's carrying out of the at least one of the plurality of cognitive tasks associated with the interactive software program in the data stored in the storage device.
- Figure 1 depicts an exemplary system for tracking human-digital media interaction.
- the exemplary system may include a first computing device 101 and a second computing device 102.
- a user 103 may interact with the first computing device 101. It will be appreciated that although two computing devices are illustrated in this example, the various features could be combined on a single device, e.g., using virtual machines, or spread over additional devices.
- the first computing device 101 may be any suitable combination of hardware and software to allow interaction between the user 103 and an interactive software program.
- the first computing device 101 may be a personal computer, a video game console, a mobile phone, a portable media player, a set-top box for a television, a mobile internet device, an e-book device, etc.
- the first computing device 101 may include a processor 104, an input device 105, an output device 106, and a communications device 107.
- a plug-in monitor 116, user's activity history 117, and a mapping 118, may be stored on the first computing device 101.
- An interactive software program 108 may be also be stored on the first computing device 101, or may reside on external media that can be accessed by the first computing device 101.
- the processor 104 may be any general or special purpose microprocessor, depending on the nature and uses of the first computing device 101, suitable for executing, and allowing the user 103 to interact with, the interactive software program 108.
- the processor 104 may be a general purpose processor from Intel®.
- the input device 105 may be any suitable device connected to the first computing device 101 that allows the user 103 to input data into the first computing device 101.
- the input device 105 may be a mouse, keyboard, keypad, trackball, touch- screen, haptic input device, microphone, video camera, drawing tablet, video game console controller, hard or soft key, gesture recognition hardware, etc.
- the first computing device 101 may make use of more than one input device 105, for example, a personal computer may have a mouse, a keyboard, a microphone and a video camera.
- the input device 105 may be connected to the first computing device 101 in any suitable manner, for example, using wired or wireless connections.
- the user 103 may use the input device 105 to login to the first computing device 101, using user login data 109.
- the user login data 109 may identify the individual user 103, for example, with a unique id, and may be any suitable data unique to the user 103, such as, for example, a password, a fingerprint, a voiceprint, a face-print, a hardware key, etc.
- the identity of the user 103 may be automatically tied to the device, and may require no separate user login data 109.
- the user 103 may then use the input device 105 to control the operation of the first computing device 101, including interacting with the interactive software program 108.
- the output device 106 may be any suitable device connected to the first computing device 101 that allows the user 103 to receive data output from the first computing device 101.
- the output device 101 may be an LCD screen, a CRT monitor, a television, a speaker, a force feedback device, a haptic feedback device, a series of LEDs, etc.
- the first computing device 101 may make use of more than one output device 106, for example, a personal computer may have an LCD screen and a pair of speakers.
- the output device 106 may be connected to the first computing device 101 in any suitable manner, for example, using wired or wireless connections.
- the user 103 may receive data from the first computing device 101 through the output device 106, allowing the user 103 to interact with the first computer 101, including the interactive software program 108.
- the communications device 107 may be any suitable device for allowing the first computing device 101 to send data to and receive data from any other computing device, for example, the second computing device 102.
- the communications device 107 may be an 802. Hx protocol based wireless (WiFi) card, an Ethernet device, a modem, a Bluetooth module, an IR link, etc.
- the first computing device 101 may make use of more than one communications device 107, for example, a personal computer may have a WiFi card a Bluetooth module.
- the communications device 107 may be connected to the first computing device 101 in any suitable manner, for example, using wired or wireless connections.
- the first computing device 101 may use the communications device 107 to transmit data, such as, for example, user behavior information 110, to the second computing device 102.
- the interactive software program 108 may be any suitable program, executable by the processor 104, which allows interaction by the user 103.
- the interactive software program may be stored on the first computing device 101, or may reside on external media that can be read or accessed by the first computing device 101.
- the interactive software program 108 may be a video game stored on a DVD and played on a video game console, a web-browser, a web-browser based game, a program installed on the hard drive of a personal computer including games and productivity applications, a text- messaging application or calling functionality of a mobile phone, a book reading application on an e-book, etc.
- the user 103 may interact with the interactive software 108 on the first computing device 101 using the input device 104.
- the user behavior information 110 may be generated for the user 103.
- the user behavior information 110 may be data generated by the interaction between the user 103 and the interactive software program 108. This data may include, for example: how long the user 103 used the interactive software program 108, how much of that time the user 103 was actually interacting with the interactive software program 103, e.g., actively inputting or receiving data, and how much of the time the user 103 was interacting with distinct sections or tasks within the interactive software program 103; a score achieved by the user 103; a task accomplished by the user 103; a task not accomplished by the user 103; an amount of time taken by the user 103 to perform a task; a speed of input by the user 103, e.g. typing speed; an accuracy of input by the user 103, e.g.
- Some interactions with the interactive software program 108 may be all or mostly passive, such as, for example, reading a book on an e-book device where the user 103 only interacts with the e-book to turn the page.
- Data for the user behavior information 110 may be inferred from combinations of passivity and activity for passive interactions, e.g. time spent reading a book on an e-book device may be inferred from the amount of time the book is loaded on the e-book and the frequency of page turning by the user 103.
- Figure 2 depicts an exemplary record storing user behavior information.
- the exemplary user behavior information 110 may indicate that on January 1, 2009, the user 103 interacted with an interactive software program 108 entitled Dr. Memory.
- the user 103 used a personal computer with a keyboard and a mouse, and interacted with Dr. Memory for a total of 2 hours, 35 minutes and 1 second.
- the user 103 completed 4 rounds of Dr. Memory, with scores of 400, 570, 1240, and 1100.
- the interactive software program 108 may include a monitor 115.
- the monitor 115 may be a process in the interactive software program 108 that may monitor the interaction between the user 103 and the interactive software program 108 in order to generate the user behavior information 110.
- the monitor 115 may run on the processor 104 along with video game and may track various statistics associated with the video game, such as, for example, time played, score achieved, tasks accomplished, etc.
- the interactive software program 108 may, in some cases, not include the monitor 115.
- a plug-in monitor 116 may be used to provide the features of the monitor 115.
- the plug-in monitor 116 may be a software plug-in, or specialized hardware device, residing on the first computing device 101.
- the plug-in monitor 116 may be a desktop widget or toolbar running on the first computing device 101.
- the plug-in monitor 116 may be activated by the processor 104 and used to generate the user behavior information 110.
- the plug-in monitor 116 may be used to generate the user behavior information 110 from the interaction between the user 103 and the Flash game.
- the plug-in monitor 116 may also reside on a computing device separate from the first computing device 101, such as, for example, in a cloud computing environment.
- the monitor 115 and plug-in monitor 116 may also be used in combination in some instances.
- the monitor 115 may gather some data that can be used as the user behavior information 110, and some data that is extraneous, for example, hardware and software monitoring e.g. RAM used, page faults, CPU utilization, etc.
- the plug- in monitor 116 may receive all the data produced by the monitor 115, and sort out the data for the user behavior information 110 from the extraneous data.
- the user's activity history 117 may be an aggregation of user behavior information 110 for the user 103, and may be stored on the first computing device 101. Alternatively, the raw user behavior information 110 may be stored and processed at a later time, although this may be more resource intensive. For every interactive software program 108 interacted with by the user 103, separate user behavior information 110 may be generated and stored in the user's activity history 117. If the user 103 has interacted with an interactive software program 108 on a computing device other than the first computing device 101, the user behavior information 110 for those interactions may also be stored in the user's activity history 117 on the first computing device 101 if the first computing device 101 receives, or can access, the user behavior information 110 from the other computing device.
- the user's activity history 117 may include other information along with the user behavior information 110, such as, for example, the identity of the interactive software program 108 responsible for generating each user behavior information 110, information about the interactive software program 108 taken from the mapping 118, and data that results from the processing and analysis of all or parts of the user behavior information 110.
- Figure 3 depicts an exemplary record storing the user's activity history.
- the exemplary user's activity history 117 may include the data from the user behavior information 110, as well as other user behavior information.
- the user 103 interacted with the interactive software program 108 Dr. Memory as indicated by the user behavior information 110, and again on January 7, 2009. On January 7, 2009 the user 103 interacted with Dr. Memory using a keypad on a mobile phone.
- the user 103 interacted with Dr. Memory for 21 minutes and 25 seconds, completed one round of play, and scored 1150.
- the exemplary user's activity history 117 includes a cumulative total time played for the user 103 for Dr. Memory of 2 hours, 56 minutes and 26 seconds, with an average score 892.
- the exemplary user's activity history 117 indicates that Dr.
- Memory may be associated with the cognitive task of short-term memory.
- the user 103 used a text messaging application on a mobile phone on January 3, 2009. The user 103 typed 48 words in 3 minutes and 1 second.
- the text messaging application may be associated with the motor function and language processing cognitive tasks.
- the mapping 118 may be data stored on the first computing device 101 that may map interactive software programs, such as the interactive software program 108, to cognitive tasks performed through interaction with the interactive software programs, and may further map the cognitive tasks to the areas of the human brain stimulated during the performance of the cognitive tasks.
- Cognitive tasks may include, for example, short-term memory, long-term memory, attention, motor function, visual search, computation, speed of processing, verbal memory, task- switching, decision making, inhibitory control, and visual search, etc.
- Figure 4 depicts an exemplary representation of an interactive software program - cognitive task - brain area mapping.
- the representation of the mapping 118 may include a software program column 401, a cognitive task column 402, and a brain area column 403.
- the arrows in the representation may represent the mapping of items from one of the columns to items in the other columns, creating associations. For example, the arrow between "Lost Highway” in the software program column 401 and "Computational Skills" in the cognitive task column 402 may indicate that interacting with the interactive software program 108 "Lost Highway" requires the user to perform cognitive tasks involving computation.
- the arrow between "Computational Skills" in the cognitive task column 402 and "Right Frontal Lobe" in the brain area column 403 may indicate that performing cognitive tasks involving computation may stimulate the right frontal lobe of the human brain.
- Any interactive software program 108 may be mapped to any number of cognitive tasks, and any cognitive task may be mapped to any number of brain areas. Specific sections or parts of the interactive software program 108 may also be mapped to different cognitive tasks.
- a video game may include sections of play that map to cognitive tasks for short-term memory and other sections that map to motor functions and reflexes.
- the mapping 118 may also include weights between interactive software programs 108, cognitive tasks, and areas of the brain.
- an interactive software program 108 may require performance of both short-term memory and motor function cognitive tasks, but may place more emphasis on short-term memory, resulting in a heavier weight in the mapping 118 for the connection between the interactive software program 108 and the short-term memory cognitive task. Further, different cognitive tasks may be mapped to specific tasks within the interactive software program 108, instead of to the interactive software program 108 as a whole.
- mapping 118 Based on the exemplary representation of the mapping 118 depicted in Figure 4, if the user's activity history 117 shows that the user 103 has interacted with the interactive software program 108 "Lost Highway", it may be inferred that the user has performed cognitive tasks involving computation, and that these tasks have stimulated the right frontal lobe of the brain of the user 103.
- the mapping 118 may be created by, for example, human analysis of various interactive software programs 108 for cognitive tasks. Automated tools may also be used to perform analysis of the interactive software programs 108, to create, or assist in the creation of, the mapping 118.
- the mapping 118 may also be based on data relating cognitive tasks to areas of the brain stimulated by performance of the cognitive tasks gathered using functional magnetic resonance imaging (fMRI), electroencephalography (EEG), positron emission tomography (PET), Magnetoencephalography (MEG), Event Related Optical Signal (EROS), near infrared spectroscopic imaging (NIRSI), event-related potential (ERP), Single Photon Emission Computed Tomography (SPECT), or Computed Tomography (CT).
- fMRI functional magnetic resonance imaging
- EEG electroencephalography
- PET positron emission tomography
- MEG Magnetoencephalography
- EROS Event Related Optical Signal
- NIRSI near infrared spectroscopic imaging
- ERP Single Photon E
- the second computing device 102 may be any suitable combination of hardware and software to allow for the storage and analysis of the user's activity history 114.
- the second computing device 102 may be a personal computer, a database server or server cluster, a computer on a distributed computing network, a suitable video game console or mobile computing device, etc.
- the second computing device 102 may include a processor 111, a communications device 112, and a database 113.
- the mapping 118 may be stored on the second computing device 102, or may reside on external media that can be read by the second computing device 102.
- the second computing device 102 may be, for example, a server, and the first computing device 101 may be a client.
- the processor 111 and the communications device 112 may be similar to the processor 104 and the communications device 107.
- the database 113 may be any suitable combination of hardware and software, e.g., hard drives and database software, for the storing and accessing the user's activity history 117 for multiple users.
- the second computing device 102 may receive the user behavior information 110, including the identity of the user 103, from other computing devices, for example, the first computing device 101, through the communications device 112.
- the user behavior information 110 may be stored in the database 113 as part of the user's activity history 117 for the user 103, as described above.
- Figure 5 depicts an exemplary system for tracking human-digital media interaction across multiple computing devices.
- a first user 504 may login, at various times, to a video game console 501, a mobile phone 502, and a personal computer 503, using the first user login 505.
- the first user 504 may interact with interactive software programs 108 on the video game console 501, the mobile phone 502, and the personal computer 503.
- the interaction between the first user 502 and the interactive software program 108 on the video game console 501 may generate first user behavior information 506, on the mobile phone 502 may generate first user behavior information 507, and on the personal computer 503 may generate first user behavior information 508.
- the first user behavior information 506, 507, and 508 may be stored locally on the computing devices, and may also be transmitted to the second computing device 102.
- the second computing device 102 may store the first user behavior information 506, 507, and 508 in the database 113 as part of the first user's activity history 509, separate from the second user's activity history 510 and the third user's activity history 511. In this way, the interactions of the first user 504 with various interactive software programs 108 on various computing devices may be tracked, as all of the behavior information generated for the user 504 may be stored centrally.
- the first user's activity history 509 may be stored on any of the computing devices used the by the use 504, in place of or in addition to being stored on the second computing device 102.
- the first user's activity history 509 may be stored on the personal computer 503, which may receive first user behavior information from other computing devices used by the user 503.
- the first user's activity history 509 may also, with suitable software and hardware, be stored in a distributed manner across multiple computing devices.
- FIG. 6 depicts an exemplary flowchart for tracking human-digital media interaction.
- a computing device may receive user login data from a user.
- the first computing device 101 may receive the user login data 109 from the user 103.
- the user login data received in block 601 may be used to identify the user. Every user may need to be identified uniquely, to allow for the segregation of use behavior information for different users who use the same computing devices and interact with the same interactive software programs.
- the first user login data 505 may be used to distinguish the first user 504 from any other users of the video game console 501, mobile phone 502, and personal computer 503, so that any user behavior information 110 for the first user 504 may be stored in the first user's activity history 509, separate from the second user's activity history 510 and the third user's activity history 511.
- an interactive software program may be run. For example, if the user 103 has logged in to the first computing device 101, the processor 104 may run the interactive software program 108 at the request of the user 103.
- the user may interact with the interactive software program run in block 603, and input may be received for the interactive software program from the user.
- the nature of the input received may depend on the type of computing device logged into by the user, the input devices connected to the computing device, and the nature of the interactive software program.
- the user 103 may interact with the Flash game using a mouse and keyboard.
- the user 103 may interact with the text messaging application using a keypad on the mobile phone.
- interactions between the user and the interactive software program from block 604 may be used to generate user behavior information.
- the monitor 115 may run on the processor 104 along with the interactive software program 108, and may monitor the interactions between the user 103 and the interactive software program 108. The interactions may be used to generate the user behavior information 110.
- the interactive software program may be ended. If the interactive software program is ended, flow proceeds block 607. Otherwise, flow proceeds back to block 604, as the user may continue to interact with the interactive software program.
- the user behavior information generated during block 605 may be stored.
- the user behavior information may be stored locally, remotely, or any suitable combination thereof, and may be aggregated with any previously stored user behavior information for the user in the user's activity history.
- the user behavior information 110 may be stored on the first computing device 101 and/or transmitted to the second computing device 102 for storage. Storage of the user's activity history may be done in any suitable manner, including distributing the user's activity history across different storage media on the same or different computing devices, for example, across multiple hard drives in a RAID server, or multiple computing devices in a cloud storage system.
- block 607 may run concurrently with block 605. Instead of waiting to store the user behavior information until after the interactive software program has ended in block 606, the user behavior information may be stored after generation in block 605.
- the user 103 after finishing with the interactive software program 108, may choose to run a different interactive software program on the computing device 101. For example, if the user 103 finishes using a text messaging application on a mobile phone after sending a text message, the user 103 may then use the voice functionality of the mobile phone to make a phone call.
- Figure 7 depicts an exemplary flowchart for storing and analyzing behavior information generated from tracking human- digital media interaction.
- the user behavior information and user identity may be received by a computing device.
- the user identity may be any form of digital identification, for example, a user name, a user id number, etc, that can be used to identify a unique user based on the user login data.
- the second computing device 102 may receive the user behavior information 110 and user identity for the user 103 from the first computing device 101.
- the appropriate program for processing and storing the user behavior information 110 may receive the user behavior information 110 and the user identity of the user 103.
- the interactive software program for which the user behavior information was generated may be checked against an interactive software program-cognitive task mapping.
- the interactive software program 108 may be checked against the mapping 118, to determine which cognitive tasks the software program 108 is associated with. If the interactive software program 108 is associated with more than one cognitive task, the user behavior information 110 may also be checked to determine which of the cognitive tasks the user 103 may have actually performed while interacting with the interactive software program 108.
- the user may be added to the database, so that the user behavior information may be stored in the database. For example, if the user 103 is not in the database 113 when the second computing device 102 receives the user behavior information 110, the user 103 may be added to the database 113.
- the user behavior information and additional data for the user just added to the database may be stored in the database in the user's activity history. Additional data may include identification of the interactive software program, as well as results of checking the interactive software program against the mapping. For example, if the user 103 has just been added to the database 113, the user behavior information 110 may be stored in the database 113 as the user's activity history 117.
- the user is already in the database, so the user behavior information and additional information may be stored in the database, in the user's activity history.
- the user behavior information 110 may be stored in the user's activity history 117.
- the user behavior information may be aggregated with the user behavior information already stored for the user in the database. Aggregating user behavior information may involve, for example, updating cumulative totals for the same interactive software program, updating cumulative totals for the same cognitive task, etc.
- the user behavior information 110 may be aggregated with any data already in the user's activity history 117 in the database 113.
- the user's activity history may be analyzed. Analysis may occur on the entirety or any subset of the user's activity history. Blocks 709-714 are examples of the types of analysis that may be performed on the user's activity history.
- the cognitive tasks present in the user's activity history may be mapped to the areas of the human brain stimulated.
- the mapping 118 may be used to determine which areas of their brain the user 103 has spent the most or least time stimulating, based on the cognitive tasks the user's activity history 117 indicates the user has performed, and the amount of the time the user 103 performed those cognitive tasks, while interacting with interactive software programs 108.
- analysis based on the mapping 118 may indicate that the user 103 has spent the most time stimulating the short-term memory related area of the brain, and the least time stimulating the motor function of the brain. This may provide the user 103 with information that can be used to balance the user's 103 use of different types of interactive software programs 108, or to suggest or report training and interactive software programs 108 for the user 103 to interact with to achieve goals based on a profile of the user 103.
- the user's activity history may be analyzed to generate reports.
- the reports may be in the form of text, charts, graphs, animations, and/or illustrations.
- the reports may include data related to any aspect of the user's activity history. For example, the reports may only indicate how much time the user 103 has spent on different cognitive tasks, or stimulating different areas of the user's 103 brain.
- the report may track the user's 103 level of performance of specific cognitive tasks over a period of time, showing how the level of the user's 103 performance has varied based on the passage of time, or in relation to the user's 103 level of performance of other cognitive tasks, usage of interactive software programs 108, etc.
- the user's activity history may be used to diagnose problems with the user's cognitive functions. For example, if the user's activity history 117 shows that the user's 103 level of performance on cognitive tasks related to short-term memory has consistently decreased over a period of time, the user 103 may be diagnosed with a condition affecting short-term memory. Diagnoses may make use of any type of data from the user's activity history, and may also make use of any known data about the user, for example, age, previous health problems, etc.
- the user's activity history may be used to evaluate the user's cognitive functions, and to make recommendations of interactive software programs for the user to use.
- the level of performance of the user 103 at various cognitive tasks may be determined from the user's activity history 117, and may be used to recommend to the user 103 interactive software programs 108 that will help the user 103 improve at cognitive tasks at which they show deficiencies, perform cognitive tasks that the user 103 has spent less time on, sharpen the user's 103 ability to perform specific cognitive tasks that the user 103 is already good at but wishes to be better at, etc.
- the usage of interactive software programs 108 that involve motor function related cognitive tasks, or use other cognitive tasks to stimulate the areas of the brain responsible for motor function may be recommend to the user 103.
- the user's activity history may be used to generate a plan for remediation therapy for the user.
- the user's activity history 117 may be used to generate plan for remediation therapy to improve the areas cognitive function and related areas of the brain affected by the user's 103 condition.
- the plan may include recommendations of interactive software programs 108 the user 103 should interact with, a schedule providing for when and how long the user 103 should interact with certain interactive software programs 108, goals or checkpoints for the user's 103 level of performance at certain cognitive functions, etc.
- the user's activity history may be correlated with physical location information for the user.
- Physical location information may include information tracking the user's movements throughout the physical world, such as, for example, GPS data, cell-phone location tracking data, RFID tag data, etc. Correlating the user's activity history to the physical location information may allow for analysis of how the user interacts with computing devices and interactive software programs during the course of the user's daily life, and how time of day and location affect the user's cognitive functions.
- physical location data may allow for analysis of the user's activity history 117 to determine that the user's 103 motor function is impaired if the user 103 is talking on a mobile phone while driving a car.
- Another example of analysis that may be performed on the user's activity history includes correlating the user's activity history with data from medical devices, such as, for example, fMRI data for the user.
- An fMRI may be used to monitor the user's 103 brain function while the user 103 performs a cognitive task, and the data produced by the fMRI may be correlated with data for the cognitive task from the user's activity history 117.
- the correlation may be used, for example, to gage the overall effect of the user's 103 use of interactive software programs 108 on the user's 103 brains ability to carry out the cognitive task.
- Figure 8 depicts an exemplary screenshot of a screen for viewing analyses and recommendations based on the user's activity history.
- the exemplary screenshot depicts a quantitative analysis 810 of a user's activity history.
- the set of recommendations 806, based on the quantitative analysis 810 recommend that the user use interactive software programs focused on memory, speed of processing, and executive function cognitive tasks.
- the user behavior information 110 may be analyzed before being stored with user's activity history 117. This analysis may be done in the same manner as the analysis of the user's activity history 117, though it may produce less comprehensive results as it may involve analyzing less data than is available in the user's activity history 117.
- the user 103 may use a variety of computing devices.
- computing devices include, without limitation, computer systems, personal digital assistants, notebook computers, and/or telephones (of either wireline or wireless variety).
- Examples of communication media that can be employed include, without limitation, wireless data networks, wireline networks, and/or a variety of networked media.
- a "computer” or “computer system” may be, for example and without limitation, either alone or in combination, a personal computer (PC), server-based computer, main frame, server, microcomputer, minicomputer, laptop, personal data assistant (PDA), cellular phone, pager, processor, including wireless and/or wireline varieties thereof, and/or any other computerized device capable of configuration for receiving, storing and/or processing data for standalone application and/or over a networked medium or media.
- PC personal computer
- PDA personal data assistant
- cellular phone pager
- processor including wireless and/or wireline varieties thereof, and/or any other computerized device capable of configuration for receiving, storing and/or processing data for standalone application and/or over a networked medium or media.
- Computers and computer systems described herein may include operatively associated computer-readable media such as memory for storing software applications used in obtaining, processing, storing and/or communicating data. It can be appreciated that such memory can be internal, external, remote or local with respect to its operatively associated computer or computer system. Memory may also include any means for storing software or other instructions including, for example and without limitation, a hard disk, an optical disk, floppy disk, DVD, compact disc, memory stick, ROM (read only memory), RAM (random access memory), PROM (programmable ROM), EEPROM (extended erasable PROM), and/or other like computer-readable media.
- ROM read only memory
- RAM random access memory
- PROM programmable ROM
- EEPROM extended erasable PROM
- computer-readable media may include any medium capable of being a carrier for an electronic signal representative of data stored, communicated or processed in accordance with embodiments of the present invention.
- method steps described herein may be embodied or executed as instructions stored on a computer-readable medium or media.
- a single component may be replaced by multiple components, and multiple components may be replaced by a single component, to provide an element or structure or to perform a given function or functions. Except where such substitution would not be operative to practice certain embodiments of the present invention, such substitution is considered within the scope of the present invention.
Abstract
A system for human-digital media interaction tracking. One example system includes a database that stores information regarding a user's activity history for various different cognitive tasks, and a computing device that receives user behavior information indicating usage by a user of an interactive software program, the interactive software program associated with at least one of the cognitive tasks. The computing device, in response to the receipt of user behavior information indicating usage by the user of the interactive software program, updates the database information regarding the user's activity history for the at least one of the cognitive tasks.
Description
SYSTEM FOR TRACKING HUMAN-DIGITAL MEDIA INTERACTION
CROSS REFERENCE TO RELATED APPLICATIONS AND PRIORITY CLAIM
[0001] This application claims the benefit of United States Patent Application No. 61/194,101, filed September 23, 2008 and United States Patent Application No. 12/343,305, filed December 23, 2008. The disclosure of each of said Applications is incorporated by reference herein.
FIELD OF THE INVENTION
[0002] Some example embodiments of the present invention are generally related to computer-implemented systems and methods for tracking human interaction with digital media, and more particularly to systems and methods for measuring and enhancing cognitive performance based on such interactions.
BACKGROUND
[0003] Digital media, including interactive software and accompanying hardware, has become the preferred form of communication and entertainment for many people. People log in, make phone calls, and interact with digitally-based media on a daily basis. Digital media has become the dominant mode by which people seek entertainment, communicate and gain information about the world. Many people choose to read materials hosted online instead of paper-based documents like newspapers and book. E-mail has become more popular than the postal service for letter- writing. Cell phones have replaced the ground-line phone as the preferred means of quick communication. Video games have become a mainstream entertainment medium, expanding beyond the demographic of children and young adults. So called "casual" video games, often available on mobile phones or free on the Internet, are used extensively by an older demographic of users than traditional video games. Digital video and music, which are seemingly passive experiences, are delivered and consumed via on-demand digital access and distribution.
[0004] The human brain and mind evolves and adapts to the experiences and environment in which it is exposed. Neuroplasticity and neurogenesis demonstrate that the evolution of the human brain continues throughout an individual's life. Exposure to and use of the different types of digital media stimulates brain function in many ways, regardless of the intentions of the makers of digital media. Specific cognitive tasks, traits and functions are
processed in localized regions of the brain, which may be stimulated by interaction with digital media. For example "Surfing the web" or "texting friends" requires cognitive work, and may stimulate areas of the brain required to perform the cognitive tasks associated with executive function, language processing, fine motor skills, and working memory. Another example of cognitive work performed while interacting with digital media is playing video games. Research shows that video games affect certain brain processes and may improve cognitive development (Green, C. Shawn & Daphne Bavelier, Action Video Game Modifies Visual Selective Attention. NATURE 2003 May 29; 423:534-7.) If video games stimulate certain aspects of the brain because of the cognitive functions required for playing them, then it could be inferred that other digital mediums would also stimulate brain processes.
[0005] While digital media is becoming a growing part of individuals' lives, there is no comprehensive tracking of individuals' interactions with digital media and mapping of the effects of using digital media on individuals' brains and behaviors. Currently, there are products that track the usage of specific forms of digital media. For example, there are products that track how much a particular website is used, and use this to help websites advertise. Cell phone companies also track the usage of cell phones by subjects for pricing purposes. None of these existing products measure and analyze the potential effects of using these types of digital media on an individuals' cognitive function and development. Additionally, these products do not evaluate the behavioral implications of digital media usage.
[0006] Recent research by neuroscientists has suggested the possibility of improving cognition through external stimulus. Called "neuroplasticity," neuroscientists have determined that the brain acts like a muscle, and cognitive "exercise" can stimulate cognitive improvement. Research shows that external stimulus such as physical exercise or interaction with digital media can stimulate brain activity in areas of the brain associated with cognition and improve cognitive development even after the brain stops developing due to age. (Draganski B et al. Neuroplasticity: Changes in grey matter induced by training. NATURE 2004 Jan 22; 427:311-2)
[0007] Coinciding with this recent research are growing demands from the aging US and world population who have become cognizant of the decline in cognitive health that often accompanies aging. Concerns such as loss of memory, decreased cognition, and mental illness associated with aging like Alzheimer's disease have fueled a growing market demand for products that help with maintaining and improving cognitive health.
BRIEF DESCRIPTION OF THE FIGURES
[0008] Figure 1 depicts an exemplary system for tracking human-digital media interaction, according to one exemplary embodiment of the present invention;
[0009] Figure 2 depicts an exemplary record storing user behavior information, according to one exemplary embodiment of the present invention;
[0010] Figure 3 depicts an exemplary record storing the user's activity history, according to one exemplary embodiment of the present invention;
[0011] Figure 4 depicts an exemplary representation of an interactive software program - cognitive task - brain area mapping, according to one exemplary embodiment of the present invention;
[0012] Figure 5 depicts an exemplary system for tracking human-digital media interaction across multiple computing devices, according to one exemplary embodiment of the present invention;
[0013] Figure 6 is a flowchart depicting an example procedure for tracking human- digital media interaction, according to one exemplary embodiment of the present invention;
[0014] Figure 7 is a flowchart depicting an example procedure for storing and analyzing user behavior information generated from tracking human-digital media interaction, according to one exemplary embodiment of the present invention;
[0015] Figure 8 depicts an exemplary screenshot from an exemplary system for viewing analyses and recommendations based on a user's activity history, according to one exemplary embodiment of the present invention.
DESCRIPTION
[0016] People interact with various forms of digital media on various computing devices on a daily basis. Interacting with different types of digital media requires the performance of various cognitive tasks, which stimulate different areas of the human brain. It may be useful to track an individual's usage of digital media across all the computing devices on which an individual interacts with digital media. The individual's interactions with digital media may be monitored by monitoring software built into the digital media, or residing on the computing devices that are used to access the digital media. The monitoring software may produce data representing various aspects of the individual's interaction with the digital media, e.g.., how long they interacted with the digital media, what tasks they accomplished, etc.
[0017] The data produced by monitoring the individual's interaction with various forms of digital media across various computing devices may be aggregated and analyzed. The data may be analyzed in view of the cognitive tasks associated with the digital media interacted
with by the user, as well as the areas of the human brain stimulated by those cognitive tasks. This may allow for the evaluation of the cognitive functions of the individual, e.g., overall cognitive health, evaluating activitiy in certain areas of the brain, improvements and declines in the performance of specific cognitive tasks, etc., and of patterns in the individual's usage of digital media, e.g., cognitive tasks the individual performs the most, cognitive tasks, and areas of the brain, the individual has neglected, etc. The individual may receive recommendations for other types of digital media to interact with based on the data, individualized plans for improving cognitive functions and stimulating certain brain areas, etc.
[0018] Some example embodiments include systems and methods that can be configured and executed to track human-digital media interactions. One exemplary embodiment may provide a system including a database that may store information regarding a user's activity history for various different cognitive tasks, and a computing device that may receive user behavior information indicating usage by a user of an interactive software program, the interactive software program associated with at least one of the cognitive tasks. The computing device may, in response to the receipt of user behavior information indicating usage by the user of the interactive software program, update the database information regarding the user's activity history for the at least one of the cognitive tasks.
[0019] Another exemplary embodiment may provide a system including a computing device that may execute an interactive software program configured to be used by a user and a storage device accessible to the computing device, the storage device storing data associating the interactive software program with at least one cognitive task. The computing device may, responsive to the user's use of the interactive software program, generate user behavior information for the user indicating the user's carrying out of the at least one of the plurality of cognitive tasks associated with the interactive software program in the data stored in the storage device.
[0020] Figure 1 depicts an exemplary system for tracking human-digital media interaction. The exemplary system may include a first computing device 101 and a second computing device 102. A user 103 may interact with the first computing device 101. It will be appreciated that although two computing devices are illustrated in this example, the various features could be combined on a single device, e.g., using virtual machines, or spread over additional devices.
[0021] The first computing device 101 may be any suitable combination of hardware and software to allow interaction between the user 103 and an interactive software program. For example, the first computing device 101 may be a personal computer, a video game console, a
mobile phone, a portable media player, a set-top box for a television, a mobile internet device, an e-book device, etc. The first computing device 101 may include a processor 104, an input device 105, an output device 106, and a communications device 107. A plug-in monitor 116, user's activity history 117, and a mapping 118, may be stored on the first computing device 101. An interactive software program 108 may be also be stored on the first computing device 101, or may reside on external media that can be accessed by the first computing device 101.
[0022] The processor 104 may be any general or special purpose microprocessor, depending on the nature and uses of the first computing device 101, suitable for executing, and allowing the user 103 to interact with, the interactive software program 108. For example, if the first computing device 101 is a personal computer, the processor 104 may be a general purpose processor from Intel®.
[0023] The input device 105 may be any suitable device connected to the first computing device 101 that allows the user 103 to input data into the first computing device 101. For example, the input device 105 may be a mouse, keyboard, keypad, trackball, touch- screen, haptic input device, microphone, video camera, drawing tablet, video game console controller, hard or soft key, gesture recognition hardware, etc. The first computing device 101 may make use of more than one input device 105, for example, a personal computer may have a mouse, a keyboard, a microphone and a video camera. The input device 105 may be connected to the first computing device 101 in any suitable manner, for example, using wired or wireless connections. The user 103 may use the input device 105 to login to the first computing device 101, using user login data 109. The user login data 109 may identify the individual user 103, for example, with a unique id, and may be any suitable data unique to the user 103, such as, for example, a password, a fingerprint, a voiceprint, a face-print, a hardware key, etc. On some computing devices, such as, for example, mobile phones, the identity of the user 103 may be automatically tied to the device, and may require no separate user login data 109. The user 103 may then use the input device 105 to control the operation of the first computing device 101, including interacting with the interactive software program 108.
[0024] The output device 106 may be any suitable device connected to the first computing device 101 that allows the user 103 to receive data output from the first computing device 101. For example, the output device 101 may be an LCD screen, a CRT monitor, a television, a speaker, a force feedback device, a haptic feedback device, a series of LEDs, etc. The first computing device 101 may make use of more than one output device 106, for example, a personal computer may have an LCD screen and a pair of speakers. The output device 106 may be connected to the first computing device 101 in any suitable manner, for example, using
wired or wireless connections. The user 103 may receive data from the first computing device 101 through the output device 106, allowing the user 103 to interact with the first computer 101, including the interactive software program 108.
[0025] The communications device 107 may be any suitable device for allowing the first computing device 101 to send data to and receive data from any other computing device, for example, the second computing device 102. For example, the communications device 107 may be an 802. Hx protocol based wireless (WiFi) card, an Ethernet device, a modem, a Bluetooth module, an IR link, etc. The first computing device 101 may make use of more than one communications device 107, for example, a personal computer may have a WiFi card a Bluetooth module. The communications device 107 may be connected to the first computing device 101 in any suitable manner, for example, using wired or wireless connections. The first computing device 101 may use the communications device 107 to transmit data, such as, for example, user behavior information 110, to the second computing device 102.
[0026] The interactive software program 108 may be any suitable program, executable by the processor 104, which allows interaction by the user 103. The interactive software program may be stored on the first computing device 101, or may reside on external media that can be read or accessed by the first computing device 101. For example, the interactive software program 108 may be a video game stored on a DVD and played on a video game console, a web-browser, a web-browser based game, a program installed on the hard drive of a personal computer including games and productivity applications, a text- messaging application or calling functionality of a mobile phone, a book reading application on an e-book, etc. The user 103 may interact with the interactive software 108 on the first computing device 101 using the input device 104. As a result of the interaction between the user 103 and the interactive software program 108, the user behavior information 110 may be generated for the user 103.
[0027] The user behavior information 110 may be data generated by the interaction between the user 103 and the interactive software program 108. This data may include, for example: how long the user 103 used the interactive software program 108, how much of that time the user 103 was actually interacting with the interactive software program 103, e.g., actively inputting or receiving data, and how much of the time the user 103 was interacting with distinct sections or tasks within the interactive software program 103; a score achieved by the user 103; a task accomplished by the user 103; a task not accomplished by the user 103; an amount of time taken by the user 103 to perform a task; a speed of input by the user 103, e.g. typing speed; an accuracy of input by the user 103, e.g. number of misspellings or errant mouse
clicks; a reaction time of the user 103 to output from the interactive software program 103, e.g. in a first-person shooter video game, the amount of time it takes for a user to react to incoming fire by firing back or hiding; etc. Some interactions with the interactive software program 108 may be all or mostly passive, such as, for example, reading a book on an e-book device where the user 103 only interacts with the e-book to turn the page. Data for the user behavior information 110 may be inferred from combinations of passivity and activity for passive interactions, e.g. time spent reading a book on an e-book device may be inferred from the amount of time the book is loaded on the e-book and the frequency of page turning by the user 103.
[0028] Figure 2 depicts an exemplary record storing user behavior information. The exemplary user behavior information 110 may indicate that on January 1, 2009, the user 103 interacted with an interactive software program 108 entitled Dr. Memory. The user 103 used a personal computer with a keyboard and a mouse, and interacted with Dr. Memory for a total of 2 hours, 35 minutes and 1 second. The user 103 completed 4 rounds of Dr. Memory, with scores of 400, 570, 1240, and 1100.
[0029] The interactive software program 108 may include a monitor 115. The monitor 115 may be a process in the interactive software program 108 that may monitor the interaction between the user 103 and the interactive software program 108 in order to generate the user behavior information 110. For example, if the interactive software program 108 is a video game on a video game console, the monitor 115 may run on the processor 104 along with video game and may track various statistics associated with the video game, such as, for example, time played, score achieved, tasks accomplished, etc.
[0030] The interactive software program 108 may, in some cases, not include the monitor 115. When the interactive software program 108 does not include the monitor 115, a plug-in monitor 116 may be used to provide the features of the monitor 115. The plug-in monitor 116 may be a software plug-in, or specialized hardware device, residing on the first computing device 101. For example, the plug-in monitor 116 may be a desktop widget or toolbar running on the first computing device 101. When the user 103 begins interacting with an interactive software program 108 that does not have the monitor 115, the plug-in monitor 116 may be activated by the processor 104 and used to generate the user behavior information 110. For example, if the user 103 is playing a Flash game in a web-browser, and neither the Flash game nor the web-browser include the monitor 115 because the respective developers did not anticipate their program being used to generate the user behavior information 110, the plug-in monitor 116 may be used to generate the user behavior information 110 from the interaction
between the user 103 and the Flash game. The plug-in monitor 116 may also reside on a computing device separate from the first computing device 101, such as, for example, in a cloud computing environment. The monitor 115 and plug-in monitor 116 may also be used in combination in some instances. For example, the monitor 115 may gather some data that can be used as the user behavior information 110, and some data that is extraneous, for example, hardware and software monitoring e.g. RAM used, page faults, CPU utilization, etc. The plug- in monitor 116 may receive all the data produced by the monitor 115, and sort out the data for the user behavior information 110 from the extraneous data.
[0031] The user's activity history 117 may be an aggregation of user behavior information 110 for the user 103, and may be stored on the first computing device 101. Alternatively, the raw user behavior information 110 may be stored and processed at a later time, although this may be more resource intensive. For every interactive software program 108 interacted with by the user 103, separate user behavior information 110 may be generated and stored in the user's activity history 117. If the user 103 has interacted with an interactive software program 108 on a computing device other than the first computing device 101, the user behavior information 110 for those interactions may also be stored in the user's activity history 117 on the first computing device 101 if the first computing device 101 receives, or can access, the user behavior information 110 from the other computing device. The user's activity history 117 may include other information along with the user behavior information 110, such as, for example, the identity of the interactive software program 108 responsible for generating each user behavior information 110, information about the interactive software program 108 taken from the mapping 118, and data that results from the processing and analysis of all or parts of the user behavior information 110.
[0032] Figure 3 depicts an exemplary record storing the user's activity history. The exemplary user's activity history 117 may include the data from the user behavior information 110, as well as other user behavior information. The user 103 interacted with the interactive software program 108 Dr. Memory as indicated by the user behavior information 110, and again on January 7, 2009. On January 7, 2009 the user 103 interacted with Dr. Memory using a keypad on a mobile phone. The user 103 interacted with Dr. Memory for 21 minutes and 25 seconds, completed one round of play, and scored 1150. The exemplary user's activity history 117 includes a cumulative total time played for the user 103 for Dr. Memory of 2 hours, 56 minutes and 26 seconds, with an average score 892. The exemplary user's activity history 117 indicates that Dr. Memory may be associated with the cognitive task of short-term memory.
[0033] Also in the exemplary user's activity history 117, the user 103 used a text messaging application on a mobile phone on January 3, 2009. The user 103 typed 48 words in 3 minutes and 1 second. The text messaging application may be associated with the motor function and language processing cognitive tasks.
[0034] The mapping 118 may be data stored on the first computing device 101 that may map interactive software programs, such as the interactive software program 108, to cognitive tasks performed through interaction with the interactive software programs, and may further map the cognitive tasks to the areas of the human brain stimulated during the performance of the cognitive tasks. Cognitive tasks may include, for example, short-term memory, long-term memory, attention, motor function, visual search, computation, speed of processing, verbal memory, task- switching, decision making, inhibitory control, and visual search, etc.
[0035] Figure 4 depicts an exemplary representation of an interactive software program - cognitive task - brain area mapping. The representation of the mapping 118 may include a software program column 401, a cognitive task column 402, and a brain area column 403. The arrows in the representation may represent the mapping of items from one of the columns to items in the other columns, creating associations. For example, the arrow between "Lost Highway" in the software program column 401 and "Computational Skills" in the cognitive task column 402 may indicate that interacting with the interactive software program 108 "Lost Highway" requires the user to perform cognitive tasks involving computation. The arrow between "Computational Skills" in the cognitive task column 402 and "Right Frontal Lobe" in the brain area column 403 may indicate that performing cognitive tasks involving computation may stimulate the right frontal lobe of the human brain. Any interactive software program 108 may be mapped to any number of cognitive tasks, and any cognitive task may be mapped to any number of brain areas. Specific sections or parts of the interactive software program 108 may also be mapped to different cognitive tasks. For example, a video game may include sections of play that map to cognitive tasks for short-term memory and other sections that map to motor functions and reflexes. The mapping 118 may also include weights between interactive software programs 108, cognitive tasks, and areas of the brain. For example, an interactive software program 108 may require performance of both short-term memory and motor function cognitive tasks, but may place more emphasis on short-term memory, resulting in a heavier weight in the mapping 118 for the connection between the interactive software program 108 and the short-term memory cognitive task. Further, different cognitive tasks may
be mapped to specific tasks within the interactive software program 108, instead of to the interactive software program 108 as a whole.
[0036] Based on the exemplary representation of the mapping 118 depicted in Figure 4, if the user's activity history 117 shows that the user 103 has interacted with the interactive software program 108 "Lost Highway", it may be inferred that the user has performed cognitive tasks involving computation, and that these tasks have stimulated the right frontal lobe of the brain of the user 103.
[0037] The mapping 118 may be created by, for example, human analysis of various interactive software programs 108 for cognitive tasks. Automated tools may also be used to perform analysis of the interactive software programs 108, to create, or assist in the creation of, the mapping 118. The mapping 118 may also be based on data relating cognitive tasks to areas of the brain stimulated by performance of the cognitive tasks gathered using functional magnetic resonance imaging (fMRI), electroencephalography (EEG), positron emission tomography (PET), Magnetoencephalography (MEG), Event Related Optical Signal (EROS), near infrared spectroscopic imaging (NIRSI), event-related potential (ERP), Single Photon Emission Computed Tomography (SPECT), or Computed Tomography (CT).
[0038] The second computing device 102 may be any suitable combination of hardware and software to allow for the storage and analysis of the user's activity history 114. For example, the second computing device 102 may be a personal computer, a database server or server cluster, a computer on a distributed computing network, a suitable video game console or mobile computing device, etc. The second computing device 102 may include a processor 111, a communications device 112, and a database 113. The mapping 118, may be stored on the second computing device 102, or may reside on external media that can be read by the second computing device 102. The second computing device 102 may be, for example, a server, and the first computing device 101 may be a client.
[0039] The processor 111 and the communications device 112 may be similar to the processor 104 and the communications device 107. The database 113 may be any suitable combination of hardware and software, e.g., hard drives and database software, for the storing and accessing the user's activity history 117 for multiple users. The second computing device 102 may receive the user behavior information 110, including the identity of the user 103, from other computing devices, for example, the first computing device 101, through the communications device 112. The user behavior information 110 may be stored in the database 113 as part of the user's activity history 117 for the user 103, as described above.
[0040] Figure 5 depicts an exemplary system for tracking human-digital media interaction across multiple computing devices. A first user 504 may login, at various times, to a video game console 501, a mobile phone 502, and a personal computer 503, using the first user login 505. The first user 504 may interact with interactive software programs 108 on the video game console 501, the mobile phone 502, and the personal computer 503. The interaction between the first user 502 and the interactive software program 108 on the video game console 501 may generate first user behavior information 506, on the mobile phone 502 may generate first user behavior information 507, and on the personal computer 503 may generate first user behavior information 508. The first user behavior information 506, 507, and 508 may be stored locally on the computing devices, and may also be transmitted to the second computing device 102. The second computing device 102 may store the first user behavior information 506, 507, and 508 in the database 113 as part of the first user's activity history 509, separate from the second user's activity history 510 and the third user's activity history 511. In this way, the interactions of the first user 504 with various interactive software programs 108 on various computing devices may be tracked, as all of the behavior information generated for the user 504 may be stored centrally.
[0041] In alternative embodiments, the first user's activity history 509 may be stored on any of the computing devices used the by the use 504, in place of or in addition to being stored on the second computing device 102. For example, the first user's activity history 509 may be stored on the personal computer 503, which may receive first user behavior information from other computing devices used by the user 503. The first user's activity history 509 may also, with suitable software and hardware, be stored in a distributed manner across multiple computing devices.
[0042] Figure 6 depicts an exemplary flowchart for tracking human-digital media interaction. In block 601, a computing device may receive user login data from a user. For example, as depicted in Figure 1, the first computing device 101 may receive the user login data 109 from the user 103.
[0043] In block 602, the user login data received in block 601 may be used to identify the user. Every user may need to be identified uniquely, to allow for the segregation of use behavior information for different users who use the same computing devices and interact with the same interactive software programs. For example, as depicted in Figure 5, the first user login data 505 may be used to distinguish the first user 504 from any other users of the video game console 501, mobile phone 502, and personal computer 503, so that any user behavior
information 110 for the first user 504 may be stored in the first user's activity history 509, separate from the second user's activity history 510 and the third user's activity history 511.
[0044] In block 603, an interactive software program may be run. For example, if the user 103 has logged in to the first computing device 101, the processor 104 may run the interactive software program 108 at the request of the user 103.
[0045] In block 604, the user may interact with the interactive software program run in block 603, and input may be received for the interactive software program from the user. The nature of the input received may depend on the type of computing device logged into by the user, the input devices connected to the computing device, and the nature of the interactive software program. For example, if the first computing device 101 is a personal computer and the interactive software program 108 is a Flash game played in a web browser, the user 103 may interact with the Flash game using a mouse and keyboard. As another example, if the first computing device 101 is a mobile phone and the interactive software program 108 is a text messaging application, the user 103 may interact with the text messaging application using a keypad on the mobile phone.
[0046] In block 605, interactions between the user and the interactive software program from block 604 may be used to generate user behavior information. For example, the monitor 115 may run on the processor 104 along with the interactive software program 108, and may monitor the interactions between the user 103 and the interactive software program 108. The interactions may be used to generate the user behavior information 110.
[0047] In block 606, the interactive software program may be ended. If the interactive software program is ended, flow proceeds block 607. Otherwise, flow proceeds back to block 604, as the user may continue to interact with the interactive software program.
[0048] In block 607, the user behavior information generated during block 605 may be stored. The user behavior information may be stored locally, remotely, or any suitable combination thereof, and may be aggregated with any previously stored user behavior information for the user in the user's activity history. For example, the user behavior information 110 may be stored on the first computing device 101 and/or transmitted to the second computing device 102 for storage. Storage of the user's activity history may be done in any suitable manner, including distributing the user's activity history across different storage media on the same or different computing devices, for example, across multiple hard drives in a RAID server, or multiple computing devices in a cloud storage system.
[0049] In an alternative embodiment, block 607 may run concurrently with block 605. Instead of waiting to store the user behavior information until after the interactive software
program has ended in block 606, the user behavior information may be stored after generation in block 605.
[0050] In block 608, if the user runs another interactive software program on the computing device, flow proceeds back to block 603. Otherwise flow proceeds to block 609 and ends. The user 103, after finishing with the interactive software program 108, may choose to run a different interactive software program on the computing device 101. For example, if the user 103 finishes using a text messaging application on a mobile phone after sending a text message, the user 103 may then use the voice functionality of the mobile phone to make a phone call.
[0051] On some computing devices, it may be possible to run more than one interactive software program 108 at a time, allowing the user 103 to interact with a second interactive software program 108 without ending a first interactive software program 108. For example, on a personal computer running a modern operating system, a user 103 may have many interactive software programs 108 running simultaneously. User behavior information 110 may be generated for all interactive software programs 108 running simultaneously, so long as every piece of information in the user behavior information 110 is associated with the correct interactive software program 108.
[0052] After the user behavior information 110 has been generated, the user behavior information 110 may undergo processing while, or after, being stored. Figure 7 depicts an exemplary flowchart for storing and analyzing behavior information generated from tracking human- digital media interaction.
[0053] In block 701, the user behavior information and user identity may be received by a computing device. The user identity may be any form of digital identification, for example, a user name, a user id number, etc, that can be used to identify a unique user based on the user login data. For example, the second computing device 102 may receive the user behavior information 110 and user identity for the user 103 from the first computing device 101. As another example, if the user behavior information 110 is being stored on the first computing device 101, where the user behavior information 110 was generated, then the appropriate program for processing and storing the user behavior information 110 may receive the user behavior information 110 and the user identity of the user 103.
[0054] In block 702, the interactive software program for which the user behavior information was generated may be checked against an interactive software program-cognitive task mapping. For example, as described previously, the interactive software program 108 may be checked against the mapping 118, to determine which cognitive tasks the software program
108 is associated with. If the interactive software program 108 is associated with more than one cognitive task, the user behavior information 110 may also be checked to determine which of the cognitive tasks the user 103 may have actually performed while interacting with the interactive software program 108.
[0055] In block 703, if the user is already in the database, flow proceeds to block 706. Otherwise flow proceeds to block 704.
[0056] In block 704, the user may be added to the database, so that the user behavior information may be stored in the database. For example, if the user 103 is not in the database 113 when the second computing device 102 receives the user behavior information 110, the user 103 may be added to the database 113.
[0057] In block 705, the user behavior information and additional data for the user just added to the database may be stored in the database in the user's activity history. Additional data may include identification of the interactive software program, as well as results of checking the interactive software program against the mapping. For example, if the user 103 has just been added to the database 113, the user behavior information 110 may be stored in the database 113 as the user's activity history 117.
[0058] In block 706, the user is already in the database, so the user behavior information and additional information may be stored in the database, in the user's activity history. For example, if the user 103 is in the database 113, the user behavior information 110 may be stored in the user's activity history 117.
[0059] In block 707, the user behavior information may be aggregated with the user behavior information already stored for the user in the database. Aggregating user behavior information may involve, for example, updating cumulative totals for the same interactive software program, updating cumulative totals for the same cognitive task, etc. For example, the user behavior information 110 may be aggregated with any data already in the user's activity history 117 in the database 113.
[0060] In block 708, the user's activity history may be analyzed. Analysis may occur on the entirety or any subset of the user's activity history. Blocks 709-714 are examples of the types of analysis that may be performed on the user's activity history.
[0061] In block 709, the cognitive tasks present in the user's activity history may be mapped to the areas of the human brain stimulated. For example, the mapping 118 may be used to determine which areas of their brain the user 103 has spent the most or least time stimulating, based on the cognitive tasks the user's activity history 117 indicates the user has performed, and the amount of the time the user 103 performed those cognitive tasks, while interacting with
interactive software programs 108. If the user 103 has spent 20 hours interacting with interactive software programs 108 that involve short-term memory related cognitive tasks, and only 4 hours interacting with interactive software programs 108 that involve motor function related cognitive tasks, analysis based on the mapping 118 may indicate that the user 103 has spent the most time stimulating the short-term memory related area of the brain, and the least time stimulating the motor function of the brain. This may provide the user 103 with information that can be used to balance the user's 103 use of different types of interactive software programs 108, or to suggest or report training and interactive software programs 108 for the user 103 to interact with to achieve goals based on a profile of the user 103.
[0062] In block 710, the user's activity history may be analyzed to generate reports. The reports may be in the form of text, charts, graphs, animations, and/or illustrations. The reports may include data related to any aspect of the user's activity history. For example, the reports may only indicate how much time the user 103 has spent on different cognitive tasks, or stimulating different areas of the user's 103 brain. As another example, the report may track the user's 103 level of performance of specific cognitive tasks over a period of time, showing how the level of the user's 103 performance has varied based on the passage of time, or in relation to the user's 103 level of performance of other cognitive tasks, usage of interactive software programs 108, etc.
[0063] In block 711, the user's activity history may be used to diagnose problems with the user's cognitive functions. For example, if the user's activity history 117 shows that the user's 103 level of performance on cognitive tasks related to short-term memory has consistently decreased over a period of time, the user 103 may be diagnosed with a condition affecting short-term memory. Diagnoses may make use of any type of data from the user's activity history, and may also make use of any known data about the user, for example, age, previous health problems, etc.
[0064] In block 712, the user's activity history may be used to evaluate the user's cognitive functions, and to make recommendations of interactive software programs for the user to use. For example, the level of performance of the user 103 at various cognitive tasks may be determined from the user's activity history 117, and may be used to recommend to the user 103 interactive software programs 108 that will help the user 103 improve at cognitive tasks at which they show deficiencies, perform cognitive tasks that the user 103 has spent less time on, sharpen the user's 103 ability to perform specific cognitive tasks that the user 103 is already good at but wishes to be better at, etc. For example, if the user 103 has spent 20 hours interacting with interactive software programs 108 that involve short-term memory related cognitive tasks, and
only 4 hours interacting with interactive software programs 108 that involve motor function related cognitive tasks, or the user 103 has shown a high level of short-term memory performance but a low-level of motor function performance, the usage of interactive software programs 108 that involve motor function related cognitive tasks, or use other cognitive tasks to stimulate the areas of the brain responsible for motor function, may be recommend to the user 103.
[0065] In block 713, the user's activity history may be used to generate a plan for remediation therapy for the user. For example, if the user 103 is known to have a particular condition affecting their cognitive function, e.g., a recent stroke, the user's activity history 117 may be used to generate plan for remediation therapy to improve the areas cognitive function and related areas of the brain affected by the user's 103 condition. The plan may include recommendations of interactive software programs 108 the user 103 should interact with, a schedule providing for when and how long the user 103 should interact with certain interactive software programs 108, goals or checkpoints for the user's 103 level of performance at certain cognitive functions, etc.
[0066] In block 714, the user's activity history may be correlated with physical location information for the user. Physical location information may include information tracking the user's movements throughout the physical world, such as, for example, GPS data, cell-phone location tracking data, RFID tag data, etc. Correlating the user's activity history to the physical location information may allow for analysis of how the user interacts with computing devices and interactive software programs during the course of the user's daily life, and how time of day and location affect the user's cognitive functions. For example, physical location data may allow for analysis of the user's activity history 117 to determine that the user's 103 motor function is impaired if the user 103 is talking on a mobile phone while driving a car.
[0067] Another example of analysis that may be performed on the user's activity history includes correlating the user's activity history with data from medical devices, such as, for example, fMRI data for the user. An fMRI may be used to monitor the user's 103 brain function while the user 103 performs a cognitive task, and the data produced by the fMRI may be correlated with data for the cognitive task from the user's activity history 117. The correlation may be used, for example, to gage the overall effect of the user's 103 use of interactive software programs 108 on the user's 103 brains ability to carry out the cognitive task.
[0068] Figure 8 depicts an exemplary screenshot of a screen for viewing analyses and recommendations based on the user's activity history. The exemplary screenshot depicts a
quantitative analysis 810 of a user's activity history. According to the qualitative summary 808 of the quantitative analysis 810, the user has spent more time during the previous week focusing on computation related cognitive tasks. The set of recommendations 806, based on the quantitative analysis 810, recommend that the user use interactive software programs focused on memory, speed of processing, and executive function cognitive tasks. Also depicted are exemplary cognitive tasks categories 804.
[0069] In alternative embodiments, the user behavior information 110 may be analyzed before being stored with user's activity history 117. This analysis may be done in the same manner as the analysis of the user's activity history 117, though it may produce less comprehensive results as it may involve analyzing less data than is available in the user's activity history 117.
[0070] With reference to Figure 1, the user 103 may use a variety of computing devices. Examples of computing devices include, without limitation, computer systems, personal digital assistants, notebook computers, and/or telephones (of either wireline or wireless variety). Examples of communication media that can be employed include, without limitation, wireless data networks, wireline networks, and/or a variety of networked media.
[0071] As used herein, a "computer" or "computer system" may be, for example and without limitation, either alone or in combination, a personal computer (PC), server-based computer, main frame, server, microcomputer, minicomputer, laptop, personal data assistant (PDA), cellular phone, pager, processor, including wireless and/or wireline varieties thereof, and/or any other computerized device capable of configuration for receiving, storing and/or processing data for standalone application and/or over a networked medium or media.
[0072] Computers and computer systems described herein may include operatively associated computer-readable media such as memory for storing software applications used in obtaining, processing, storing and/or communicating data. It can be appreciated that such memory can be internal, external, remote or local with respect to its operatively associated computer or computer system. Memory may also include any means for storing software or other instructions including, for example and without limitation, a hard disk, an optical disk, floppy disk, DVD, compact disc, memory stick, ROM (read only memory), RAM (random access memory), PROM (programmable ROM), EEPROM (extended erasable PROM), and/or other like computer-readable media.
[0073] In general, computer-readable media may include any medium capable of being a carrier for an electronic signal representative of data stored, communicated or processed in accordance with embodiments of the present invention. Where applicable, method steps
described herein may be embodied or executed as instructions stored on a computer-readable medium or media.
[0074] It is to be understood that the figures and descriptions of the present invention have been simplified to illustrate elements that are relevant for a clear understanding of the present invention, while eliminating, for purposes of clarity, other elements. Those of ordinary skill in the art will recognize, however, that these and other elements may be desirable. However, because such elements are well known in the art, and because they do not facilitate a better understanding of the present invention, a discussion of such elements is not provided herein. It should be appreciated that the figures are presented for illustrative purposes and not as construction drawings. Omitted details and modifications or alternative embodiments are within the purview of persons of ordinary skill in the art.
[0075] It can be appreciated that, in certain aspects of the present invention, a single component may be replaced by multiple components, and multiple components may be replaced by a single component, to provide an element or structure or to perform a given function or functions. Except where such substitution would not be operative to practice certain embodiments of the present invention, such substitution is considered within the scope of the present invention.
[0076] The examples presented herein are intended to illustrate potential and specific implementations of the present invention. It can be appreciated that the examples are intended primarily for purposes of illustration of the invention for those skilled in the art. The diagrams depicted herein are provided by way of example. There may be variations to these diagrams or the operations described herein without departing from the spirit of the invention. For instance, in certain cases, method steps or operations may be performed or executed in differing order, or operations may be added, deleted or modified.
[0077] Furthermore, whereas particular embodiments of the invention have been described herein for the purpose of illustrating the invention and not for the purpose of limiting the same, it will be appreciated by those of ordinary skill in the art that numerous variations of the details, materials and arrangement of elements, steps, structures, and/or parts may be made within the principle and scope of the invention without departing from the invention as described in the following claims.
Claims
1. System for tracking human-digital media interaction comprising at least a computing device (101, 102) comprising: an input device (105) adapted to receive input from a user (103), an output device (106) adapted to send output to the user (103), a processor (104, 111) adapted to execute computer readable instructions, a communications device (107, 112) adapted to transmit information from and to the computing device (101, 102), and at least a storage device accessible by said computing device (101, 102), characterised in that the computing device (101, 102) is set up to: receive user behaviour information (110, 506, 507, 508) indicating usage by at least a user (103) of an interactive software program (108) executed by the processor (104, 111) and associated with at least a cognitive task, generate user's activity history (117, 509, 510, 511) data for said cognitive tasks in a database (113) accessible from at least one of said computing device (101,
103), and perform an analysis of said user's activity history (117, 509, 510, 511) data.
2. System according to claim 1 characterised in that the user (103) behaviour information comprises at least one of: an amount of time spent by the user (103) interacting with the software program
(108), an amount of time spent by the user (103) interacting with a part of the interactive software program (108) associated with one of the at least one cognitive tasks, a score achieved by the user (103) related to a task accomplished by the user
(103), a task not accomplished by the user (103), and an amount of time taken by the user (103) to perform a task.
3. System according to claim 1 characterised in that the user's activity history (117,509,510, 511) data is stored in at least a database (113).
4. System according to claim 1 characterised in that the analysis comprises: mapping (709) the user (103) behavior information to regions of the brain based on the cognitive task, analyzing (710) the user (103) behavior information to produce reports, evaluating (712) the user's (103) cognitive functions, diagnosing a deficiency in the user's (103) cognitive functions and generating recommendations for the user
(103) of an additional interactive software program associated with an additional cognitive task, generating (713) a plan for remediation therapy to address a deficiency in the user's (103) cognitive functions, and correlating (714) the user's activity history (117, 509, 510,511) with physical location data.
5. System according to claim 1 characterised in that the storage device is further adapted to store the user behavior information (110, 506, 507, 508) in a user's activity history (117, 509, 510, 511) for the user (103).
6. System according to claim 1 characterised in that the processor (104, 111) is further adapted to execute a monitor process to generate the user behavior information (110, 506, 507, 508).
7. System according to claim 6 characterised in that the monitor process is a plug-in monitor separate from the interactive software program (108).
8. System according to claim 1 characterised in that the processor (104, 111) is further adapted to accept user's (103) login data from the user (103) and identify the user (103) based on said user's (103) login data.
9. Computer- implemented method for tracking human-digital media interaction using the system described in any of the preceding claims characterised by: receiving on a computing device (101, 103) information identifying a user (103), identifying by the computing device (101, 103) the user (103) based on user (103) login data, executing on the computing device (101, 103) an interactive software program
(108) wherein the interactive software program (108) is associated with at least one cognitive task, receiving on the computing device (101, 103) input from the user (103) to the interactive software program (108), generating on the computing device (101, 103) user behavior information (110,
506, 507, 508) based on the input from the user (103) to the interactive software program (108) , and storing on the storage device or the computing device (101, 103) the user behavior information (110, 506, 507, 508).
10. Method according to claim 9 further comprising performing with the user 's activity history (117, 509, 510, 511) at least one of: map (709) the user's activity history (117, 509, 510, 511) to regions of the brain based on the cognitive task, analyze (710) the user's activity history (117, 509, 510, 511) for producing reports showing the status of the user's cognitive functions, generate recommendations for the user (103) of an additional interactive software program associated with an additional cognitive task, evaluate (712) the user (103)'s cognitive functions, diagnose (711) a deficiency in the user's cognitive functions, generate (713) a plan for remediation therapy to address a deficiency in the user
(103)' s cognitive functions, and correlate (714) the users activity history (117, 509, 510, 51 l)with physical location data.
11. Method according to claim 10 further comprising transmitting the information generated by the computing device (101, 103) using the communications device (107, 112).
12. A computer readable medium storing computer readable instructions executable by the processor (104, 111) of the system described in any of claims 1-8 to cause said system to implement all the steps of the method of any one of claims 9 to 11.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP09816742A EP2342658A4 (en) | 2008-09-23 | 2009-09-21 | System for tracking human-digital media interaction |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US19410108P | 2008-09-23 | 2008-09-23 | |
US61/194,101 | 2008-09-23 | ||
US12/343,305 US9713444B2 (en) | 2008-09-23 | 2008-12-23 | Human-digital media interaction tracking |
US12/343,305 | 2008-12-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010036605A1 true WO2010036605A1 (en) | 2010-04-01 |
Family
ID=42038352
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2009/057664 WO2010036605A1 (en) | 2008-09-23 | 2009-09-21 | System for tracking human-digital media interaction |
Country Status (3)
Country | Link |
---|---|
US (3) | US9713444B2 (en) |
EP (1) | EP2342658A4 (en) |
WO (1) | WO2010036605A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022221329A1 (en) * | 2021-04-13 | 2022-10-20 | Dathomir Laboratories Llc | User suggestions based on engagement |
Families Citing this family (62)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10438308B2 (en) * | 2003-02-04 | 2019-10-08 | Lexisnexis Risk Solutions Fl Inc. | Systems and methods for identifying entities using geographical and social mapping |
US20080243005A1 (en) * | 2007-03-30 | 2008-10-02 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational user-health testing |
US20090234667A1 (en) * | 2007-12-19 | 2009-09-17 | Thayne Timmy R | Systems and methods for enabling collaboration and coordination of support |
US9153141B1 (en) | 2009-06-30 | 2015-10-06 | Amazon Technologies, Inc. | Recommendations based on progress data |
US9390402B1 (en) | 2009-06-30 | 2016-07-12 | Amazon Technologies, Inc. | Collection of progress data |
US8510247B1 (en) | 2009-06-30 | 2013-08-13 | Amazon Technologies, Inc. | Recommendation of media content items based on geolocation and venue |
US9672335B2 (en) * | 2009-12-17 | 2017-06-06 | Laird H Shuart | Cognitive-based logon process for computing device |
US8434001B2 (en) | 2010-06-03 | 2013-04-30 | Rhonda Enterprises, Llc | Systems and methods for presenting a content summary of a media item to a user based on a position within the media item |
WO2012008961A1 (en) * | 2010-07-15 | 2012-01-19 | Sony Ericsson Mobile Communications Ab | A user analytics engine for detecting and mitigating stress and/or concentration lapses for an associated user of an electronic device |
US8554640B1 (en) | 2010-08-19 | 2013-10-08 | Amazon Technologies, Inc. | Content completion recommendations |
US8555332B2 (en) | 2010-08-20 | 2013-10-08 | At&T Intellectual Property I, L.P. | System for establishing communications with a mobile device server |
US9326116B2 (en) | 2010-08-24 | 2016-04-26 | Rhonda Enterprises, Llc | Systems and methods for suggesting a pause position within electronic text |
US8438285B2 (en) | 2010-09-15 | 2013-05-07 | At&T Intellectual Property I, L.P. | System for managing resources accessible to a mobile device server |
US9069754B2 (en) | 2010-09-29 | 2015-06-30 | Rhonda Enterprises, Llc | Method, system, and computer readable medium for detecting related subgroups of text in an electronic document |
US9535884B1 (en) | 2010-09-30 | 2017-01-03 | Amazon Technologies, Inc. | Finding an end-of-body within content |
US8989055B2 (en) | 2011-07-17 | 2015-03-24 | At&T Intellectual Property I, L.P. | Processing messages with a device server operating in a telephone |
US8478905B2 (en) | 2010-10-01 | 2013-07-02 | At&T Intellectual Property I, Lp | System for synchronizing to a mobile device server |
US8443420B2 (en) | 2010-10-01 | 2013-05-14 | At&T Intellectual Property I, L.P. | System for communicating with a mobile device server |
US8610546B2 (en) | 2010-10-01 | 2013-12-17 | At&T Intellectual Property I, L.P. | System for selecting resources accessible to a mobile device server |
US8516039B2 (en) | 2010-10-01 | 2013-08-20 | At&T Intellectual Property I, L.P. | Apparatus and method for managing mobile device servers |
US8504449B2 (en) | 2010-10-01 | 2013-08-06 | At&T Intellectual Property I, L.P. | Apparatus and method for managing software applications of a mobile device server |
US9392316B2 (en) | 2010-10-28 | 2016-07-12 | At&T Intellectual Property I, L.P. | Messaging abstraction in a mobile device server |
US9066123B2 (en) | 2010-11-30 | 2015-06-23 | At&T Intellectual Property I, L.P. | System for monetizing resources accessible to a mobile device server |
US20120278179A1 (en) | 2011-04-28 | 2012-11-01 | Ray Campbell | Systems and methods for deducing user information from input device behavior |
US9355110B1 (en) | 2011-07-14 | 2016-05-31 | Google Inc. | Dynamic presentation of data items based on prioritized associations |
US9819753B2 (en) | 2011-12-02 | 2017-11-14 | Location Labs, Inc. | System and method for logging and reporting mobile device activity information |
US9477966B2 (en) * | 2011-12-22 | 2016-10-25 | Adobe Systems Incorporated | Accurately estimating the audience of digital content |
US8954571B2 (en) * | 2012-01-13 | 2015-02-10 | Wavemarket, Inc. | System and method for implementing histogram controlled mobile devices |
US20130204535A1 (en) * | 2012-02-03 | 2013-08-08 | Microsoft Corporation | Visualizing predicted affective states over time |
US9628573B1 (en) | 2012-05-01 | 2017-04-18 | Amazon Technologies, Inc. | Location-based interaction with digital works |
US9389832B2 (en) * | 2012-10-18 | 2016-07-12 | Sony Corporation | Experience log |
US20140114901A1 (en) * | 2012-10-19 | 2014-04-24 | Cbs Interactive Inc. | System and method for recommending application resources |
US9462332B2 (en) | 2012-12-05 | 2016-10-04 | At&T Intellectual Property I, L.P. | Method and apparatus for controlling a media device |
US10055418B2 (en) | 2014-03-14 | 2018-08-21 | Highspot, Inc. | Narrowing information search results for presentation to a user |
US10560324B2 (en) | 2013-03-15 | 2020-02-11 | Location Labs, Inc. | System and method for enabling user device control |
US20150006257A1 (en) * | 2013-03-15 | 2015-01-01 | Studio Sbv, Inc. | Subscription-based mobile reading platform |
US8938488B1 (en) * | 2013-12-27 | 2015-01-20 | Linkedin Corporation | Techniques for populating a content stream on a mobile device |
US10447838B2 (en) | 2014-04-03 | 2019-10-15 | Location Labs, Inc. | Telephone fraud management system and method |
US10148805B2 (en) | 2014-05-30 | 2018-12-04 | Location Labs, Inc. | System and method for mobile device control delegation |
US10325205B2 (en) * | 2014-06-09 | 2019-06-18 | Cognitive Scale, Inc. | Cognitive information processing system environment |
TWI544357B (en) * | 2014-08-20 | 2016-08-01 | 王基旆 | Computer network system with the function of one-click for quickly and safely logging in |
US10188950B2 (en) * | 2014-10-23 | 2019-01-29 | Nokia Technologies Oy | Method and apparatus for providing privacy policy generation based on in-game behavior data |
US9984310B2 (en) * | 2015-01-23 | 2018-05-29 | Highspot, Inc. | Systems and methods for identifying semantically and visually related content |
US20160267799A1 (en) * | 2015-03-09 | 2016-09-15 | CurriculaWorks | Systems and methods for cognitive training with adaptive motivation features |
US10643745B2 (en) | 2015-09-29 | 2020-05-05 | Jeff Scott Bruno | Systems and methods for determining human performance capacity and utility of a biomedical intervention/neurotechnology device |
DE102015121763A1 (en) * | 2015-12-14 | 2017-06-14 | Otto-Von-Guericke-Universität Magdeburg | Device for neurovascular stimulation |
US11222270B2 (en) | 2016-07-28 | 2022-01-11 | International Business Machiness Corporation | Using learned application flow to predict outcomes and identify trouble spots in network business transactions |
US11030673B2 (en) | 2016-07-28 | 2021-06-08 | International Business Machines Corporation | Using learned application flow to assist users in network business transaction based apps |
US10210283B2 (en) | 2016-09-28 | 2019-02-19 | International Business Machines Corporation | Accessibility detection and resolution |
US20180225985A1 (en) * | 2017-02-06 | 2018-08-09 | Dusan Damjanovic | Operator readiness testing and tracking system |
US10559387B2 (en) * | 2017-06-14 | 2020-02-11 | Microsoft Technology Licensing, Llc | Sleep monitoring from implicitly collected computer interactions |
US10853375B1 (en) * | 2017-08-25 | 2020-12-01 | Roblox Corporation | Leveraging historical data to improve the relevancy of search results |
WO2019060298A1 (en) | 2017-09-19 | 2019-03-28 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement |
US11717686B2 (en) | 2017-12-04 | 2023-08-08 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement to facilitate learning and performance |
US11478603B2 (en) | 2017-12-31 | 2022-10-25 | Neuroenhancement Lab, LLC | Method and apparatus for neuroenhancement to enhance emotional response |
EP3764904A4 (en) * | 2018-03-14 | 2022-01-19 | Yale University | Systems and methods for neuro-behavioral relationships in dimensional geometric embedding (n-bridge) |
US11364361B2 (en) | 2018-04-20 | 2022-06-21 | Neuroenhancement Lab, LLC | System and method for inducing sleep by transplanting mental states |
WO2020056418A1 (en) | 2018-09-14 | 2020-03-19 | Neuroenhancement Lab, LLC | System and method of improving sleep |
US11786694B2 (en) | 2019-05-24 | 2023-10-17 | NeuroLight, Inc. | Device, method, and app for facilitating sleep |
IT202000030989A1 (en) * | 2020-12-16 | 2022-06-16 | Univ Degli Studi Di Brescia | METHODS, TECHNIQUES AND HARDWARE AND SOFTWARE TOOLS FOR MONITORING USER ACTIVITY AT THE VIDEO TERMINAL (VDT) |
CN115904059A (en) * | 2021-09-30 | 2023-04-04 | 华为技术有限公司 | Human-computer interaction continuing method, device and system |
FR3133462A1 (en) * | 2022-03-08 | 2023-09-15 | Université Grenoble Alpes | automatic determination of a digital lifestyle measure by aggregation of a set of heterogeneous measures coming from heterogeneous sources |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5911581A (en) * | 1995-02-21 | 1999-06-15 | Braintainment Resources, Inc. | Interactive computer program for measuring and analyzing mental ability |
US20050159921A1 (en) * | 1999-08-26 | 2005-07-21 | Louviere Jordan J. | On-line experimentation |
Family Cites Families (78)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5697844A (en) * | 1986-03-10 | 1997-12-16 | Response Reward Systems, L.C. | System and method for playing games and rewarding successful players |
US5269315A (en) * | 1991-08-16 | 1993-12-14 | The Regents Of The University Of California | Determining the nature of brain lesions by electroencephalography |
WO1995018565A1 (en) * | 1991-09-26 | 1995-07-13 | Sam Technology, Inc. | Non-invasive neurocognitive testing method and system |
US5724987A (en) * | 1991-09-26 | 1998-03-10 | Sam Technology, Inc. | Neurocognitive adaptive computer-aided training method and system |
US6334778B1 (en) * | 1994-04-26 | 2002-01-01 | Health Hero Network, Inc. | Remote psychological diagnosis and monitoring system |
US5678571A (en) * | 1994-05-23 | 1997-10-21 | Raya Systems, Inc. | Method for treating medical conditions using a microprocessor-based video game |
US5899855A (en) * | 1992-11-17 | 1999-05-04 | Health Hero Network, Inc. | Modular microprocessor-based health monitoring system |
US5913310A (en) * | 1994-05-23 | 1999-06-22 | Health Hero Network, Inc. | Method for diagnosis and treatment of psychological and emotional disorders using a microprocessor-based video game |
US5377100A (en) * | 1993-03-08 | 1994-12-27 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Method of encouraging attention by correlating video game difficulty with attention level |
US6186794B1 (en) * | 1993-04-02 | 2001-02-13 | Breakthrough To Literacy, Inc. | Apparatus for interactive adaptive learning by an individual through at least one of a stimuli presentation device and a user perceivable display |
JP3310498B2 (en) * | 1994-09-02 | 2002-08-05 | 独立行政法人産業技術総合研究所 | Biological information analyzer and biological information analysis method |
US5890906A (en) * | 1995-01-20 | 1999-04-06 | Vincent J. Macri | Method and apparatus for tutorial, self and assisted instruction directed to simulated preparation, training and competitive play and entertainment |
US6057846A (en) * | 1995-07-14 | 2000-05-02 | Sever, Jr.; Frank | Virtual reality psychophysiological conditioning medium |
US5742748A (en) * | 1995-07-14 | 1998-04-21 | Sever, Jr.; Frank | Virtual reality mental conditioning medium |
US5736986A (en) * | 1995-07-14 | 1998-04-07 | Sever, Jr.; Frank | Virtual reality mental conditioning medium |
US5907831A (en) * | 1997-04-04 | 1999-05-25 | Lotvin; Mikhail | Computer apparatus and methods supporting different categories of users |
US6019607A (en) * | 1997-12-17 | 2000-02-01 | Jenkins; William M. | Method and apparatus for training of sensory and perceptual systems in LLI systems |
US5927988A (en) * | 1997-12-17 | 1999-07-27 | Jenkins; William M. | Method and apparatus for training of sensory and perceptual systems in LLI subjects |
US6159014A (en) * | 1997-12-17 | 2000-12-12 | Scientific Learning Corp. | Method and apparatus for training of cognitive and memory systems in humans |
US6261101B1 (en) * | 1997-12-17 | 2001-07-17 | Scientific Learning Corp. | Method and apparatus for cognitive training of humans using adaptive timing of exercises |
AUPP354798A0 (en) * | 1998-05-15 | 1998-06-11 | Swinburne Limited | Decentralised patient management system |
US6231344B1 (en) * | 1998-08-14 | 2001-05-15 | Scientific Learning Corporation | Prophylactic reduction and remediation of schizophrenic impairments through interactive behavioral training |
US6149441A (en) * | 1998-11-06 | 2000-11-21 | Technology For Connecticut, Inc. | Computer-based educational system |
US6280198B1 (en) * | 1999-01-29 | 2001-08-28 | Scientific Learning Corporation | Remote computer implemented methods for cognitive testing |
US6450820B1 (en) * | 1999-07-09 | 2002-09-17 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Method and apparatus for encouraging physiological self-regulation through modulation of an operator's control input to a video game or training simulator |
US6206702B1 (en) * | 1999-08-24 | 2001-03-27 | Deborah A. Hayden | Methods and devices for treating unilateral neglect |
US6409513B1 (en) * | 1999-11-24 | 2002-06-25 | Infinite Mind, L.C. | Method for improving reading speed and comprehension skills |
US6807535B2 (en) * | 2000-03-08 | 2004-10-19 | Lnk Corporation | Intelligent tutoring system |
US6434419B1 (en) * | 2000-06-26 | 2002-08-13 | Sam Technology, Inc. | Neurocognitive ability EEG measurement method and system |
US6632174B1 (en) * | 2000-07-06 | 2003-10-14 | Cognifit Ltd (Naiot) | Method and apparatus for testing and training cognitive ability |
EP1299814A1 (en) * | 2000-07-11 | 2003-04-09 | Abraham Glezerman | Agent for guiding children in a virtual learning environment |
US20050283053A1 (en) * | 2002-01-30 | 2005-12-22 | Decharms Richard C | Methods for physiological monitoring, training, exercise and regulation |
US7343296B2 (en) * | 2001-03-14 | 2008-03-11 | Puppetools, Inc. | Puppetry based communication system, method and internet utility |
US7210938B2 (en) * | 2001-05-09 | 2007-05-01 | K12.Com | System and method of virtual schooling |
US7063535B2 (en) * | 2001-12-21 | 2006-06-20 | Jill Stamm | System and method for facilitating early childhood brain development |
US7677896B1 (en) * | 2002-02-19 | 2010-03-16 | Nishikant Sonwalkar | System, method, and computer-readable medium for course structure design to support adaptive learning |
US20040043373A1 (en) * | 2002-09-04 | 2004-03-04 | Kaiserman Jeffrey M. | System for providing computer-assisted development |
US7347818B2 (en) * | 2003-02-24 | 2008-03-25 | Neurotrax Corporation | Standardized medical cognitive assessment tool |
EP1639814B1 (en) * | 2003-05-29 | 2015-03-18 | eat.tv, inc. | System for presentation of multimedia content |
AU2004266029A1 (en) * | 2003-08-21 | 2005-03-03 | Sspt Pty. Ltd. | Aptitude testing |
US20060184494A1 (en) * | 2003-09-17 | 2006-08-17 | Torkel Klingberg | Method and arrangement in a computer training system |
US20050143175A1 (en) * | 2003-12-29 | 2005-06-30 | Steven Ahlquist | System and method for regulating use of an electronic device |
US20070065789A1 (en) * | 2004-01-13 | 2007-03-22 | Posit Science Corporation | Method for enhancing memory and cognition in aging adults |
US20050216243A1 (en) * | 2004-03-02 | 2005-09-29 | Simon Graham | Computer-simulated virtual reality environments for evaluation of neurobehavioral performance |
US7364432B2 (en) * | 2004-03-31 | 2008-04-29 | Drb Lit Ltd. | Methods of selecting Lock-In Training courses and sessions |
US8298078B2 (en) * | 2005-02-28 | 2012-10-30 | Wms Gaming Inc. | Wagering game machine with biofeedback-aware game presentation |
US20060286538A1 (en) * | 2005-06-20 | 2006-12-21 | Scalone Alan R | Interactive distributed processing learning system and method |
GB2430072B (en) * | 2005-08-18 | 2008-02-13 | Mark Jones | Teaching apparatus |
US7720784B1 (en) * | 2005-08-30 | 2010-05-18 | Walt Froloff | Emotive intelligence applied in electronic devices and internet using emotion displacement quantification in pain and pleasure space |
US20070065795A1 (en) * | 2005-09-21 | 2007-03-22 | Erickson Ranel E | Multiple-channel learner-centered whole-brain training system |
US8215961B2 (en) * | 2005-12-15 | 2012-07-10 | Posit Science Corporation | Cognitive training using visual sweeps |
US20070218439A1 (en) * | 2005-12-15 | 2007-09-20 | Posit Science Corporation | Cognitive training using visual searches |
US20070166675A1 (en) * | 2005-12-15 | 2007-07-19 | Posit Science Corporation | Cognitive training using visual stimuli |
US20070166676A1 (en) * | 2005-12-15 | 2007-07-19 | Posit Science Corporation | Cognitive training using guided eye movements |
US20070218440A1 (en) * | 2005-12-15 | 2007-09-20 | Posit Science Corporation | Cognitive training using multiple object tracking |
EP2026715A2 (en) * | 2006-05-22 | 2009-02-25 | Richard Jorgensen | Learning system |
US7933852B2 (en) * | 2006-06-09 | 2011-04-26 | Scientific Learning Corporation | Method and apparatus for developing cognitive skills |
US20070298401A1 (en) * | 2006-06-13 | 2007-12-27 | Subhashis Mohanty | Educational System and Method Using Remote Communication Devices |
US20080003553A1 (en) * | 2006-06-14 | 2008-01-03 | Roger Stark | Cognitive learning video game |
CN101484899A (en) * | 2006-07-06 | 2009-07-15 | 皇家飞利浦电子股份有限公司 | Remote patient management platform with entertainment component |
US20080138777A1 (en) * | 2006-09-27 | 2008-06-12 | Darion Rapoza | Use of game constructs in measurement and enhancement of inhibitory control |
US7773097B2 (en) * | 2006-10-05 | 2010-08-10 | Posit Science Corporation | Visual emphasis for cognitive training exercises |
US7540615B2 (en) * | 2006-12-15 | 2009-06-02 | Posit Science Corporation | Cognitive training using guided eye movements |
US20090018407A1 (en) * | 2007-03-30 | 2009-01-15 | Searete Llc, A Limited Corporation Of The State Of Delaware | Computational user-health testing |
US20090005653A1 (en) * | 2007-03-30 | 2009-01-01 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational user-health testing |
US20080287821A1 (en) * | 2007-03-30 | 2008-11-20 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational user-health testing |
US20080243005A1 (en) * | 2007-03-30 | 2008-10-02 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Computational user-health testing |
US20090069707A1 (en) * | 2007-09-06 | 2009-03-12 | Sandford Joseph A | Method to improve neurofeedback training using a reinforcement system of computerized game-like cognitive or entertainment-based training activities |
WO2009046224A1 (en) * | 2007-10-02 | 2009-04-09 | Emsense Corporation | Providing remote access to media, and reaction and survey data from viewers of the media |
EP2045690A1 (en) * | 2007-10-04 | 2009-04-08 | Koninklijke Philips Electronics N.V. | Improvements relating to brain computer interfaces |
US8348671B2 (en) * | 2008-08-18 | 2013-01-08 | Posit Science Corporation | Visual divided attention training |
US20100092933A1 (en) * | 2008-10-15 | 2010-04-15 | William Kuchera | System and method for an interactive phoneme video game |
US8628392B1 (en) * | 2009-05-22 | 2014-01-14 | Xiaohui Kong | Game of actual planning, task/time management, and information sharing |
US8335715B2 (en) * | 2009-11-19 | 2012-12-18 | The Nielsen Company (Us), Llc. | Advertisement exchange using neuro-response data |
US20110137727A1 (en) * | 2009-12-07 | 2011-06-09 | Rovi Technologies Corporation | Systems and methods for determining proximity of media objects in a 3d media environment |
US9993190B2 (en) * | 2011-08-16 | 2018-06-12 | Intendu Ltd. | System and method for neurocognitive training and/or neuropsychological assessment |
KR101557957B1 (en) * | 2012-02-20 | 2015-10-12 | 주식회사 엔텔리전트 게임즈 | Platform apparatur for serious game |
US9498704B1 (en) * | 2013-09-23 | 2016-11-22 | Cignition, Inc. | Method and system for learning and cognitive training in a virtual environment |
-
2008
- 2008-12-23 US US12/343,305 patent/US9713444B2/en active Active
-
2009
- 2009-09-21 WO PCT/US2009/057664 patent/WO2010036605A1/en active Application Filing
- 2009-09-21 EP EP09816742A patent/EP2342658A4/en not_active Ceased
-
2017
- 2017-07-24 US US15/658,003 patent/US10327690B2/en active Active
-
2019
- 2019-06-05 US US16/432,302 patent/US20190282154A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5911581A (en) * | 1995-02-21 | 1999-06-15 | Braintainment Resources, Inc. | Interactive computer program for measuring and analyzing mental ability |
US20050159921A1 (en) * | 1999-08-26 | 2005-07-21 | Louviere Jordan J. | On-line experimentation |
Non-Patent Citations (1)
Title |
---|
See also references of EP2342658A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022221329A1 (en) * | 2021-04-13 | 2022-10-20 | Dathomir Laboratories Llc | User suggestions based on engagement |
Also Published As
Publication number | Publication date |
---|---|
US10327690B2 (en) | 2019-06-25 |
US20100076274A1 (en) | 2010-03-25 |
EP2342658A1 (en) | 2011-07-13 |
US9713444B2 (en) | 2017-07-25 |
US20170319124A1 (en) | 2017-11-09 |
EP2342658A4 (en) | 2012-02-29 |
US20190282154A1 (en) | 2019-09-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10327690B2 (en) | Human-digital media interaction tracking | |
US10885530B2 (en) | Digital credentials based on personality and health-based evaluation | |
Ghanvatkar et al. | User models for personalized physical activity interventions: scoping review | |
KR102571097B1 (en) | Wellness support groups for mobile devices | |
US10580531B2 (en) | System and method for predicting mortality amongst a user base | |
US10650474B2 (en) | System and method for using social network content to determine a lifestyle category of users | |
Korpershoek et al. | User-centered design of a mobile health intervention to enhance exacerbation-related self-management in patients with chronic obstructive pulmonary disease (Copilot): mixed methods study | |
US20170103180A1 (en) | Automated determination of user health profile | |
Huynh et al. | Engagemon: Multi-modal engagement sensing for mobile games | |
US20160171180A1 (en) | Incentivized wellness behavior modification | |
US20230230140A1 (en) | Data processing system with machine learning engine to provide output generating functions | |
US10930378B2 (en) | Remote health assertion verification and health prediction system | |
JP6779205B2 (en) | Systems and methods for providing health assessment services based on user knowledge and activities | |
US20200104935A1 (en) | Systems and methods for wealth and health planning | |
US11423335B2 (en) | Data processing system with machine learning engine to provide output generating functions | |
KR20170067796A (en) | One way and two way data flow systems and methods | |
Subramanian et al. | Virtual reality interventions to enhance upper limb motor improvement after a stroke: commonly used types of platform and outcomes | |
US10068492B2 (en) | Controlled resources based on good behavior | |
US10535018B1 (en) | Machine learning technique for recommendation of skills in a social networking service based on confidential data | |
Paddock et al. | Analysis of rolling group therapy data using conditionally autoregressive priors | |
Mairittha et al. | Crowdsourcing system management for activity data with mobile sensors | |
US20140156547A1 (en) | Methods and systems for assessing computer applications | |
WO2020210438A1 (en) | Data processing system with machine learning engine to provide output generating functions | |
Gary et al. | A pain reporting platform for adolescents with sickle-cell disease | |
KR102615456B1 (en) | Snoezelen-based xr mental care content platform system and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09816742 Country of ref document: EP Kind code of ref document: A1 |
|
REEP | Request for entry into the european phase |
Ref document number: 2009816742 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009816742 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |