US20080068447A1 - Bedside video communication system - Google Patents
Bedside video communication system Download PDFInfo
- Publication number
- US20080068447A1 US20080068447A1 US11/552,328 US55232806A US2008068447A1 US 20080068447 A1 US20080068447 A1 US 20080068447A1 US 55232806 A US55232806 A US 55232806A US 2008068447 A1 US2008068447 A1 US 2008068447A1
- Authority
- US
- United States
- Prior art keywords
- terminal
- resident
- video conference
- remote
- terminals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Definitions
- Example embodiments described herein relate to communications systems and, in particular, to video conferencing methods and systems.
- FIG. 1 shows a block diagram of an example of a communications system to which example embodiments can be applied
- FIG. 2 shows a block diagram of a resident video conference terminal to be used on the communications system shown in FIG. 1 ;
- FIGS. 3A , 3 B, 3 C, 3 D, 3 E and 3 F show, in diagrammatic form, a front view of an example of the resident video conference terminal of FIG. 2 , with example graphical user interface screens thereon when no video conference session is active;
- FIG. 4 shows a diagrammatic view of an example graphical user interface for the resident video conference terminal of FIG. 2 , while a session request is sent to a monitoring station terminal;
- FIG. 5 shows a diagrammatic view of a graphical user interface for the resident video conference terminal of FIG. 2 after a session with a monitoring station terminal has been established;
- FIG. 5A shows a diagrammatic view of a graphical user interface for the resident video conference terminal of FIG. 2 after a session with a remote terminal has been established;
- FIG. 6 shows a diagrammatic view of a graphical user interface on the resident video conference terminal of FIG. 2 that is displayed in response to pressing of a “call family” button;
- FIG. 7 is a diagrammatic view of an interface screen for the resident video conference terminal of FIG. 2 , when a video conference session request is incoming;
- FIG. 8 is an illustrative front view of a remote control for use with the resident terminal of FIG. 2 ;
- FIGS. 9 to 11 show examples of administrative user interface screens displayed on the resident terminal of FIG. 2 in example embodiments
- FIG. 12 shows a block diagram of a monitoring station video conference terminal to be used on the communications system shown in FIG. 1 ;
- FIG. 13 shows a diagrammatic view of an example graphical user interface of an idle screen for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 14 shows a diagrammatic view of an example graphical user interface of an incoming session request screen for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 15 shows a diagrammatic view of an example graphical user interface of a multiple incoming session request screen for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 16 shows a diagrammatic view of an example graphical user interface of a current video conference session for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 17 shows a diagrammatic view of an example graphical user interface of a paging function for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 18 shows a diagrammatic view of an example graphical user interface of a messaging function for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 19 shows a diagrammatic view of an example graphical user interface of an administration function for the monitoring station video conference terminal of FIG. 12 ;
- FIG. 20 shows a block diagram of a remote video conference terminal to be used on the communications system shown in FIG. 1 ;
- FIG. 21 shows a diagrammatic view of an example graphical user interface for the remote video conference terminal of FIG. 12 ;
- FIG. 22 shows a diagrammatic view of an example graphical user interface for an incoming session request from a resident terminal for the remote video conference terminal of FIG. 12 ;
- FIG. 23 shows a diagrammatic view of another example graphical user interface for an incoming session request from a monitoring station terminal for the remote video conference terminal of FIG. 12 ;
- FIG. 24 shows a diagrammatic view of an example graphical user interface of a messaging application for the remote video conference terminal of FIG. 12 ;
- FIG. 25 shows a block diagram of a conference server to be used on the communications system shown in FIG. 1 ;
- FIG. 26 shows a diagram illustrating conference session management according to an example embodiment
- FIGS. 27A-27D illustrate an example of a possible user interface screens for a VOIP function on the resident terminal of FIG. 2 .
- a resident video conference terminal for use by a resident of a facility, the resident terminal including: a controller for controlling the operation of the resident terminal; a touch screen display connected to the controller; a camera connected to the controller for capturing a video image of a user of the resident terminal during a video conference session; an audio transducer connected to the controller for capturing audio of a user of the resident terminal during a video conference session; an audio output connected to the controller; and a communications interface connected to the controller for exchanging signals with a communications network during a video conference session.
- the controller renders on the touch screen display a simplified user interface screen including a first user selectable button for initiating a video conference session with a monitoring station terminal within the facility and a second user selectable button for initiating a video conference session with at least one remote terminal that is external to the facility.
- a video conferencing system for facilitating communications between residents of a health care facility and remote users located outside of the health care facility.
- the system includes a plurality of resident terminals connected to a local area network within the health care facility, each resident terminal being associated with a resident of the health care facility and having stored thereon information identifying at least one remote user terminal located external to the local area network and that the resident terminal is associated with, each resident terminal being configured to display on a screen thereof a visual image that can be selected by a user thereof to initiate a video conference session with the at least one remote user terminal associated therewith.
- the system also includes a remote conference server located external to the health care facility and in communication with the plurality of resident terminals and the remote user terminals that are associated with the resident terminals, the conference server tracking usage information for video conference sessions that are established between the resident terminals and the remote user terminals associated therewith.
- the monitoring station includes: a controller for controlling the operation of the monitoring station terminal; a display connected to the controller; a camera connected to the controller for capturing a video image of a user of the monitoring station terminal during a video conference session; an audio transducer connected to the controller for capturing audio of a user of the monitoring station terminal during a video conference session; an audio output connected to the controller; and a communications interface connected to the controller for exchanging signals with a communications network during a video conference session.
- the controller is configured for selectively establishing, in response to user input, video conferences sessions with the resident terminals assigned thereto.
- the method includes providing resident terminals for use by residents of a care facility for video conference sessions, the resident terminals each having a user interface configured for use by a person having at least one of reduced cognitive abilities and reduced physical abilities; and assigning at least some of the resident terminals to specific residents of the care facility and storing at each resident video conference terminal assigned to a resident information identifying at least one remote terminal associated with the resident video conference terminal.
- FIG. 1 shows a block diagram of a communications system 10 that in example embodiments facilitates 2 -way video communication between patients/residents in a care facility, care providers within the facility, and other parties, such as family members and friends, who are remotely located relative to the care facility.
- the communications system 10 includes, within a care facility 14 , a number of bed side units (“BU”) or resident video conference terminals 12 and in some example embodiments at least one nursing station unit (“NSU”) or central monitoring station video conference terminal 20 . In some example embodiments, central monitoring station video conference terminal 20 may not be present.
- BU bed side units
- NSU nursing station unit
- central monitoring station video conference terminal 20 may not be present.
- the resident terminals 12 and monitoring station terminal 20 within the care facility 14 are connected to and part of a common intranet, including for example at least one local area network (“LAN”) 16 .
- the resident terminals 12 are enabled for wireless communication with network 16 through wireless access points located within the care facility 14 .
- the communication system 10 also includes a number of remote video conference terminals 26 that are exterior of the health care facility 14 for use by family members or friends or other concerned parties to video conference with patients and care givers at the care facility 14 .
- the remote terminals 26 are each connected to a wide area network (WAN) 24 , which in an example embodiment includes the Internet.
- the LAN 16 is also connected, typically through a gateway server and firewall 23 to the WAN 24 .
- a conference server 28 is also connected to the WAN 24 to facilitate communications between the remote terminals 26 and the patient and care provider terminals 12 , 20 at the care facility 14 .
- the LAN 16 may be a computer network, typically covering a small local area such as single building of the care facility 14 or group of buildings that make up the care facility 14 .
- the LAN 16 may be based on wired (such as switched Ethernet) and/or wireless technology (including for example technologies compliant with at least some of the family of IEEE 802.11 standards).
- the care facility 14 may be any suitable institution, and includes long-term care facilities, retirement homes, assisted living facilities, hospitals, and other institutional care facilities.
- a patient 18 , health care professional 22 , or remote user 30 may wish to request a session between their respective video conference terminals (resident terminals 12 , central monitoring station terminal 20 , and remote terminal 26 , respectively).
- a patient 18 may operate a resident video conference terminal 12 located at the patient's bedside. The patient 18 may initiate a session request on the resident video conference terminal 12 with another terminal, for example monitoring station terminal 20 , which is used as a health care provider terminal.
- a health care professional 22 such as a nurse, doctor, technician, or assistant, may use the health care provider central monitoring station video conference terminal 20 to accept the session request by the patient terminal 12 , resulting in a video conference session being established over the LAN 16 between the resident video conference terminal 12 and the monitoring station video conference terminal 20 located at the health care facility 14 .
- a remote user 30 may initiate a session request on the remote video conference terminal 26 with another terminal, for example a resident video conference terminal 12 .
- the patient 18 may then use the resident video conference terminal 12 to accept the session request from the remote video conference terminal 26 , such that a video conference session is established over the WAN 24 and LAN 16 between the remote video conference terminal 26 and the resident video conference terminal 12 .
- a video conference session may be similarly established between the monitoring station video conference terminal 20 and the remote video conference terminal 26 .
- a three-way network session (or a network session between a multiplicity of video conference terminals) may also be created between the resident video conference terminal 12 , central monitoring station video conference terminal 20 , and remote video conference terminal 26 .
- conference server 28 may act as both a connection manager module and directory service module to facilitate network sessions between the video conference terminals 12 , 20 , 26 , to facilitate the customer settings and administration of the network sessions, and to facilitate user registration and billing.
- FIGS. 2 to 11 show illustrative embodiments of the resident video conference terminal 12 for use by a patient 18 .
- the resident terminal 12 is in at least some example embodiments configured to allow a patient with limited or reduced cognitive and physical abilities to participate in video conference communications with care givers at the care facility 14 , and concerned persons (such as family) at remote terminals 26 .
- FIG. 2 shows an illustrative block diagram of an example resident video conference terminal 12 to be used on the communications system 10 .
- the resident video conference terminal 12 has a controller 100 for controlling operation of the resident video conference terminal 12 , an audio/video input 102 and an audio/video output 104 coupled to the controller, a user input 106 , and a wireless communications subsystem 108 coupled to the controller 100 for sending and receiving communications information over a wireless connection to LAN 16 .
- each resident terminal 12 is configured to communicate with the Internet 24 through LAN network 16 .
- Terminal 12 also includes electronic storage 107 , which is coupled to the controller 100 and can include transient memory such as RAM and one or more persistent storage elements such as, but not limited to, flash memory or a hard drive.
- the controller 100 can include one or more microprocessors that are coupled to the persistent and/or transient memory of storage 107 .
- Storage 107 stores information and software enabling the microprocessor(s) of controller 100 to implement the resident terminal functionality described below.
- the resident terminal 12 includes a rechargeable power source 109 for powering terminal 12 .
- the audio/video input 102 may be a microphone 112 and camera 110 , respectively.
- the audio/video output 104 may be a speaker 122 and a display screen 120 , respectively.
- suitable options for the user input 106 may be a touch screen 114 , a remote control 116 , or a keyboard 118 .
- the resident terminal 12 is packaged as a self-contained mobile, compact tablet-style console 160 that is ergonomically configured to be easily picked up, moved about, and used by a patient 18 who may have impaired physical functions and/or limited cognitive abilities.
- the resident terminal 12 can be mounted to a hospital-style rolling bedside table, or mounted on a swing arm such as those used for hospital televisions, so that it can be positioned for use by the patient 18 .
- the console 160 can in at least some example embodiments, have a depth (i.e. going into the page in FIG.
- a charging station (not shown) can be located in the patient's room for charging the power source 109 when, for example, the resident terminal 12 is not in use.
- the resident video conference terminal 12 includes integrated user interface components including display screen 120 , camera 110 , speaker 122 and microphone 1 12 (a headset can be used in some example embodiments).
- the display screen 120 is a touch screen 114 .
- the modules on controller 100 are implemented by software applications running on a processor of the controller 100 , the executable code for such applications being stored on storage 107 .
- the controller 100 has a video conference module 130 , a symptom input module 132 , a television module 134 , an information display module 136 , a speech stretcher module 140 and a setup module 142 .
- the video conference module 130 includes a session module 131 .
- additional or fewer modules may be implemented by controller 100 , and some or all of the functions performed by some modules could be combined into other modules or split into separate modules.
- At least some of the modules shown in FIG. 2 could be at least partially hosted on a device other than the resident terminal 12 , such as on a resident server 21 , a central monitoring station 20 , or a Web-accessible server such as conference server 28 , with the resident terminal calling on the remotely located modules in a client-server fashion.
- a patient or resident 18 may operate the resident video conference terminal 12 to initiate or accept video conference sessions with another video conference terminal (including, for example, monitoring station terminal and/or a remote terminal 26 ) by manipulating the user input 106 , which in the illustrated embodiment of FIGS. 3-11 takes the form of an LCD touch screen 114 which performs the dual role of a display screen 120 and a user input 116 .
- the resident terminal 12 is preconfigured for a specific resident, and in this regard information is stored on the resident terminal 12 that identifies one or more remote terminals 26 that are associated with one or more remote users 30 that the resident 12 is authorized to establish video conference sessions with.
- the stored information in at least some example embodiments includes for each authorized remote terminal 26 , a picture of and name of the remote user(s) 30 associated with the remote terminal 26 .
- FIG. 3A shows an example of a default home or idle graphical user interface 162 on the display screen 120 with three video conference options shown as user selectable icons or buttons: a call nurse button 150 ; a call family button 152 ; and an end call button 154 .
- the display screen 120 will be blank or have reduced back lighting in a power saving mode when no user interaction with the terminal 12 has occurred within a predetermined time period.
- the terminal 12 can be brought out of power saving mode to display the default idle interface 162 in response to a user input, for example a user touching any portion of the screen 114 .
- the terminal 12 may be equipped with a motion switch or motion detector 119 ( FIG.
- the terminal 12 can also be brought out of a power saving or standby mode to display an incoming session request interface (described below) when an incoming session request is received by the terminal 12 .
- the patient when the terminal 12 is in an idle mode and not currently involved in a video conference session, the patient is presented with only two active options to select—the “Call Nurse” button 150 and the “Call Family” button 152 , which are presented with light lettering (for example white) and bright backgrounds to provide a visual indication that such options are available for selection; the “End Call” button 154 is presented in interface 162 with faded or darker lettering and/or a faded or darker background to provide a visual indication that the “end call” option is not currently available for selection. In an alternative example embodiment, the “end call” button 154 is not displayed at all in the interface 162 when it is not an available option. As shown in FIG.
- the default interface 162 includes a large portion 155 that displays nothing, except perhaps a time at a bottom portion of it.
- screen area 155 can be configured to display, while in idle mode, information and/or pictures for the patient.
- a schedule of events organized for the day for the residents of the care facility could be presented in area 155 of the default interface 162 .
- FIG. 3D shows an example embodiment in which a daily schedule 163 for the resident user 18 is presented in the area 155 of the default idle interface screen 162 .
- Daily menu information could alternatively or additionally be shown in the area 155 . Such information could be customized for the particular resident that the terminal 12 has been assigned to.
- a general program schedule for the facility 14 can be stored at the central monitoring station 21 or central server 20 , or remotely at an external server, and periodically sent to the resident terminal 12 with appropriate filtering being applied (either at the terminal 12 itself or at a server from which the scheduling data is retrieved) according to predetermined activity preferences for the resident.
- a picture for example of family, a pet, etc.
- a picture could loaded onto the terminal 12 and then displayed in area 155 of the default interface 162 .
- option buttons 150 , 152 and 154 are displayed with different colour backgrounds to help distinguish them from each other, such as green, blue and red, respectively. As illustrated, the option buttons 150 , 152 and 154 are positioned in a column at a right side portion of the touch screen 114 , however they could be displayed in other configurations as well.
- option button location and/or size can be a configurable setting of the terminal 12 . For example, if it is known that a left handed patient will be using the terminal, the controller 100 can be pre-configured to locate the column or option buttons 150 , 152 and 154 along the left hand side of the screen 114 .
- the option buttons 150 , 152 and 154 are in example embodiments presented as sufficiently large portions of touch screen 115 that they can easily be seen and pressed by a patient using the device, while at the same time minimizing accidental selections.
- the display area of touch screen 114 is between 4 and 6 inches high and between 6 and 8 inches wide, and each option button is between 1.5 and 2 inches high and between 1.5 and 2 inches wide, however other configurations can be used in other embodiments.
- Presenting a patient with a limited number of selectable touch screen buttons in the illustrated embodiment, only two selectable buttons are shown in idle mode: the “Call Nurse” button 150 and “Call Family” button 152 ) from the default interface screen 160 provides an easy to use, relatively error proof interface.
- the buttons have been shown in the Figures labeled as “Call Family” and “Call Nurse”, other labels could be assigned to the option buttons as appropriate.
- the terminal 12 when a resident terminal 12 is assigned to a resident, the terminal will typically be preconfigured for the specific resident to which it is being assigned. Such pre configuration may occur in a number of ways - for example, the terminal 12 could include port (for example a USB port or an Ethernet jack that allows it to be connected to a configuring device or network), or could include an on-board configuration interface screen, or could be configured through signals received from LAN 16 through wireless communications system 108 . In some embodiments, configuration information can be received from conference server 28 via Internet 24 and LAN 16 .
- Configuration or set-up can include for example specifying the on-screen button location and size, and the language to use on the labels for the buttons, loading up pictures to be used in the various interfaces, and associating specific identifying information with the “Call Family” option such that pressing the call family button will initiate a video conference session with the correct remote terminal 26 .
- FIGS. 3 , 4 , and 5 illustrate how a patient/resident 18 may initiate a video conference session request from the resident video conference terminal 12 with the monitoring station video conference terminal 20 .
- the patient 18 wishes to contact monitoring station video conference terminal 20 (for example to talk to a nurse at the nursing station)
- the patient 18 selects the “Call Nurse” button 150 by pressing it on touch screen 114 .
- the resident terminal 12 transmits a video conference session request through wireless communications subsystem 108 and network 16 to the monitoring station terminal 20 .
- a graphical user interface 164 is displayed on screen 114 that indicates, in large letters: “Calling Nurse” in screen area 155 .
- the “Call Nurse” button 150 and “Call Family” button 152 are each displayed with faded letters and background (compared to default interface 162 ) to provide a visual indication that they are currently unavailable.
- the “End Call” button 154 is shown with bright letters and background to provide a visual indication that it is currently available as an option for the resident to select. Assuming that the nurse at monitoring station terminal 20 decides to accept the video conference request, a video conference session will be established over network 16 between the resident terminal 12 and the monitoring station terminal 20 . Thus, in the above described example, the resident only has to select a single on screen button (“Call Nurse”) from the idle screen to cause a video conference session to be established with the monitoring terminal 20 .
- FIG. 5 illustrates a graphical user interface 166 displayed on screen 114 of the resident terminal 12 when a video conference session is established between it (through communications subsystem 28 and network 16 ) and the monitoring station terminal 20 .
- the call nurse button 150 becomes a faded call nurse button 150 , which means that the button is no longer an available option to the patient 18 .
- the call family button 152 becomes faded.
- the end call button 154 is brightly displayed as it is a selectable option.
- a substantially real time video stream of the nurse (or other party) 22 will appear in area 155 of the resident terminal display screen 120 , and substantially real time audio of the nurse 22 will be output from the speaker 122 .
- a video of the patient 18 will be captured by the camera 110 and an audio of the patient will be captured by the microphone 112 for sending through the network 16 to the monitoring station terminal 20 , enabling an interactive, two-way video conference session to be held.
- the patient can end or terminate the session by pressing the end call button 154 .
- a message such as “Nurse Unavailable Now” or “Nurse Will Return” can be generated in the area 155 of interface screen 164 .
- the patient 18 can press the “Call Family” button 152 .
- the resident terminal 12 has been pre-associated with two possible remote parties, such that pressing the “Call Family” button 152 links, with reference to FIG. 6 , to a user interface 168 having two call family buttons “Rick” 156 and “Judy” 158 .
- the resident terminal 12 has been preconfigured to display in user interface 168 as a user selectable button 156 a photo of “Rick” and his family along with the identifying name “Rick” within a border 170 , and to display as user selectable button 158 a photo of “Judy” along with the identifying name “Rick” within a border 172 .
- Pressing the touch screen 114 within the border 170 signals to the video conference module 130 acceptance of the call “Rick” option; pressing the touch screen 114 within the border 172 170 signals to the video conference module 130 acceptance of the call “Judy” option.
- Configuring the resident terminal to prominently display recognizable pictures and names for touch screen selection can provide a simple-to-use interface for residents of limited abilities.
- the “Call Family” button 152 is faded so to provide visual feedback that such option is not currently available from interface screen 168 .
- the patient 18 may then select one of the call family buttons ( 156 , 158 ) by touching the screen in the appropriate place to initiate a video conference session request with the appropriate remote user 30 (Rick or Judy) that is associated with the selected button.
- this causes the session module 131 to initiate a session request through conference server 28 with the appropriate remote video conference terminal 26 . While the session is in the process of being initiated, the display screen may look similar to that shown in FIG. 4 , with the message “calling Rick” or “calling Judy” replacing the message “Calling Nurse”.
- a remote user 30 will then be able to see the session request by way of display screen 440 , as shown in FIG. 22 .
- the remote user 30 may accept the session request by selecting the connect icon 462 , thereby initiating the network session.
- FIG. 5A illustrates a possible video conference user interface on resident terminal 12 when a video conference session with a remote terminal 26 is active.
- a resident need only make two on-screen selections to cause a video conference session to be established with a family member, namely selection of the “Call Family” button 152 , followed by selection of the button representing the particular family member that the resident wants to call.
- the “Call Family” button 152 is shown in the illustrated embodiment as linking to an interface screen 168 ( FIG. 6 ) having two possible family or friend calling options, more than or fewer than two possible remote user calling options could be provided. In the case of just a single remote user calling option, the user interface screen 168 can be optionally omitted, with activation of the “Call Family” button 152 immediately causing a session request to be initiated by the resident terminal 12 .
- the call nurse icon 150 becomes faded to convey that information.
- the call family icon 152 becomes faded to convey information about its unavailability.
- the selectable call buttons or icons 156 , 158 may also be visually coded to indicate if the remote parties are currently on-line or logged in with the conference server 28 , and thus available to accept an incoming session request from the remote terminal 12 . For example, if the remote terminal(s) 26 associated with “Rick” is currently unavailable for a video-conference session than the button 156 may be displayed with muted colors or faded relative to how the thumbnail image 156 would be displayed if a remote terminal(s) 26 associated with “Rick” was currently available.
- FIG. 3B illustrates another possible “idle” user interface screen 50 which can be substituted in place of the user interface 176 of FIG. 3A .
- the user interface screen of FIG. 3B shows an example where the terminal 12 is preconfigured to be shared by two residents “Nancy” and “Emily”, although it will be appreciated that the terminal 12 could be configured for sharing by more than two residents.
- user selectable areas or buttons 52 and 54 associated with the respective resident users of the terminal 12 are presented side by side on the touch-screen.
- each selectable button 52 , 54 includes the picture and name of the subject resident, to facilitate selection of the correct button by the appropriate resident.
- User selection of either the button 52 or 54 links to a user interface screen 162 for the subject resident that is similar to that shown in FIG. 3A .
- FIG. 3C shows an example interface screen 162 A that is displayed after selection of the “Emily” button 52 .
- Identifying information (for example the name “Emily” in block 56 ) can be shown on the interface 162 A to identify the current user of the terminal 12 .
- Identifying information for example the name “Emily” in block 56
- the user interface screen 162 A includes a touch-screen “Call Nurse” button 150 , “Call Family” button 152 and “End Call” button 154 which operate in a manner similar to the buttons described above in respect of interface screen 162 .
- the terminal 12 is preconfigured so that selecting the “Call Family” button 52 will present the calling interface 168 (see FIG. 6 ) for calling Emily's family members.
- the “End Call” button can be selected from interface 162 A to return to the idle screen 50 .
- FIG. 7 illustrates screen 120 when an incoming video conference session request is received from the monitoring station video conference terminal 20 .
- the phrase “Nurse is Calling” is displayed on the display screen 120 .
- the call nurse button ( 150 in FIG. 3 ) is changed to answer nurse button 150 b . If the patient 18 wishes to accept the session request, the patient 18 selects the answer nurse button 150 b .
- a video conference session will then be established between the resident video conference terminal 12 and with the monitoring station video conference terminal 20 .
- a message such as “Family is Calling” can be prominently displayed in screen area 155 , and the “Call Family” button 152 replaced with an “Answer Family” button that can be touched to accept the call and establish a video conference session.
- the resident terminal 12 includes a further user input device in addition to a touch screen, such as, for example, a short range wireless hand held remote control 116 , as shown in FIG. 8 .
- the remote control 116 is equipped with oversize “elder friendly” buttons and allows a resident user to access additional or other features of the resident terminal 12 that are not easily accessible through the touch screen buttons 150 , 153 , 154 of default interface 162 .
- pressing a “Symptom Input” button 188 on remote control 116 allows a user to access the symptom input module 132 (see FIG. 2 ) and allows a patient 18 to enter health information for future reference, such as for a health care user 22 .
- a user selectable “Symptom Register” button 702 may be presented on the touch screen of resident terminal 12 , for example in the area 155 of the idle mode interface screen 162 , as an alternative to a “Symptom Input” button on the remote control 116 .
- the symptom input module 132 Upon selection of either the remote control “Symptom Input” button 188 or the touchscreen “Symptom Register” button 702 , the symptom input module 132 will display a menu of possible symptoms on the display screen 120 . The patient 18 may then select a symptom, for example using touch screen 114 (or a navigation/selection key combination 190 , 192 on remote control 116 ) to record incidences of pain, dizziness, or other symptoms as well as severity. This information may then be sent by the communications subsystem 108 to the monitoring station video conference terminal 20 , for diagnosis by a health care user 22 .
- a health care user 22 By way of example, with reference to FIG.
- the resident terminal 12 is preconfigured during setup for its assigned resident, or a subsequent update, to present a series of symptom input screens that correspond to the type of ailment(s) that the resident assigned to the terminal 12 suffers from.
- FIG. 3F shows an example of one such symptom user input interface 704 displayed in the area 155 of idle mode screen 162 after a user has selected either the remote control “Symptom Input” button 188 or the touchscreen “Symptom Register” button 702 .
- the input interface 704 which prompts a user to select one of three possible touch screen buttons “Mild” 706 A, “Medium” 706 B and “Severe” 706 C (which may be color coded) to describe “Abdominal Pain” can be a stand-alone input screen or one in a series of symptom input screens that are presented sequentially to the resident user.
- the input information, and its entry time can be stored at the remote terminal 12 and/or transmitted to a facility server 21 , a central monitoring station 20 , and/or a remote web-based server 28 , for further analysis by a health care provider in near real time or at a later time.
- the resident terminal 12 may be configured to or cause to periodically prompt the resident, for example through audible or visual alerts, to enter the symptom information at predetermined times.
- the resident terminal 12 can be configured to present user input interfaces such as shown in FIGS. 3E and 3F for facilitating resident input about food menu items.
- a user selectable touch screen button labeled “Menu Choice” could be shown in place of or in addition to “Symptom Register” Button 702 in the interface 162 ( FIG. 3E ), and then a series of alternative selectable food options be presented in a interface screen similar to that shown in FIG. 3F .
- the menu items selected by the resident can then be sent to another terminal 20 , 21 either within the facility 14 and/or to a terminal 28 outside the facility, such that the desired food items can then be provided to the resident at the appropriate times.
- selection of a “TV” button 180 on remote control 116 allows a user to access television module 134 which allows a patient 18 to switch the display screen 120 from the existing screen to display television programming broadcast using network 16 (or over an alternative network).
- the patient 18 may then control the television using the remote control 116 (which may for example include channel and volume buttons 182 , 184 ).
- selection of an “Information” button 198 on remote control 116 allows access to the information display module 136 , permitting the resident video conference terminal 12 to display information to the patient 18 on the display screen 120 .
- the types of information to be displayed may include: a screen-saver, educational programming, information about the institution, its services and caregiver staff, reminders and information about medication, disease, management and nutrition, reminders about upcoming events, and menu choices for meals (and respective selectable icons for the menu choices).
- such information may be displayed on the default or idle mode screen interface 162 (see FIG. 3A ), such that pressing an “Information” button on the remote control 116 is not required to view the information.
- the information display module can also include a patient monitoring station equipment module 138 .
- Patient vital signs information from patient monitoring station equipment may be provided to the controller 100 , through a short range communications interface 108 A between the monitoring equipment and the resident terminal 12 such as a USB cable, or through a short range wireless link, for example a BluetoothTM connection or an Infrared link.
- the patient monitoring station information from the patient monitoring equipment may be collected by the resident terminal 12 .
- collected monitoring information can be displayed on the display screen 120 .
- Typical patient vital signs monitoring equipment can include, among other things, equipment for performing electrocardiograms (EKG), electromyograms (EMG), electroencephalograms (EEG), as well as heart rate/pulse monitoring equipment, breathing monitoring equipment, and blood pressure monitoring equipment.
- the patient monitoring information may also be sent by resident terminal 12 over network 16 to care provider/monitoring station video conference terminal 20 , for viewing by a health care user 22 and/or automated monitoring, and/or to a central server 21 for the facility 14 , and/or to an off-site web-based server such as conference server 28 .
- Such a configuration allows the hardware and networks used for video conferencing to also be employed in transmitting patient vital signs information.
- the remote control includes a button 187 to activate and deactivate a speech stretcher module 140 that slows or delays the speech being received by the resident video conference terminal 12 .
- the speech stretcher module 140 thus slows the audio outputted from the speaker 122 . This may aid with any diminished hearing capacity of the patient 18 .
- the speech stretching function could alternatively be activated and de-activated through a selectable button on the touch screen display 120 , including for example a selectable “speech stretcher” button 161 that could be displayed on the screen 120 during a video conference session (see FIG. 5 ).
- the resident user can be provided with an interface for adjusting the amount or degree of speech speed adjustment that occurs during a video conference session when the speech stretching module is activated, and in this regard FIG. 5A illustrates a Speech speed adjustment bar 708 displayed on touch screen display 120 during a video conference session.
- the resident user can adjust the degree of speech speed adjustment that is applied to incoming audio by touching the adjustment bar at or between the “Slow” and “Normal” locations, and is provided with visual feedback of the current setting.
- the speech stretcher module 140 is configured to track the speech adjustment level that was used in the most recent video conference session used by the terminal and apply that adjustment as the starting default in the next video conference session.
- the default speech adjustment level that is applied is tracked for each specific monitoring or remote terminal that the resident terminal 12 has had past video conference sessions with, allowing the resident terminal 12 to “automatically” apply a default speech speed adjustment that is appropriate for the specific party that the resident is communicating with.
- Known speech speed adjustment algorithms can be applied by the speech stretching module 140 .
- the remote control 116 includes a “stand-by” button 186 which returns the resident terminal 12 to the default interface screen 162 of FIG. 3 . Additionally, in an example embodiment, the remote control includes a call nurse button 196 a, a call family button 196 b and an end call button 196 c, each of which performs a similar function as the on-screen call nurse button 150 , call family button 152 and end call button 154 , respectively.
- the controller 100 implements a setup module 142 .
- the setup module 142 allows a user (typically someone other than a patient 18 ) to run a setup application to perform various administrative functions to the resident video conference terminal 12 .
- the setup application is accessed by using a touch screen 114 and simultaneously selecting the end call icon 154 and an unmarked icon in the upper left of the display screen 120 .
- a temporary keyboard (not shown) may be connected to the resident video conference terminal 12 to interface with the setup module.
- pressing one or more keys 194 on remote 116 may access the setup application.
- the setup application is accessed remotely by an administrator (acting through conference server 28 or monitoring station terminal 20 , for example) through Internet 24 and/or network 16 .
- the setup module may be used to perform account assignment.
- the account assignment allows assignment of the video conference module 130 to specific monitoring station video conference terminals 20 arid/or remote video conference terminals 26 . This allows selection of the call nurse icon 150 or call family icon 152 to initiate a session request with the desired video conference terminal.
- the account assignment may also be used to enter the name of the patient 18 , the room number, and a representative graphic of the patient 18 .
- the setup application may also display menus on the display screen 120 for network setup and hardware setup.
- the setup application may also allow a selection of languages for display on the display screen 120 , for example English, French, and Spanish.
- FIG. 9 to 1 l show examples of some interface screens that can be generated on resident terminal 12 by the setup module 142 .
- FIG. 9 shows a default user interface screen when no resident user is currently assigned to or registered in association with the resident terminal 12 .
- An administrator can press touch screen button 60 to reach a basic setup interface screen 62 shown in FIG. 10 , which in the illustrated embodiment offers selectable options of “Account Assignment”; “Network”; “Hardware Parameters”; and “Exit”. Selecting the “Account Assignment” button on the touch screen results in the user interface screen 64 of FIG. 11 appearing.
- Screen 64 includes a touch screen alphanumeric key pad 66 that can be used by an administrator to enter assignment information to assign the resident terminal 12 to a particular resident of the care facility.
- Examples of information that can be input during set up of a resident terminal 12 include for example: (1) Room number in institution arid/or numeric identifier of patient/resident (in some embodiments, in the absence of a name programmed in the system, the room number will appear as the identifier at the monitoring station terminal 20 ); (2) Account Number for Video Conference Service (this predetermined account number that is issued by the conference server 28 enables 2-way video chat to be initiated to selected remote terminals 26 ; the account number is required for the resident terminal 24 to communicate via the Internet 24 with the conference server 28 , allowing various data stored at the conference server 28 (identified below) to be transferred to the resident terminal 24 and the monitoring station terminal 20 ; (3) Monitoring Station Terminal ID—assigns the resident terminal 24 to the specified monitoring station terminal 20 (there can be more than one monitoring station at facility 14 ); (4) Resident's name (if not already automatically downloaded from conference server 28 ); ( 5 ) Resident's photo (if not already automatically downloaded from conference server 28 ).
- resident terminal 12 can be configured such that a camera or audio pickup of the terminal 12 or associated with the terminal 12 can, in a one-way monitoring mode of terminal 12 , stream near real time video and/or audio from the resident's room to a remote terminal 26 to allow remote parties to monitor in substantially real time the condition of or treatment of the resident.
- Such remote monitoring feature can, in example embodiments, be activated through setup module 142 .
- the resident terminal 12 in order to facilitate remote monitoring of the treatment of the resident, includes or is coupled to an auxiliary “monitoring” video camera 712 (see FIG. 2 ) that is located in the room of the resident 18 that the resident terminal 12 has been assigned to.
- the auxiliary video camera 712 can be physically separated from the terminal console 160 and coupled to the resident terminal controller 100 through short range communications link 108 A (which may be a direct physical link such as a IJSB cable for example, or a wireless link).
- the camera 712 can be positioned to offer a wide area view of the resident's room or surrounding environment in order to enable the resident and the treatment of the resident by staff to be remotely monitored.
- Video camera 712 can also include an audio microphone so that noises in the resident's room can be monitored as well, although such noises could alternatively be monitored through the console microphone 112 .
- the controller 100 is configured to operate in a one-way monitoring mode in which video signals from the video camera 712 (and possibly audio signals) can be streamed during a monitoring session from the resident terminal 12 to either the central monitoring station 20 and/or an authorized remote terminal 26 through networks 16 , 24 .
- the on-board camera 110 of the terminal 12 could also be used for one-way monitoring purposes instead of or in addition to the auxiliary camera 712 , although the on-board camera 110 may not always be appropriately positioned for optimized viewing of the resident.
- the system 10 is configured so that remote monitoring of the resident is permitted at authorized remote terminals 26 (typically belonging to family members of the resident), but not at the monitoring station terminal 20 .
- the resident terminal 12 and/or auxiliary camera 712 are configured to provide a visual or audible indication to the resident when they are being used in a monitoring mode, so that the resident is aware when such monitoring is occurring.
- the resident terminal 12 could be configured or caused to perform the video monitoring periodically at set times throughout the day, with captured video images stored locally at the terminal 12 or off-site at a web-based server such as server 28 , for subsequent review at an authorized remote terminal 26 .
- the resident terminal can include a Voice Over IP (VOIP) module 143 and be configured as a Voice-over-IP telephone terminal to establish and receive calls via the Internet 24 , with a suitable interface being provided through the display screen working on its own or in conjunction with the remote control or other input device.
- VOIP Voice Over IP
- FIGS. 27A-27D illustrate an example of a possible user interface screens 710 A- 710 D that can be generated on the touch screen display 114 / 120 of resident terminal 12 by controller 100 .
- the first interface screen 710 A allows a user to initiate a VOIP call, and may, for example, be displayed after a user selects a predetermined key on remote control 116 , or a user selects a “VOIP” selection touch screen button 714 which could for example be displayed in the idle screen interface 162 (see FIG. 3E ).
- Interface screen 710 A allow a user to enter a phone number to call, or to select names of parties for which numbers have been preprogrammed. After entering a number and pressing a “Start Call” button, or after selecting the name associated with a preprogrammed number, the VOIP module 143 causes the terminal 12 to initiate a VOIP call to the appropriate remote terminal.
- FIG. 27B is an example of a screen that is displayed while the call is being placed
- FIG. 27C is an example of a user interface screen that can be displayed when a VOIP call has been connected.
- FIG. 27D illustrates a possible user interface 71 D that includes user selectable “Answer” button for receiving an incoming VOIP call. As illustrated in each of FIGS. 27A-27D , an “End Call” button can be pressed at any time to terminate the VOIP call process and return to either a prior user interface screen or the idle user interface screen.
- the resident terminal 12 is a portable wireless enabled tablet-style device with a touch screen user interface.
- the resident terminal 12 could be implemented in other ways, for example by a suitably configured personal computer that is hard-wired to the local area network 16 and which has an AC power connection.
- FIGS. 12 to 19 show illustrative embodiments of the care provider/monitoring station video conference terminal 20 .
- the health care user 22 may use monitoring station terminal 20 to participate in video conference sessions with resident and remote video conference terminals 12 , 26 .
- FIG. 12 shows a block diagram of the monitoring station video conference terminal 20 to be used on the communications system 10 .
- the terminal 20 has a controller 200 for controlling its operation, an audio/video input 202 and an audio/video output 204 coupled to the controller, a user input 206 , and a communications subsystem 208 coupled to the controller 200 for sending and receiving communications information over the networks 16 and 24 .
- a health care user 22 may operate the monitoring station video conference terminal 20 by manipulating the user input 206 .
- the controller 100 can include one or more microprocessors that are coupled to a storage 207 that includes persistent and/or transient memory. Storage 107 stores information and software enabling the microprocessor(s) of controller 200 to implement the monitoring station terminal functionality described herein.
- the audio/video input 202 may be a microphone 212 and camera 210 , respectively.
- the audio/video output 204 may be a speaker 222 and a display screen 220 , respectively.
- suitable options for the user input 206 may be a touch screen 214 , a keyboard 216 , and a mouse 224 .
- the monitoring station video conference terminal 20 may be a conventional personal computer with the appropriate peripheral devices.
- the controller 200 has a video conference manager module 230 , a caregiver paging module 240 , a messaging module 242 , a security camera module 244 , and a setup module 248 .
- the video conference manager module 230 includes a session module 131 , a contact manager module 236 , and an audio/video recording module 238 .
- the contact manager module 236 permits the managing of contact information of both patients 12 and remote users 30 .
- FIG. 13 is an example of a user interface screen on the display screen 220 of the monitoring station video conference terminal 20 for operation by a health care user 22 .
- the user interface screen of FIG. 13 shows an example idle mode screen when the monitoring station terminal 20 is not involved in any active video conference sessions.
- an administration button or icon 250 there is an administration button or icon 250 , a patients icon 252 , a system icon 254 , and a help icon 256 .
- There is a main video display 258 which may show video images, for example during a video conference session (a feed from a security camera is shown in the example idle mode screen of FIG. 13 ).
- Selection of the administration icon 250 displays on the display screen 220 an administration interface.
- Selection of the patients icon 252 displays on the display screen 220 a summary page of patient 18 information.
- Selection of the system icon 254 displays on the display screen 220 a system setup
- the interface for the remote monitoring terminal 20 includes a tabbed active calls menu 266 , residents menu 268 , and families menu 270 .
- the selected active calls menu 266 shows a list of active video conference calls between the monitoring station 20 and resident terminals 12 (see FIGS. 13-16 ).
- the active calls menu 266 displays the resident name for the active calls, the call time, and the status (for example, “waiting” or “Hold”).
- the residents menu 268 is best illustrated in FIG. 19 , and shows a list of patients 12 and their respective information, such as room number. Another patient 12 may be added to the residents menu 268 by selecting the add-resident icon 306 . A patient 12 may be edited by selecting the edit resident icon 308 . Similarly, selection of the families menu 270 shows a list of remote users 30 and their respective information (as best illustrated in FIG. 18 ).
- the session module 231 ( FIG. 12 ) manages the establishment and termination of video conference sessions between the monitoring station terminal 20 and other terminals.
- a health care user 22 may use the monitoring station video conference terminal 20 and select the residents menu 268 using the user input 206 (as best illustrated in FIG. 19 ). The health care user 22 may then select a patient 12 from the list of patients.
- the session module 231 Upon selection of a patient 12 , the session module 231 initiates a session request to the specified resident video conference terminal 12 .
- the resident video conference terminal 12 will display the phrase “Nurse is Calling” on the display screen 120 , as shown in FIG. 7 .
- the patient 18 may accept the session request, as explained above, thereby initiating a substantially real-time video conference session.
- the monitoring station video conference terminal 20 may also receive a session request from a resident video conference terminal 12 .
- a resident video conference terminal 12 initiates a session request (as explained above)
- the monitoring station video conference terminal 20 displays the incoming session request on the display screen 220 as follows.
- the name of the patient 12 is displayed on the active calls menu 266 and additionally, in at least some example embodiments, a patient thumbnail 272 including a still image (pre-stored) along with the name and room number of the calling patient 12 is displayed.
- An audible sound can also be used in some embodiments to signal the incoming session request.
- the patient thumbnail 272 could present active video live from the resident terminal rather than just a pres-store still image.
- the health care user 22 may accept the session request by selecting the appropriate patient thumbnail 272 or by selecting the name of the patient 12 displayed on the active calls menu 266 , thereby initiating the network session.
- the monitoring station terminal 20 may receive a number of concurrent incoming video conference session requests for processing in which case names and thumbnail images for each of the incoming requests can be displayed (see thumbnails 272 a - 272 d for example), and the incoming requests can be displayed in the Active Calls list 266 .
- the care giver can accept a session by using an on-screen indicator to point at and select an appropriate thumbnail image or name in the calls list 266 to processing with establishing a video conference session. As shown in FIG.
- a pre-existing video conference session is labeled as “On-Hold” (see thumbnail 272 ), meaning that a video conference session with that particular resident has been placed on-hold.
- some residents may be identified, through pre-configuration, as residents requiring extra care or attention, such that incoming session requests from such patients can be flagged visually and/or audibly in order to bring them quickly to the attention of the care giver 22 .
- FIG. 1 For example, in FIG.
- thumbnail 272 d (Erika Wilson) has been pre-identified as a resident requiring special attention, and accordingly when an incoming session request from her resident terminal 12 is received at monitoring station terminal 20 , both her still thumbnail image 272 d and her name in calls list 266 are presented in a different colour (for example red) than the remaining thumbnail images/names, thereby visually flagging that she is a resident that a quick response is desirable for.
- FIG. 16 A video conference session user interface screen for an on-going session is best illustrated in FIG. 16 (which illustrates a session with a patient 18 ).
- the display screen 220 shows a main video display 258 , a healthcare user video display 264 , a status menu 265 , a volume control 278 , an end call icon 260 , and a hold icon 260 .
- a substantially real-time video stream of the patient 18 will appear on the main video display 258 , and a substantially real-time audio of the patient 18 will be output from the speaker 222 for the health care user 22 .
- a video of the health care user 22 will be captured by the camera 210 and the audio will be captured by the microphone 212 , for substantially real-time transmission to the resident video conference terminal 12 .
- a video image 264 of the health care user 22 can also be displayed on the monitoring terminal 20 , which mirrors what is shown on the resident video conference terminal 12 .
- the status menu 265 may be set to “available” or “unavailable”. If the status menu 265 is set to “available”, the monitoring station video conference terminal 20 is available for network sessions. If the status menu 265 is set to “unavailable”, the monitoring station video conference terminal 20 is not available for network sessions and any existing network sessions are ended or terminated.
- the volume control 278 may be used to increase or decrease the volume from the speaker 222 , or to mute the speaker 222 .
- Selection of the end call icon 260 will end or terminate the active session that is currently shown in window 258 , and take the terminal 20 to the “Incoming Session Request” interface screen of FIG. 15 if other sessions are active, or to an idle screen (such as shown in FIG. 13 ) if no other sessions are active. Selection of the hold icon 260 will hold the active network session that is currently shown in window 258 , and take the terminal 20 to the “Incoming Call” interface of FIG. 15 .
- the monitoring station video conference terminal 20 may also initiate a video conference session with a remote video conference terminal 26 over Internet 24 .
- a health care user 22 may use the monitoring station video conference terminal 20 and select the families menu 270 using the user input 206 (see FIG. 18 ). The health care user 22 may then select a remote user 30 from the list of remote users.
- the session module 231 Upon selection of a remote user 30 , the session module 231 initiates a session request to the specified remote video conference terminal 26 .
- the remote user 30 may accept the session request, thereby initiating the network session.
- a three-way video conference session between a resident terminal 12 , a monitoring station terminal 20 and a remote user terminal 26 can be implemented.
- the audio/video recording module 238 permits the recording of video conference session with the monitoring station video conference terminal 20 .
- the audio/video recording menu 302 may be used to configure the audio/video recording module 238 .
- the monitoring station video conference terminal 20 may record both audio and video, audio only, or recording off.
- the caregiver paging module 240 permits the monitoring station video conference terminal 20 to send paging to pagers or other wireless devices carried by caregivers.
- the caregiver paging module 240 runs a paging application that is accessed from selecting the pager icon ( 274 in FIG. 16 ).
- there is an attendant menu 286 a resident requiring assistance menu 288 , an additional text menu 290 , a priority menu 292 , and a send icon 294 .
- the attendant menu 286 has a list of caregivers for selection.
- the attendant menu 286 shows the name of the caregiver and the position (i.e. registered nurse (RN) or attendant (Att)).
- the resident requiring assistance menu 288 has a drop-down list of patients 18 and the respective room numbers.
- the additional text menu has drop-down list of optional text to accompany the page. As shown, toilet assistance is a possible option. Other options (not shown) include bed discomfort, move to/from bed, food, spill clean-up, and drink.
- a custom message can be typed in at any time.
- the priority menu 292 has a list of high, normal, and low, to indicate the priority of the page. An appropriate paging message would include the name of the attendant, the name of the patient 18 , the room number, the additional text, and the priority.
- the caregiver paging module 240 Upon selection of the send icon 294 , the caregiver paging module 240 sends the paging message over network 16 to a paging system that packages the paging message and sends it over a wireless network to the appropriate paging device.
- the messaging module 242 runs a messaging application as represented in FIG. 18 .
- the messaging application may be initiated by selecting the families menu 270 or by selecting the messages icon ( 284 in FIG. 13 ) when a message is waiting.
- the received messages menu 296 has a listing of messages, and includes the sender name, the subject, and the received date.
- the compose new message icon 298 when selected, displays a composition screen (not shown) for composing a new text or email message.
- the forward messages field 299 allows a user to forward a message upon receipt to an alternative email address.
- the security camera module 244 implements a security camera function as represented in the idle screen of FIG. 13 .
- the security camera application may be initiated by selecting the safety cam icon 276 (see FIG. 13 ), which fades when selected.
- the main video display 258 shows a security camera video image (shown on the idle screen of the monitoring station terminal 20 in the illustrated example) taken from a security camera that is located in a common area of the facility 14 .
- the speaker ( 222 in FIG. 6 ) may also output audio corresponding to the video image.
- Camera thumbnails ( 282 a-d) show smaller video images of other selectable security camera video images of other common areas in the facility.
- the monitoring station terminal 20 can also be configured to permit monitoring of residents through one-way video streamed from either the main camera 110 or the auxiliary camera 712 of one or more resident terminals 12 can be viewed at the monitoring station terminal 20 .
- the setup module 248 allows a health care user 22 or other person to perform various administrative functions to the monitoring station video conference terminal 20 .
- the setup application may be initiated by selecting the administration icon 250 .
- Selection of the activity information icon 310 displays on the display screen 220 an information page (not shown) for composing and enabling of information pages to be shown by the information display module 136 on the resident video conference terminal 12 .
- the NSU transfer menu 300 permits the monitoring station video conference terminal 20 to transfer responsibility for a group that includes a plurality of resident terminals 12 from the terminal 20 to another video conference terminal 20 , after which incoming video conference requests from resident terminals 12 and remote terminals 26 previously associated with the remote monitoring terminal 20 will be routed to another remote monitoring terminal 20 .
- all of the features and services that a monitoring station 20 is providing or performing for a group of resident terminals 12 that are assigned to it could be transferred for the entire group to another monitoring station terminal by selecting the desired transferee terminal option from menu 300 .
- a facility 14 may have a plurality of remote monitoring terminals 20 that each have a respective coverage area or resident responsibility during peak times, with the coverage areas/ responsibility being consolidated to fewer terminals during non-peak times.
- an audible alerts menu 304 may be used to configure the alert volume for specified events, such as resident calling, family calling, and new message.
- a system icon 254 may also be selected to configure the monitoring station video conference terminal 20 for applications such as network parameters (such as Internet Protocol address), timeouts, passwords, and unit identification.
- Setup of the monitoring station terminal 20 can include providing information to the terminal such as: (a) input of an identifier for the monitoring station terminal 20 - associated with an IP address, this identifier allows the resident terminals 12 to make themselves available to a particular monitoring station terminal 20 ; (b) User names and passwords for caregivers using this monitoring station terminal 20 ; (c) identification of resident terminals 12 visible on network that will be associated with and hence share 2-way video chat with the monitoring station terminal 20 ; (d) Photos and names of residents if not available from the resident terminal or other sources automatically - these photos become the thumbnails presented at the monitoring station terminal 20 when a session request is initiated; (e) Information (names, email addresses) for family members subscribing to the service will in at least some example embodiments be automatically uploaded to the monitoring station terminal 20 from the resident terminal 12 and/or conference server 28 if the information is available and (f) Safety Camera are chosen and enabled from a list of available cameras presented after an automatic discovery of which cameras are on the network with the monitoring station terminal 20 . Safety Cam
- some of the information used by a care giver monitoring terminal 20 can be stored on central server 21 within the care facility network 16 , such that such information can be accessed by a plurality of monitoring terminals 20 .
- patient information including a patient photograph, room number, etc. could be stored in a central server 21 and drawn on by various monitoring terminals 20 .
- Account information identifying the monitoring terminals 20 of the care facility 14 to the conference server 28 and/or remote terminals 26 can be stored on the central server 21 .
- FIG. 20 shows a block diagram of the remote video conference terminal 26 to be used on the communications system 10 .
- the remote video conference terminal 26 has a controller 400 that includes one or more processors for operation of the remote video conference terminal 26 , an audio/video input 402 and an audio/video output 404 coupled to the controller, a user input 406 , a electronic storage 407 including persistent and RAM storage elements, and a communications subsystem 408 coupled to the controller 400 for sending and receiving communications information over the network (Internet) 24 .
- the audio/video input 402 may be a microphone 412 and camera 410 , respectively.
- the audio/video output 404 may be a speaker 422 and a display screen 420 , respectively.
- suitable options for the user input 406 may be (but are not limited to) a keyboard 416 and a mouse 424 .
- the remote terminal 26 can be implemented through a wide variety of electronic devices that are enabled to exchange video and audio data through a wide area network such the Internet, including for example a suitably configured stationary personal computer, a mobile lap top or other mobile computing device such as a handheld personal digital assistant or cell phone.
- the controller 400 has a video conference manager module 430 , a messaging module 432 , a security camera module 434 , and a setup module 436 .
- the video conference module 430 includes a session module 431 .
- FIG. 21 is an exemplary video conference user interface screen 420 of the remote video conference terminal 26 .
- the main video display 440 may show video images, for example of another party in a video conference session.
- a video image of the user 30 of the remote terminal 26 is displayed on the remote user video display 450 , which mirrors what is displayed on the other video conference terminal.
- the status menu 451 may be set to “available” or “unavailable”. If the status menu 451 is set to “available”, the remote video conference terminal 26 is available for network sessions. If the status menu 451 is set to “unavailable”, the remote video conference terminal 26 is not available for network sessions and any existing network, sessions are ended or terminated.
- FIGS. 21 to 23 Operation of the video conference module 430 is illustrated in FIGS. 21 to 23 .
- FIG. 21 shows a call patient or resident menu 452 and a call health care menu 454 .
- FIG. 22 shows a resident or patient calling notice on the main video display 440 and a connect icon 462 .
- FIG. 23 shows a health care calling notice on the main video display 440 and the connect icon 462 .
- the video conference module 430 can initiate a network session with another video conference terminal.
- a remote user 30 may use the remote video conference terminal 26 and select the call patient menu 452 using the user input 406 .
- the remote user 30 may then select a resident patient 12 from a drop down menu (not shown) of patient names (in many cases, there will only be one resident name to select).
- the session module 431 Upon selection of the name of a resident patient 12 , the session module 431 initiates a session request to the specified resident video conference terminal 12 .
- the resident video conference terminal 12 will display a notice that a remote user 30 is calling on the display screen 120 .
- the patient 18 may accept the session request, as explained above, thereby initiating the video conference session.
- the remote video conference terminal 26 may also initiate a network session with a health care conference terminal 20 .
- a remote user 30 may use the remote video conference terminal 26 and select the call health care menu 454 using the user input 406 .
- the health care user 22 may then select a health care user 22 from a drop down menu (not shown) of names of health care users 22 .
- the session module 431 Upon selection of a health care user 22 , the session module 431 initiates a session request to the specified monitoring station video conference terminal 20 .
- a health care user 22 may use the monitoring station video conference terminal 20 to accept the session request, as explained above, thereby initiating the video conference session.
- substantially real-time video of the resident 18 will appear on the main video display area 440 for the remote user 30 to see, and audio of the resident 18 (or care giver 22 ) will be output from the speaker 422 .
- substantially real-time video and audio of the remote user 30 will be captured by the camera 410 and microphone 412 , for sending to the resident video conference terminal 12 (or remote monitoring terminal 20 ) by the communications subsystem 408 .
- the remote video conference terminal 26 may also accept a session request from another video conference terminal, as shown in FIGS. 22 and 23 .
- FIG. 22 shows a session request from a resident video conference terminal 12 .
- a resident calling notice is displayed on the main video display screen 440 .
- FIG. 23 shows a session request from a monitoring station video conference terminal 20 .
- a health care calling notice is displayed on the main video display screen 440 .
- the messaging module 432 runs a messaging application as illustrated in FIG. 24 .
- Selection of the away message icon 464 allows a remote user 30 to compose an away message to be displayed in response to a session request when the remote video conference terminal 26 is offline.
- the text message icon 466 allows a remote user 30 to compose a text message for sending to the monitoring station video conference terminal 20 .
- a security camera module 434 implements a security camera feature when the safety cam icon 456 ( FIG. 21 ) is selected.
- the main video display area 440 displays a one way video feed (and possible audio) from a local security camera at facility 14 (for example an auxiliary camera 712 or main camera 110 of resident terminal 12 or another camera) located in proximity to the patient 18 .
- a remote user 30 may be able to remotely monitor the patient 18 and the manner in which the patient 18 is being treated by care giver staff.
- the setup module 436 runs a setup application when the administration icon 458 is selected.
- Applications that may be run in the setup application include alert forwarding (sends an email notifying a remote user 30 of a session request when the remote video conference terminal 26 is unavailable), password change, and account information.
- FIG. 25 shows a block diagram of a conference server 28 to facilitate communications on the communications system 10 .
- the conference server 28 may manage accounts and log data relating to video conference sessions carried out using the system 10 .
- the conference server 28 may provide access to software updates, and help for users of the communications system 10 .
- the conference server may include a single server or a server cluster.
- the conference server 28 has a controller 500 (implemented by one or more processors) for controlling operation of the conference server 28 .
- Software and data stored on an electronic storage element 507 is used by controller to implement various modules including a connection manager module 502 and a directory service module 508 .
- the connection manager module 502 includes a customer module 504 and an administration module 506 .
- the directory service module 508 includes a customer module 510 and an administration module 512 .
- a communications subsystem 520 is coupled to the controller 400 for sending and receiving communications information over the Internet 24 .
- the customer module 504 of the connection manager module 502 permits a user to review family and friend online status, find appropriate endpoints by account name, set personal online status, initiate or terminate sessions, manage runtime settings and display items and other operational parameters (for items such as cameras and microphones, favorite links, display preferences), view system alerts (i.e. incoming call attempts), manage the system, and call log.
- the administration module 506 of the connection manager module 502 includes a number of features, permitting an administrator to review online status, review active connections, forced session management (terminate, disconnect, etc), review login and usage statistics for all accounts, and review logs for all accounts.
- the customer module 510 of the directory service module 508 implements a number of features, including history, manage profile, manage account, and help.
- the history feature maintains a call history with usage metrics, logs the total connection hours, and supports invoicing.
- the manage profile feature maintains login and account settings, information change, allows a user to change or upload away screens and other graphics, and set customer based limits and thresholds.
- the manage account feature maintains activation or cancellation of accounts, payment methods, billing methods (per call, bandwidth, etc.), allows viewing of active credits, and account recycling.
- the help documentation feature maintains frequently asked questions (FAQ), troubleshooting, online instruction manuals, privacy policy, and other agreements.
- FAQ frequently asked questions
- the administration module 512 of the directory service module 508 implements a number of features, including customer profile, account information, and current users.
- the customer profile feature allows viewing of the customer profile (except password and private items), resetting of passwords, and bandwidth restrictions or quality of service.
- the account information feature allows the change of information as necessary.
- the current users feature permits viewing of a list of current users logged on.
- a service provider will operate the conference server 28 and provide the hardware and software required for resident terminals 12 .
- the resident terminals 12 can in various embodiments be purchased or leased by the operators of facility 14 from the service provider, or purchased or leased by residents (or their family members) from the service provider, or may be provided by the service provider on loan to the facility 14 and/or residents 18 in exchange for the opportunity to entice remote users 30 (typically family members) or residents to subscribe to video conference services.
- the monitoring station terminal 20 may be acquired (through purchase, lease, license or free loan, for example, under various business models) with the required software from the service provider.
- software required to implement the monitoring station terminal 20 on an existing facility computer or server can be acquired (licensed) from the service provider, for example, through an Internet connection to a store front maintained at conference server 28 , or installed from a disc or other software medium.
- the entity that operates the conference server 28 can be a different entity that the entity that provides any proprietary hardware and software required for implementing the terminals 12 , 20 and 26 and server 28 .
- remote terminals 26 may in example embodiments be licensed for a fee or for free to remote users 30 who subscribe for video conference services, and can be obtained by remote users from the service provider, for example, through an Internet connection to a store front maintained at conference server 28 , or installed from a disc or other software medium.
- the video conference services facilitated through conference server 28 could be made available for various fees to the different participants.
- the monitoring station software could be licensed for a fee to the operator of facility 14 ; remote users and/or residents could sign up for subscription packages billed monthly, yearly, or based on pay per use, or combinations of the forgoing.
- the costs for high speed Internet access to resident terminals 12 could be paid for by the operators of facility 14 , or remote user's, or residents, or combinations of the forgoing.
- a new user for example, a family member of a resident of a facility 14 that is enabled with resident terminals 12 and a central monitoring terminal 20 .
- a new user desires to set up or register a new account they will access a “New Account” Web page maintained by conference server 28 .
- the information collected from the new user while setting up an account can include, among other things: (a) contact information for the new user/subscriber (who may be a family member of a resident 18 , for example); (b) billing information (Credit Card, pre-payment by cheque, etc.); (c) resident information, including Resident's name, and a still photo of resident, uploaded for example as a JPEG or other graphics file—the resident photo can be passed on to the resident terminal 12 through the network (Internet 24 and LAN 16 ) where it is in turn can be retrieved from the resident terminal by any monitoring station terminal 20 that is associated with that resident terminal 12 ; and (d) Family/friends associated with account, i.e.
- Remote user's name (a prompt for a full name for each remote user can be provided as well as a short name or nick name, with the full name being optional for inclusion in the “Families” menu 270 of the monitoring station terminal 20 if communications with the monitoring station terminal 20 are desired, and the short name being used for display on the interfaces presented on the resident terminal 12 ;
- Remote user's email address and/or text message address (optional—required if email or text message communication with monitoring station terminal 20 is desired)
- Remote user's still photo (uploaded for example as a JPEG or other graphics file).
- the photo is passed on to the resident terminal 12 and used by the resident terminal as an image combined with the short name on the resident terminal's touch screen, and acts as the touch screen control for calling (see FIG. 6 , for example); (iv) user name; and (v) Password—the conference server 28 can create a default that can be updated through a change password facility.
- a terminal can “log in” with the conference server 28 and provide the server with terminal and/or user identification information and any further authentication information that may be required.
- remote terminals 26 , and resident terminals 12 and monitoring terminals 20 that are available for video conference sessions through the Internet 24 with remote terminals 26 , will be those terminals that are “logged in” or “on-line” with the conference server 28 .
- the log in procedure could for example be carried out by the video conference module 430 (see FIG.20 ).
- such module may have an associated icon displayed the display screen 420 of the remote terminal 26 —user selection of such icon initiates a video conference application that implements the video conference module 430 on processor 400 .
- the remote terminal 26 could be configured to initiate the video conference application upon start-up of the remote terminal 26 .
- the video conference module 430 then stays on-line with the video conference server 28 over Internet 24 until the video conference application is shut down or the Internet connection severed.
- a remote terminal user may alternatively just log-on using a web browser to go to a designated web site hosted by the conference server 28 .
- resident terminals 12 and monitoring terminals 20 are each configured to log-in to the conference server 28 through the Internet 24 once they are turned on, and to remain logged in so long as a connection exists through the Internet 24 to the conference server 28 . Furthermore, as the monitoring terminal(s) 20 and resident terminals 12 within a care facility 14 are each connected to a common enterprise network 16 in at least one example configuration, such the resident terminals 12 are aware through communications over the enterprise network 16 of the monitoring terminal(s) 20 present on the network 16 , and the monitoring terminal(s) 20 is (are) aware of the resident terminals 12 present on the network. In some embodiments, users of terminals 12 , 20 and 26 can select an “unavailable status”, even when in a logged state, indicating that the user's terminal is unavailable to accept incoming video conference requests.
- the conference server 28 maintains a log of what terminals 12 , 20 , and 16 are currently online, and the availability status of such on-line terminals for accepting incoming video conference requests.
- the server can be configured to periodically poll the on-line terminals to determine if their status changes, and the terminals can also be configured to notify the server 28 of any changes in their status (for example if a terminal logs off, or goes from being available to accept incoming session requests to unavailable).
- a resident terminal 12 can periodically poll the conference server 28 to track which of the remote terminals 26 that it is associated with (i.e. terminals 26 used by remote users that the resident terminal 12 is preconfigured to initiate video conference sessions with) are presently logged in to the conference server and available for accepting video conference calls from the resident terminal - using this information, the resident terminal 12 can then “fade in” or “fade out” thumbnail images 156 , 158 (see FIG. 6 ) depending on the on-line/availability status of the respective remote users.
- the conference server 28 can also be configured to push such status information out to affected resident terminals 12 when the conference server 28 becomes aware of changes in the status of a remote terminal 26 associated with a particular resident terminal 12 .
- remote terminals 26 can also acquire information from the conference server 28 about the status of their associated resident terminals 12 .
- resident terminals 12 can exchange status/availability information with relevant monitoring units 20 directly through enterprise network 16 without going through the conference server 28 , however in at least one example embodiment, such communications could alternatively be coordinated through the conference server 28 .
- conference participant 1 represents a resident terminal 12
- conference participant 2 represents a remote terminal 26
- CP 1 conference participant 1
- CP 2 conference participant 2
- terminal CP 1 sends a connect request message to the conference server 28 (see step 600 ).
- the connect request message includes information identifying the sending terminal (CP 1 ID) and information identifying the target recipient terminal (CP 2 ID).
- the conference server 28 validates and/or authenticates the two conference participants (for example, the conference server 28 may ensure the terminals CP 1 and CP 2 are properly logged in, and associated with an active account having appropriate billing credits), and then provides a unique conference ID to each of the initiating and target terminals in a conference enable message (steps 602 , 604 ) that is sent to the initiating terminal CP 1 in the form of a response message and to the target terminal CP 2 as an update message.
- the terminals connect directly using the conference ID provided by the conference server 28 .
- the initiating terminal CP 1 after receipt of the conference enable message, the initiating terminal CP 1 then sends a connect request message to the target terminal CP 2 that includes the conference ID, and the target terminal CP 2 then sends a conformation message to the target terminal CP 1 that includes the conference ID, thereby establishing a bi-directional video conference session in which video and data are exchanged.
- the participating terminals CP 1 and CP 2 each periodically validate the ongoing session with the conference server 28 using the conference ID (see steps 610 , 612 , 614 and 616 ). So long as the conference server 28 concludes that the conference ID is still valid (the server 28 may for example check to confirm that a time credit is still outstanding on a prepaid account, or that costs or time have not exceeded a predetermined limit), then the server will signal for the ongoing conference session to continue.
- Either of the participants can terminate a video conference session by selecting the “End Call” option at their respective terminal.
- the participant's terminal terminal CP 1 in FIG. 26
- the conference server 28 sends a Kill Request message to the conference server 28 that includes the conference ID.
- the conference server 28 then sends a terminate session message to each of the participating terminals CP 1 , CP 2 , to end the session (steps 618 , 620 ).
- the conference server 28 can also terminate the video conference session unilaterally by sending the terminate signals to the participating terminals CP 1 and CP 2 , for example if participant credits run out or the ongoing conference validation in steps 610 - 616 otherwise fails.
- FIG. 26 The messaging diagram of FIG. 26 has been described above in respect of a video conference session initiated by a resident terminal 12 with a target remote terminal 26 .
- the diagram would be similar for a video conference session initiated by a remote terminal 26 with a target resident terminal 12 , with the roles of the two terminals being reversed.
- video conference sessions between a monitoring terminal 20 and a remote terminal 26 could also be carried out as shown in FIG. 26 .
- video conference sessions within the enterprise network 16 are managed directly between the resident terminals 12 and the monitoring terminal(s) 20 without involving the conference server 28 , however in some example embodiments even sessions between resident terminals 12 and the monitoring terminal(s) 20 could be managed through the conference sever 28 using the methodology shown in FIG. 26 .
- video conference sessions could be managed by the conferencing server 28 in a manner that is different than what is shown in the example diagram of FIG. 26 .
- the conference server 28 participates in the set up, ongoing authorization, and subsequent tear down of video conference sessions, the conference server is able to track for accounting and billing purposes information about the video conference sessions that involve remote terminals 26 , including the identity of terminals 12 , 20 , 26 involved and the duration of the video conference sessions.
- the conference server 28 can facilitate and track one-way video monitoring sessions in which video from resident terminal camera 712 and/or camera 110 is streamed from a resident terminal to a remote terminal 26 in much the same way as a two-way video conference session is facilitated.
- resident terminals 12 can be enabled to include a VoIP (Voice Over Internet Protocol) function allowing such terminals to initiate and receive VoIP calls to and from remote terminals 26 and other remote communications devices.
- VoIP Voice Over Internet Protocol
- communication system 10 has been described above in the context of care facilities, embodiments of the system could also be applied to facilities or organizations having residents that wish to communicate with remotely located family members or other parties, including, but not limited to, for example, detention facilities, boarding schools, summer camps, and military camps.
Abstract
Description
- This application claims priority to, and any other benefit of, U.S. provisional patent application No. 60/825,828 filed Sept. 15, 2006.
- Example embodiments described herein relate to communications systems and, in particular, to video conferencing methods and systems.
- Patients or residents of care facilities are often physically separated from health care practitioners within the facility who may be attending to other duties and functions. As well, family members and other parties who would like to communicate with the patient typically are often not able to be physically present at the care facility.
- Patients may experience isolation as a result of these difficulties. Also, if a patient requires assistance in the instance of an emergency or other difficulty, health care practitioners or family members may not be able to be physically present to address the patients' needs. Accordingly, it is desirable to provide systems and methods for facilitating communications between residents of care facilities and other parties that are involved in caring for or supporting the residents.
- Example embodiments will now be described by way of example with reference to the accompanying drawings, through which like reference numerals are used to indicate similar features.
-
FIG. 1 shows a block diagram of an example of a communications system to which example embodiments can be applied; -
FIG. 2 shows a block diagram of a resident video conference terminal to be used on the communications system shown inFIG. 1 ; -
FIGS. 3A , 3B, 3C,3D, 3E and 3F show, in diagrammatic form, a front view of an example of the resident video conference terminal ofFIG. 2 , with example graphical user interface screens thereon when no video conference session is active; -
FIG. 4 shows a diagrammatic view of an example graphical user interface for the resident video conference terminal ofFIG. 2 , while a session request is sent to a monitoring station terminal; -
FIG. 5 shows a diagrammatic view of a graphical user interface for the resident video conference terminal ofFIG. 2 after a session with a monitoring station terminal has been established; -
FIG. 5A shows a diagrammatic view of a graphical user interface for the resident video conference terminal ofFIG. 2 after a session with a remote terminal has been established; -
FIG. 6 shows a diagrammatic view of a graphical user interface on the resident video conference terminal ofFIG. 2 that is displayed in response to pressing of a “call family” button; -
FIG. 7 is a diagrammatic view of an interface screen for the resident video conference terminal ofFIG. 2 , when a video conference session request is incoming; -
FIG. 8 is an illustrative front view of a remote control for use with the resident terminal ofFIG. 2 ; -
FIGS. 9 to 11 show examples of administrative user interface screens displayed on the resident terminal ofFIG. 2 in example embodiments -
FIG. 12 shows a block diagram of a monitoring station video conference terminal to be used on the communications system shown inFIG. 1 ; -
FIG. 13 shows a diagrammatic view of an example graphical user interface of an idle screen for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 14 shows a diagrammatic view of an example graphical user interface of an incoming session request screen for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 15 shows a diagrammatic view of an example graphical user interface of a multiple incoming session request screen for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 16 shows a diagrammatic view of an example graphical user interface of a current video conference session for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 17 shows a diagrammatic view of an example graphical user interface of a paging function for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 18 shows a diagrammatic view of an example graphical user interface of a messaging function for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 19 shows a diagrammatic view of an example graphical user interface of an administration function for the monitoring station video conference terminal ofFIG. 12 ; -
FIG. 20 shows a block diagram of a remote video conference terminal to be used on the communications system shown inFIG. 1 ; -
FIG. 21 shows a diagrammatic view of an example graphical user interface for the remote video conference terminal ofFIG. 12 ; -
FIG. 22 shows a diagrammatic view of an example graphical user interface for an incoming session request from a resident terminal for the remote video conference terminal ofFIG. 12 ; -
FIG. 23 shows a diagrammatic view of another example graphical user interface for an incoming session request from a monitoring station terminal for the remote video conference terminal ofFIG. 12 ; -
FIG. 24 shows a diagrammatic view of an example graphical user interface of a messaging application for the remote video conference terminal ofFIG. 12 ; -
FIG. 25 shows a block diagram of a conference server to be used on the communications system shown inFIG. 1 ; -
FIG. 26 shows a diagram illustrating conference session management according to an example embodiment; and -
FIGS. 27A-27D illustrate an example of a possible user interface screens for a VOIP function on the resident terminal ofFIG. 2 . - According to one example embodiment of the invention is a resident video conference terminal for use by a resident of a facility, the resident terminal including: a controller for controlling the operation of the resident terminal; a touch screen display connected to the controller; a camera connected to the controller for capturing a video image of a user of the resident terminal during a video conference session; an audio transducer connected to the controller for capturing audio of a user of the resident terminal during a video conference session; an audio output connected to the controller; and a communications interface connected to the controller for exchanging signals with a communications network during a video conference session. The controller renders on the touch screen display a simplified user interface screen including a first user selectable button for initiating a video conference session with a monitoring station terminal within the facility and a second user selectable button for initiating a video conference session with at least one remote terminal that is external to the facility.
- According to another example embodiment is a video conferencing system for facilitating communications between residents of a health care facility and remote users located outside of the health care facility. The system includes a plurality of resident terminals connected to a local area network within the health care facility, each resident terminal being associated with a resident of the health care facility and having stored thereon information identifying at least one remote user terminal located external to the local area network and that the resident terminal is associated with, each resident terminal being configured to display on a screen thereof a visual image that can be selected by a user thereof to initiate a video conference session with the at least one remote user terminal associated therewith. The system also includes a remote conference server located external to the health care facility and in communication with the plurality of resident terminals and the remote user terminals that are associated with the resident terminals, the conference server tracking usage information for video conference sessions that are established between the resident terminals and the remote user terminals associated therewith.
- According to another example embodiment is a monitoring station video conference terminal for use by a care giver in a care facility in which a plurality of resident video conference terminals located with the care facility are assigned to the monitoring station terminal. The monitoring station includes: a controller for controlling the operation of the monitoring station terminal; a display connected to the controller; a camera connected to the controller for capturing a video image of a user of the monitoring station terminal during a video conference session; an audio transducer connected to the controller for capturing audio of a user of the monitoring station terminal during a video conference session; an audio output connected to the controller; and a communications interface connected to the controller for exchanging signals with a communications network during a video conference session. The controller is configured for selectively establishing, in response to user input, video conferences sessions with the resident terminals assigned thereto.
- According to another example embodiment is a method of facilitating video conference sessions between residents of a care facility and remote parties who are outside of the care facility. The method includes providing resident terminals for use by residents of a care facility for video conference sessions, the resident terminals each having a user interface configured for use by a person having at least one of reduced cognitive abilities and reduced physical abilities; and assigning at least some of the resident terminals to specific residents of the care facility and storing at each resident video conference terminal assigned to a resident information identifying at least one remote terminal associated with the resident video conference terminal.
- The terms “include” and “comprise” are used interchangeably within this document and are non-exhaustive when used, meaning, for example, that elements and items that are identified as including or comprising certain components or features can also include additional components or features that are not expressly identified.
- Reference is now made to
FIG. 1 , which shows a block diagram of acommunications system 10 that in example embodiments facilitates 2-way video communication between patients/residents in a care facility, care providers within the facility, and other parties, such as family members and friends, who are remotely located relative to the care facility. Thecommunications system 10 includes, within acare facility 14, a number of bed side units (“BU”) or residentvideo conference terminals 12 and in some example embodiments at least one nursing station unit (“NSU”) or central monitoring stationvideo conference terminal 20. In some example embodiments, central monitoring stationvideo conference terminal 20 may not be present. In an example embodiment, theresident terminals 12 andmonitoring station terminal 20 within thecare facility 14 are connected to and part of a common intranet, including for example at least one local area network (“LAN”) 16. In example embodiments, theresident terminals 12 are enabled for wireless communication withnetwork 16 through wireless access points located within thecare facility 14. Thecommunication system 10 also includes a number of remotevideo conference terminals 26 that are exterior of thehealth care facility 14 for use by family members or friends or other concerned parties to video conference with patients and care givers at thecare facility 14. Theremote terminals 26 are each connected to a wide area network (WAN) 24, which in an example embodiment includes the Internet. TheLAN 16 is also connected, typically through a gateway server andfirewall 23 to the WAN 24. In an example embodiment, aconference server 28 is also connected to the WAN 24 to facilitate communications between theremote terminals 26 and the patient andcare provider terminals care facility 14. - The LAN 16 may be a computer network, typically covering a small local area such as single building of the
care facility 14 or group of buildings that make up thecare facility 14. TheLAN 16 may be based on wired (such as switched Ethernet) and/or wireless technology (including for example technologies compliant with at least some of the family of IEEE 802.11 standards). Thecare facility 14 may be any suitable institution, and includes long-term care facilities, retirement homes, assisted living facilities, hospitals, and other institutional care facilities. - In operation, a
patient 18, health care professional 22, orremote user 30 may wish to request a session between their respective video conference terminals (resident terminals 12, centralmonitoring station terminal 20, andremote terminal 26, respectively). By way of example, apatient 18 may operate a residentvideo conference terminal 12 located at the patient's bedside. The patient 18 may initiate a session request on the residentvideo conference terminal 12 with another terminal, for examplemonitoring station terminal 20, which is used as a health care provider terminal. A health care professional 22, such as a nurse, doctor, technician, or assistant, may use the health care provider central monitoring stationvideo conference terminal 20 to accept the session request by thepatient terminal 12, resulting in a video conference session being established over theLAN 16 between the residentvideo conference terminal 12 and the monitoring stationvideo conference terminal 20 located at thehealth care facility 14. - By way of another example, a
remote user 30, such as a family member, friend or other third party, may initiate a session request on the remotevideo conference terminal 26 with another terminal, for example a residentvideo conference terminal 12. The patient 18 may then use the residentvideo conference terminal 12 to accept the session request from the remotevideo conference terminal 26, such that a video conference session is established over theWAN 24 andLAN 16 between the remotevideo conference terminal 26 and the residentvideo conference terminal 12. By way of yet another example, a video conference session may be similarly established between the monitoring stationvideo conference terminal 20 and the remotevideo conference terminal 26. - It can be appreciated that a three-way network session (or a network session between a multiplicity of video conference terminals) may also be created between the resident
video conference terminal 12, central monitoring stationvideo conference terminal 20, and remotevideo conference terminal 26. - In example embodiments,
conference server 28 may act as both a connection manager module and directory service module to facilitate network sessions between thevideo conference terminals - Now that an overview of
communications system 10 has been provided, aspects of the system will now be described in greater detail. - Reference is now made to
FIGS. 2 to 11 , which show illustrative embodiments of the residentvideo conference terminal 12 for use by apatient 18. Theresident terminal 12 is in at least some example embodiments configured to allow a patient with limited or reduced cognitive and physical abilities to participate in video conference communications with care givers at thecare facility 14, and concerned persons (such as family) atremote terminals 26. -
FIG. 2 shows an illustrative block diagram of an example residentvideo conference terminal 12 to be used on thecommunications system 10. As shown inFIG. 2 , the residentvideo conference terminal 12 has acontroller 100 for controlling operation of the residentvideo conference terminal 12, an audio/video input 102 and an audio/video output 104 coupled to the controller, auser input 106, and awireless communications subsystem 108 coupled to thecontroller 100 for sending and receiving communications information over a wireless connection toLAN 16. In an example embodiment, eachresident terminal 12 is configured to communicate with theInternet 24 throughLAN network 16.Terminal 12 also includeselectronic storage 107, which is coupled to thecontroller 100 and can include transient memory such as RAM and one or more persistent storage elements such as, but not limited to, flash memory or a hard drive. Thecontroller 100 can include one or more microprocessors that are coupled to the persistent and/or transient memory ofstorage 107.Storage 107 stores information and software enabling the microprocessor(s) ofcontroller 100 to implement the resident terminal functionality described below. In an example embodiment, theresident terminal 12 includes arechargeable power source 109 for poweringterminal 12. - The audio/
video input 102 may be amicrophone 112 andcamera 110, respectively. The audio/video output 104 may be aspeaker 122 and adisplay screen 120, respectively. As shown, suitable options for theuser input 106 may be atouch screen 114, aremote control 116, or akeyboard 118. - Referring to
FIG. 3A , in an example embodiment, theresident terminal 12 is packaged as a self-contained mobile, compact tablet-style console 160 that is ergonomically configured to be easily picked up, moved about, and used by a patient 18 who may have impaired physical functions and/or limited cognitive abilities. In some example embodiments, theresident terminal 12 can be mounted to a hospital-style rolling bedside table, or mounted on a swing arm such as those used for hospital televisions, so that it can be positioned for use by thepatient 18. By way of non-limiting example, in terms of external dimensions, theconsole 160 can in at least some example embodiments, have a depth (i.e. going into the page inFIG. 3 ) of between 2 to 5 inches, a height “H” of between 6 to 9 inches and a width W of between 7 to 10 inches, although other dimensions are also possible. A charging station (not shown) can be located in the patient's room for charging thepower source 109 when, for example, theresident terminal 12 is not in use. - As shown in
FIG. 3A , the residentvideo conference terminal 12 includes integrated user interface components includingdisplay screen 120,camera 110,speaker 122 andmicrophone 1 12 (a headset can be used in some example embodiments). In the illustrated example embodiment, thedisplay screen 120 is atouch screen 114. - Referring again to
FIG. 2 , there are a number of modules of thecontroller 100 that may perform desired functions on the residentvideo conference terminal 12. In one example embodiment, the modules oncontroller 100 are implemented by software applications running on a processor of thecontroller 100, the executable code for such applications being stored onstorage 107. As shown, thecontroller 100 has avideo conference module 130, asymptom input module 132, atelevision module 134, aninformation display module 136, aspeech stretcher module 140 and asetup module 142. Thevideo conference module 130 includes asession module 131. In various embodiments, additional or fewer modules may be implemented bycontroller 100, and some or all of the functions performed by some modules could be combined into other modules or split into separate modules. In some example embodiments, rather than having all the code for the modules present on eachresident terminal 12, at least some of the modules shown inFIG. 2 could be at least partially hosted on a device other than theresident terminal 12, such as on aresident server 21, acentral monitoring station 20, or a Web-accessible server such asconference server 28, with the resident terminal calling on the remotely located modules in a client-server fashion. - In example embodiments, a patient or
resident 18 may operate the residentvideo conference terminal 12 to initiate or accept video conference sessions with another video conference terminal (including, for example, monitoring station terminal and/or a remote terminal 26) by manipulating theuser input 106, which in the illustrated embodiment ofFIGS. 3-11 takes the form of anLCD touch screen 114 which performs the dual role of adisplay screen 120 and auser input 116. In an example embodiment, theresident terminal 12 is preconfigured for a specific resident, and in this regard information is stored on theresident terminal 12 that identifies one or moreremote terminals 26 that are associated with one or moreremote users 30 that theresident 12 is authorized to establish video conference sessions with. The stored information in at least some example embodiments includes for each authorizedremote terminal 26, a picture of and name of the remote user(s) 30 associated with theremote terminal 26. - The
video conference module 130 performs a video conferencing as follows.FIG. 3A shows an example of a default home or idlegraphical user interface 162 on thedisplay screen 120 with three video conference options shown as user selectable icons or buttons: acall nurse button 150; acall family button 152; and anend call button 154. In one example embodiment, thedisplay screen 120 will be blank or have reduced back lighting in a power saving mode when no user interaction with the terminal 12 has occurred within a predetermined time period. The terminal 12 can be brought out of power saving mode to display the defaultidle interface 162 in response to a user input, for example a user touching any portion of thescreen 114. In some example embodiments, the terminal 12 may be equipped with a motion switch or motion detector 119 (FIG. 2 ), such that motion of the console 160 (for example, if the console is picked up) causes thecontroller 100 to exit power saving mode anddisplay default interface 162. Thus, in such an embodiment, thedefault interface 162 can be easily displayed by a patient having limited physical or cognitive abilities. The terminal 12 can also be brought out of a power saving or standby mode to display an incoming session request interface (described below) when an incoming session request is received by the terminal 12. - In the illustrated embodiment of
FIG. 3A , when the terminal 12 is in an idle mode and not currently involved in a video conference session, the patient is presented with only two active options to select—the “Call Nurse”button 150 and the “Call Family”button 152, which are presented with light lettering (for example white) and bright backgrounds to provide a visual indication that such options are available for selection; the “End Call”button 154 is presented ininterface 162 with faded or darker lettering and/or a faded or darker background to provide a visual indication that the “end call” option is not currently available for selection. In an alternative example embodiment, the “end call”button 154 is not displayed at all in theinterface 162 when it is not an available option. As shown inFIG. 3A , thedefault interface 162 includes alarge portion 155 that displays nothing, except perhaps a time at a bottom portion of it. However, in some example embodiments,screen area 155 can be configured to display, while in idle mode, information and/or pictures for the patient. For example, a schedule of events organized for the day for the residents of the care facility could be presented inarea 155 of thedefault interface 162. In this regard,FIG. 3D shows an example embodiment in which adaily schedule 163 for theresident user 18 is presented in thearea 155 of the defaultidle interface screen 162. Daily menu information could alternatively or additionally be shown in thearea 155. Such information could be customized for the particular resident that the terminal 12 has been assigned to. For example, a general program schedule for thefacility 14 can be stored at thecentral monitoring station 21 orcentral server 20, or remotely at an external server, and periodically sent to theresident terminal 12 with appropriate filtering being applied (either at the terminal 12 itself or at a server from which the scheduling data is retrieved) according to predetermined activity preferences for the resident. Alternatively (or additionally) a picture (for example of family, a pet, etc.) provided by or on behalf of the resident could loaded onto the terminal 12 and then displayed inarea 155 of thedefault interface 162. - In an example embodiment, the
option buttons option buttons touch screen 114, however they could be displayed in other configurations as well. In some embodiments, option button location and/or size can be a configurable setting of the terminal 12. For example, if it is known that a left handed patient will be using the terminal, thecontroller 100 can be pre-configured to locate the column oroption buttons screen 114. - The
option buttons touch screen 114 is between 4 and 6 inches high and between 6 and 8 inches wide, and each option button is between 1.5 and 2 inches high and between 1.5 and 2 inches wide, however other configurations can be used in other embodiments. Presenting a patient with a limited number of selectable touch screen buttons (in the illustrated embodiment, only two selectable buttons are shown in idle mode: the “Call Nurse”button 150 and “Call Family” button 152) from thedefault interface screen 160 provides an easy to use, relatively error proof interface. Although the buttons have been shown in the Figures labeled as “Call Family” and “Call Nurse”, other labels could be assigned to the option buttons as appropriate. - As mentioned above, when a
resident terminal 12 is assigned to a resident, the terminal will typically be preconfigured for the specific resident to which it is being assigned. Such pre configuration may occur in a number of ways - for example, the terminal 12 could include port (for example a USB port or an Ethernet jack that allows it to be connected to a configuring device or network), or could include an on-board configuration interface screen, or could be configured through signals received fromLAN 16 throughwireless communications system 108. In some embodiments, configuration information can be received fromconference server 28 viaInternet 24 andLAN 16. Configuration or set-up can include for example specifying the on-screen button location and size, and the language to use on the labels for the buttons, loading up pictures to be used in the various interfaces, and associating specific identifying information with the “Call Family” option such that pressing the call family button will initiate a video conference session with the correctremote terminal 26. - Reference is now made to
FIGS. 3 , 4, and 5 which illustrate how a patient/resident 18 may initiate a video conference session request from the residentvideo conference terminal 12 with the monitoring stationvideo conference terminal 20. If the patient 18 wishes to contact monitoring station video conference terminal 20 (for example to talk to a nurse at the nursing station), thepatient 18 selects the “Call Nurse”button 150 by pressing it ontouch screen 114. Once the “Call Nurse”button 150 has been pressed, theresident terminal 12 transmits a video conference session request throughwireless communications subsystem 108 andnetwork 16 to themonitoring station terminal 20. Referring toFIG. 4 , while the session is being established, agraphical user interface 164 is displayed onscreen 114 that indicates, in large letters: “Calling Nurse” inscreen area 155. The “Call Nurse”button 150 and “Call Family”button 152 are each displayed with faded letters and background (compared to default interface 162) to provide a visual indication that they are currently unavailable. The “End Call”button 154 is shown with bright letters and background to provide a visual indication that it is currently available as an option for the resident to select. Assuming that the nurse atmonitoring station terminal 20 decides to accept the video conference request, a video conference session will be established overnetwork 16 between theresident terminal 12 and themonitoring station terminal 20. Thus, in the above described example, the resident only has to select a single on screen button (“Call Nurse”) from the idle screen to cause a video conference session to be established with themonitoring terminal 20. -
FIG. 5 illustrates agraphical user interface 166 displayed onscreen 114 of theresident terminal 12 when a video conference session is established between it (throughcommunications subsystem 28 and network 16) and themonitoring station terminal 20. Thecall nurse button 150 becomes a fadedcall nurse button 150, which means that the button is no longer an available option to thepatient 18. Similarly, thecall family button 152 becomes faded. Theend call button 154 is brightly displayed as it is a selectable option. During the video conference session, a substantially real time video stream of the nurse (or other party) 22 will appear inarea 155 of the residentterminal display screen 120, and substantially real time audio of thenurse 22 will be output from thespeaker 122. A video of the patient 18 will be captured by thecamera 110 and an audio of the patient will be captured by themicrophone 112 for sending through thenetwork 16 to themonitoring station terminal 20, enabling an interactive, two-way video conference session to be held. The patient can end or terminate the session by pressing theend call button 154. - Tuning again to
FIG. 4 , in the event that after a predetermined duration of time the health care professional stationed at themonitoring station terminal 20 does not respond to the incoming video conference request, or indicates through an input to themonitoring station terminal 20 that he or she does not want to take the call, then a message such as “Nurse Unavailable Now” or “Nurse Will Return” can be generated in thearea 155 ofinterface screen 164. - Turning again to
FIG. 3A , if the patient 18 wishes to initiate a video conference session with aremote user 30, such as a family member, the patient 18 can press the “Call Family”button 152. In the illustrated embodiment, theresident terminal 12 has been pre-associated with two possible remote parties, such that pressing the “Call Family”button 152 links, with reference toFIG. 6 , to auser interface 168 having two call family buttons “Rick” 156 and “Judy” 158. In the illustrated embodiment, theresident terminal 12 has been preconfigured to display inuser interface 168 as a user selectable button 156 a photo of “Rick” and his family along with the identifying name “Rick” within aborder 170, and to display as user selectable button 158 a photo of “Judy” along with the identifying name “Rick” within a border 172. Pressing thetouch screen 114 within theborder 170 signals to thevideo conference module 130 acceptance of the call “Rick” option; pressing thetouch screen 114 within the border 172 170 signals to thevideo conference module 130 acceptance of the call “Judy” option. Configuring the resident terminal to prominently display recognizable pictures and names for touch screen selection can provide a simple-to-use interface for residents of limited abilities. - As shown in
FIG. 6 , the “Call Family”button 152 is faded so to provide visual feedback that such option is not currently available frominterface screen 168. The patient 18 may then select one of the call family buttons (156, 158) by touching the screen in the appropriate place to initiate a video conference session request with the appropriate remote user 30 (Rick or Judy) that is associated with the selected button. As will be explained in greater detail below, this causes thesession module 131 to initiate a session request throughconference server 28 with the appropriate remotevideo conference terminal 26. While the session is in the process of being initiated, the display screen may look similar to that shown inFIG. 4 , with the message “calling Rick” or “calling Judy” replacing the message “Calling Nurse”. Turning briefly to theremote terminal 26, aremote user 30 will then be able to see the session request by way ofdisplay screen 440, as shown inFIG. 22 . Theremote user 30 may accept the session request by selecting theconnect icon 462, thereby initiating the network session. - If a video conference session is successfully established with the
remote user 30, then substantially real-time audio and video will be exchanged between theresident terminal 12 and theremote terminal 26 of theremote user 30 viaLAN 16 andInternet 24, with the user interface screen onresident terminal 12 being similar to that shown inFIG. 5 . In this regard,FIG. 5A illustrates a possible video conference user interface onresident terminal 12 when a video conference session with aremote terminal 26 is active. Thus, in the above described example, a resident need only make two on-screen selections to cause a video conference session to be established with a family member, namely selection of the “Call Family”button 152, followed by selection of the button representing the particular family member that the resident wants to call. - Although the “Call Family”
button 152 is shown in the illustrated embodiment as linking to an interface screen 168 (FIG. 6 ) having two possible family or friend calling options, more than or fewer than two possible remote user calling options could be provided. In the case of just a single remote user calling option, theuser interface screen 168 can be optionally omitted, with activation of the “Call Family”button 152 immediately causing a session request to be initiated by theresident terminal 12. - Turning again to
FIG. 3A , in one example embodiment, if the care provider or monitoring stationvideo conference terminal 20 is currently unavailable for a video conference session, thecall nurse icon 150 becomes faded to convey that information. Similarly, if the subject remotevideo conference terminal 26 is currently unavailable, thecall family icon 152 becomes faded to convey information about its unavailability. - Turning to
FIG. 6 , in the case where theresident terminal 12 has been preconfigured to present multiple family or friends calling options, the selectable call buttons oricons conference server 28, and thus available to accept an incoming session request from theremote terminal 12. For example, if the remote terminal(s) 26 associated with “Rick” is currently unavailable for a video-conference session than thebutton 156 may be displayed with muted colors or faded relative to how thethumbnail image 156 would be displayed if a remote terminal(s) 26 associated with “Rick” was currently available. - In some example embodiments, a
single resident terminal 12 may be preconfigured for shared use by multiple residents, and in this regardFIG. 3B illustrates another possible “idle”user interface screen 50 which can be substituted in place of the user interface 176 ofFIG. 3A . The user interface screen ofFIG. 3B shows an example where the terminal 12 is preconfigured to be shared by two residents “Nancy” and “Emily”, although it will be appreciated that the terminal 12 could be configured for sharing by more than two residents. In the idlemode interface screen 50, user selectable areas orbuttons selectable button button user interface screen 162 for the subject resident that is similar to that shown inFIG. 3A . For example,FIG. 3C shows anexample interface screen 162A that is displayed after selection of the “Emily”button 52. Identifying information (for example the name “Emily” in block 56) can be shown on theinterface 162A to identify the current user of the terminal 12. As withuser interface screen 162 ofFIGS. 3A , theuser interface screen 162A includes a touch-screen “Call Nurse”button 150, “Call Family”button 152 and “End Call”button 154 which operate in a manner similar to the buttons described above in respect ofinterface screen 162. For example, the terminal 12 is preconfigured so that selecting the “Call Family”button 52 will present the calling interface 168 (seeFIG. 6 ) for calling Emily's family members. In one example embodiment, the “End Call” button can be selected frominterface 162A to return to theidle screen 50. - Referring now to
FIG. 7 , theresident terminal patient 18 may also accept a session request from another video conference terminal.FIG. 7 illustratesscreen 120 when an incoming video conference session request is received from the monitoring stationvideo conference terminal 20. The phrase “Nurse is Calling” is displayed on thedisplay screen 120. The call nurse button (150 inFIG. 3 ) is changed to answernurse button 150 b. If the patient 18 wishes to accept the session request, thepatient 18 selects theanswer nurse button 150 b. A video conference session will then be established between the residentvideo conference terminal 12 and with the monitoring stationvideo conference terminal 20. Similarly, in example embodiments when an incoming conference requests from aremote terminal 26 is received atresident terminal 12, a message such as “Family is Calling” can be prominently displayed inscreen area 155, and the “Call Family”button 152 replaced with an “Answer Family” button that can be touched to accept the call and establish a video conference session. - Other features of
resident terminal 12 will now be explained in greater detail. In at least some example embodiments, theresident terminal 12 includes a further user input device in addition to a touch screen, such as, for example, a short range wireless hand heldremote control 116, as shown inFIG. 8 . In at least some example embodiments, theremote control 116 is equipped with oversize “elder friendly” buttons and allows a resident user to access additional or other features of theresident terminal 12 that are not easily accessible through thetouch screen buttons default interface 162. - For example, in an example embodiment, pressing a “Symptom Input”
button 188 onremote control 116 allows a user to access the symptom input module 132 (seeFIG. 2 ) and allows a patient 18 to enter health information for future reference, such as for ahealth care user 22. With reference toFIG. 3E , in at least one example embodiment, a user selectable “Symptom Register”button 702 may be presented on the touch screen ofresident terminal 12, for example in thearea 155 of the idlemode interface screen 162, as an alternative to a “Symptom Input” button on theremote control 116. Upon selection of either the remote control “Symptom Input”button 188 or the touchscreen “Symptom Register”button 702, thesymptom input module 132 will display a menu of possible symptoms on thedisplay screen 120. The patient 18 may then select a symptom, for example using touch screen 114 (or a navigation/selectionkey combination communications subsystem 108 to the monitoring stationvideo conference terminal 20, for diagnosis by ahealth care user 22. By way of example, with reference toFIG. 3F , in one example embodiment theresident terminal 12 is preconfigured during setup for its assigned resident, or a subsequent update, to present a series of symptom input screens that correspond to the type of ailment(s) that the resident assigned to the terminal 12 suffers from.FIG. 3F shows an example of one such symptomuser input interface 704 displayed in thearea 155 ofidle mode screen 162 after a user has selected either the remote control “Symptom Input”button 188 or the touchscreen “Symptom Register”button 702. Theinput interface 704, which prompts a user to select one of three possible touch screen buttons “Mild” 706A, “Medium” 706B and “Severe” 706C (which may be color coded) to describe “Abdominal Pain” can be a stand-alone input screen or one in a series of symptom input screens that are presented sequentially to the resident user. The input information, and its entry time, can be stored at theremote terminal 12 and/or transmitted to afacility server 21, acentral monitoring station 20, and/or a remote web-basedserver 28, for further analysis by a health care provider in near real time or at a later time. In some embodiments, theresident terminal 12 may be configured to or cause to periodically prompt the resident, for example through audible or visual alerts, to enter the symptom information at predetermined times. - In at least some example embodiments, the
resident terminal 12 can be configured to present user input interfaces such as shown inFIGS. 3E and 3F for facilitating resident input about food menu items. By way of example, a user selectable touch screen button labeled “Menu Choice” could be shown in place of or in addition to “Symptom Register”Button 702 in the interface 162 (FIG. 3E ), and then a series of alternative selectable food options be presented in a interface screen similar to that shown inFIG. 3F . The menu items selected by the resident can then be sent to another terminal 20,21 either within thefacility 14 and/or to a terminal 28 outside the facility, such that the desired food items can then be provided to the resident at the appropriate times. - Turning again to
FIG. 8 , in at least some example embodiments, selection of a “TV”button 180 onremote control 116 allows a user to accesstelevision module 134 which allows a patient 18 to switch thedisplay screen 120 from the existing screen to display television programming broadcast using network 16 (or over an alternative network). The patient 18 may then control the television using the remote control 116 (which may for example include channel andvolume buttons 182, 184). - In at least some example embodiments, selection of an “Information”
button 198 onremote control 116 allows access to theinformation display module 136, permitting the residentvideo conference terminal 12 to display information to the patient 18 on thedisplay screen 120. The types of information to be displayed may include: a screen-saver, educational programming, information about the institution, its services and caregiver staff, reminders and information about medication, disease, management and nutrition, reminders about upcoming events, and menu choices for meals (and respective selectable icons for the menu choices). As suggested above, in some example embodiments, such information may be displayed on the default or idle mode screen interface 162 (seeFIG. 3A ), such that pressing an “Information” button on theremote control 116 is not required to view the information. - In at least some example embodiments, the information display module can also include a patient monitoring
station equipment module 138. Patient vital signs information from patient monitoring station equipment (not shown) may be provided to thecontroller 100, through a shortrange communications interface 108A between the monitoring equipment and theresident terminal 12 such as a USB cable, or through a short range wireless link, for example a Bluetooth™ connection or an Infrared link. As a result, the patient monitoring station information from the patient monitoring equipment (not shown) may be collected by theresident terminal 12. In some embodiments, collected monitoring information can be displayed on thedisplay screen 120. Typical patient vital signs monitoring equipment can include, among other things, equipment for performing electrocardiograms (EKG), electromyograms (EMG), electroencephalograms (EEG), as well as heart rate/pulse monitoring equipment, breathing monitoring equipment, and blood pressure monitoring equipment. The patient monitoring information may also be sent byresident terminal 12 overnetwork 16 to care provider/monitoring stationvideo conference terminal 20, for viewing by ahealth care user 22 and/or automated monitoring, and/or to acentral server 21 for thefacility 14, and/or to an off-site web-based server such asconference server 28. Such a configuration allows the hardware and networks used for video conferencing to also be employed in transmitting patient vital signs information. - In at least some example embodiments, the remote control includes a
button 187 to activate and deactivate aspeech stretcher module 140 that slows or delays the speech being received by the residentvideo conference terminal 12. Thespeech stretcher module 140 thus slows the audio outputted from thespeaker 122. This may aid with any diminished hearing capacity of thepatient 18. In some example embodiments, the speech stretching function could alternatively be activated and de-activated through a selectable button on thetouch screen display 120, including for example a selectable “speech stretcher”button 161 that could be displayed on thescreen 120 during a video conference session (seeFIG. 5 ). In at least some example embodiments, the resident user can be provided with an interface for adjusting the amount or degree of speech speed adjustment that occurs during a video conference session when the speech stretching module is activated, and in this regardFIG. 5A illustrates a Speech speed adjustment bar 708 displayed ontouch screen display 120 during a video conference session. The resident user can adjust the degree of speech speed adjustment that is applied to incoming audio by touching the adjustment bar at or between the “Slow” and “Normal” locations, and is provided with visual feedback of the current setting. In an example embodiment, thespeech stretcher module 140 is configured to track the speech adjustment level that was used in the most recent video conference session used by the terminal and apply that adjustment as the starting default in the next video conference session. In some example embodiments, the default speech adjustment level that is applied is tracked for each specific monitoring or remote terminal that theresident terminal 12 has had past video conference sessions with, allowing theresident terminal 12 to “automatically” apply a default speech speed adjustment that is appropriate for the specific party that the resident is communicating with. Known speech speed adjustment algorithms can be applied by thespeech stretching module 140. - In at least some example embodiments, the
remote control 116 includes a “stand-by”button 186 which returns theresident terminal 12 to thedefault interface screen 162 ofFIG. 3 . Additionally, in an example embodiment, the remote control includes acall nurse button 196a, acall family button 196b and anend call button 196c, each of which performs a similar function as the on-screencall nurse button 150, callfamily button 152 and endcall button 154, respectively. - As indicated above, in at least some example embodiments, the
controller 100 implements asetup module 142. Thesetup module 142 allows a user (typically someone other than a patient 18) to run a setup application to perform various administrative functions to the residentvideo conference terminal 12. In one embodiment, the setup application is accessed by using atouch screen 114 and simultaneously selecting theend call icon 154 and an unmarked icon in the upper left of thedisplay screen 120. In another embodiment, a temporary keyboard (not shown) may be connected to the residentvideo conference terminal 12 to interface with the setup module. In another example embodiment, pressing one ormore keys 194 on remote 116 may access the setup application. In another example embodiment, the setup application is accessed remotely by an administrator (acting throughconference server 28 ormonitoring station terminal 20, for example) throughInternet 24 and/ornetwork 16. - The setup module may be used to perform account assignment. The account assignment allows assignment of the
video conference module 130 to specific monitoring stationvideo conference terminals 20 arid/or remotevideo conference terminals 26. This allows selection of thecall nurse icon 150 or callfamily icon 152 to initiate a session request with the desired video conference terminal. The account assignment may also be used to enter the name of thepatient 18, the room number, and a representative graphic of thepatient 18. - The setup application may also display menus on the
display screen 120 for network setup and hardware setup. The setup application may also allow a selection of languages for display on thedisplay screen 120, for example English, French, and Spanish. - By way of example,
FIG. 9 to 1 l show examples of some interface screens that can be generated onresident terminal 12 by thesetup module 142.FIG. 9 shows a default user interface screen when no resident user is currently assigned to or registered in association with theresident terminal 12. An administrator can presstouch screen button 60 to reach a basicsetup interface screen 62 shown inFIG. 10 , which in the illustrated embodiment offers selectable options of “Account Assignment”; “Network”; “Hardware Parameters”; and “Exit”. Selecting the “Account Assignment” button on the touch screen results in theuser interface screen 64 ofFIG. 11 appearing.Screen 64 includes a touch screen alphanumerickey pad 66 that can be used by an administrator to enter assignment information to assign theresident terminal 12 to a particular resident of the care facility. - Examples of information that can be input during set up of a
resident terminal 12 include for example: (1) Room number in institution arid/or numeric identifier of patient/resident (in some embodiments, in the absence of a name programmed in the system, the room number will appear as the identifier at the monitoring station terminal 20); (2) Account Number for Video Conference Service (this predetermined account number that is issued by theconference server 28 enables 2-way video chat to be initiated to selectedremote terminals 26; the account number is required for theresident terminal 24 to communicate via theInternet 24 with theconference server 28, allowing various data stored at the conference server 28 (identified below) to be transferred to theresident terminal 24 and themonitoring station terminal 20; (3) Monitoring Station Terminal ID—assigns theresident terminal 24 to the specified monitoring station terminal 20 (there can be more than one monitoring station at facility 14); (4) Resident's name (if not already automatically downloaded from conference server 28); (5) Resident's photo (if not already automatically downloaded from conference server 28). - In some embodiments,
resident terminal 12 can be configured such that a camera or audio pickup of the terminal 12 or associated with the terminal 12 can, in a one-way monitoring mode ofterminal 12, stream near real time video and/or audio from the resident's room to aremote terminal 26 to allow remote parties to monitor in substantially real time the condition of or treatment of the resident. Such remote monitoring feature can, in example embodiments, be activated throughsetup module 142. In at least some example embodiments, in order to facilitate remote monitoring of the treatment of the resident, theresident terminal 12 includes or is coupled to an auxiliary “monitoring” video camera 712 (seeFIG. 2 ) that is located in the room of theresident 18 that theresident terminal 12 has been assigned to. Theauxiliary video camera 712 can be physically separated from theterminal console 160 and coupled to theresident terminal controller 100 through short range communications link 108A (which may be a direct physical link such as a IJSB cable for example, or a wireless link). Thecamera 712 can be positioned to offer a wide area view of the resident's room or surrounding environment in order to enable the resident and the treatment of the resident by staff to be remotely monitored.Video camera 712 can also include an audio microphone so that noises in the resident's room can be monitored as well, although such noises could alternatively be monitored through theconsole microphone 112. In an example embodiment thecontroller 100 is configured to operate in a one-way monitoring mode in which video signals from the video camera 712 (and possibly audio signals) can be streamed during a monitoring session from theresident terminal 12 to either thecentral monitoring station 20 and/or an authorizedremote terminal 26 throughnetworks board camera 110 of the terminal 12 could also be used for one-way monitoring purposes instead of or in addition to theauxiliary camera 712, although the on-board camera 110 may not always be appropriately positioned for optimized viewing of the resident. - In some example embodiments, for privacy reasons, the
system 10 is configured so that remote monitoring of the resident is permitted at authorized remote terminals 26 (typically belonging to family members of the resident), but not at themonitoring station terminal 20. In some example embodiments, theresident terminal 12 and/orauxiliary camera 712 are configured to provide a visual or audible indication to the resident when they are being used in a monitoring mode, so that the resident is aware when such monitoring is occurring. In some example embodiments, theresident terminal 12 could be configured or caused to perform the video monitoring periodically at set times throughout the day, with captured video images stored locally at the terminal 12 or off-site at a web-based server such asserver 28, for subsequent review at an authorizedremote terminal 26. - In at least some example embodiments, the resident terminal can include a Voice Over IP (VOIP)
module 143 and be configured as a Voice-over-IP telephone terminal to establish and receive calls via theInternet 24, with a suitable interface being provided through the display screen working on its own or in conjunction with the remote control or other input device. By way of example,FIGS. 27A-27D illustrate an example of a possible user interface screens 710A-710D that can be generated on thetouch screen display 114/120 ofresident terminal 12 bycontroller 100. Thefirst interface screen 710A allows a user to initiate a VOIP call, and may, for example, be displayed after a user selects a predetermined key onremote control 116, or a user selects a “VOIP” selectiontouch screen button 714 which could for example be displayed in the idle screen interface 162 (seeFIG. 3E ).Interface screen 710A allow a user to enter a phone number to call, or to select names of parties for which numbers have been preprogrammed. After entering a number and pressing a “Start Call” button, or after selecting the name associated with a preprogrammed number, theVOIP module 143 causes the terminal 12 to initiate a VOIP call to the appropriate remote terminal.Interface screen 710B ofFIG. 27B is an example of a screen that is displayed while the call is being placed, andFIG. 27C is an example of a user interface screen that can be displayed when a VOIP call has been connected.FIG. 27D illustrates a possible user interface 71D that includes user selectable “Answer” button for receiving an incoming VOIP call. As illustrated in each ofFIGS. 27A-27D , an “End Call” button can be pressed at any time to terminate the VOIP call process and return to either a prior user interface screen or the idle user interface screen. - As described above, the
resident terminal 12 is a portable wireless enabled tablet-style device with a touch screen user interface. In some embodiments, theresident terminal 12 could be implemented in other ways, for example by a suitably configured personal computer that is hard-wired to thelocal area network 16 and which has an AC power connection. - Reference is now made to
FIGS. 12 to 19 , which show illustrative embodiments of the care provider/monitoring stationvideo conference terminal 20. In example embodiments, thehealth care user 22 may usemonitoring station terminal 20 to participate in video conference sessions with resident and remotevideo conference terminals -
FIG. 12 shows a block diagram of the monitoring stationvideo conference terminal 20 to be used on thecommunications system 10. As shown inFIG. 12 , the terminal 20 has acontroller 200 for controlling its operation, an audio/video input 202 and an audio/video output 204 coupled to the controller, auser input 206, and acommunications subsystem 208 coupled to thecontroller 200 for sending and receiving communications information over thenetworks health care user 22 may operate the monitoring stationvideo conference terminal 20 by manipulating theuser input 206. Thecontroller 100 can include one or more microprocessors that are coupled to astorage 207 that includes persistent and/or transient memory.Storage 107 stores information and software enabling the microprocessor(s) ofcontroller 200 to implement the monitoring station terminal functionality described herein. - The audio/
video input 202 may be amicrophone 212 andcamera 210, respectively. The audio/video output 204 may be aspeaker 222 and adisplay screen 220, respectively. As shown, suitable options for theuser input 206 may be atouch screen 214, akeyboard 216, and amouse 224. The monitoring stationvideo conference terminal 20 may be a conventional personal computer with the appropriate peripheral devices. - In an example embodiment, there are a number of modules implemented through software running on the
controller 200 that may perform desired functions on the monitoring stationvideo conference terminal 20. The software instructions used to implement the various modules can be stored onstorage 207, for example. As shown, thecontroller 200 has a videoconference manager module 230, acaregiver paging module 240, amessaging module 242, asecurity camera module 244, and asetup module 248. The videoconference manager module 230 includes asession module 131, acontact manager module 236, and an audio/video recording module 238. Thecontact manager module 236 permits the managing of contact information of bothpatients 12 andremote users 30. -
FIG. 13 is an example of a user interface screen on thedisplay screen 220 of the monitoring stationvideo conference terminal 20 for operation by ahealth care user 22. The user interface screen ofFIG. 13 shows an example idle mode screen when themonitoring station terminal 20 is not involved in any active video conference sessions. As shown, there is an administration button oricon 250, apatients icon 252, asystem icon 254, and ahelp icon 256. There is also apager icon 274, asafety cam icon 276, and amessages icon 284. There is amain video display 258 which may show video images, for example during a video conference session (a feed from a security camera is shown in the example idle mode screen ofFIG. 13 ). Selection of theadministration icon 250 displays on thedisplay screen 220 an administration interface. Selection of thepatients icon 252 displays on the display screen 220 a summary page ofpatient 18 information. Selection of thesystem icon 254 displays on the display screen 220 a system setup page. - As shown in
FIG. 13 to 19 , the interface for theremote monitoring terminal 20 includes a tabbedactive calls menu 266,residents menu 268, andfamilies menu 270. The selectedactive calls menu 266 shows a list of active video conference calls between themonitoring station 20 and resident terminals 12 (seeFIGS. 13-16 ). As shown inFIG. 16 , when selected, theactive calls menu 266 displays the resident name for the active calls, the call time, and the status (for example, “waiting” or “Hold”). - The
residents menu 268 is best illustrated inFIG. 19 , and shows a list ofpatients 12 and their respective information, such as room number. Another patient 12 may be added to theresidents menu 268 by selecting the add-resident icon 306. A patient 12 may be edited by selecting theedit resident icon 308. Similarly, selection of thefamilies menu 270 shows a list ofremote users 30 and their respective information (as best illustrated inFIG. 18 ). - The session module 231 (
FIG. 12 ) manages the establishment and termination of video conference sessions between themonitoring station terminal 20 and other terminals. To initiate a session request with a residentvideo conference terminal 12 overlocal network 16, ahealth care user 22 may use the monitoring stationvideo conference terminal 20 and select theresidents menu 268 using the user input 206 (as best illustrated inFIG. 19 ). Thehealth care user 22 may then select a patient 12 from the list of patients. Upon selection of apatient 12, thesession module 231 initiates a session request to the specified residentvideo conference terminal 12. The residentvideo conference terminal 12 will display the phrase “Nurse is Calling” on thedisplay screen 120, as shown inFIG. 7 . The patient 18 may accept the session request, as explained above, thereby initiating a substantially real-time video conference session. - Reference is now made to
FIG. 14 . The monitoring stationvideo conference terminal 20 may also receive a session request from a residentvideo conference terminal 12. When a residentvideo conference terminal 12 initiates a session request (as explained above), the monitoring stationvideo conference terminal 20 displays the incoming session request on thedisplay screen 220 as follows. The name of thepatient 12 is displayed on theactive calls menu 266 and additionally, in at least some example embodiments, apatient thumbnail 272 including a still image (pre-stored) along with the name and room number of the callingpatient 12 is displayed. An audible sound can also be used in some embodiments to signal the incoming session request. In at least some example embodiments, thepatient thumbnail 272 could present active video live from the resident terminal rather than just a pres-store still image. Thehealth care user 22 may accept the session request by selecting theappropriate patient thumbnail 272 or by selecting the name of the patient 12 displayed on theactive calls menu 266, thereby initiating the network session. As represented inFIG. 15 , in some example embodiments, themonitoring station terminal 20 may receive a number of concurrent incoming video conference session requests for processing in which case names and thumbnail images for each of the incoming requests can be displayed (seethumbnails 272 a-272 d for example), and the incoming requests can be displayed in the Active Calls list 266. In an example embodiment, the care giver can accept a session by using an on-screen indicator to point at and select an appropriate thumbnail image or name in the calls list 266 to processing with establishing a video conference session. As shown inFIG. 15 , a pre-existing video conference session is labeled as “On-Hold” (see thumbnail 272), meaning that a video conference session with that particular resident has been placed on-hold. In some example embodiments, some residents may be identified, through pre-configuration, as residents requiring extra care or attention, such that incoming session requests from such patients can be flagged visually and/or audibly in order to bring them quickly to the attention of thecare giver 22. By way of example, inFIG. 15 , the resident associated withthumbnail 272 d (Erika Wilson) has been pre-identified as a resident requiring special attention, and accordingly when an incoming session request from herresident terminal 12 is received atmonitoring station terminal 20, both her stillthumbnail image 272 d and her name in calls list 266 are presented in a different colour (for example red) than the remaining thumbnail images/names, thereby visually flagging that she is a resident that a quick response is desirable for. - A video conference session user interface screen for an on-going session is best illustrated in
FIG. 16 (which illustrates a session with a patient 18). Thedisplay screen 220 shows amain video display 258, a healthcareuser video display 264, astatus menu 265, a volume control 278, an end call icon 260, and a hold icon 260. A substantially real-time video stream of the patient 18 will appear on themain video display 258, and a substantially real-time audio of the patient 18 will be output from thespeaker 222 for thehealth care user 22. A video of thehealth care user 22 will be captured by thecamera 210 and the audio will be captured by themicrophone 212, for substantially real-time transmission to the residentvideo conference terminal 12. Avideo image 264 of thehealth care user 22 can also be displayed on themonitoring terminal 20, which mirrors what is shown on the residentvideo conference terminal 12. - Referring again to
FIG. 13 , thestatus menu 265 may be set to “available” or “unavailable”. If thestatus menu 265 is set to “available”, the monitoring stationvideo conference terminal 20 is available for network sessions. If thestatus menu 265 is set to “unavailable”, the monitoring stationvideo conference terminal 20 is not available for network sessions and any existing network sessions are ended or terminated. The volume control 278 may be used to increase or decrease the volume from thespeaker 222, or to mute thespeaker 222. Selection of the end call icon 260 will end or terminate the active session that is currently shown inwindow 258, and take the terminal 20 to the “Incoming Session Request” interface screen ofFIG. 15 if other sessions are active, or to an idle screen (such as shown inFIG. 13 ) if no other sessions are active. Selection of the hold icon 260 will hold the active network session that is currently shown inwindow 258, and take the terminal 20 to the “Incoming Call” interface ofFIG. 15 . - The monitoring station
video conference terminal 20 may also initiate a video conference session with a remotevideo conference terminal 26 overInternet 24. For example, to initiate a session request with aremote user 30, ahealth care user 22 may use the monitoring stationvideo conference terminal 20 and select thefamilies menu 270 using the user input 206 (seeFIG. 18 ). Thehealth care user 22 may then select aremote user 30 from the list of remote users. Upon selection of aremote user 30, thesession module 231 initiates a session request to the specified remotevideo conference terminal 26. Theremote user 30 may accept the session request, thereby initiating the network session. In some example embodiments, a three-way video conference session between aresident terminal 12, amonitoring station terminal 20 and aremote user terminal 26 can be implemented. - Referring now to other modules implemented on
controller 200, in at least some example embodiments the audio/video recording module 238 permits the recording of video conference session with the monitoring stationvideo conference terminal 20. As shown inFIG. 19 , the audio/video recording menu 302 may be used to configure the audio/video recording module 238. As shown on the audio/video recording menu 302, the monitoring stationvideo conference terminal 20 may record both audio and video, audio only, or recording off. - In at least some example embodiments, as illustrated in
FIG. 17 , thecaregiver paging module 240 permits the monitoring stationvideo conference terminal 20 to send paging to pagers or other wireless devices carried by caregivers. Thecaregiver paging module 240 runs a paging application that is accessed from selecting the pager icon (274 inFIG. 16 ). As shown inFIG. 17 , there is anattendant menu 286, a resident requiring assistance menu 288, an additional text menu 290, a priority menu 292, and asend icon 294. Theattendant menu 286 has a list of caregivers for selection. Theattendant menu 286 shows the name of the caregiver and the position (i.e. registered nurse (RN) or attendant (Att)). The resident requiring assistance menu 288 has a drop-down list ofpatients 18 and the respective room numbers. The additional text menu has drop-down list of optional text to accompany the page. As shown, toilet assistance is a possible option. Other options (not shown) include bed discomfort, move to/from bed, food, spill clean-up, and drink. In addition to the drop down list of pre-defined common text, a custom message can be typed in at any time. The priority menu 292 has a list of high, normal, and low, to indicate the priority of the page. An appropriate paging message would include the name of the attendant, the name of thepatient 18, the room number, the additional text, and the priority. Upon selection of thesend icon 294, thecaregiver paging module 240 sends the paging message overnetwork 16 to a paging system that packages the paging message and sends it over a wireless network to the appropriate paging device. - In at least some example embodiments, the
messaging module 242 runs a messaging application as represented inFIG. 18 . The messaging application may be initiated by selecting thefamilies menu 270 or by selecting the messages icon (284 inFIG. 13 ) when a message is waiting. As shown, there is a receivedmessages menu 296, a composenew message icon 298, and aforward messages field 299. The receivedmessages menu 296 has a listing of messages, and includes the sender name, the subject, and the received date. Upon selection of one of the messages, the message will be displayed on the display screen 220 (not shown). The composenew message icon 298, when selected, displays a composition screen (not shown) for composing a new text or email message. The forward messages field 299 allows a user to forward a message upon receipt to an alternative email address. - In at least some example embodiments, the
security camera module 244 implements a security camera function as represented in the idle screen ofFIG. 13 . The security camera application may be initiated by selecting the safety cam icon 276 (seeFIG. 13 ), which fades when selected. As shown, themain video display 258 shows a security camera video image (shown on the idle screen of themonitoring station terminal 20 in the illustrated example) taken from a security camera that is located in a common area of thefacility 14. The speaker (222 inFIG. 6 ) may also output audio corresponding to the video image. Camera thumbnails (282 a-d) show smaller video images of other selectable security camera video images of other common areas in the facility. Upon selection of one of the camera thumbnails (282 a-d), the corresponding security camera video image will be shown on themain video display 258. In some example embodiments, in addition to or as an alternative to viewing images captured through security cameras located in common areas of the facility, themonitoring station terminal 20 can also be configured to permit monitoring of residents through one-way video streamed from either themain camera 110 or theauxiliary camera 712 of one ormore resident terminals 12 can be viewed at themonitoring station terminal 20. - In at least some example embodiments, the
setup module 248 allows ahealth care user 22 or other person to perform various administrative functions to the monitoring stationvideo conference terminal 20. As shown inFIG. 19 , the setup application may be initiated by selecting theadministration icon 250. As shown, there is an activity information icon 310, anNSU transfer menu 300, an audible alerts menu 304, and the audio/video recording menu 302. Selection of the activity information icon 310 displays on thedisplay screen 220 an information page (not shown) for composing and enabling of information pages to be shown by theinformation display module 136 on the residentvideo conference terminal 12. TheNSU transfer menu 300 permits the monitoring stationvideo conference terminal 20 to transfer responsibility for a group that includes a plurality ofresident terminals 12 from the terminal 20 to anothervideo conference terminal 20, after which incoming video conference requests fromresident terminals 12 andremote terminals 26 previously associated with theremote monitoring terminal 20 will be routed to anotherremote monitoring terminal 20. Thus, all of the features and services that amonitoring station 20 is providing or performing for a group ofresident terminals 12 that are assigned to it could be transferred for the entire group to another monitoring station terminal by selecting the desired transferee terminal option frommenu 300. For example, afacility 14 may have a plurality ofremote monitoring terminals 20 that each have a respective coverage area or resident responsibility during peak times, with the coverage areas/ responsibility being consolidated to fewer terminals during non-peak times. - In at least some example embodiments, as indicated in
FIG. 19 , an audible alerts menu 304 may be used to configure the alert volume for specified events, such as resident calling, family calling, and new message. Asystem icon 254 may also be selected to configure the monitoring stationvideo conference terminal 20 for applications such as network parameters (such as Internet Protocol address), timeouts, passwords, and unit identification. - Setup of the
monitoring station terminal 20 can include providing information to the terminal such as: (a) input of an identifier for the monitoring station terminal 20 - associated with an IP address, this identifier allows theresident terminals 12 to make themselves available to a particularmonitoring station terminal 20; (b) User names and passwords for caregivers using thismonitoring station terminal 20; (c) identification ofresident terminals 12 visible on network that will be associated with and hence share 2-way video chat with themonitoring station terminal 20; (d) Photos and names of residents if not available from the resident terminal or other sources automatically - these photos become the thumbnails presented at themonitoring station terminal 20 when a session request is initiated; (e) Information (names, email addresses) for family members subscribing to the service will in at least some example embodiments be automatically uploaded to themonitoring station terminal 20 from theresident terminal 12 and/orconference server 28 if the information is available and (f) Safety Camera are chosen and enabled from a list of available cameras presented after an automatic discovery of which cameras are on the network with themonitoring station terminal 20. Safety Cams may have default names (Camera 1,Camera 2 . . . ) on the network, but can be renamedmonitoring station terminal 20. - In at least some example embodiments, some of the information used by a care
giver monitoring terminal 20 can be stored oncentral server 21 within thecare facility network 16, such that such information can be accessed by a plurality ofmonitoring terminals 20. For example, patient information including a patient photograph, room number, etc. could be stored in acentral server 21 and drawn on byvarious monitoring terminals 20. Account information identifying themonitoring terminals 20 of thecare facility 14 to theconference server 28 and/orremote terminals 26 can be stored on thecentral server 21. - Reference is now made to
FIGS. 20 to 24 , which show illustrative embodiments of the remotevideo conference terminal 26 for use by aremote user 30.FIG. 20 shows a block diagram of the remotevideo conference terminal 26 to be used on thecommunications system 10. As shown inFIG. 20 , the remotevideo conference terminal 26 has acontroller 400 that includes one or more processors for operation of the remotevideo conference terminal 26, an audio/video input 402 and an audio/video output 404 coupled to the controller, auser input 406, aelectronic storage 407 including persistent and RAM storage elements, and acommunications subsystem 408 coupled to thecontroller 400 for sending and receiving communications information over the network (Internet) 24. The audio/video input 402 may be amicrophone 412 andcamera 410, respectively. The audio/video output 404 may be aspeaker 422 and adisplay screen 420, respectively. As shown, suitable options for theuser input 406 may be (but are not limited to) akeyboard 416 and amouse 424. The example embodiments, theremote terminal 26 can be implemented through a wide variety of electronic devices that are enabled to exchange video and audio data through a wide area network such the Internet, including for example a suitably configured stationary personal computer, a mobile lap top or other mobile computing device such as a handheld personal digital assistant or cell phone. - Software instructions stored on
storage 407 configure the controller to implement modules on thecontroller 400 to perform desired functions. As shown, thecontroller 400 has a videoconference manager module 430, amessaging module 432, asecurity camera module 434, and asetup module 436. Thevideo conference module 430 includes asession module 431. -
FIG. 21 is an exemplary video conferenceuser interface screen 420 of the remotevideo conference terminal 26. As shown, there is a mainvideo display area 440, a remote uservideo display area 450, astatus menu 451, asafety cam icon 456, anadministration icon 458, a log officon 470, and anexit icon 472. Themain video display 440 may show video images, for example of another party in a video conference session. A video image of theuser 30 of theremote terminal 26 is displayed on the remoteuser video display 450, which mirrors what is displayed on the other video conference terminal. Thestatus menu 451 may be set to “available” or “unavailable”. If thestatus menu 451 is set to “available”, the remotevideo conference terminal 26 is available for network sessions. If thestatus menu 451 is set to “unavailable”, the remotevideo conference terminal 26 is not available for network sessions and any existing network, sessions are ended or terminated. - Operation of the
video conference module 430 is illustrated inFIGS. 21 to 23 .FIG. 21 shows a call patient orresident menu 452 and a callhealth care menu 454.FIG. 22 shows a resident or patient calling notice on themain video display 440 and aconnect icon 462.FIG. 23 shows a health care calling notice on themain video display 440 and theconnect icon 462. - Referring again to
FIG. 21 , thevideo conference module 430 can initiate a network session with another video conference terminal. To initiate a session request with a residentvideo conference terminal 12, aremote user 30 may use the remotevideo conference terminal 26 and select thecall patient menu 452 using theuser input 406. Theremote user 30 may then select aresident patient 12 from a drop down menu (not shown) of patient names (in many cases, there will only be one resident name to select). Upon selection of the name of aresident patient 12, thesession module 431 initiates a session request to the specified residentvideo conference terminal 12. The residentvideo conference terminal 12 will display a notice that aremote user 30 is calling on thedisplay screen 120. The patient 18 may accept the session request, as explained above, thereby initiating the video conference session. - The remote
video conference terminal 26 may also initiate a network session with a healthcare conference terminal 20. To initiate a session request, aremote user 30 may use the remotevideo conference terminal 26 and select the callhealth care menu 454 using theuser input 406. Thehealth care user 22 may then select ahealth care user 22 from a drop down menu (not shown) of names ofhealth care users 22. Upon selection of ahealth care user 22, thesession module 431 initiates a session request to the specified monitoring stationvideo conference terminal 20. Ahealth care user 22 may use the monitoring stationvideo conference terminal 20 to accept the session request, as explained above, thereby initiating the video conference session. - During a video conference session, substantially real-time video of the resident 18 (or
care giver 22, as the case may be) will appear on the mainvideo display area 440 for theremote user 30 to see, and audio of the resident 18 (or care giver 22) will be output from thespeaker 422. Similarly, substantially real-time video and audio of theremote user 30 will be captured by thecamera 410 andmicrophone 412, for sending to the resident video conference terminal 12 (or remote monitoring terminal 20) by thecommunications subsystem 408. - The remote
video conference terminal 26 may also accept a session request from another video conference terminal, as shown inFIGS. 22 and 23 .FIG. 22 shows a session request from a residentvideo conference terminal 12. A resident calling notice is displayed on the mainvideo display screen 440.FIG. 23 shows a session request from a monitoring stationvideo conference terminal 20. A health care calling notice is displayed on the mainvideo display screen 440. Upon selection of theconnect icon 462, the session request is accepted and a video conference session is established between the remotevideo conference terminal 26 and either the residentvideo conference terminal 12 or the monitoring stationvideo conference terminal 20. - The other modules of
controller 400 will now be explained in greater detail. In at least some example embodiments, themessaging module 432 runs a messaging application as illustrated inFIG. 24 . As shown, there is an awaymessage icon 464 and atext message icon 466. Selection of theaway message icon 464 allows aremote user 30 to compose an away message to be displayed in response to a session request when the remotevideo conference terminal 26 is offline. Thetext message icon 466 allows aremote user 30 to compose a text message for sending to the monitoring stationvideo conference terminal 20. - In at least some example embodiments, a
security camera module 434 implements a security camera feature when the safety cam icon 456 (FIG. 21 ) is selected. The mainvideo display area 440 displays a one way video feed (and possible audio) from a local security camera at facility 14 (for example anauxiliary camera 712 ormain camera 110 ofresident terminal 12 or another camera) located in proximity to thepatient 18. Thus, aremote user 30 may be able to remotely monitor thepatient 18 and the manner in which thepatient 18 is being treated by care giver staff. - In at least some example embodiments, the
setup module 436 runs a setup application when theadministration icon 458 is selected. Applications that may be run in the setup application include alert forwarding (sends an email notifying aremote user 30 of a session request when the remotevideo conference terminal 26 is unavailable), password change, and account information. - Reference is now made to
FIG. 25 , which shows a block diagram of aconference server 28 to facilitate communications on thecommunications system 10. Generally, theconference server 28 may manage accounts and log data relating to video conference sessions carried out using thesystem 10. Theconference server 28 may provide access to software updates, and help for users of thecommunications system 10. The conference server may include a single server or a server cluster. As shown inFIG. 25 , theconference server 28 has a controller 500 (implemented by one or more processors) for controlling operation of theconference server 28. Software and data stored on anelectronic storage element 507 is used by controller to implement various modules including aconnection manager module 502 and adirectory service module 508. Theconnection manager module 502 includes acustomer module 504 and anadministration module 506. Thedirectory service module 508 includes acustomer module 510 and anadministration module 512. Acommunications subsystem 520 is coupled to thecontroller 400 for sending and receiving communications information over theInternet 24. - The
customer module 504 of theconnection manager module 502 permits a user to review family and friend online status, find appropriate endpoints by account name, set personal online status, initiate or terminate sessions, manage runtime settings and display items and other operational parameters (for items such as cameras and microphones, favorite links, display preferences), view system alerts (i.e. incoming call attempts), manage the system, and call log. - In at least some example embodiments, the
administration module 506 of theconnection manager module 502 includes a number of features, permitting an administrator to review online status, review active connections, forced session management (terminate, disconnect, etc), review login and usage statistics for all accounts, and review logs for all accounts. - In at least some example embodiments, the
customer module 510 of thedirectory service module 508 implements a number of features, including history, manage profile, manage account, and help. The history feature maintains a call history with usage metrics, logs the total connection hours, and supports invoicing. The manage profile feature maintains login and account settings, information change, allows a user to change or upload away screens and other graphics, and set customer based limits and thresholds. The manage account feature maintains activation or cancellation of accounts, payment methods, billing methods (per call, bandwidth, etc.), allows viewing of active credits, and account recycling. The help documentation feature maintains frequently asked questions (FAQ), troubleshooting, online instruction manuals, privacy policy, and other agreements. - In at least some example embodiments, the
administration module 512 of thedirectory service module 508 implements a number of features, including customer profile, account information, and current users. The customer profile feature allows viewing of the customer profile (except password and private items), resetting of passwords, and bandwidth restrictions or quality of service. The account information feature allows the change of information as necessary. The current users feature permits viewing of a list of current users logged on. - Further features of the
video conferencing system 10 will now be described. In at least some example embodiments, a service provider will operate theconference server 28 and provide the hardware and software required forresident terminals 12. Theresident terminals 12 can in various embodiments be purchased or leased by the operators offacility 14 from the service provider, or purchased or leased by residents (or their family members) from the service provider, or may be provided by the service provider on loan to thefacility 14 and/orresidents 18 in exchange for the opportunity to entice remote users 30 (typically family members) or residents to subscribe to video conference services. - In some embodiments, the
monitoring station terminal 20 may be acquired (through purchase, lease, license or free loan, for example, under various business models) with the required software from the service provider. In other embodiments, software required to implement themonitoring station terminal 20 on an existing facility computer or server can be acquired (licensed) from the service provider, for example, through an Internet connection to a store front maintained atconference server 28, or installed from a disc or other software medium. In some embodiments, the entity that operates theconference server 28 can be a different entity that the entity that provides any proprietary hardware and software required for implementing theterminals server 28. - The software required to implement
remote terminals 26 may in example embodiments be licensed for a fee or for free toremote users 30 who subscribe for video conference services, and can be obtained by remote users from the service provider, for example, through an Internet connection to a store front maintained atconference server 28, or installed from a disc or other software medium. - The video conference services facilitated through
conference server 28 could be made available for various fees to the different participants. For example, the monitoring station software could be licensed for a fee to the operator offacility 14; remote users and/or residents could sign up for subscription packages billed monthly, yearly, or based on pay per use, or combinations of the forgoing. In some embodiments, the costs for high speed Internet access toresident terminals 12 could be paid for by the operators offacility 14, or remote user's, or residents, or combinations of the forgoing. - In an example embodiment, when a new user (for example, a family member of a resident of a
facility 14 that is enabled withresident terminals 12 and a central monitoring terminal 20) desires to set up or register a new account they will access a “New Account” Web page maintained byconference server 28. In an example embodiment, the information collected from the new user while setting up an account can include, among other things: (a) contact information for the new user/subscriber (who may be a family member of aresident 18, for example); (b) billing information (Credit Card, pre-payment by cheque, etc.); (c) resident information, including Resident's name, and a still photo of resident, uploaded for example as a JPEG or other graphics file—the resident photo can be passed on to theresident terminal 12 through the network (Internet 24 and LAN 16) where it is in turn can be retrieved from the resident terminal by anymonitoring station terminal 20 that is associated with thatresident terminal 12; and (d) Family/friends associated with account, i.e. available for video conference sessions with aresident terminal 12. This information can be made available to theappropriate resident terminal 12, and anymonitoring station terminals 20 that are associated with theresident terminal 12. There can be several friends and family members (i.e. remote users) listed (and presented) at theresident terminal 12 as possible parties that video conference sessions can be established with, and for each of the remote users the following information can be collected: (i) Remote user's name (a prompt for a full name for each remote user can be provided as well as a short name or nick name, with the full name being optional for inclusion in the “Families”menu 270 of themonitoring station terminal 20 if communications with themonitoring station terminal 20 are desired, and the short name being used for display on the interfaces presented on theresident terminal 12; (ii) Remote user's email address and/or text message address (optional—required if email or text message communication withmonitoring station terminal 20 is desired) (iii) Remote user's still photo (uploaded for example as a JPEG or other graphics file). The photo is passed on to theresident terminal 12 and used by the resident terminal as an image combined with the short name on the resident terminal's touch screen, and acts as the touch screen control for calling (seeFIG. 6 , for example); (iv) user name; and (v) Password—theconference server 28 can create a default that can be updated through a change password facility. - In one example embodiment, once a terminal 26, 12 or 20 has been suitably configured and appropriate accounts opened with the
conference server 28, then a terminal can “log in” with theconference server 28 and provide the server with terminal and/or user identification information and any further authentication information that may be required. In at least some example embodiments,remote terminals 26, andresident terminals 12 andmonitoring terminals 20 that are available for video conference sessions through theInternet 24 withremote terminals 26, will be those terminals that are “logged in” or “on-line” with theconference server 28. In the case ofremote terminals 26, the log in procedure could for example be carried out by the video conference module 430 (seeFIG.20 ). For example, such module may have an associated icon displayed thedisplay screen 420 of theremote terminal 26—user selection of such icon initiates a video conference application that implements thevideo conference module 430 onprocessor 400. Alternatively, theremote terminal 26 could be configured to initiate the video conference application upon start-up of theremote terminal 26. Once logged-in, thevideo conference module 430 then stays on-line with thevideo conference server 28 overInternet 24 until the video conference application is shut down or the Internet connection severed. In some example embodiments, a remote terminal user may alternatively just log-on using a web browser to go to a designated web site hosted by theconference server 28. - In at least some example embodiments,
resident terminals 12 andmonitoring terminals 20 are each configured to log-in to theconference server 28 through theInternet 24 once they are turned on, and to remain logged in so long as a connection exists through theInternet 24 to theconference server 28. Furthermore, as the monitoring terminal(s) 20 andresident terminals 12 within acare facility 14 are each connected to acommon enterprise network 16 in at least one example configuration, such theresident terminals 12 are aware through communications over theenterprise network 16 of the monitoring terminal(s) 20 present on thenetwork 16, and the monitoring terminal(s) 20 is (are) aware of theresident terminals 12 present on the network. In some embodiments, users ofterminals - The
conference server 28 maintains a log of whatterminals server 28 of any changes in their status (for example if a terminal logs off, or goes from being available to accept incoming session requests to unavailable). - In one example embodiment, a
resident terminal 12 can periodically poll theconference server 28 to track which of theremote terminals 26 that it is associated with (i.e.terminals 26 used by remote users that theresident terminal 12 is preconfigured to initiate video conference sessions with) are presently logged in to the conference server and available for accepting video conference calls from the resident terminal - using this information, theresident terminal 12 can then “fade in” or “fade out”thumbnail images 156, 158 (seeFIG. 6 ) depending on the on-line/availability status of the respective remote users. Theconference server 28 can also be configured to push such status information out toaffected resident terminals 12 when theconference server 28 becomes aware of changes in the status of aremote terminal 26 associated with aparticular resident terminal 12. Similarly,remote terminals 26 can also acquire information from theconference server 28 about the status of their associatedresident terminals 12. - In example embodiments,
resident terminals 12 can exchange status/availability information withrelevant monitoring units 20 directly throughenterprise network 16 without going through theconference server 28, however in at least one example embodiment, such communications could alternatively be coordinated through theconference server 28. - An example conference session between a
remote terminal 26 and a terminal located within the enterprise network 16 (for example aresident terminal 12 or monitoring terminal 26) will now be discussed with reference to the conference session management messaging diagram ofFIG. 26 . In the diagram ofFIG. 26 , for the purpose of the following example conference participant 1 (CP1) represents aresident terminal 12 and conference participant 2 (CP2) represents aremote terminal 26. When a resident user of aresident terminal 12 selects a remote user to call by selecting an on-screen button associated with the remote user (for example, the “Rick”button 156 ofFIG. 6 ), terminal CP1 sends a connect request message to the conference server 28 (see step 600). The connect request message includes information identifying the sending terminal (CP1 ID) and information identifying the target recipient terminal (CP2 ID). In response to the connect request message, theconference server 28 validates and/or authenticates the two conference participants (for example, theconference server 28 may ensure the terminals CP1 and CP2 are properly logged in, and associated with an active account having appropriate billing credits), and then provides a unique conference ID to each of the initiating and target terminals in a conference enable message (steps 602, 604) that is sent to the initiating terminal CP1 in the form of a response message and to the target terminal CP2 as an update message. - Once the conference enable messages have been sent to the participating terminals, the terminals connect directly using the conference ID provided by the
conference server 28. In particular, in the example shown inFIG. 26 , after receipt of the conference enable message, the initiating terminal CP1 then sends a connect request message to the target terminal CP2 that includes the conference ID, and the target terminal CP2 then sends a conformation message to the target terminal CP1 that includes the conference ID, thereby establishing a bi-directional video conference session in which video and data are exchanged. - During the video conference session, the participating terminals CP1 and CP2 each periodically validate the ongoing session with the
conference server 28 using the conference ID (seesteps conference server 28 concludes that the conference ID is still valid (theserver 28 may for example check to confirm that a time credit is still outstanding on a prepaid account, or that costs or time have not exceeded a predetermined limit), then the server will signal for the ongoing conference session to continue. - Either of the participants can terminate a video conference session by selecting the “End Call” option at their respective terminal. As indicated at
step 618, when a participant selects the “End Call” option, the participant's terminal (terminal CP1 inFIG. 26 ) sends a Kill Request message to theconference server 28 that includes the conference ID. Theconference server 28 then sends a terminate session message to each of the participating terminals CP1, CP2, to end the session (steps 618, 620). Theconference server 28 can also terminate the video conference session unilaterally by sending the terminate signals to the participating terminals CP1 and CP2, for example if participant credits run out or the ongoing conference validation in steps 610-616 otherwise fails. - The messaging diagram of
FIG. 26 has been described above in respect of a video conference session initiated by aresident terminal 12 with a targetremote terminal 26. The diagram would be similar for a video conference session initiated by aremote terminal 26 with atarget resident terminal 12, with the roles of the two terminals being reversed. Similarly, video conference sessions between a monitoringterminal 20 and aremote terminal 26 could also be carried out as shown inFIG. 26 . In at least some example embodiments, video conference sessions within theenterprise network 16 are managed directly between theresident terminals 12 and the monitoring terminal(s) 20 without involving theconference server 28, however in some example embodiments even sessions betweenresident terminals 12 and the monitoring terminal(s) 20 could be managed through the conference sever 28 using the methodology shown inFIG. 26 . - It will be appreciated that video conference sessions could be managed by the
conferencing server 28 in a manner that is different than what is shown in the example diagram ofFIG. 26 . In example embodiments in which theconference server 28 participates in the set up, ongoing authorization, and subsequent tear down of video conference sessions, the conference server is able to track for accounting and billing purposes information about the video conference sessions that involveremote terminals 26, including the identity ofterminals - In some example embodiments, the
conference server 28 can facilitate and track one-way video monitoring sessions in which video fromresident terminal camera 712 and/orcamera 110 is streamed from a resident terminal to aremote terminal 26 in much the same way as a two-way video conference session is facilitated. In some example embodiments,resident terminals 12 can be enabled to include a VoIP (Voice Over Internet Protocol) function allowing such terminals to initiate and receive VoIP calls to and fromremote terminals 26 and other remote communications devices. - Although the
communication system 10 has been described above in the context of care facilities, embodiments of the system could also be applied to facilities or organizations having residents that wish to communicate with remotely located family members or other parties, including, but not limited to, for example, detention facilities, boarding schools, summer camps, and military camps. - While the invention has been described in detail in the foregoing specification, it will be understood by those skilled in the art that variations may be made without departing from the scope of the invention, being limited only by the appended claims.
Claims (40)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/552,328 US7965309B2 (en) | 2006-09-15 | 2006-10-24 | Bedside video communication system |
PCT/CA2007/001619 WO2008031216A1 (en) | 2006-09-15 | 2007-09-12 | Bedside video communication system |
CA2699425A CA2699425C (en) | 2006-09-15 | 2007-09-12 | Bedside video communication system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US82582806P | 2006-09-15 | 2006-09-15 | |
US11/552,328 US7965309B2 (en) | 2006-09-15 | 2006-10-24 | Bedside video communication system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20080068447A1 true US20080068447A1 (en) | 2008-03-20 |
US7965309B2 US7965309B2 (en) | 2011-06-21 |
Family
ID=39183316
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/552,328 Expired - Fee Related US7965309B2 (en) | 2006-09-15 | 2006-10-24 | Bedside video communication system |
Country Status (3)
Country | Link |
---|---|
US (1) | US7965309B2 (en) |
CA (1) | CA2699425C (en) |
WO (1) | WO2008031216A1 (en) |
Cited By (98)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080153427A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Data Processing Apparatus and a Method of Operating Data Processing Apparatus for Setting a State of a User Application |
US20080153531A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Presence Engine and a Method of Operating a Presence Engine for Encoding or Decoding Availability Status into a Signal Representative of an Audio Signal |
US20080155567A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Data Processing Apparatus and a Method of Operating Data Processing Apparatus for Generating Representations of Availability Status for Application Programs |
US20080153538A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Terminating Device and a Method of Operating a Terminating Device Configured to Communicate Availability Status Directly Between Terminating Devices |
US20080218490A1 (en) * | 2007-03-02 | 2008-09-11 | Lg Electronics Inc. | Terminal and method of controlling terminal |
US20080249376A1 (en) * | 2007-04-09 | 2008-10-09 | Siemens Medical Solutions Usa, Inc. | Distributed Patient Monitoring System |
US20090054107A1 (en) * | 2007-08-20 | 2009-02-26 | Synaptics Incorporated | Handheld communication device and method for conference call initiation |
US20090079811A1 (en) * | 2007-09-20 | 2009-03-26 | Brandt Matthew K | Videoconferencing System Discovery |
US20090109961A1 (en) * | 2007-10-31 | 2009-04-30 | John Michael Garrison | Multiple simultaneous call management using voice over internet protocol |
US20090163185A1 (en) * | 2007-12-24 | 2009-06-25 | Samsung Electronics Co., Ltd. | Method and system for creating, receiving and playing multiview images, and related mobile communication device |
US20090174759A1 (en) * | 2008-01-04 | 2009-07-09 | Viable Communications, Inc. | Audio video communications device |
US20090307606A1 (en) * | 2008-06-06 | 2009-12-10 | Microsoft Corporation | Storage and expedited retrieval of messages and responses in multi-tasking environments |
US20090326979A1 (en) * | 2007-02-02 | 2009-12-31 | Koninklijke Philips Electronics N. V. | Interactive patient forums |
US20100007732A1 (en) * | 2008-07-08 | 2010-01-14 | Ron Tolmei | Image, sound, and sensor data capture apparatus embedded into display apparatus |
US20100020185A1 (en) * | 2006-11-22 | 2010-01-28 | Sony Corporation | Image display system, display device and display method |
US20100057862A1 (en) * | 2008-08-29 | 2010-03-04 | International Business Machines Corporation | Solution that leverages an instant messaging system to manage ad hoc business process workflows |
US20100085417A1 (en) * | 2008-10-07 | 2010-04-08 | Ottalingam Satyanarayanan | Service level view of audiovisual conference systems |
US20100087173A1 (en) * | 2008-10-02 | 2010-04-08 | Microsoft Corporation | Inter-threading Indications of Different Types of Communication |
US20100091084A1 (en) * | 2008-10-14 | 2010-04-15 | Keith Parker | Combined video phone and television set |
US20100105370A1 (en) * | 2008-10-23 | 2010-04-29 | Kruzeniski Michael J | Contextual Search by a Mobile Communications Device |
US20100298026A1 (en) * | 2009-05-22 | 2010-11-25 | A-Vu Media Corp | Interactive terminal and associated terminal control system for communication and media distribution |
US20110106320A1 (en) * | 2009-10-30 | 2011-05-05 | Rain Bird Corporation | Method and apparatus for generating an irrigation schedule |
US20110106557A1 (en) * | 2009-10-30 | 2011-05-05 | iHAS INC | Novel one integrated system for real-time virtual face-to-face encounters |
US20110115875A1 (en) * | 2009-05-07 | 2011-05-19 | Innovate, Llc | Assisted Communication System |
US20110137438A1 (en) * | 2009-12-07 | 2011-06-09 | Vimicro Electronics Corporation | Video conference system and method based on video surveillance system |
US20110157460A1 (en) * | 2009-12-30 | 2011-06-30 | Samsung Electronics Co., Ltd. | Method and apparatus for driving camera |
US7983718B1 (en) * | 2007-10-11 | 2011-07-19 | Sprint Spectrum L.P. | Wireless phones with keys displaying image files |
US20110187812A1 (en) * | 2008-10-28 | 2011-08-04 | University Of Tsukuba | Communication wall panel, nursing care system having communication wall panel, and conference system having communication wall panel |
WO2011137303A2 (en) * | 2010-04-30 | 2011-11-03 | American Teleconferencing Services, Ltd. | Transferring a conference session between client devices |
US20110276895A1 (en) * | 2010-05-04 | 2011-11-10 | Qwest Communications International Inc. | Conversation Capture |
US20110307266A1 (en) * | 2007-05-14 | 2011-12-15 | Henley Terry L | Real-time interactive proactive, automated patient tracking and patient/hospital staff/care provider engagement system and method |
US20120040319A1 (en) * | 2010-08-16 | 2012-02-16 | Honeywell International Inc. | Systems and methods for medication compliance |
US20120039457A1 (en) * | 2010-08-16 | 2012-02-16 | Chunghwa Telecom Co., Ltd. | Teleconferencing control system and method |
CN102404130A (en) * | 2010-09-19 | 2012-04-04 | 中华电信股份有限公司 | Control method and control system of electronic conferences |
US20120081225A1 (en) * | 2010-04-05 | 2012-04-05 | Donald Craig Waugh | Medication delivery and validation system, method and apparatus |
US20120182245A1 (en) * | 2009-10-16 | 2012-07-19 | Golden Hour Data Systems, Inc | System And Method Of Using A Portable Touch Screen Device |
US20130129305A1 (en) * | 2011-11-22 | 2013-05-23 | Fu-Wen Hsiao | Digitized hospital management system |
US20130141513A1 (en) * | 2011-12-01 | 2013-06-06 | Eric Setton | Video messaging |
US20140153447A1 (en) * | 2008-03-07 | 2014-06-05 | Centurylink Intellectual Property Llc | System and Method for Remote Home Monitoring Utilizing a VoIP Phone |
AU2010260165B2 (en) * | 2009-06-15 | 2014-07-03 | Microsoft Technology Licensing, Llc | Mobile communications device user interface |
US8819566B2 (en) | 2010-05-04 | 2014-08-26 | Qwest Communications International Inc. | Integrated multi-modal chat |
US8892170B2 (en) | 2009-03-30 | 2014-11-18 | Microsoft Corporation | Unlock screen |
US8914072B2 (en) | 2009-03-30 | 2014-12-16 | Microsoft Corporation | Chromeless user interface |
CN104378578A (en) * | 2013-08-15 | 2015-02-25 | 中兴通讯股份有限公司 | Video source switching method and device and display device |
US9003306B2 (en) | 2010-05-04 | 2015-04-07 | Qwest Communications International Inc. | Doodle-in-chat-context |
WO2015145401A1 (en) * | 2014-03-28 | 2015-10-01 | Aetonix Systems | Simple video communication platform |
US20160050175A1 (en) * | 2014-08-18 | 2016-02-18 | Cisco Technology, Inc. | Alerting a meeting participant to rejoin a videoconference |
US9323424B2 (en) | 2008-10-23 | 2016-04-26 | Microsoft Corporation | Column organization of content |
US9356790B2 (en) | 2010-05-04 | 2016-05-31 | Qwest Communications International Inc. | Multi-user integrated task list |
US9438851B2 (en) | 2013-10-04 | 2016-09-06 | Samsung Electronics Co., Ltd. | Display apparatus and method for preventing divulgence of image information thereof |
US9443070B2 (en) | 2012-04-04 | 2016-09-13 | Intelmate Llc | Secure social network |
US9559869B2 (en) | 2010-05-04 | 2017-01-31 | Qwest Communications International Inc. | Video call handling |
WO2017040968A1 (en) * | 2015-09-04 | 2017-03-09 | Silexpro Llc | Wireless content sharing, center-of-table collaboration, and panoramic telepresence experience (pte) devices |
US9736428B1 (en) * | 2014-04-01 | 2017-08-15 | Securus Technologies, Inc. | Providing remote visitation and other services to non-residents of controlled-environment facilities via display devices |
US9800830B2 (en) * | 2012-02-01 | 2017-10-24 | Homewav, Llc | Method and apparatus for providing secured per-call adminstration, management, and control of communications between a secured party and a remote party |
US9942519B1 (en) | 2017-02-21 | 2018-04-10 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
US9948786B2 (en) | 2015-04-17 | 2018-04-17 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
US20180103893A1 (en) * | 2009-03-24 | 2018-04-19 | International Business Machines Corporation | Remote delivery and monitoring of health care |
US20180160072A1 (en) * | 2010-04-07 | 2018-06-07 | Apple Inc. | Establishing a video conference during a phone call |
US9998508B2 (en) | 2013-09-22 | 2018-06-12 | Cisco Technology, Inc. | Multi-site screen interactions |
US10009456B1 (en) * | 2014-07-02 | 2018-06-26 | Securus Technologies, Inc. | Controlled communication between residents of controlled-environment facilities |
US10009389B2 (en) | 2007-01-03 | 2018-06-26 | Cisco Technology, Inc. | Scalable conference bridge |
US10084665B1 (en) | 2017-07-25 | 2018-09-25 | Cisco Technology, Inc. | Resource selection using quality prediction |
US10135970B2 (en) * | 2014-04-22 | 2018-11-20 | Apham Nnaji | Active undetectable monitoring system |
US20180352012A1 (en) * | 2015-09-25 | 2018-12-06 | International Business Machines Corporation | Multiplexed, multimodal conferencing |
US10171261B2 (en) * | 2014-04-24 | 2019-01-01 | Vivint, Inc. | Remote talk down to panel, camera and speaker |
US10291762B2 (en) | 2015-12-04 | 2019-05-14 | Cisco Technology, Inc. | Docking station for mobile computing devices |
US10291597B2 (en) | 2014-08-14 | 2019-05-14 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
US10375474B2 (en) | 2017-06-12 | 2019-08-06 | Cisco Technology, Inc. | Hybrid horn microphone |
US10375125B2 (en) | 2017-04-27 | 2019-08-06 | Cisco Technology, Inc. | Automatically joining devices to a video conference |
US10404481B2 (en) | 2017-06-06 | 2019-09-03 | Cisco Technology, Inc. | Unauthorized participant detection in multiparty conferencing by comparing a reference hash value received from a key management server with a generated roster hash value |
US20190289098A1 (en) * | 2018-03-16 | 2019-09-19 | Coretronic Corporation | Remote management system and method |
US20190297302A1 (en) * | 2012-02-01 | 2019-09-26 | Homewav, Llc | Inmate device and user interface for inmate initiated video visitation system |
US10440073B2 (en) | 2017-04-11 | 2019-10-08 | Cisco Technology, Inc. | User interface for proximity based teleconference transfer |
US10438692B2 (en) | 2014-03-20 | 2019-10-08 | Cerner Innovation, Inc. | Privacy protection based on device presence |
US10452337B1 (en) * | 2015-11-30 | 2019-10-22 | Securus Technologies, Inc. | Controlled-environment facility digital bulletin board |
US10477148B2 (en) | 2017-06-23 | 2019-11-12 | Cisco Technology, Inc. | Speaker anticipation |
US10516709B2 (en) | 2017-06-29 | 2019-12-24 | Cisco Technology, Inc. | Files automatically shared at conference initiation |
US10515117B2 (en) | 2017-02-14 | 2019-12-24 | Cisco Technology, Inc. | Generating and reviewing motion metadata |
US10516707B2 (en) | 2016-12-15 | 2019-12-24 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
US10534474B1 (en) * | 2011-08-05 | 2020-01-14 | P4tents1, LLC | Gesture-equipped touch screen system, method, and computer program product |
US10542126B2 (en) | 2014-12-22 | 2020-01-21 | Cisco Technology, Inc. | Offline virtual participation in an online conference meeting |
US10574609B2 (en) | 2016-06-29 | 2020-02-25 | Cisco Technology, Inc. | Chat room access control |
US10592867B2 (en) | 2016-11-11 | 2020-03-17 | Cisco Technology, Inc. | In-meeting graphical user interface display using calendar information and system |
US10652504B2 (en) | 2014-03-28 | 2020-05-12 | Aetonix Systems | Simple video communication platform |
US20200152325A1 (en) * | 2007-08-29 | 2020-05-14 | Hill-Rom Services, Inc. | Bed having housekeeping request button |
EP3654639A1 (en) * | 2018-11-19 | 2020-05-20 | Ricoh Company, Ltd. | Communication system, carrier means, and terminal apparatus |
US10666899B2 (en) * | 2012-02-01 | 2020-05-26 | Homewav, Llc | Visitor device and user interface for inmate initiated video visitation system |
US10706391B2 (en) | 2017-07-13 | 2020-07-07 | Cisco Technology, Inc. | Protecting scheduled meeting in physical room |
US10715582B2 (en) * | 2016-09-19 | 2020-07-14 | Samsung Electronics Co., Ltd. | Method for managing communication in mission critical data (MCData) communication system |
US10771621B2 (en) | 2017-10-31 | 2020-09-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
US10904296B1 (en) * | 2017-04-28 | 2021-01-26 | Securus Technologies, Llc | Management of controlled-environment facility resident image and/or background during video visitation |
US20210168331A1 (en) * | 2013-07-17 | 2021-06-03 | Ebay Inc. | Methods, systems and apparatus for providing video communications |
US11275757B2 (en) | 2015-02-13 | 2022-03-15 | Cerner Innovation, Inc. | Systems and methods for capturing data, creating billable information and outputting billable information |
US11307734B1 (en) * | 2020-12-18 | 2022-04-19 | Securas Technologies, LLC | Dynamic controlled-environment facility resident communication and/or media device user interfaces |
US11363238B1 (en) * | 2020-09-28 | 2022-06-14 | Healthcare Information, Llc | Systems and methods for healthcare facility contactless communication |
US11632258B1 (en) * | 2020-04-12 | 2023-04-18 | All Turtles Corporation | Recognizing and mitigating displays of unacceptable and unhealthy behavior by participants of online video meetings |
US20230262100A1 (en) * | 2020-07-14 | 2023-08-17 | Sony Group Corporation | Information processing device, information processing method, program, and system |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8069512B2 (en) | 2006-09-14 | 2011-12-06 | Martin B Rawls-Meehan | Adjustable bed frame |
US10064784B2 (en) | 2006-09-14 | 2018-09-04 | Martin B. Rawls-Meehan | System and method of an adjustable bed with a vibration motor |
US8926535B2 (en) | 2006-09-14 | 2015-01-06 | Martin B. Rawls-Meehan | Adjustable bed position control |
US7321811B1 (en) | 2006-09-14 | 2008-01-22 | Rawls-Meehan Martin B | Methods and systems of adjustable bed position control |
US10864137B2 (en) | 2006-09-14 | 2020-12-15 | Ascion, Llc | System and method of an adjustable bed with a vibration motor |
DE102008037433A1 (en) * | 2008-10-10 | 2010-04-15 | Kbh Kommunikations-Beteiligungs-Holding Gmbh | Video and / or communication system |
US20100110160A1 (en) * | 2008-10-30 | 2010-05-06 | Brandt Matthew K | Videoconferencing Community with Live Images |
US8305423B2 (en) * | 2008-11-24 | 2012-11-06 | Innovatec, S.L. | Communication system for remote patient visits and clinical status monitoring |
US9641557B2 (en) * | 2009-12-08 | 2017-05-02 | Alcatel Lucent | Method for joining SIP communication devices into an existing call |
CA2742468C (en) | 2010-06-08 | 2018-04-24 | Aastra Technologies Limited | Method and system for video communication |
WO2012061406A2 (en) | 2010-11-01 | 2012-05-10 | Rawls-Meehan Martin B | Adjustable bed controls |
US9019099B2 (en) | 2012-11-12 | 2015-04-28 | Covidien Lp | Systems and methods for patient monitoring |
JP2016032128A (en) * | 2014-07-25 | 2016-03-07 | 株式会社リコー | Remote conference system, communication terminal, and program |
US9773501B1 (en) | 2017-01-06 | 2017-09-26 | Sorenson Ip Holdings, Llc | Transcription of communication sessions |
US9974111B1 (en) | 2017-01-06 | 2018-05-15 | Sorenson Ip Holdings, Llc | Establishment of communication between devices |
US9787842B1 (en) | 2017-01-06 | 2017-10-10 | Sorenson Ip Holdings, Llc | Establishment of communication between devices |
US9787941B1 (en) | 2017-01-06 | 2017-10-10 | Sorenson Ip Holdings, Llc | Device to device communication |
CN109495712A (en) * | 2017-09-13 | 2019-03-19 | 上海博取投资管理咨询有限公司 | Video and screen sharing method, apparatus and system applied to e-commerce system |
USD925517S1 (en) | 2019-05-14 | 2021-07-20 | Hill-Rom Services, Inc. | Communication console |
Citations (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3613669A (en) * | 1969-02-05 | 1971-10-19 | Smith Kline Instr | System and method employing video equipment for remote monitoring of body function activities |
US5305420A (en) * | 1991-09-25 | 1994-04-19 | Nippon Hoso Kyokai | Method and apparatus for hearing assistance with speech speed control function |
US5544649A (en) * | 1992-03-25 | 1996-08-13 | Cardiomedix, Inc. | Ambulatory patient health monitoring techniques utilizing interactive visual communication |
US5553609A (en) * | 1995-02-09 | 1996-09-10 | Visiting Nurse Service, Inc. | Intelligent remote visual monitoring system for home health care service |
US5810747A (en) * | 1996-08-21 | 1998-09-22 | Interactive Remote Site Technology, Inc. | Remote site medical intervention system |
US5942986A (en) * | 1995-08-09 | 1999-08-24 | Cedars-Sinai Medical Center | System and method for automatic critical event notification |
US5987519A (en) * | 1996-09-20 | 1999-11-16 | Georgia Tech Research Corporation | Telemedicine system using voice video and data encapsulation and de-encapsulation for communicating medical information between central monitoring stations and remote patient monitoring stations |
US5999207A (en) * | 1997-05-16 | 1999-12-07 | Scientific-Atlanta, Inc. | Method and apparatus for implementing a user interface for a videophone in a cable television network |
US6020916A (en) * | 1997-12-31 | 2000-02-01 | At&T Corp | Videophone multimedia interactive on-hold information menus |
US20010037461A1 (en) * | 2000-01-27 | 2001-11-01 | Web Data Solutions | Point-to-point data streaming using a mediator node for administration and security |
US6442432B2 (en) * | 1999-12-21 | 2002-08-27 | Medtronic, Inc. | Instrumentation and software for remote monitoring and programming of implantable medical devices (IMDs) |
US6487583B1 (en) * | 1998-09-15 | 2002-11-26 | Ikimbo, Inc. | System and method for information and application distribution |
US20030046108A1 (en) * | 2001-09-05 | 2003-03-06 | Iris Labadie | Method of providing visitation services between remotely located parties |
US6620099B1 (en) * | 1994-09-08 | 2003-09-16 | Fujitsu Limited | Home care system, center terminal and patient terminal |
US6638218B2 (en) * | 2001-05-14 | 2003-10-28 | American Doctors On-Line, Inc. | System and method for delivering medical examination, diagnosis, and treatment over a network |
US6731324B2 (en) * | 1998-11-18 | 2004-05-04 | William W. Levy | Video teleconferencing assembly and process |
US20040117498A1 (en) * | 2002-12-02 | 2004-06-17 | Nec Infrontia Corporation | Packet transmission system and packet reception system |
US20040148635A1 (en) * | 2003-01-29 | 2004-07-29 | Riaz Merchant | Audio and video stream integrating platform and method for allowing websites to stream audio and video from at least one camera to multiple viewers simultaneously over the internet without excessive infrastructure |
US20040222638A1 (en) * | 2003-05-08 | 2004-11-11 | Vladimir Bednyak | Apparatus and method for providing electrical energy generated from motion to an electrically powered device |
US6847334B2 (en) * | 1998-06-29 | 2005-01-25 | William Hayhurst | Mobile telecommunication device for simultaneously transmitting and receiving sound and image data |
US6850889B1 (en) * | 2000-06-09 | 2005-02-01 | Internet Treatment Consulting, N.V. | System and method for conducting a physician-patient consultation |
US20050038326A1 (en) * | 2003-05-30 | 2005-02-17 | Michael Mathur | System, device, and method for remote monitoring and servicing |
US20050111388A1 (en) * | 2003-11-19 | 2005-05-26 | Lg Electronics Inc. | Video-conferencing system using mobile terminal device and method for implementing the same |
US20050164633A1 (en) * | 2004-01-26 | 2005-07-28 | Nokia Corporation | Method, apparatus and computer program product for intuitive energy management of a short-range communication transceiver associated with a mobile terminal |
US20050251421A1 (en) * | 2004-03-29 | 2005-11-10 | Calvin Chang | Providing video interpreting services |
US20050273494A1 (en) * | 2004-06-07 | 2005-12-08 | Koichi Uchide | Graphical user interface apparatus and connection method in two-way communication system |
US20060088154A1 (en) * | 2004-10-21 | 2006-04-27 | Motorola, Inc. | Telecommunication devices that adjust audio characteristics for elderly communicators |
US7038588B2 (en) * | 2001-05-04 | 2006-05-02 | Draeger Medical Infant Care, Inc. | Apparatus and method for patient point-of-care data management |
US7239338B2 (en) * | 2003-10-01 | 2007-07-03 | Worldgate Service, Inc. | Videophone system and method |
US20070186002A1 (en) * | 2002-03-27 | 2007-08-09 | Marconi Communications, Inc. | Videophone and method for a video call |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5961446A (en) | 1995-10-06 | 1999-10-05 | Tevital Incorporated | Patient terminal for home health care system |
CA2403586A1 (en) | 2000-04-13 | 2001-10-25 | Hospitalcareonline.Com Inc. | Remote patient care |
-
2006
- 2006-10-24 US US11/552,328 patent/US7965309B2/en not_active Expired - Fee Related
-
2007
- 2007-09-12 WO PCT/CA2007/001619 patent/WO2008031216A1/en active Application Filing
- 2007-09-12 CA CA2699425A patent/CA2699425C/en not_active Expired - Fee Related
Patent Citations (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3613669A (en) * | 1969-02-05 | 1971-10-19 | Smith Kline Instr | System and method employing video equipment for remote monitoring of body function activities |
US5305420A (en) * | 1991-09-25 | 1994-04-19 | Nippon Hoso Kyokai | Method and apparatus for hearing assistance with speech speed control function |
US5544649A (en) * | 1992-03-25 | 1996-08-13 | Cardiomedix, Inc. | Ambulatory patient health monitoring techniques utilizing interactive visual communication |
US6620099B1 (en) * | 1994-09-08 | 2003-09-16 | Fujitsu Limited | Home care system, center terminal and patient terminal |
US5553609A (en) * | 1995-02-09 | 1996-09-10 | Visiting Nurse Service, Inc. | Intelligent remote visual monitoring system for home health care service |
US5942986A (en) * | 1995-08-09 | 1999-08-24 | Cedars-Sinai Medical Center | System and method for automatic critical event notification |
US5810747A (en) * | 1996-08-21 | 1998-09-22 | Interactive Remote Site Technology, Inc. | Remote site medical intervention system |
US5987519A (en) * | 1996-09-20 | 1999-11-16 | Georgia Tech Research Corporation | Telemedicine system using voice video and data encapsulation and de-encapsulation for communicating medical information between central monitoring stations and remote patient monitoring stations |
US5999207A (en) * | 1997-05-16 | 1999-12-07 | Scientific-Atlanta, Inc. | Method and apparatus for implementing a user interface for a videophone in a cable television network |
US6020916A (en) * | 1997-12-31 | 2000-02-01 | At&T Corp | Videophone multimedia interactive on-hold information menus |
US6847334B2 (en) * | 1998-06-29 | 2005-01-25 | William Hayhurst | Mobile telecommunication device for simultaneously transmitting and receiving sound and image data |
US6487583B1 (en) * | 1998-09-15 | 2002-11-26 | Ikimbo, Inc. | System and method for information and application distribution |
US6731324B2 (en) * | 1998-11-18 | 2004-05-04 | William W. Levy | Video teleconferencing assembly and process |
US6442432B2 (en) * | 1999-12-21 | 2002-08-27 | Medtronic, Inc. | Instrumentation and software for remote monitoring and programming of implantable medical devices (IMDs) |
US20010037461A1 (en) * | 2000-01-27 | 2001-11-01 | Web Data Solutions | Point-to-point data streaming using a mediator node for administration and security |
US6850889B1 (en) * | 2000-06-09 | 2005-02-01 | Internet Treatment Consulting, N.V. | System and method for conducting a physician-patient consultation |
US7038588B2 (en) * | 2001-05-04 | 2006-05-02 | Draeger Medical Infant Care, Inc. | Apparatus and method for patient point-of-care data management |
US6638218B2 (en) * | 2001-05-14 | 2003-10-28 | American Doctors On-Line, Inc. | System and method for delivering medical examination, diagnosis, and treatment over a network |
US20030046108A1 (en) * | 2001-09-05 | 2003-03-06 | Iris Labadie | Method of providing visitation services between remotely located parties |
US20070186002A1 (en) * | 2002-03-27 | 2007-08-09 | Marconi Communications, Inc. | Videophone and method for a video call |
US20040117498A1 (en) * | 2002-12-02 | 2004-06-17 | Nec Infrontia Corporation | Packet transmission system and packet reception system |
US20040148635A1 (en) * | 2003-01-29 | 2004-07-29 | Riaz Merchant | Audio and video stream integrating platform and method for allowing websites to stream audio and video from at least one camera to multiple viewers simultaneously over the internet without excessive infrastructure |
US20040222638A1 (en) * | 2003-05-08 | 2004-11-11 | Vladimir Bednyak | Apparatus and method for providing electrical energy generated from motion to an electrically powered device |
US20050038326A1 (en) * | 2003-05-30 | 2005-02-17 | Michael Mathur | System, device, and method for remote monitoring and servicing |
US7239338B2 (en) * | 2003-10-01 | 2007-07-03 | Worldgate Service, Inc. | Videophone system and method |
US20050111388A1 (en) * | 2003-11-19 | 2005-05-26 | Lg Electronics Inc. | Video-conferencing system using mobile terminal device and method for implementing the same |
US20050164633A1 (en) * | 2004-01-26 | 2005-07-28 | Nokia Corporation | Method, apparatus and computer program product for intuitive energy management of a short-range communication transceiver associated with a mobile terminal |
US20050251421A1 (en) * | 2004-03-29 | 2005-11-10 | Calvin Chang | Providing video interpreting services |
US20050273494A1 (en) * | 2004-06-07 | 2005-12-08 | Koichi Uchide | Graphical user interface apparatus and connection method in two-way communication system |
US20060088154A1 (en) * | 2004-10-21 | 2006-04-27 | Motorola, Inc. | Telecommunication devices that adjust audio characteristics for elderly communicators |
Cited By (172)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9800840B2 (en) | 2006-11-22 | 2017-10-24 | Sony Corporation | Image display system, image display apparatus, and image display method |
US10187612B2 (en) | 2006-11-22 | 2019-01-22 | Sony Corporation | Display apparatus for displaying image data received from an image pickup apparatus attached to a moving body specified by specification information |
US9413983B2 (en) * | 2006-11-22 | 2016-08-09 | Sony Corporation | Image display system, display device and display method |
US20100020185A1 (en) * | 2006-11-22 | 2010-01-28 | Sony Corporation | Image display system, display device and display method |
US20080153538A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Terminating Device and a Method of Operating a Terminating Device Configured to Communicate Availability Status Directly Between Terminating Devices |
US7715859B2 (en) * | 2006-12-22 | 2010-05-11 | Palm, Inc. | Presence engine and a method of operating a presence engine for encoding or decoding availability status into a signal representative of an audio signal |
US7970391B2 (en) * | 2006-12-22 | 2011-06-28 | Hewlett-Packard Development Company, L. P. | Managing availability status in a communications network |
US20080153427A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Data Processing Apparatus and a Method of Operating Data Processing Apparatus for Setting a State of a User Application |
US20080155567A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Data Processing Apparatus and a Method of Operating Data Processing Apparatus for Generating Representations of Availability Status for Application Programs |
US7694313B2 (en) | 2006-12-22 | 2010-04-06 | Palm, Inc. | Terminating device and a method of operating a terminating device configured to communicate availability status directly between terminating devices |
US20080153531A1 (en) * | 2006-12-22 | 2008-06-26 | Palm, Inc. | Presence Engine and a Method of Operating a Presence Engine for Encoding or Decoding Availability Status into a Signal Representative of an Audio Signal |
US20100177812A1 (en) * | 2006-12-22 | 2010-07-15 | Palm, Inc. | Managing availability status in a communications network |
US7685608B2 (en) | 2006-12-22 | 2010-03-23 | Palm, Inc. | Data processing apparatus and a method of operating data processing apparatus for generating representations of availability status for application programs |
US10009389B2 (en) | 2007-01-03 | 2018-06-26 | Cisco Technology, Inc. | Scalable conference bridge |
US20090326979A1 (en) * | 2007-02-02 | 2009-12-31 | Koninklijke Philips Electronics N. V. | Interactive patient forums |
US20140085403A1 (en) * | 2007-02-02 | 2014-03-27 | Koninklijke Philips N.V. | Interactive patient forums |
US8615408B2 (en) * | 2007-02-02 | 2013-12-24 | Koninklijke Philips N.V. | Interactive patient forums |
US8933891B2 (en) * | 2007-03-02 | 2015-01-13 | Lg Electronics Inc. | Terminal and method of controlling terminal |
US20080218490A1 (en) * | 2007-03-02 | 2008-09-11 | Lg Electronics Inc. | Terminal and method of controlling terminal |
US20080249376A1 (en) * | 2007-04-09 | 2008-10-09 | Siemens Medical Solutions Usa, Inc. | Distributed Patient Monitoring System |
US20110307266A1 (en) * | 2007-05-14 | 2011-12-15 | Henley Terry L | Real-time interactive proactive, automated patient tracking and patient/hospital staff/care provider engagement system and method |
US20090054107A1 (en) * | 2007-08-20 | 2009-02-26 | Synaptics Incorporated | Handheld communication device and method for conference call initiation |
US10886024B2 (en) * | 2007-08-29 | 2021-01-05 | Hill-Rom Services, Inc. | Bed having housekeeping request button |
US20200152325A1 (en) * | 2007-08-29 | 2020-05-14 | Hill-Rom Services, Inc. | Bed having housekeeping request button |
US11574736B2 (en) | 2007-08-29 | 2023-02-07 | Hill-Rom Services, Inc. | Wireless bed and surface locating system |
US20090079811A1 (en) * | 2007-09-20 | 2009-03-26 | Brandt Matthew K | Videoconferencing System Discovery |
US9661267B2 (en) * | 2007-09-20 | 2017-05-23 | Lifesize, Inc. | Videoconferencing system discovery |
US7983718B1 (en) * | 2007-10-11 | 2011-07-19 | Sprint Spectrum L.P. | Wireless phones with keys displaying image files |
US20090109961A1 (en) * | 2007-10-31 | 2009-04-30 | John Michael Garrison | Multiple simultaneous call management using voice over internet protocol |
US9219852B2 (en) | 2007-12-24 | 2015-12-22 | Samsung Electronics Co., Ltd. | Method and system for creating, receiving and playing multiview images, and related mobile communication device |
US20090163185A1 (en) * | 2007-12-24 | 2009-06-25 | Samsung Electronics Co., Ltd. | Method and system for creating, receiving and playing multiview images, and related mobile communication device |
US20090174759A1 (en) * | 2008-01-04 | 2009-07-09 | Viable Communications, Inc. | Audio video communications device |
US20140153447A1 (en) * | 2008-03-07 | 2014-06-05 | Centurylink Intellectual Property Llc | System and Method for Remote Home Monitoring Utilizing a VoIP Phone |
US9398060B2 (en) * | 2008-03-07 | 2016-07-19 | Centurylink Intellectual Property Llc | System and method for remote home monitoring utilizing a VoIP phone |
US8341533B2 (en) * | 2008-06-06 | 2012-12-25 | Microsoft Corporation | Storage and expedited retrieval of messages and responses in multi-tasking environments |
US20090307606A1 (en) * | 2008-06-06 | 2009-12-10 | Microsoft Corporation | Storage and expedited retrieval of messages and responses in multi-tasking environments |
US20100007732A1 (en) * | 2008-07-08 | 2010-01-14 | Ron Tolmei | Image, sound, and sensor data capture apparatus embedded into display apparatus |
US9454737B2 (en) * | 2008-08-29 | 2016-09-27 | International Business Machines Corporation | Solution that leverages an instant messaging system to manage ad hoc business process workflows |
US20100057862A1 (en) * | 2008-08-29 | 2010-03-04 | International Business Machines Corporation | Solution that leverages an instant messaging system to manage ad hoc business process workflows |
US20100087173A1 (en) * | 2008-10-02 | 2010-04-08 | Microsoft Corporation | Inter-threading Indications of Different Types of Communication |
US20100085417A1 (en) * | 2008-10-07 | 2010-04-08 | Ottalingam Satyanarayanan | Service level view of audiovisual conference systems |
US8441516B2 (en) * | 2008-10-07 | 2013-05-14 | Cisco Technology, Inc. | Service level view of audiovisual conference systems |
US9007424B2 (en) | 2008-10-07 | 2015-04-14 | Cisco Technology, Inc. | Service level view of audiovisual conference systems |
US9571358B2 (en) | 2008-10-07 | 2017-02-14 | Cisco Technology, Inc. | Service level view of audiovisual conference systems |
US20100091084A1 (en) * | 2008-10-14 | 2010-04-15 | Keith Parker | Combined video phone and television set |
US9223412B2 (en) | 2008-10-23 | 2015-12-29 | Rovi Technologies Corporation | Location-based display characteristics in a user interface |
US8781533B2 (en) | 2008-10-23 | 2014-07-15 | Microsoft Corporation | Alternative inputs of a mobile communications device |
US20100105370A1 (en) * | 2008-10-23 | 2010-04-29 | Kruzeniski Michael J | Contextual Search by a Mobile Communications Device |
US9323424B2 (en) | 2008-10-23 | 2016-04-26 | Microsoft Corporation | Column organization of content |
US10133453B2 (en) | 2008-10-23 | 2018-11-20 | Microsoft Technology Licensing, Llc | Alternative inputs of a mobile communications device |
US9606704B2 (en) | 2008-10-23 | 2017-03-28 | Microsoft Technology Licensing, Llc | Alternative inputs of a mobile communications device |
US8970499B2 (en) | 2008-10-23 | 2015-03-03 | Microsoft Technology Licensing, Llc | Alternative inputs of a mobile communications device |
US9703452B2 (en) | 2008-10-23 | 2017-07-11 | Microsoft Technology Licensing, Llc | Mobile communications device user interface |
US20100107100A1 (en) * | 2008-10-23 | 2010-04-29 | Schneekloth Jason S | Mobile Device Style Abstraction |
US20100180233A1 (en) * | 2008-10-23 | 2010-07-15 | Kruzeniski Michael J | Mobile Communications Device User Interface |
US9218067B2 (en) | 2008-10-23 | 2015-12-22 | Microsoft Technology Licensing, Llc | Mobile communications device user interface |
US8825699B2 (en) | 2008-10-23 | 2014-09-02 | Rovi Corporation | Contextual search by a mobile communications device |
EP2343888A4 (en) * | 2008-10-28 | 2017-04-26 | University of Tsukuba | Communication wall panel, care system equipped with communication wall panel, and conference system equipped with communication wall panel |
US20110187812A1 (en) * | 2008-10-28 | 2011-08-04 | University Of Tsukuba | Communication wall panel, nursing care system having communication wall panel, and conference system having communication wall panel |
US8755505B2 (en) * | 2008-10-28 | 2014-06-17 | University Of Tsukuba | Communication wall panel, nursing care system having communication wall panel, and conference system having communication wall panel |
US20180103893A1 (en) * | 2009-03-24 | 2018-04-19 | International Business Machines Corporation | Remote delivery and monitoring of health care |
US10813582B2 (en) * | 2009-03-24 | 2020-10-27 | International Business Machines Corporation | Remote delivery and monitoring of health care |
US11141099B2 (en) | 2009-03-24 | 2021-10-12 | International Business Machines Corporation | Remote delivery and monitoring of health care |
US8914072B2 (en) | 2009-03-30 | 2014-12-16 | Microsoft Corporation | Chromeless user interface |
US9977575B2 (en) | 2009-03-30 | 2018-05-22 | Microsoft Technology Licensing, Llc | Chromeless user interface |
US8892170B2 (en) | 2009-03-30 | 2014-11-18 | Microsoft Corporation | Unlock screen |
US20110115875A1 (en) * | 2009-05-07 | 2011-05-19 | Innovate, Llc | Assisted Communication System |
US20100298026A1 (en) * | 2009-05-22 | 2010-11-25 | A-Vu Media Corp | Interactive terminal and associated terminal control system for communication and media distribution |
AU2010260165B2 (en) * | 2009-06-15 | 2014-07-03 | Microsoft Technology Licensing, Llc | Mobile communications device user interface |
US20120182245A1 (en) * | 2009-10-16 | 2012-07-19 | Golden Hour Data Systems, Inc | System And Method Of Using A Portable Touch Screen Device |
US20110106320A1 (en) * | 2009-10-30 | 2011-05-05 | Rain Bird Corporation | Method and apparatus for generating an irrigation schedule |
US20110106557A1 (en) * | 2009-10-30 | 2011-05-05 | iHAS INC | Novel one integrated system for real-time virtual face-to-face encounters |
US20110137438A1 (en) * | 2009-12-07 | 2011-06-09 | Vimicro Electronics Corporation | Video conference system and method based on video surveillance system |
US8891004B2 (en) * | 2009-12-30 | 2014-11-18 | Samsung Electronics Co., Ltd | Method and apparatus for driving camera |
US20150070571A1 (en) * | 2009-12-30 | 2015-03-12 | Samsung Electronics Co., Ltd. | Method and apparatus for driving camera |
US20110157460A1 (en) * | 2009-12-30 | 2011-06-30 | Samsung Electronics Co., Ltd. | Method and apparatus for driving camera |
US9413958B2 (en) * | 2009-12-30 | 2016-08-09 | Samsung Electronics Co., Ltd | Method and apparatus for driving camera |
US20120081225A1 (en) * | 2010-04-05 | 2012-04-05 | Donald Craig Waugh | Medication delivery and validation system, method and apparatus |
US20120083666A1 (en) * | 2010-04-05 | 2012-04-05 | Donald Craig Waugh | Medication delivery and compliance system, method and apparatus |
US20210360192A1 (en) * | 2010-04-07 | 2021-11-18 | Apple Inc. | Establishing a video conference during a phone call |
US20180160072A1 (en) * | 2010-04-07 | 2018-06-07 | Apple Inc. | Establishing a video conference during a phone call |
US10462420B2 (en) * | 2010-04-07 | 2019-10-29 | Apple Inc. | Establishing a video conference during a phone call |
WO2011137303A3 (en) * | 2010-04-30 | 2012-01-05 | American Teleconferencing Services, Ltd. | Transferring a conference session between client devices |
WO2011137303A2 (en) * | 2010-04-30 | 2011-11-03 | American Teleconferencing Services, Ltd. | Transferring a conference session between client devices |
US20110276895A1 (en) * | 2010-05-04 | 2011-11-10 | Qwest Communications International Inc. | Conversation Capture |
US9559869B2 (en) | 2010-05-04 | 2017-01-31 | Qwest Communications International Inc. | Video call handling |
US9003306B2 (en) | 2010-05-04 | 2015-04-07 | Qwest Communications International Inc. | Doodle-in-chat-context |
US9501802B2 (en) * | 2010-05-04 | 2016-11-22 | Qwest Communications International Inc. | Conversation capture |
US8819566B2 (en) | 2010-05-04 | 2014-08-26 | Qwest Communications International Inc. | Integrated multi-modal chat |
US9356790B2 (en) | 2010-05-04 | 2016-05-31 | Qwest Communications International Inc. | Multi-user integrated task list |
US20120040319A1 (en) * | 2010-08-16 | 2012-02-16 | Honeywell International Inc. | Systems and methods for medication compliance |
US20120039457A1 (en) * | 2010-08-16 | 2012-02-16 | Chunghwa Telecom Co., Ltd. | Teleconferencing control system and method |
CN102404130A (en) * | 2010-09-19 | 2012-04-04 | 中华电信股份有限公司 | Control method and control system of electronic conferences |
US10534474B1 (en) * | 2011-08-05 | 2020-01-14 | P4tents1, LLC | Gesture-equipped touch screen system, method, and computer program product |
US20130129305A1 (en) * | 2011-11-22 | 2013-05-23 | Fu-Wen Hsiao | Digitized hospital management system |
US20130141513A1 (en) * | 2011-12-01 | 2013-06-06 | Eric Setton | Video messaging |
US8941707B2 (en) * | 2011-12-01 | 2015-01-27 | Tangome, Inc. | Video messaging |
US9262753B2 (en) | 2011-12-01 | 2016-02-16 | Tangome, Inc. | Video messaging |
US20220217302A1 (en) * | 2012-02-01 | 2022-07-07 | Homewav, Llc | Adminstrator device and user interface for inmate initiated video visitation system |
US20180048862A1 (en) * | 2012-02-01 | 2018-02-15 | Homewav, Llc | Method and system providing inmate text-initiated web-based audio-video secured visitor visitation |
US10666899B2 (en) * | 2012-02-01 | 2020-05-26 | Homewav, Llc | Visitor device and user interface for inmate initiated video visitation system |
US9800830B2 (en) * | 2012-02-01 | 2017-10-24 | Homewav, Llc | Method and apparatus for providing secured per-call adminstration, management, and control of communications between a secured party and a remote party |
US10313632B2 (en) * | 2012-02-01 | 2019-06-04 | Homewav, Llc | Method and system providing inmate text-initiated web-based audio-video secured visitor visitation |
US11258981B2 (en) * | 2012-02-01 | 2022-02-22 | Homewav, Llc | Inmate device and user interface for inmate initiated video visitation system |
US11265511B2 (en) * | 2012-02-01 | 2022-03-01 | Homewav, Llc | Adminstrator device and user interface for inmate initiated video visitation system |
US20190297302A1 (en) * | 2012-02-01 | 2019-09-26 | Homewav, Llc | Inmate device and user interface for inmate initiated video visitation system |
US10701314B2 (en) * | 2012-02-01 | 2020-06-30 | Homewav, Llc | Inmate device and user interface for inmate initiated video visitation system |
US11856325B2 (en) * | 2012-02-01 | 2023-12-26 | Homewav, Llc | Inmate device and user interface for inmate initiated video visitation system |
US20220141421A1 (en) * | 2012-02-01 | 2022-05-05 | Homewav, Llc | Inmate device and user interface for inmate initiated video visitation system |
US9832233B2 (en) | 2012-04-04 | 2017-11-28 | Intelmate Llc | Secure social network |
US9443070B2 (en) | 2012-04-04 | 2016-09-13 | Intelmate Llc | Secure social network |
US11683442B2 (en) * | 2013-07-17 | 2023-06-20 | Ebay Inc. | Methods, systems and apparatus for providing video communications |
US20210168331A1 (en) * | 2013-07-17 | 2021-06-03 | Ebay Inc. | Methods, systems and apparatus for providing video communications |
US9756285B2 (en) | 2013-08-15 | 2017-09-05 | Zte Corporation | Method, device, and display device for switching video source |
CN104378578A (en) * | 2013-08-15 | 2015-02-25 | 中兴通讯股份有限公司 | Video source switching method and device and display device |
EP3035675A4 (en) * | 2013-08-15 | 2016-08-03 | Zte Corp | Method, device, and display device for switching video source |
US9998508B2 (en) | 2013-09-22 | 2018-06-12 | Cisco Technology, Inc. | Multi-site screen interactions |
US9438851B2 (en) | 2013-10-04 | 2016-09-06 | Samsung Electronics Co., Ltd. | Display apparatus and method for preventing divulgence of image information thereof |
US10438692B2 (en) | 2014-03-20 | 2019-10-08 | Cerner Innovation, Inc. | Privacy protection based on device presence |
WO2015145401A1 (en) * | 2014-03-28 | 2015-10-01 | Aetonix Systems | Simple video communication platform |
US9491206B2 (en) | 2014-03-28 | 2016-11-08 | Aetonix Systems | Simple video communication platform |
US10652504B2 (en) | 2014-03-28 | 2020-05-12 | Aetonix Systems | Simple video communication platform |
US9736428B1 (en) * | 2014-04-01 | 2017-08-15 | Securus Technologies, Inc. | Providing remote visitation and other services to non-residents of controlled-environment facilities via display devices |
US10135970B2 (en) * | 2014-04-22 | 2018-11-20 | Apham Nnaji | Active undetectable monitoring system |
US10171261B2 (en) * | 2014-04-24 | 2019-01-01 | Vivint, Inc. | Remote talk down to panel, camera and speaker |
US10425529B1 (en) * | 2014-07-02 | 2019-09-24 | Securus Technologies, Inc. | Controlled communication between residents of controlled-environment facilities |
US10009456B1 (en) * | 2014-07-02 | 2018-06-26 | Securus Technologies, Inc. | Controlled communication between residents of controlled-environment facilities |
US10291597B2 (en) | 2014-08-14 | 2019-05-14 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
US10778656B2 (en) | 2014-08-14 | 2020-09-15 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
US20160050175A1 (en) * | 2014-08-18 | 2016-02-18 | Cisco Technology, Inc. | Alerting a meeting participant to rejoin a videoconference |
US10542126B2 (en) | 2014-12-22 | 2020-01-21 | Cisco Technology, Inc. | Offline virtual participation in an online conference meeting |
US11275757B2 (en) | 2015-02-13 | 2022-03-15 | Cerner Innovation, Inc. | Systems and methods for capturing data, creating billable information and outputting billable information |
US9948786B2 (en) | 2015-04-17 | 2018-04-17 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
US10623576B2 (en) | 2015-04-17 | 2020-04-14 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
WO2017040968A1 (en) * | 2015-09-04 | 2017-03-09 | Silexpro Llc | Wireless content sharing, center-of-table collaboration, and panoramic telepresence experience (pte) devices |
US20180352012A1 (en) * | 2015-09-25 | 2018-12-06 | International Business Machines Corporation | Multiplexed, multimodal conferencing |
US10630734B2 (en) | 2015-09-25 | 2020-04-21 | International Business Machines Corporation | Multiplexed, multimodal conferencing |
US10452337B1 (en) * | 2015-11-30 | 2019-10-22 | Securus Technologies, Inc. | Controlled-environment facility digital bulletin board |
US11194540B1 (en) | 2015-11-30 | 2021-12-07 | Securus Technologies, Llc | Controlled-environment facility digital bulletin board |
US10291762B2 (en) | 2015-12-04 | 2019-05-14 | Cisco Technology, Inc. | Docking station for mobile computing devices |
US11444900B2 (en) | 2016-06-29 | 2022-09-13 | Cisco Technology, Inc. | Chat room access control |
US10574609B2 (en) | 2016-06-29 | 2020-02-25 | Cisco Technology, Inc. | Chat room access control |
US11122111B2 (en) * | 2016-09-19 | 2021-09-14 | Samsung Electronics Co., Ltd. | Method for managing communication in mission critical data (MCData) communication system |
US10715582B2 (en) * | 2016-09-19 | 2020-07-14 | Samsung Electronics Co., Ltd. | Method for managing communication in mission critical data (MCData) communication system |
US11227264B2 (en) | 2016-11-11 | 2022-01-18 | Cisco Technology, Inc. | In-meeting graphical user interface display using meeting participant status |
US10592867B2 (en) | 2016-11-11 | 2020-03-17 | Cisco Technology, Inc. | In-meeting graphical user interface display using calendar information and system |
US10516707B2 (en) | 2016-12-15 | 2019-12-24 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
US11233833B2 (en) | 2016-12-15 | 2022-01-25 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
US10515117B2 (en) | 2017-02-14 | 2019-12-24 | Cisco Technology, Inc. | Generating and reviewing motion metadata |
US10334208B2 (en) | 2017-02-21 | 2019-06-25 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
US9942519B1 (en) | 2017-02-21 | 2018-04-10 | Cisco Technology, Inc. | Technologies for following participants in a video conference |
US10440073B2 (en) | 2017-04-11 | 2019-10-08 | Cisco Technology, Inc. | User interface for proximity based teleconference transfer |
US10375125B2 (en) | 2017-04-27 | 2019-08-06 | Cisco Technology, Inc. | Automatically joining devices to a video conference |
US10904296B1 (en) * | 2017-04-28 | 2021-01-26 | Securus Technologies, Llc | Management of controlled-environment facility resident image and/or background during video visitation |
US11509695B1 (en) * | 2017-04-28 | 2022-11-22 | Securus Technologies, Llc | Management of controlled-environment facility resident image and/or background during video visitation |
US10404481B2 (en) | 2017-06-06 | 2019-09-03 | Cisco Technology, Inc. | Unauthorized participant detection in multiparty conferencing by comparing a reference hash value received from a key management server with a generated roster hash value |
US10375474B2 (en) | 2017-06-12 | 2019-08-06 | Cisco Technology, Inc. | Hybrid horn microphone |
US11019308B2 (en) | 2017-06-23 | 2021-05-25 | Cisco Technology, Inc. | Speaker anticipation |
US10477148B2 (en) | 2017-06-23 | 2019-11-12 | Cisco Technology, Inc. | Speaker anticipation |
US10516709B2 (en) | 2017-06-29 | 2019-12-24 | Cisco Technology, Inc. | Files automatically shared at conference initiation |
US10706391B2 (en) | 2017-07-13 | 2020-07-07 | Cisco Technology, Inc. | Protecting scheduled meeting in physical room |
US10084665B1 (en) | 2017-07-25 | 2018-09-25 | Cisco Technology, Inc. | Resource selection using quality prediction |
US10225313B2 (en) | 2017-07-25 | 2019-03-05 | Cisco Technology, Inc. | Media quality prediction for collaboration services |
US10091348B1 (en) | 2017-07-25 | 2018-10-02 | Cisco Technology, Inc. | Predictive model for voice/video over IP calls |
US11245788B2 (en) | 2017-10-31 | 2022-02-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
US10771621B2 (en) | 2017-10-31 | 2020-09-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
US20190289098A1 (en) * | 2018-03-16 | 2019-09-19 | Coretronic Corporation | Remote management system and method |
EP3654639A1 (en) * | 2018-11-19 | 2020-05-20 | Ricoh Company, Ltd. | Communication system, carrier means, and terminal apparatus |
US11632258B1 (en) * | 2020-04-12 | 2023-04-18 | All Turtles Corporation | Recognizing and mitigating displays of unacceptable and unhealthy behavior by participants of online video meetings |
US20230262100A1 (en) * | 2020-07-14 | 2023-08-17 | Sony Group Corporation | Information processing device, information processing method, program, and system |
US11363238B1 (en) * | 2020-09-28 | 2022-06-14 | Healthcare Information, Llc | Systems and methods for healthcare facility contactless communication |
US11307734B1 (en) * | 2020-12-18 | 2022-04-19 | Securas Technologies, LLC | Dynamic controlled-environment facility resident communication and/or media device user interfaces |
Also Published As
Publication number | Publication date |
---|---|
CA2699425A1 (en) | 2008-03-20 |
US7965309B2 (en) | 2011-06-21 |
CA2699425C (en) | 2015-12-29 |
WO2008031216A1 (en) | 2008-03-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7965309B2 (en) | Bedside video communication system | |
US20190357880A1 (en) | Systems and methods for communicating | |
US20080129816A1 (en) | Childcare video conferencing system and method | |
US20190116337A1 (en) | Communication Systems | |
US7929465B2 (en) | Method of providing digital data service to users of video telephony calls | |
US7185282B1 (en) | Interface device for an integrated television-based broadband home health system | |
EP2356814B1 (en) | Hospital tv/monitor display control with hierarchical access control | |
US9094569B1 (en) | Remote web-based visitation system for prisons | |
US20090012373A1 (en) | System and Method for Providing Health Care Services | |
US20150019250A1 (en) | Manager-controllable integrated user content and services system | |
US20150221196A1 (en) | Method and Apparatus for Facilitating the Management of Health and Security | |
US20030167176A1 (en) | System and method for greeting a visitor | |
US20170302885A1 (en) | Providing Remote Visitation and Other Services to Non-Residents of Controlled-Environment Facilities via Display Devices | |
US20140025740A1 (en) | Collaboration activity initiation | |
US20100298026A1 (en) | Interactive terminal and associated terminal control system for communication and media distribution | |
US20060029273A1 (en) | Physician communication system | |
EP3223514A1 (en) | System and method for tele-assistance by means of a smart television | |
JP7128984B2 (en) | Telemedicine system and method | |
JP2001333396A (en) | Visual call system | |
CN114155979A (en) | Picture display control method and equipment and remote consultation system | |
JP2021047919A (en) | Remote medical care system and method | |
WO2021108948A1 (en) | Method for teleconsultation and related device | |
JP3470608B2 (en) | Home care terminal | |
TWI833507B (en) | Telemedicine consultation method and system | |
JP2019097864A (en) | Nurse call system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: QUICKWOLF TECHNOLOGY INC., CANADA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MATTILA, ERIC W.;MOOTE, STANLEY R.;REEL/FRAME:018429/0129 Effective date: 20061024 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20190621 |