US20020003469A1 - Internet browser facility and method for the visually impaired - Google Patents

Internet browser facility and method for the visually impaired Download PDF

Info

Publication number
US20020003469A1
US20020003469A1 US09/577,307 US57730700A US2002003469A1 US 20020003469 A1 US20020003469 A1 US 20020003469A1 US 57730700 A US57730700 A US 57730700A US 2002003469 A1 US2002003469 A1 US 2002003469A1
Authority
US
United States
Prior art keywords
tactile
matrix
list
representation
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/577,307
Other versions
US6459364B2 (en
Inventor
Aloke Gupta
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Development Co LP
Original Assignee
Hewlett Packard Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Co filed Critical Hewlett Packard Co
Priority to US09/577,307 priority Critical patent/US6459364B2/en
Assigned to HEWLETT-PACKARD COMPANY reassignment HEWLETT-PACKARD COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GUPTA, ALOKE
Publication of US20020003469A1 publication Critical patent/US20020003469A1/en
Application granted granted Critical
Publication of US6459364B2 publication Critical patent/US6459364B2/en
Assigned to HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. reassignment HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HEWLETT-PACKARD COMPANY
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • G09B21/005Details of specially-adapted software to access information, e.g. to browse through hyperlinked information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/247Telephone sets including user guidance or feature selection means facilitating their use
    • H04M1/2474Telephone terminals specially adapted for disabled people
    • H04M1/2476Telephone terminals specially adapted for disabled people for a visually impaired user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72445User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting Internet browser applications

Definitions

  • This invention relates to reading devices for the visual impaired, and to methods for displaying electronic files such as internet web pages.
  • Electro-mechanical devices have served to translate text into a tactilely readable format such as the Braille character set, which employs a matrix of tactile elements for each character, symbol, or word, with each element either being a flat spot or a raised bump.
  • the standard Braille character set uses an 8-dot matrix (2 columns of 4 dots), allowing adequate permutations, with the character matrices spaced apart on a surface to allow them to be distinguished.
  • a tactile device To display graphic content, such as icons, symbols, a cursor, borders, arrows, drawings, and photo images, a tactile device requires that the tactile elements be evenly and closely spaced apart.
  • Such devices have been proposed which use a matrix arranged on a standard Braille 1.5 mm dot pitch, so that Braille characters are displayed by leaving intervening columns and rows of dots blank or flat, and so that simple graphic images are displayed in a dot matrix fashion using all available tactile elements.
  • Web browsing often involves proceeding through several “layers” of pages at a web site to reach the page with the desired content. For a sighted person, this can be rapid; for the visually impaired, it can be time consuming to read up to the entire content of each page to find the desired link to the next page. This delay is exacerbated by the limited rate at which Braille text may be read.
  • the present invention overcomes the limitations of the prior art by providing a method of communicating electronic information via a display device having a matrix of movable tactile elements.
  • the method includes displaying a representation of a file containing hypertext links on a first portion of the matrix, and displaying a list of the hypertext links on a second portion of the matrix.
  • the representation may include graphical elements and text symbols such as Braille.
  • FIG. 1 is a perspective view of a tactile interface device according to a preferred embodiment of the invention.
  • FIG. 2 is a sample tactile screen display of a device operated according to the embodiment of FIG. 1.
  • FIG. 1 shows a portable computer device 10 having a housing 12 containing a display screen 14 and a keyboard 16 .
  • the device is intended for connection to a computer network such as the Internet via any means, including a hard-wired connection (not shown) for use with desktop applications, or a wireless communication link for portable usage.
  • the device is intended to serve as hardware for browsing the world wide web, but may be used for other computer or entertainment tasks, including creating and reading documents.
  • the screen 14 is a tactile feedback display capable of displaying the Braille character set in standard format, and includes a matrix of individually addressable dot or tactile elements 20 , as shown in FIG. 2.
  • the elements are arranged in an evenly spaced apart grid, so that each Braille character is spaced apart from an adjacent character by at least one blank row or column between the 2-dot by 4-dot individual character fields, unlike conventional Braille devices that do not provide active dots between character fields.
  • the use of active dots at all points on the grid permits the entire display or any portion to be used for displaying graphic images.
  • Each tactile element 20 is switchable between an inactive position in which the dot is flush with the surrounding surface, and an active position in which the dot is raised above the surrounding surface, in the manner of a raised embossed dot on a Braille-imprinted paper document page.
  • the mechanism for this may be of any type, including electromechanical actuators, electromagnetic elements, and switchable dimpled plastic film.
  • the mechanism may be transparent, to permit a conventional visual flat panel display to be positioned behind the tactile screen, to aid sighted users including those assisting the visually impaired, as well as users with limited visual impairment that may be able to perceive some visual elements.
  • a Braille word may be superimposed over the same word in conventional text.
  • a graphical image such as an icon, a picture, a line, a cursor, or an arrow may underlay the raised dots corresponding to the image.
  • the display screen may also include a touch sensor operable to detect pressure from a user's finger on a particular part of the screen.
  • the touch sensor may be a film behind a flexible tactile transducer film, or may be a thin film in front of the tactile elements, with sufficient flexibility and compliance that it dies not impair the tactile perception of the screen.
  • the touch sensor may also be a film layer of the tactile surface itself, or may include touch sensitive elements interspersed adjacent the tactile dot elements so that neither the touch sensor nor tactile display elements overlay the other.
  • Other touch screens may use grids of interruptible beams, capacitive discharge sensors, and conductive grids sensing a circuit made across nearby nodes.
  • the visual display may include picture elements in the form of switchable emitters or reflectors adjacent to each tactile element, aiding a partially sighted user to identify the locations on the screen where tactile readable elements are raised.
  • FIG. 2 shows a sample display screen in detail.
  • the screen includes three main portions: A content frame 22 , an index frame 24 , and a button frame 26 .
  • the content frame displays a Braille-translated version of a web page or other document. All text from the original downloaded file is translated to Braille, and graphic images are selectively simplified and converted to a dot matrix image of suitable scale on the screen.
  • a text title 30 identifies the web page contents; a text block 32 is displayed in Braille.
  • a number of images and symbols are displayed in the content frame, including a cursor arrow or icon 34 , a small line drawing 36 (showing a star shape in the example), and a larger image rendering 40 (showing a pine tree).
  • the text block includes several hypertext links 42 , 44 , 46 , 50 , each corresponding to a different web address, and leading to a different web page.
  • the links may be in text form, either listing the actual URL or web address, or including other words (e.g. “click here for more information”).
  • Links may conventionally be tied to an icon, image, or region of the screen, which if clicked with a user's cursor will cause the web browsing software to connect to an associated site.
  • the link is preferably indicated by a Braille text string identifying the link.
  • the links are often dispersed amongst the other words of text on the content frame, there is no way for the user relying on touch to quickly locate and identify the links. All the text must be read to ensure that all links are located. Therefore, the system software extracts all active links in the displayed page, and lists them in the index frame. In the illustrated example, the four links are listed in the order they are found in the text. The user may select other sort modes, such as segregating links by class (e.g. those pointing to other pages at the current site, to other sites, to commercial advertisements, and essential index links such as “search site”, “contact us”, “what's new”, and the like, often found in a separate page frame or at the bottom of each page.
  • class e.g. those pointing to other pages at the current site, to other sites, to commercial advertisements
  • essential index links such as “search site”, “contact us”, “what's new”, and the like, often found in a separate page frame or at the bottom of each page.
  • the device may detect a user's finger hovering over a link, and offer additional information about the link before actually connecting to the associated site or page. This information may be provided by an audible voice synthesizer, or by creating a temporary Braille text box containing the descriptive text adjacent to the touched link, in the manner of a drop down menu used in a graphical user interface.
  • the matrix tactile elements may be the pressure sensors, with the signal-to-motion transducers operating in reverse from the display function, such that a pressure generates a signal.
  • the system software retrieves the page associated with the clicked link, converts it to the tactile format, and displays it in the content frame by raising the appropriate tactile elements or dots.
  • the system also extracts the hypertext link information from the retrieved page, and lists the included links in the index frame.
  • the index frame includes several symbols 52 corresponding to the common browsing commands of “back”, “stop”, and “forward.” These may be used in the conventional manner, or may be used in a way more useful to visually impaired users to access a chronological history of pages visited, as opposed to the conventional approach that does not permit the back command to bring the user into a deeper level page reached via a parent page from which the user accesses a different deeper level page (i.e. the user may only back upward in the hierarchy to the first page visited.)
  • the preferred embodiment permits the user to “back” in sequence through all pages visited, even if going “back” takes the user to a lower level, or in a conceptually retrograde direction.
  • buttons 54 in the form of Braille text labels identifying their functions. Buttons may serve to select the type of information displayed in the index frame 24 , such as “list”, which indicates the current preferred status in which hyperlinks are listed; “search”, which displays a search utility; “favorites”, which lists book-marked favorite web pages; “home”, and “help”, which have conventional usage. Other buttons may open features for controlling software settings, and operations such as printing and saving of files.
  • All frames are bordered and divided from each other by boxes or lines 60 formed by raised dots in straight single rows. These lines formed from the matrix of tactile elements permit the user to know which frame is being read, and to ensure that information in different frames is not confused.

Abstract

A method of communicating electronic information via a display device having a matrix of movable tactile elements. The method includes displaying a representation of a file containing hypertext links on a first portion of the matrix, and displaying a list of the hypertext links on a second portion of the matrix. The representation may include graphical elements and text symbols such as Braille.

Description

    FIELD OF THE INVENTION
  • This invention relates to reading devices for the visual impaired, and to methods for displaying electronic files such as internet web pages. [0001]
  • BACKGROUND AND SUMMARY OF THE INVENTION
  • As the Internet has become an important communication tool, the visually impaired require display devices that permit Internet content such as web pages to be displayed. Electro-mechanical devices have served to translate text into a tactilely readable format such as the Braille character set, which employs a matrix of tactile elements for each character, symbol, or word, with each element either being a flat spot or a raised bump. The standard Braille character set uses an 8-dot matrix (2 columns of 4 dots), allowing adequate permutations, with the character matrices spaced apart on a surface to allow them to be distinguished. [0002]
  • To display graphic content, such as icons, symbols, a cursor, borders, arrows, drawings, and photo images, a tactile device requires that the tactile elements be evenly and closely spaced apart. Such devices have been proposed which use a matrix arranged on a standard Braille 1.5 mm dot pitch, so that Braille characters are displayed by leaving intervening columns and rows of dots blank or flat, and so that simple graphic images are displayed in a dot matrix fashion using all available tactile elements. [0003]
  • Other systems may be developed having a tactile element matrix with a finer resolution than the standard Braille dot spacing, with each dot generated by raising a cluster of tactile elements, and a number of inactive tactile elements between each adjacent Braille dot. This would permit a finer resolution for graphical purposes than provided for by the standard Braille dot pitch. [0004]
  • However, these systems are believed to be currently limited to the simple translation of electronic text (such as may be received in ASCII format) into strings of tactilely displayed Braille symbols. Since much of the content of a web page or other file may be in non-text form, this is not discernable to a visually impaired user of current Braille display devices. Current systems lack a means of identifying which words are selectable hypertext links to other web pages or downloadable content, nor do they provide a convenient means to locate such links on a page of text or to select and activate such links. Because the visually impaired user is unable to find these links “at a glance” in the manner of sighted users, he or she must serially read through the entire text to find a link of interest. [0005]
  • Web browsing often involves proceeding through several “layers” of pages at a web site to reach the page with the desired content. For a sighted person, this can be rapid; for the visually impaired, it can be time consuming to read up to the entire content of each page to find the desired link to the next page. This delay is exacerbated by the limited rate at which Braille text may be read. [0006]
  • The present invention overcomes the limitations of the prior art by providing a method of communicating electronic information via a display device having a matrix of movable tactile elements. The method includes displaying a representation of a file containing hypertext links on a first portion of the matrix, and displaying a list of the hypertext links on a second portion of the matrix. The representation may include graphical elements and text symbols such as Braille.[0007]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a perspective view of a tactile interface device according to a preferred embodiment of the invention. [0008]
  • FIG. 2 is a sample tactile screen display of a device operated according to the embodiment of FIG. 1.[0009]
  • DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT
  • FIG. 1 shows a [0010] portable computer device 10 having a housing 12 containing a display screen 14 and a keyboard 16. The device is intended for connection to a computer network such as the Internet via any means, including a hard-wired connection (not shown) for use with desktop applications, or a wireless communication link for portable usage. The device is intended to serve as hardware for browsing the world wide web, but may be used for other computer or entertainment tasks, including creating and reading documents.
  • The [0011] screen 14 is a tactile feedback display capable of displaying the Braille character set in standard format, and includes a matrix of individually addressable dot or tactile elements 20, as shown in FIG. 2. The elements are arranged in an evenly spaced apart grid, so that each Braille character is spaced apart from an adjacent character by at least one blank row or column between the 2-dot by 4-dot individual character fields, unlike conventional Braille devices that do not provide active dots between character fields. The use of active dots at all points on the grid permits the entire display or any portion to be used for displaying graphic images.
  • Each [0012] tactile element 20 is switchable between an inactive position in which the dot is flush with the surrounding surface, and an active position in which the dot is raised above the surrounding surface, in the manner of a raised embossed dot on a Braille-imprinted paper document page. The mechanism for this may be of any type, including electromechanical actuators, electromagnetic elements, and switchable dimpled plastic film. The mechanism may be transparent, to permit a conventional visual flat panel display to be positioned behind the tactile screen, to aid sighted users including those assisting the visually impaired, as well as users with limited visual impairment that may be able to perceive some visual elements. Thus, a Braille word may be superimposed over the same word in conventional text. A graphical image such as an icon, a picture, a line, a cursor, or an arrow may underlay the raised dots corresponding to the image.
  • The display screen may also include a touch sensor operable to detect pressure from a user's finger on a particular part of the screen. The touch sensor may be a film behind a flexible tactile transducer film, or may be a thin film in front of the tactile elements, with sufficient flexibility and compliance that it dies not impair the tactile perception of the screen. The touch sensor may also be a film layer of the tactile surface itself, or may include touch sensitive elements interspersed adjacent the tactile dot elements so that neither the touch sensor nor tactile display elements overlay the other. Other touch screens may use grids of interruptible beams, capacitive discharge sensors, and conductive grids sensing a circuit made across nearby nodes. Similarly, the visual display may include picture elements in the form of switchable emitters or reflectors adjacent to each tactile element, aiding a partially sighted user to identify the locations on the screen where tactile readable elements are raised. [0013]
  • FIG. 2 shows a sample display screen in detail. The screen includes three main portions: A [0014] content frame 22, an index frame 24, and a button frame 26. The content frame displays a Braille-translated version of a web page or other document. All text from the original downloaded file is translated to Braille, and graphic images are selectively simplified and converted to a dot matrix image of suitable scale on the screen. A text title 30 identifies the web page contents; a text block 32 is displayed in Braille. A number of images and symbols are displayed in the content frame, including a cursor arrow or icon 34, a small line drawing 36 (showing a star shape in the example), and a larger image rendering 40 (showing a pine tree).
  • Like typical web page text content, the text block includes [0015] several hypertext links 42, 44, 46, 50, each corresponding to a different web address, and leading to a different web page. On conventional visually displayed web pages the links may be in text form, either listing the actual URL or web address, or including other words (e.g. “click here for more information”). Links may conventionally be tied to an icon, image, or region of the screen, which if clicked with a user's cursor will cause the web browsing software to connect to an associated site. However, with tactile displays, a detailed image is unlikely to convey to the user adequate information about the link. Therefore, the link is preferably indicated by a Braille text string identifying the link.
  • Because the links are often dispersed amongst the other words of text on the content frame, there is no way for the user relying on touch to quickly locate and identify the links. All the text must be read to ensure that all links are located. Therefore, the system software extracts all active links in the displayed page, and lists them in the index frame. In the illustrated example, the four links are listed in the order they are found in the text. The user may select other sort modes, such as segregating links by class (e.g. those pointing to other pages at the current site, to other sites, to commercial advertisements, and essential index links such as “search site”, “contact us”, “what's new”, and the like, often found in a separate page frame or at the bottom of each page. [0016]
  • Using pressure- or presence-sensing transducers, the device may detect a user's finger hovering over a link, and offer additional information about the link before actually connecting to the associated site or page. This information may be provided by an audible voice synthesizer, or by creating a temporary Braille text box containing the descriptive text adjacent to the touched link, in the manner of a drop down menu used in a graphical user interface. The matrix tactile elements may be the pressure sensors, with the signal-to-motion transducers operating in reverse from the display function, such that a pressure generates a signal. [0017]
  • When a link is selected or clicked by application of a deliberate pressure, or by other input such as tapping the link with a given force profile or pattern (e.g. a double tap,) the system software retrieves the page associated with the clicked link, converts it to the tactile format, and displays it in the content frame by raising the appropriate tactile elements or dots. The system also extracts the hypertext link information from the retrieved page, and lists the included links in the index frame. [0018]
  • The index frame includes [0019] several symbols 52 corresponding to the common browsing commands of “back”, “stop”, and “forward.” These may be used in the conventional manner, or may be used in a way more useful to visually impaired users to access a chronological history of pages visited, as opposed to the conventional approach that does not permit the back command to bring the user into a deeper level page reached via a parent page from which the user accesses a different deeper level page (i.e. the user may only back upward in the hierarchy to the first page visited.) The preferred embodiment permits the user to “back” in sequence through all pages visited, even if going “back” takes the user to a lower level, or in a conceptually retrograde direction.
  • The [0020] button frame 26 includes buttons 54 in the form of Braille text labels identifying their functions. Buttons may serve to select the type of information displayed in the index frame 24, such as “list”, which indicates the current preferred status in which hyperlinks are listed; “search”, which displays a search utility; “favorites”, which lists book-marked favorite web pages; “home”, and “help”, which have conventional usage. Other buttons may open features for controlling software settings, and operations such as printing and saving of files.
  • All frames are bordered and divided from each other by boxes or [0021] lines 60 formed by raised dots in straight single rows. These lines formed from the matrix of tactile elements permit the user to know which frame is being read, and to ensure that information in different frames is not confused.
  • While the above is discussed in terms of preferred and alternative embodiments, the invention is not intended to be so limited. [0022]

Claims (20)

1. A method of communicating electronic information by tactile means comprising:
providing a display device having an matrix of movable tactile elements;
displaying a representation of a file containing hypertext links on a first portion of the matrix; and
displaying a list of the hypertext links on a second portion of the matrix.
2. The method of claim 1 wherein displaying a file includes downloading web content and converting it to a tactile-readable format.
3. The method of claim 2 wherein converting to a tactile readable format includes converting text characters to tactile symbols, and includes representing graphical image content by generating a corresponding pattern of raised tactile elements.
4. The method of claim 1 wherein displaying the list of links includes sorting the list.
5. The method of claim 1 including displaying in the first portion of the matrix a representation of a document associated with a selected hypertext link on the list of hypertext links, in response to selection of the link by a user.
6. The method of claim 5 wherein displaying a document occurs in response to sensing an applied force to at least a portion of a set of raised tactile elements corresponding to the selected hypertext link.
7. The method of claim 5 including updating the first portion of the matrix with a list of links from the document associated with the selected hypertext link.
8. A tactile web browsing device comprising:
a display device having an matrix of movable tactile elements;
a first portion of the matrix operable to display a representation of a file containing hypertext links; and
a second portion of the matrix operable to display a list of the hypertext links.
9. The device of claim 8 wherein the tactile elements are evenly spaced apart, such that graphical images are readily displayed.
10. The device of claim 8 including a touch sensor responsive to pressure on the matrix, and operable to identify the location of a pressure applied to the matrix.
11. The device of claim 8 including conversion means for converting a web page to a tactile readable form.
12. The device of claim 8 including link extraction means for identifying links displayed in the first portion of the matrix, and for displaying the links in a list form in the second portion of the matrix.
13. A web browsing method comprising:
downloading a file containing hypertext links;
generating a tactile representation of the file;
extracting a list of hypertext links contained in the file; and
generating a tactile representation of the list.
14. The method of claim 13 wherein generating a tactile representation of the file includes converting a text portion of the file to a tactile character set.
15. The method of claim 13 wherein generating a tactile representation of the file includes converting a graphics image in the file to a tactile pattern corresponding to the image.
16. The method of claim 13 wherein generating a tactile representation of the list includes sorting the list.
17. The method of claim 13 including displaying in a first portion of a tactile display screen a representation of a selected file associated with a selected hypertext link on the list of hypertext links, in response to selection of the link by a user.
18. The method of claim 17 wherein displaying the representation occurs in response to sensing an applied force to a representation of the selected hypertext link.
19. The method of claim 17 including extracting hypertext links from the selected file, and generating a representation of a list of the links extracted from the selected file.
20. The method of claim 13 wherein generating a tactile representation of the file and of the list includes providing a display device having an evenly spaced matrix of movable tactile elements.
US09/577,307 2000-05-23 2000-05-23 Internet browser facility and method for the visually impaired Expired - Fee Related US6459364B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US09/577,307 US6459364B2 (en) 2000-05-23 2000-05-23 Internet browser facility and method for the visually impaired

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/577,307 US6459364B2 (en) 2000-05-23 2000-05-23 Internet browser facility and method for the visually impaired

Publications (2)

Publication Number Publication Date
US20020003469A1 true US20020003469A1 (en) 2002-01-10
US6459364B2 US6459364B2 (en) 2002-10-01

Family

ID=24308160

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/577,307 Expired - Fee Related US6459364B2 (en) 2000-05-23 2000-05-23 Internet browser facility and method for the visually impaired

Country Status (1)

Country Link
US (1) US6459364B2 (en)

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020035581A1 (en) * 2000-06-06 2002-03-21 Microsoft Corporation Application program interfaces for semantically labeling strings and providing actions based on semantically labeled strings
US20020087591A1 (en) * 2000-06-06 2002-07-04 Microsoft Corporation Method and system for providing restricted actions for recognized semantic categories
US20020101441A1 (en) * 2001-01-31 2002-08-01 Microsoft Corporation Input device with pattern and tactile feedback for computer input and control
US20020122053A1 (en) * 2001-03-01 2002-09-05 International Business Machines Corporation Method and apparatus for presenting non-displayed text in Web pages
US20030164848A1 (en) * 2001-03-01 2003-09-04 International Business Machines Corporation Method and apparatus for summarizing content of a document for a visually impaired user
US20030220795A1 (en) * 2002-05-23 2003-11-27 Microsoft Corporation Method, system, and apparatus for converting currency values based upon semantically lableled strings
US20030237049A1 (en) * 2002-06-25 2003-12-25 Microsoft Corporation System and method for issuing a message to a program
US20040162833A1 (en) * 2003-02-13 2004-08-19 Microsoft Corporation Linking elements of a document to corresponding fields, queries and/or procedures in a database
US20040172584A1 (en) * 2003-02-28 2004-09-02 Microsoft Corporation Method and system for enhancing paste functionality of a computer software application
US20040230666A1 (en) * 2003-05-14 2004-11-18 Microsoft Corporation Method, system, and computer-readable medium for communicating results to a data query in a computer network
US20040268237A1 (en) * 2003-06-27 2004-12-30 Microsoft Corporation Leveraging markup language data for semantically labeling text strings and data and for providing actions based on semantically labeled text strings and data
US6925611B2 (en) 2001-01-31 2005-08-02 Microsoft Corporation Navigational interface for mobile and wearable computers
US20050182617A1 (en) * 2004-02-17 2005-08-18 Microsoft Corporation Methods and systems for providing automated actions on recognized text strings in a computer-generated document
US20060103634A1 (en) * 2004-11-17 2006-05-18 Samsung Electronics Co., Ltd. Apparatus and method of providing fingertip haptics of visual information using electro-active polymer for image display device
US20070073652A1 (en) * 2005-09-26 2007-03-29 Microsoft Corporation Lightweight reference user interface
WO2007104064A1 (en) * 2006-03-10 2007-09-20 Hahn, Werner Braille reading device
EP1850305A2 (en) * 2006-04-29 2007-10-31 Metec AG Display device for tactile recordable display elements and display system with such a display device
US20070258439A1 (en) * 2006-05-04 2007-11-08 Microsoft Corporation Hyperlink-based softphone call and management
WO2007130274A1 (en) 2006-05-04 2007-11-15 Microsoft Corporation Hover to call
US20080010593A1 (en) * 2006-06-30 2008-01-10 Nokia Corporation User interface input device
US20080021886A1 (en) * 2005-09-26 2008-01-24 Microsoft Corporation Lingtweight reference user interface
US20080046812A1 (en) * 2002-06-06 2008-02-21 Jeff Reynar Providing contextually sensitive tools and help content in computer-generated documents
US20080165142A1 (en) * 2006-10-26 2008-07-10 Kenneth Kocienda Portable Multifunction Device, Method, and Graphical User Interface for Adjusting an Insertion Point Marker
WO2009097866A1 (en) 2008-02-04 2009-08-13 Nokia Corporation Device and method for providing tactile information
US20090217164A1 (en) * 2007-11-13 2009-08-27 Beitle Robert R User Interface for Software Applications
US20090228842A1 (en) * 2008-03-04 2009-09-10 Apple Inc. Selecting of text using gestures
US20090286211A1 (en) * 2007-11-21 2009-11-19 Roche Diagnostics Operations, Inc. Medical device for visually impaired users and users not visually impaired
US20090315836A1 (en) * 2008-06-24 2009-12-24 Nokia Corporation Method and Apparatus for Executing a Feature Using a Tactile Cue
US20090319893A1 (en) * 2008-06-24 2009-12-24 Nokia Corporation Method and Apparatus for Assigning a Tactile Cue
US7707496B1 (en) 2002-05-09 2010-04-27 Microsoft Corporation Method, system, and apparatus for converting dates between calendars and languages based upon semantically labeled strings
US7711550B1 (en) 2003-04-29 2010-05-04 Microsoft Corporation Methods and system for recognizing names in a computer-generated document and for providing helpful actions associated with recognized names
US7716163B2 (en) 2000-06-06 2010-05-11 Microsoft Corporation Method and system for defining semantic categories and actions
US7742048B1 (en) 2002-05-23 2010-06-22 Microsoft Corporation Method, system, and apparatus for converting numbers based upon semantically labeled strings
US7770102B1 (en) 2000-06-06 2010-08-03 Microsoft Corporation Method and system for semantically labeling strings and providing actions based on semantically labeled strings
US7778816B2 (en) 2001-04-24 2010-08-17 Microsoft Corporation Method and system for applying input mode bias
US20100235729A1 (en) * 2009-03-16 2010-09-16 Kocienda Kenneth L Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US20100259500A1 (en) * 2004-07-30 2010-10-14 Peter Kennedy Visual Expander
US7827546B1 (en) 2002-06-05 2010-11-02 Microsoft Corporation Mechanism for downloading software components from a remote source for use by a local software application
US20110080364A1 (en) * 2006-10-26 2011-04-07 Bas Ording Method, System, and Graphical User Interface for Positioning an Insertion Marker in a Touch Screen Display
US20110111376A1 (en) * 2009-11-12 2011-05-12 Apple Inc. Braille Mirroring
US20110138277A1 (en) * 2006-10-04 2011-06-09 Immersion Corporation Haptic effects with proximity sensing
US20110283243A1 (en) * 2010-05-11 2011-11-17 Al Squared Dedicated on-screen closed caption display
US20120007809A1 (en) * 2010-07-06 2012-01-12 Padmanabhan Mahalingam Touch Screen Overlay for Visually Impaired Persons
US20120075200A1 (en) * 2010-09-27 2012-03-29 Nokia Corporation Touch Sensitive Input
US20120151218A1 (en) * 2005-11-30 2012-06-14 Mona Singh Methods, Systems, And Computer Program Products For Entering Sensitive And Padding Data Using User-Defined Criteria
US20120315607A1 (en) * 2011-06-09 2012-12-13 Samsung Electronics Co., Ltd. Apparatus and method for providing an interface in a device with touch screen
US20130164717A1 (en) * 2011-12-21 2013-06-27 Thomson Licensing Braille display system and method for operating a refreshable braille display
US8620938B2 (en) 2002-06-28 2013-12-31 Microsoft Corporation Method, system, and apparatus for routing a query to one or more providers
US8661339B2 (en) 2011-05-31 2014-02-25 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US8774679B2 (en) 2012-08-22 2014-07-08 Eastman Kodak Company Electrographic tactile image printing system
US8849159B2 (en) 2012-08-22 2014-09-30 Eastman Kodak Company Electrographic printing of tactile images
US8856682B2 (en) 2010-05-11 2014-10-07 AI Squared Displaying a user interface in a dedicated display area
US8870367B2 (en) 2012-05-02 2014-10-28 Eastman Kodak Company Printed image for visually-impaired person
US20150024371A1 (en) * 2013-01-21 2015-01-22 Susan E. Mon Pere Textured Screen Cover for Tactile Learning and Method of Use Thereof
US20150242096A1 (en) * 2003-04-18 2015-08-27 International Business Machines Corporation Enabling a visually impaired or blind person to have access to information printed on a physical document
US9240129B1 (en) * 2012-05-01 2016-01-19 Google Inc. Notifications and live updates for braille displays
US9259953B2 (en) 2013-09-27 2016-02-16 Eastman Kodak Company Tactile images having coefficient of friction differences
US20160269528A1 (en) * 2013-11-21 2016-09-15 Kyocera Corporation Information transmission device and information transmission method
US9529524B2 (en) 2008-03-04 2016-12-27 Apple Inc. Methods and graphical user interfaces for editing on a portable multifunction device
US20200090547A1 (en) * 2017-06-15 2020-03-19 Dot Incorporation Information output apparatus and method
CN111356969A (en) * 2017-09-21 2020-06-30 贝宝公司 Providing haptic feedback on a screen
EP3996071A1 (en) * 2020-11-04 2022-05-11 Freedom Scientific, Inc. Dynamic partitioning of a refreshable braille display based on presence of ancillary alphanumeric content
US11955027B2 (en) * 2017-06-15 2024-04-09 Dot Incorporation Information output apparatus and method

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2790567B1 (en) * 1999-03-02 2001-05-25 Philippe Soulie KEYBOARD FOR TOUCH READING INFORMATION FROM AN ELECTRONIC COMPUTER
US7155489B1 (en) * 2000-06-28 2006-12-26 Microsoft Corporation Acquiring web page information without commitment to downloading the web page
FR2816092B1 (en) * 2000-10-31 2003-01-24 France Telecom METHOD FOR MAKING PRE-EXISTING INFORMATION ACCESSIBLE TO INDIVIDUALS WITH VISUAL AND / OR HEARING IMPAIRMENTS
US6671577B2 (en) * 2000-12-01 2003-12-30 United States Postal Service System and method for directly connecting an advanced facer canceler system to a delivery bar code sorter
US7092907B2 (en) * 2001-02-05 2006-08-15 International Business Machines Corporation System and method for software selling
US7496831B2 (en) * 2001-02-22 2009-02-24 International Business Machines Corporation Method to reformat regions with cluttered hyperlinks
US20020124020A1 (en) * 2001-03-01 2002-09-05 International Business Machines Corporation Extracting textual equivalents of multimedia content stored in multimedia files
AU2002308250A1 (en) * 2001-03-15 2002-10-03 International Business Machines Corporation Method and system for accessing interactive multimedia information or services from braille documents
US7085811B2 (en) * 2001-03-27 2006-08-01 Pitney Bowes Inc. Sender elected messaging services
US7386457B2 (en) * 2001-03-27 2008-06-10 Pitney Bowes Inc. Messaging services for the visually impaired
US6993491B2 (en) 2001-03-27 2006-01-31 Pitney Bowes Inc. Method for a carrier to determine the location of a missing person
US7346591B2 (en) 2001-03-27 2008-03-18 Pitney Bowes Inc. Messaging services for uniquely identified mail
US7389238B2 (en) * 2001-03-27 2008-06-17 Pitney Bowes Inc. Recipient elected messaging services
US7386458B2 (en) 2001-03-27 2008-06-10 Pitney Bowes Inc. Recipient elected messaging services for mail that is transported in trays or tubs
US20020158903A1 (en) * 2001-04-26 2002-10-31 International Business Machines Corporation Apparatus for outputting textual renditions of graphical data and method therefor
US6636202B2 (en) * 2001-04-27 2003-10-21 International Business Machines Corporation Interactive tactile display for computer screen
US6941509B2 (en) * 2001-04-27 2005-09-06 International Business Machines Corporation Editing HTML DOM elements in web browsers with non-visual capabilities
US20020161824A1 (en) * 2001-04-27 2002-10-31 International Business Machines Corporation Method for presentation of HTML image-map elements in non visual web browsers
US7010581B2 (en) * 2001-09-24 2006-03-07 International Business Machines Corporation Method and system for providing browser functions on a web page for client-specific accessibility
US6864878B2 (en) * 2002-03-29 2005-03-08 Xerox Corporation Tactile overlays for screens
AU2003262199A1 (en) * 2002-04-17 2003-10-27 Cbt (Technology) Limited Accessibility of computer based training systems for the visually impaired
FI20021162A0 (en) * 2002-06-14 2002-06-14 Nokia Corp Electronic device and a method for administering its keypad
US6774788B1 (en) * 2002-10-07 2004-08-10 Thomas J. Balfe Navigation device for use by the visually impaired
US7200560B2 (en) * 2002-11-19 2007-04-03 Medaline Elizabeth Philbert Portable reading device with display capability
US7185284B2 (en) * 2002-12-20 2007-02-27 Motorola, Inc. Method and apparatus for providing a hyperlink indication on a display for an image in a web page
US7118135B2 (en) * 2003-02-07 2006-10-10 Meadwestvaco Corporation Embossed paper
US7717713B2 (en) 2003-02-07 2010-05-18 Meadwestvaco Corporation Writing guide system
US7306463B2 (en) * 2004-07-19 2007-12-11 Brian Paul Hanley Pseudo-cuneiform tactile display
US8629839B2 (en) * 2005-06-17 2014-01-14 Sharp Laboratories Of America, Inc. Display screen translator
US20080131849A1 (en) * 2006-12-01 2008-06-05 Ki Uk Kyung Apparatus and method for generating tactile sensation by using constellation metaphor
US7930212B2 (en) * 2007-03-29 2011-04-19 Susan Perry Electronic menu system with audio output for the visually impaired
US8740618B2 (en) * 2007-07-20 2014-06-03 Keith N. Shaw Braille module with compressible pin arrays
US8666765B2 (en) * 2007-12-31 2014-03-04 Aetna Inc. Online health care consumer portal
US20090287596A1 (en) * 2008-05-15 2009-11-19 Alex Henriquez Torrenegra Method, System, and Apparatus for Facilitating Transactions Between Sellers and Buyers for Travel Related Services
US20090303175A1 (en) * 2008-06-05 2009-12-10 Nokia Corporation Haptic user interface
US20090313020A1 (en) * 2008-06-12 2009-12-17 Nokia Corporation Text-to-speech user interface control
US8388346B2 (en) * 2008-08-30 2013-03-05 Nokia Corporation Tactile feedback
US20100240019A1 (en) * 2009-03-17 2010-09-23 Sathy Kumar R Instructional aids and methods
US8954848B2 (en) 2009-12-18 2015-02-10 Honda Motor Co., Ltd. Morphable pad for tactile control
CA2797231C (en) 2010-04-23 2018-09-25 Jonathan Seliger System and method for internet meta-browser for users with disabilities
US20120295232A1 (en) * 2011-02-03 2012-11-22 Stephen Sophorn Lim Touch sense device for the visually impaired
WO2015175193A1 (en) 2014-05-16 2015-11-19 Tactile Engineering, Llc Refreshable tactile display
US10121335B2 (en) 2014-07-18 2018-11-06 Google Technology Holdings LLC Wearable haptic device for the visually impaired
US9965036B2 (en) * 2014-07-18 2018-05-08 Google Technology Holdings LLC Haptic guides for a touch-sensitive display
CN104238821B (en) * 2014-09-21 2017-09-12 长春吉大博硕科技有限责任公司 A kind of tactile representation device and method applied to Braille reading

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3594787A (en) 1969-07-16 1971-07-20 Millard J Ickes Scene scanner and tactile display device for the blind
FR2282677A1 (en) 1974-08-22 1976-03-19 Tretiakoff Oleg POCKET ELECTRONIC CALCULATOR FOR THE BLIND
US4305067A (en) 1974-08-22 1981-12-08 Oleg Tretiakoff Electromechanical transducer for relief display panel
US4023969A (en) 1975-01-03 1977-05-17 Xerox Corporation Deformable elastomer imaging member employing an internal opaque deformable metallic layer
US4018603A (en) 1975-04-24 1977-04-19 Xerox Corporation Deformation imaging system using thermoplastic and elastomeric layers
US4021236A (en) 1975-04-24 1977-05-03 Xerox Corporation Imaging system
US4126854A (en) 1976-05-05 1978-11-21 Xerox Corporation Twisting ball panel display
US4182553A (en) 1978-01-19 1980-01-08 Xerox Corporation Honeycomb display devices
US4266936A (en) 1978-11-06 1981-05-12 Leonard Rose Braille display reader
FR2541011A1 (en) * 1983-02-11 1984-08-17 Cii Honeywell Bull DEVICE FOR CONVERTING ELECTRIC REPRESENTATIVE DATA SIGNALS TO A SET OF HIGHLIGHTS CONSTITUTING THE IMAGE OF THESE DATA
AT381181B (en) * 1984-03-30 1986-09-10 Siemens Ag Oesterreich TACTILE BRAILLE DISPLAY DEVICE WITH A SURFACE DISPLAY
US4871992A (en) 1988-07-08 1989-10-03 Petersen Robert C Tactile display apparatus
CA2027440C (en) 1989-11-08 1995-07-04 Nicholas K. Sheridon Paper-like computer output display and scanning system therefor
DE4012267A1 (en) 1990-03-13 1991-11-28 Joerg Fricke DEVICE FOR TASTABLE PRESENTATION OF INFORMATION
JPH0695586A (en) * 1991-07-15 1994-04-08 Eiji Nagaoka Braille display in crt and its device
JPH086493A (en) * 1993-07-21 1996-01-12 Texas Instr Inc <Ti> Tangible-type display that can be electronically refreshed for braille text and braille diagram
US5466154A (en) * 1993-07-26 1995-11-14 Thompson; James M. Braille board with movable dot pins
FR2709364B1 (en) * 1993-08-27 1995-10-13 Montane Ioan Interactive braille device.
US5496174A (en) 1994-08-04 1996-03-05 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Method and device for producing a tactile display using an electrorheological fluid
US5685721A (en) 1995-11-06 1997-11-11 American Research Corporation Of Virginia Refreshable braille-cell display implemented with shape memory alloys
US5636038A (en) * 1996-06-24 1997-06-03 Lynt; Ingrid H. Apparatus for converting visual images into tactile representations for use by a person who is visually impaired
US6128671A (en) * 1998-05-18 2000-10-03 F.J. Tieman B.V. Tactile feel device having a plurality of pins that allow a user to read information from the pins and make selection by depressing the pins
US5942970A (en) * 1998-10-08 1999-08-24 Norman; Jim Image optical-to-tactile converter
US6059575A (en) * 1998-10-21 2000-05-09 Murphy; Kevin C. Tactile recognition input device and overlay for use with an input device

Cited By (125)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020035581A1 (en) * 2000-06-06 2002-03-21 Microsoft Corporation Application program interfaces for semantically labeling strings and providing actions based on semantically labeled strings
US20020087591A1 (en) * 2000-06-06 2002-07-04 Microsoft Corporation Method and system for providing restricted actions for recognized semantic categories
US7716163B2 (en) 2000-06-06 2010-05-11 Microsoft Corporation Method and system for defining semantic categories and actions
US7770102B1 (en) 2000-06-06 2010-08-03 Microsoft Corporation Method and system for semantically labeling strings and providing actions based on semantically labeled strings
US7788602B2 (en) 2000-06-06 2010-08-31 Microsoft Corporation Method and system for providing restricted actions for recognized semantic categories
US7712024B2 (en) 2000-06-06 2010-05-04 Microsoft Corporation Application program interfaces for semantically labeling strings and providing actions based on semantically labeled strings
US6925611B2 (en) 2001-01-31 2005-08-02 Microsoft Corporation Navigational interface for mobile and wearable computers
US20040207601A1 (en) * 2001-01-31 2004-10-21 Microsoft Corporation Input device with pattern and tactile feedback for computer input and control
US20020101441A1 (en) * 2001-01-31 2002-08-01 Microsoft Corporation Input device with pattern and tactile feedback for computer input and control
US7461355B2 (en) 2001-01-31 2008-12-02 Microsoft Corporation Navigational interface for mobile and wearable computers
US6967642B2 (en) * 2001-01-31 2005-11-22 Microsoft Corporation Input device with pattern and tactile feedback for computer input and control
US20020122053A1 (en) * 2001-03-01 2002-09-05 International Business Machines Corporation Method and apparatus for presenting non-displayed text in Web pages
US20030164848A1 (en) * 2001-03-01 2003-09-04 International Business Machines Corporation Method and apparatus for summarizing content of a document for a visually impaired user
US7778816B2 (en) 2001-04-24 2010-08-17 Microsoft Corporation Method and system for applying input mode bias
US7707496B1 (en) 2002-05-09 2010-04-27 Microsoft Corporation Method, system, and apparatus for converting dates between calendars and languages based upon semantically labeled strings
US20030220795A1 (en) * 2002-05-23 2003-11-27 Microsoft Corporation Method, system, and apparatus for converting currency values based upon semantically lableled strings
US7742048B1 (en) 2002-05-23 2010-06-22 Microsoft Corporation Method, system, and apparatus for converting numbers based upon semantically labeled strings
US7707024B2 (en) 2002-05-23 2010-04-27 Microsoft Corporation Method, system, and apparatus for converting currency values based upon semantically labeled strings
US7827546B1 (en) 2002-06-05 2010-11-02 Microsoft Corporation Mechanism for downloading software components from a remote source for use by a local software application
US8706708B2 (en) 2002-06-06 2014-04-22 Microsoft Corporation Providing contextually sensitive tools and help content in computer-generated documents
US20080046812A1 (en) * 2002-06-06 2008-02-21 Jeff Reynar Providing contextually sensitive tools and help content in computer-generated documents
US20030237049A1 (en) * 2002-06-25 2003-12-25 Microsoft Corporation System and method for issuing a message to a program
US7716676B2 (en) 2002-06-25 2010-05-11 Microsoft Corporation System and method for issuing a message to a program
US8620938B2 (en) 2002-06-28 2013-12-31 Microsoft Corporation Method, system, and apparatus for routing a query to one or more providers
US7783614B2 (en) 2003-02-13 2010-08-24 Microsoft Corporation Linking elements of a document to corresponding fields, queries and/or procedures in a database
US20040162833A1 (en) * 2003-02-13 2004-08-19 Microsoft Corporation Linking elements of a document to corresponding fields, queries and/or procedures in a database
US20040172584A1 (en) * 2003-02-28 2004-09-02 Microsoft Corporation Method and system for enhancing paste functionality of a computer software application
US10614729B2 (en) 2003-04-18 2020-04-07 International Business Machines Corporation Enabling a visually impaired or blind person to have access to information printed on a physical document
US20150242096A1 (en) * 2003-04-18 2015-08-27 International Business Machines Corporation Enabling a visually impaired or blind person to have access to information printed on a physical document
US10276065B2 (en) * 2003-04-18 2019-04-30 International Business Machines Corporation Enabling a visually impaired or blind person to have access to information printed on a physical document
US7711550B1 (en) 2003-04-29 2010-05-04 Microsoft Corporation Methods and system for recognizing names in a computer-generated document and for providing helpful actions associated with recognized names
US20040230666A1 (en) * 2003-05-14 2004-11-18 Microsoft Corporation Method, system, and computer-readable medium for communicating results to a data query in a computer network
US7739588B2 (en) 2003-06-27 2010-06-15 Microsoft Corporation Leveraging markup language data for semantically labeling text strings and data and for providing actions based on semantically labeled text strings and data
US20040268237A1 (en) * 2003-06-27 2004-12-30 Microsoft Corporation Leveraging markup language data for semantically labeling text strings and data and for providing actions based on semantically labeled text strings and data
US20050182617A1 (en) * 2004-02-17 2005-08-18 Microsoft Corporation Methods and systems for providing automated actions on recognized text strings in a computer-generated document
US20100259500A1 (en) * 2004-07-30 2010-10-14 Peter Kennedy Visual Expander
US8427445B2 (en) 2004-07-30 2013-04-23 Apple Inc. Visual expander
US20060103634A1 (en) * 2004-11-17 2006-05-18 Samsung Electronics Co., Ltd. Apparatus and method of providing fingertip haptics of visual information using electro-active polymer for image display device
US20100127999A1 (en) * 2004-11-17 2010-05-27 Samsung Electronics Co., Ltd. Apparatus and method of providing fingertip haptics of visual information using electro-active polymer for image display device
US20070073652A1 (en) * 2005-09-26 2007-03-29 Microsoft Corporation Lightweight reference user interface
US7992085B2 (en) 2005-09-26 2011-08-02 Microsoft Corporation Lightweight reference user interface
US20080021886A1 (en) * 2005-09-26 2008-01-24 Microsoft Corporation Lingtweight reference user interface
US7788590B2 (en) 2005-09-26 2010-08-31 Microsoft Corporation Lightweight reference user interface
US20120151218A1 (en) * 2005-11-30 2012-06-14 Mona Singh Methods, Systems, And Computer Program Products For Entering Sensitive And Padding Data Using User-Defined Criteria
US8341420B2 (en) * 2005-11-30 2012-12-25 Armstrong, Quinton Co. LLC Methods, systems, and computer program products for entering sensitive and padding data using user-defined criteria
WO2007104064A1 (en) * 2006-03-10 2007-09-20 Hahn, Werner Braille reading device
EP1850305A3 (en) * 2006-04-29 2011-03-16 Metec AG Display device for tactile recordable display elements and display system with such a display device
EP1850305A2 (en) * 2006-04-29 2007-10-31 Metec AG Display device for tactile recordable display elements and display system with such a display device
EP2014037A1 (en) * 2006-05-04 2009-01-14 Microsoft Corporation Hover to call
US20070258439A1 (en) * 2006-05-04 2007-11-08 Microsoft Corporation Hyperlink-based softphone call and management
WO2007130274A1 (en) 2006-05-04 2007-11-15 Microsoft Corporation Hover to call
US20070274300A1 (en) * 2006-05-04 2007-11-29 Microsoft Corporation Hover to call
US7817792B2 (en) 2006-05-04 2010-10-19 Microsoft Corporation Hyperlink-based softphone call and management
EP2014037A4 (en) * 2006-05-04 2009-11-25 Microsoft Corp Hover to call
US20080010593A1 (en) * 2006-06-30 2008-01-10 Nokia Corporation User interface input device
CN101480024A (en) * 2006-06-30 2009-07-08 诺基亚公司 User interface input device
US7916002B2 (en) * 2006-06-30 2011-03-29 Nokia Corporation Haptic operative user interface input apparatus
US9600075B2 (en) 2006-10-04 2017-03-21 Immersion Corporation Haptic effects with proximity sensing
US8898564B2 (en) * 2006-10-04 2014-11-25 Immersion Corporation Haptic effects with proximity sensing
US20110138277A1 (en) * 2006-10-04 2011-06-09 Immersion Corporation Haptic effects with proximity sensing
US8570278B2 (en) 2006-10-26 2013-10-29 Apple Inc. Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker
US9207855B2 (en) 2006-10-26 2015-12-08 Apple Inc. Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker
US9348511B2 (en) 2006-10-26 2016-05-24 Apple Inc. Method, system, and graphical user interface for positioning an insertion marker in a touch screen display
US9632695B2 (en) 2006-10-26 2017-04-25 Apple Inc. Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker
US20110080364A1 (en) * 2006-10-26 2011-04-07 Bas Ording Method, System, and Graphical User Interface for Positioning an Insertion Marker in a Touch Screen Display
US20080165142A1 (en) * 2006-10-26 2008-07-10 Kenneth Kocienda Portable Multifunction Device, Method, and Graphical User Interface for Adjusting an Insertion Point Marker
US8201090B2 (en) * 2007-11-13 2012-06-12 The Board Of Trustees Of The University Of Arkansas User interface for software applications
US20090217164A1 (en) * 2007-11-13 2009-08-27 Beitle Robert R User Interface for Software Applications
US20090286211A1 (en) * 2007-11-21 2009-11-19 Roche Diagnostics Operations, Inc. Medical device for visually impaired users and users not visually impaired
US8766786B2 (en) * 2008-02-04 2014-07-01 Nokia Corporation Device and method for providing tactile information
WO2009097866A1 (en) 2008-02-04 2009-08-13 Nokia Corporation Device and method for providing tactile information
US20100315212A1 (en) * 2008-02-04 2010-12-16 Nokia Corporation Device and method for providing tactile information
US8650507B2 (en) 2008-03-04 2014-02-11 Apple Inc. Selecting of text using gestures
US9529524B2 (en) 2008-03-04 2016-12-27 Apple Inc. Methods and graphical user interfaces for editing on a portable multifunction device
US20090228842A1 (en) * 2008-03-04 2009-09-10 Apple Inc. Selecting of text using gestures
US20090319893A1 (en) * 2008-06-24 2009-12-24 Nokia Corporation Method and Apparatus for Assigning a Tactile Cue
US20090315836A1 (en) * 2008-06-24 2009-12-24 Nokia Corporation Method and Apparatus for Executing a Feature Using a Tactile Cue
US8659555B2 (en) 2008-06-24 2014-02-25 Nokia Corporation Method and apparatus for executing a feature using a tactile cue
US20100235793A1 (en) * 2009-03-16 2010-09-16 Bas Ording Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US8370736B2 (en) 2009-03-16 2013-02-05 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US8584050B2 (en) 2009-03-16 2013-11-12 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US20100235778A1 (en) * 2009-03-16 2010-09-16 Kocienda Kenneth L Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US9875013B2 (en) 2009-03-16 2018-01-23 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US8510665B2 (en) 2009-03-16 2013-08-13 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US9846533B2 (en) 2009-03-16 2017-12-19 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US8661362B2 (en) 2009-03-16 2014-02-25 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US20100235735A1 (en) * 2009-03-16 2010-09-16 Bas Ording Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US20100235783A1 (en) * 2009-03-16 2010-09-16 Bas Ording Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US20100235785A1 (en) * 2009-03-16 2010-09-16 Bas Ording Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US20100235726A1 (en) * 2009-03-16 2010-09-16 Bas Ording Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US8756534B2 (en) * 2009-03-16 2014-06-17 Apple Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US20100235729A1 (en) * 2009-03-16 2010-09-16 Kocienda Kenneth L Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US20100235784A1 (en) * 2009-03-16 2010-09-16 Bas Ording Methods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen Display
US10761716B2 (en) 2009-03-16 2020-09-01 Apple, Inc. Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
US20110111376A1 (en) * 2009-11-12 2011-05-12 Apple Inc. Braille Mirroring
US9747813B2 (en) * 2009-11-12 2017-08-29 Apple Inc. Braille mirroring
US8856682B2 (en) 2010-05-11 2014-10-07 AI Squared Displaying a user interface in a dedicated display area
US9401099B2 (en) * 2010-05-11 2016-07-26 AI Squared Dedicated on-screen closed caption display
US20110283243A1 (en) * 2010-05-11 2011-11-17 Al Squared Dedicated on-screen closed caption display
US8633907B2 (en) * 2010-07-06 2014-01-21 Padmanabhan Mahalingam Touch screen overlay for visually impaired persons
US20120007809A1 (en) * 2010-07-06 2012-01-12 Padmanabhan Mahalingam Touch Screen Overlay for Visually Impaired Persons
US20120075200A1 (en) * 2010-09-27 2012-03-29 Nokia Corporation Touch Sensitive Input
US9971405B2 (en) * 2010-09-27 2018-05-15 Nokia Technologies Oy Touch sensitive input
US8719695B2 (en) 2011-05-31 2014-05-06 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US9092130B2 (en) 2011-05-31 2015-07-28 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US11256401B2 (en) 2011-05-31 2022-02-22 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US9244605B2 (en) 2011-05-31 2016-01-26 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US10664144B2 (en) 2011-05-31 2020-05-26 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US8661339B2 (en) 2011-05-31 2014-02-25 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US8677232B2 (en) 2011-05-31 2014-03-18 Apple Inc. Devices, methods, and graphical user interfaces for document manipulation
US20120315607A1 (en) * 2011-06-09 2012-12-13 Samsung Electronics Co., Ltd. Apparatus and method for providing an interface in a device with touch screen
US20130164717A1 (en) * 2011-12-21 2013-06-27 Thomson Licensing Braille display system and method for operating a refreshable braille display
US9183759B2 (en) * 2011-12-21 2015-11-10 Thomson Licensing Braille display system and method for operating a refreshable Braille display
US9240129B1 (en) * 2012-05-01 2016-01-19 Google Inc. Notifications and live updates for braille displays
US8870367B2 (en) 2012-05-02 2014-10-28 Eastman Kodak Company Printed image for visually-impaired person
US8849159B2 (en) 2012-08-22 2014-09-30 Eastman Kodak Company Electrographic printing of tactile images
US8774679B2 (en) 2012-08-22 2014-07-08 Eastman Kodak Company Electrographic tactile image printing system
US20150024371A1 (en) * 2013-01-21 2015-01-22 Susan E. Mon Pere Textured Screen Cover for Tactile Learning and Method of Use Thereof
US9259953B2 (en) 2013-09-27 2016-02-16 Eastman Kodak Company Tactile images having coefficient of friction differences
US9871904B2 (en) * 2013-11-21 2018-01-16 Kyocera Corporation Information transmission device and information transmission method
US20160269528A1 (en) * 2013-11-21 2016-09-15 Kyocera Corporation Information transmission device and information transmission method
US20200090547A1 (en) * 2017-06-15 2020-03-19 Dot Incorporation Information output apparatus and method
US11955027B2 (en) * 2017-06-15 2024-04-09 Dot Incorporation Information output apparatus and method
CN111356969A (en) * 2017-09-21 2020-06-30 贝宝公司 Providing haptic feedback on a screen
EP3996071A1 (en) * 2020-11-04 2022-05-11 Freedom Scientific, Inc. Dynamic partitioning of a refreshable braille display based on presence of ancillary alphanumeric content

Also Published As

Publication number Publication date
US6459364B2 (en) 2002-10-01

Similar Documents

Publication Publication Date Title
US6459364B2 (en) Internet browser facility and method for the visually impaired
CN1848081B (en) User interface systems and methods for viewing and manipulating digital documents
US7856603B2 (en) Graphical user interface
US7316566B2 (en) Method for accessing interactive multimedia information or services from Braille documents
CA2290166C (en) Touch screen region assist for hypertext links
JP3941292B2 (en) Page information display method and apparatus, and storage medium storing page information display program or data
US7373588B2 (en) Method and system for accessing interactive multimedia information or services by touching marked items on physical documents
US5991781A (en) Method and apparatus for detecting and presenting client side image map attributes including sound attributes using page layout data strings
US7406663B2 (en) Graphical input device with dynamic field width adjustment for input of variable data via a browser-based display
US5544285A (en) Graphical user interface control for replicating data fields in forms
US8599147B2 (en) Computer interface for navigating graphical user interface by touch
US7689924B1 (en) Link annotation for keyboard navigation
KR20040094305A (en) Character and text unit input correction system
EP3190482A1 (en) Electronic device, character input module and method for selecting characters thereof
JP4972011B2 (en) Tactile presentation device and tactile presentation method
JP4972010B2 (en) Tactile presentation device and tactile presentation method
US9250710B2 (en) User interface for a hand held device
JP2002175141A (en) Integrally displaying and processing method for a plurality of informations
WO2021168333A1 (en) Display for braille tablet
US20020105496A1 (en) Non-visual user interface
Berliss et al. Design of accessible Web pages
Chen et al. Interactive visualization of multivariate statistical data
Stöger et al. The conventional Braille display state of the art and future perspectives
Fernandez Gonzalez et al. User Interface Guidelines

Legal Events

Date Code Title Description
AS Assignment

Owner name: HEWLETT-PACKARD COMPANY, COLORADO

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GUPTA, ALOKE;REEL/FRAME:011181/0001

Effective date: 20000516

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P., TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HEWLETT-PACKARD COMPANY;REEL/FRAME:026945/0699

Effective date: 20030131

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20141001