US20140340340A1 - Visual interface system - Google Patents

Visual interface system Download PDF

Info

Publication number
US20140340340A1
US20140340340A1 US14/344,462 US201114344462A US2014340340A1 US 20140340340 A1 US20140340340 A1 US 20140340340A1 US 201114344462 A US201114344462 A US 201114344462A US 2014340340 A1 US2014340340 A1 US 2014340340A1
Authority
US
United States
Prior art keywords
information
interface system
visual interface
signal
matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/344,462
Inventor
Hsiung-Kuang Tsai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Slim Hmi Technology
Original Assignee
Hsiung-Kuang Tsai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hsiung-Kuang Tsai filed Critical Hsiung-Kuang Tsai
Publication of US20140340340A1 publication Critical patent/US20140340340A1/en
Assigned to SLIM HMI TECHNOLOGY reassignment SLIM HMI TECHNOLOGY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TSAI, HSIUNG-KUANG
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H04B5/72
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0446Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14Handling requests for interconnection or transfer
    • G06F13/20Handling requests for interconnection or transfer for access to input/output bus
    • G06F13/28Handling requests for interconnection or transfer for access to input/output bus using burst mode transfer, e.g. direct memory access DMA, cycle steal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412Digitisers structurally integrated in a display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/046Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/041012.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup

Definitions

  • the present invention relates to a human-machine interface system and, in particular, to a visual interface system.
  • touch panels have been widely applied to the commercial electronic products such as mobile phones, digital cameras, MP 3 , PDA, GPS, tablet PC, UMPC, and the likes.
  • the touch panel is bound with a screen to form a touch input display apparatus.
  • a manufacturing method of a conventional touch input display apparatus is to dispose a touch panel on a display panel of a display module.
  • this approach not only increases the weight and sized of the product, but also the cost.
  • NFC near field communication
  • An objective of the present invention is to provide a visual interface system that can achieve the touch input function without configuring an additional touch panel, and is equipped with a near field communication (NFC) function.
  • NFC near field communication
  • the present invention can be implemented by the following technical proposals.
  • a visual interface system of the invention includes an operation apparatus and a matrix display apparatus.
  • the matrix display apparatus includes a display surface and a matrix substrate including a substrate and a matrix.
  • the matrix is disposed at one side of the substrate while the display surface is located at the other side of the substrate.
  • the encoded signal is capacitive coupled to the operation apparatus from the matrix substrate.
  • the transmission signal is transmitted to the matrix display apparatus or other apparatuses outside the visual interface system.
  • the transmission signal includes touch input information, instruction information, identification information, transaction information, file information or other information.
  • Another apparatus outside the system or the matrix display apparatus processes the transmission signal to obtain an information signal, which may includes touch input information, instruction information, identification information, transaction information, file information or other information.
  • the visual interface system further includes at least one relay apparatus for processing the transmission signal to generate a relay process signal.
  • the relay process signal is transmitted to the matrix display apparatus or other apparatuses outside the visual interface system.
  • the transmission signal may include touch input information, instruction information, identification information, transaction information, file information or other information.
  • the relay process signal may also include touch input information, instruction information, identification information, transaction information, file information or other information.
  • Another apparatus outside the system or the matrix display apparatus processes the relay process signal to obtain an information signal, which may includes touch input information, instruction information, identification information, transaction information, file information or other information.
  • the visual interface system further includes a mode trigger apparatus for enabling the matrix display apparatus into an operating mode to output the encoded signal as the mode trigger apparatus is triggered by a user or the operation apparatus.
  • the visual interface system when the operation apparatus is a user, the visual interface system further includes a sensing apparatus, and then when the user touches the display surface and the sensing apparatus simultaneously, the transmission signal is transmitted to the sensing apparatus.
  • the sensing apparatus is electrically coupled with other apparatuses outside the visual interface system or the matrix display apparatus.
  • the matrix further includes a plurality of row electrodes and a plurality of column electrodes.
  • the row electrodes and the column electrodes are intersected, and the encoded signal is applied to the row electrodes or the column electrodes.
  • the matrix further includes a plurality of transistors and a plurality of pixel electrodes, and the transistors are electrically connected with the row electrodes, the column electrodes and the pixel electrodes.
  • the encoded signal when the operation apparatus is operated on the display surface, the encoded signal is coupled to the operation apparatus from the matrix substrate, and the operation apparatus receives the encoded signal to generate a transmission signal.
  • the transmission signal can be transmitted to other apparatuses outside the system or at least one relay apparatus, or be sent back to the matrix display apparatus.
  • the transmission signal can be processed by other apparatuses outside the system, and/or at least one relay apparatus, and/or the matrix display apparatus, so as to retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal/signal processed by the relay apparatus/transmission signal.
  • the visual interface system of the invention can be directly applied to the system containing matrix structure such as TFT LCD panel, OLED panel, LED panel, electrophoretic display panel, MEMS display panel, or the likes, thereby integrating display, touch input and data transmission functions together.
  • the manufactured products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness.
  • the encoded signal is coupled to the external operation apparatus instead of being directly read by the matrix substrate, so that it is unnecessary to modify the layout on the matrix substrate. For example, regarding the touch input application, it is unnecessary to add the capacitance sensing components in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and shrink the process time.
  • FIG. 1 is a block diagram of a visual interface system according to a first embodiment of the invention
  • FIG. 2 is a side view of a matrix display apparatus according to the first embodiment of the invention.
  • FIG. 3 is a schematic diagram showing a TFT substrate used in the first embodiment of the invention.
  • FIG. 4 is a schematic diagram showing the signals for two row electrodes and two column electrodes of the TFT substrate of FIG. 3 ;
  • FIG. 5 is a timing chart of the encoded signal transmitted through each column electrode according to the first embodiment of the invention.
  • FIG. 6 is a perspective view of the matrix display apparatus of the visual interface system according to the first embodiment of the invention.
  • FIG. 7 is a schematic diagram showing the matrix display apparatus and a user, as the operation apparatus, of the visual interface system according to the first embodiment of the invention.
  • FIG. 8 is a block diagram of a visual interface system according to a second embodiment of the invention.
  • FIG. 1 is a block diagram of a visual interface system 1 according to a first embodiment of the invention.
  • the visual interface system 1 includes an operation apparatus 11 and a matrix display apparatus 12 , which are coupled with each other.
  • the operation apparatus 11 is capacitive coupled to the matrix display apparatus 12 for transmitting signals, which is a non-contact signal transmission.
  • the operation apparatus 11 is, for example, a stylus, an IC card, an NFC reading apparatus, or a user (especially the hand of a user).
  • the operation apparatus 11 is an electronic apparatus, it may include some functional circuits such as a process control circuit, a storage circuit or a transmission circuit.
  • any circuit can be composed of hardware, software or firmware, or their combinations.
  • the operation apparatus 11 is a user, the user (operation apparatus) can serve as a conductor for transmitting signals.
  • FIG. 2 is a side view of the matrix display apparatus 12 .
  • the matrix display apparatus 12 includes a display surface 121 and a matrix substrate 122 .
  • the matrix substrate 122 includes a substrate 123 and a matrix 124 .
  • the matrix 124 is disposed at one side of the substrate 123 , while the display surface 121 is located at the other side of the substrate 123 .
  • the display surface 121 is the surface of the matrix display apparatus 12 , which is closest to the viewer when the viewer is watching the images displayed on the matrix display apparatus 12 .
  • the matrix display apparatus 12 may further include a protect glass 125 disposed on one side of the substrate 123 opposite to the matrix 124 .
  • the display surface 121 is the surface of the protect glass closest to the viewer.
  • one side of the substrate 123 close to the protect glass 125 may be further configured with other components such as a polarizer, frame, or the likes.
  • the matrix substrate 122 is a substrate configured with pixel matrix for displaying images, such as the TFT substrate of LCD panel, OLED panel, LED panel, electrophoretic panel, MEMS display panel, and the likes.
  • the matrix 124 includes a plurality of row electrodes, a plurality of column electrodes, and a plurality of pixel electrodes, wherein the row electrodes and the column electrodes are intersected.
  • the matrix 124 can be an active matrix or a passive matrix.
  • the matrix 124 is an active matrix for example.
  • the matrix 124 may further include a plurality of transistors electrically connected with the row electrodes, the column electrodes and the pixel electrodes, respectively.
  • an encoded signal ES is coupled to the operation apparatus 11 from the matrix substrate 122 , and the operation apparatus 11 receives the encoded signal ES so as to generate a transmission signal TS.
  • the encoded signal ES contains the coordinates of the display screen of the matrix display apparatus 12
  • the transmission signal TS contains the coordinate information.
  • the encoded signal can be composed of any information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information.
  • information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information.
  • the encoded signal ES is applied to the matrix substrate 122 , and additional display data signal is applied to the matrix substrate 122 for displaying images.
  • the encoded signal ES is applied during the blanking time of the display data signals.
  • the encoded signal ES can be applied between two frames or scan operations of two row electrodes, or during the gap generated as shortening the input time of the display signals.
  • the encoded signal ES can have a higher frequency and be directly added to the display signal.
  • the encoded signal ES and the transmission signal TS will be further described hereinbelow, wherein the matrix substrate 122 is a TFT substrate of an LCD apparatus.
  • FIG. 3 is a schematic diagram showing a TFT substrate used in this embodiment.
  • the matrix 124 includes a plurality of row electrodes S 1 ⁇ S M , a plurality of column electrodes D 1 ⁇ D N , and a plurality of pixel electrodes E 11 ⁇ E MN .
  • the row electrodes and the column electrodes are intersected and they are substantially perpendicular to each other or have an included angle.
  • the matrix 124 further includes a plurality of transistors for electrically connected with the row electrodes S 1 ⁇ S M , column electrodes D 1 ⁇ D N , and pixel electrodes E 11 ⁇ E MN .
  • the row electrodes S 1 ⁇ S M are referred to scan lines, while the column electrodes D 1 ⁇ D N are referred to data lines.
  • the substrate 123 may further be configured with a driving module, which includes data driving circuit, scan driving circuit, timing control circuit (not shown), and gamma calibration circuit (not shown), for driving the LCD panel to display images. Since the function of the driving module is well known in this art, the detailed description thereof will be omitted here.
  • the above-mentioned matrix substrate is for illustrations only and is not to limit the invention.
  • the point of this embodiment is that the encoded signal is transmitted from the matrix substrate to the operation apparatus through the row electrodes S 1 ⁇ S M and/or the column electrodes D 1 ⁇ D N so as to generate the transmission signal.
  • the encoded signal may contain various information for different applications such as the reference coordinates of the display screen, the file information of different formats (e.g. personal data, music, images, and etc.), and the likes.
  • the column electrodes D 1 ⁇ D N can transmit not only the data signals for displaying images but also the encoded signal.
  • the display signal can be directly added to the encoded signal with higher frequency or be added to the blank period of the displayed data signal such as the period after the scan procedure of all row electrodes S 1 ⁇ S M are finished and before the next scan procedure start (the blank period between frames).
  • the display signal can be inserted after one row electrode is scanned and before the scan of next row electrode, or within the scan period of row electrode by reducing the display data signal period and before sending the display data.
  • the encoded signal can be provided by expending T-con circuit function and data or scan driving circuit, thereby simplifying the circuit design.
  • FIG. 4 is a schematic diagram showing the signals for two adjacent row electrodes and two adjacent column electrodes.
  • the row electrodes S 1 ⁇ S M transmit the scan signals SS, respectively, for sequentially turning on the transistors of each column.
  • each of the column electrodes D 1 ⁇ D N respectively transmits the corresponding encoded signal ES and the displayed data signal DS.
  • the encoded signal ES will be described hereinafter by taking one dimension touch input perpendicular to the row electrode and sequentially encoded in time as an example. Of course, this method can also be applied to another dimension touch input perpendicular to the column electrode. Consequently, a complete two-dimensional touch input can be built. In this embodiment, as shown in FIG.
  • the encoded signal ES is labeled with a level different from that of the displayed data signal DS; or, in practice, the encoded signal ES and the displayed data signal DS may have the same level.
  • FIG. 5 is a timing chart of the encoded signal transmitted through each column electrode, wherein the data signals for display are omitted.
  • the column electrodes D 1 ⁇ D N transmit the encoded signals ES 1 ⁇ ESN, respectively.
  • the encoded signals can be transmitted through different column electrodes, respectively, or multiple column electrodes may transmit the same encoded signal.
  • the column electrodes D 1 ⁇ D 3 transmit the encoded signal ES 1 .
  • This approach may also be applied to the transmission of encoded signals through the row electrodes.
  • the encoded signals transmitted through the row electrodes and the column electrodes may be independent.
  • the column electrodes transmit the encoded signals ES, respectively, it is necessary to provide a time reference point for determining the positions of the column electrodes by comparing with the reference point.
  • This reference point can be a specific code and transmitted by the same manner. For example, all column electrodes may output the code “1” twice and then transmit the sequential signal.
  • the encoded signal coupled to the operation apparatus is “110010000”, it represents that the operation apparatus is located on the third column electrode, thereby figuring out the coordinate (x-coordinate) of the operation apparatus.
  • the y-coordinate of the operation apparatus can be estimated according to another encoded signal applied to the row electrode.
  • the scan signals from the row electrodes for driving the display signal are sequentially generated, they can also be used as the encoded signals of the row electrodes.
  • the encoded signals of the row electrodes and the column electrodes may have a common reference point such as the horizontal or vertical sync signals for displaying images.
  • the column electrodes D 1 ⁇ D N and the row electrodes S 1 ⁇ S M may have more complicated encoded signals, which will not be described in detail here.
  • the duty cycle of the encoded signal of this embodiment is smaller than that of the data signals so as to maintain the display quality.
  • the encoded signal is capacitive coupled from the matrix substrate 122 to the operation apparatus 11 .
  • This embodiment takes the column electrodes D 1 ⁇ D N for transmitting the encoded signals ES for an example, so the column electrode can serve as one of the capacitive coupling electrodes, and the operation apparatus 11 has the other capacitive coupling electrode.
  • the operation apparatus 11 is a stylus
  • a conductor configured at the tip of the stylus functions as the other capacitive coupling electrode.
  • the operation apparatus 11 After receiving the encoded signal ES through the capacitive coupling, the operation apparatus 11 processes the received encoded signal ES to generate a transmission signal TS.
  • This process includes amplifying and/or decoding the encoded signal ES so as to determine the touch position, the touch gesture (writing style), the corresponding function instruction, or which column electrode is touched or pressed.
  • the encoded signal ES is capacitive coupled to the operation apparatus 11 , and the value of the capacitance relies upon the distance between the operation apparatus and the display surface, which means the amplitude of the signal can provide the z-axis information, so that the operation apparatus 11 can get not only the two-dimensional coordinates but also the z coordinate.
  • the transmission signal TS stands for the result of processing the encoded signal ES, ranging from simple amplification to extract the information like commands of action.
  • the operation apparatus 11 can transmit the transmission signal TS to the matrix display apparatus 12 , other relay apparatus, or other apparatuses outside the visual interface system through wire/wireless electrical coupling (including capacitive coupling) or optical coupling.
  • the transmission signal TS is directly transmitted to the matrix display apparatus 12 .
  • the information to be transmitted is encoded to generate an encoded signal ES based on a specific coding rule, and then the encoded signal ES is capacitive coupled from the matrix substrate 122 (e.g. configured as a cell phone or tablet computer) to the operation apparatus 11 (e.g. short distance wireless reading apparatus attached on the wall).
  • the operation apparatus 11 can process (decodes or modifies) the encoded signal ES based on the preset coding rule so as to obtain the transmission signal TS, and then uses the transmission signal TS on the corresponding application such as access control, payment, financial transaction, file transmission, and the likes.
  • the operation apparatus 11 processes the encoded signal ES to obtain the information contained in the transmission signal TS such as the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the matrix display apparatus 12 may process the transmission signal TS to obtain an information signal, which contains the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the information signal instead of the transmission signal TS, carries the complete information.
  • the signal is processed by, for example, amplification and decoding, which can be handled by either one of the operation apparatus 11 and the matrix display apparatus 12 or among these units. Accordingly, the resulting transmission signal TS or the information signal can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • a response signal RS can also be transmitted between the operation apparatus 11 and the matrix display apparatus 12 .
  • the response signal RS is for providing the information of the receiving status of the operation apparatus 11 to the matrix display apparatus 12 , announcing the operation apparatus 11 to get ready for receiving the signal, or synchronizing the operation apparatus 11 and the matrix display apparatus 12 .
  • This configuration can create an interactive mechanism between the transmitting and receiving signals.
  • the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11 and the matrix display apparatus 12 .
  • FIG. 6 is a schematic drawing of the matrix display apparatus 12 of the visual interface system according to the first embodiment of the invention.
  • the visual interface system further includes a mode trigger apparatus 127 .
  • the mode trigger apparatus 127 can enable the matrix display apparatus 12 into an operating mode to output the encoded signal ES.
  • the user needs the touch input function, he/she activates the mode trigger apparatus 127 so as to enable the matrix display apparatus 12 into the touch input mode.
  • the row electrode or column electrode starts to transmit the encoded signal. Otherwise, the matrix display apparatus 12 does not enter the touch input mode and the touch input function of the matrix display apparatus 12 may be partially or totally shut down.
  • the operation of the mode trigger apparatus 127 may have different operation modes. For example, after being activated, the mode trigger apparatus 127 may remain in the new state for a while and then return to the original state, or it may change the state while been activated each time, or it remains in the new state only when the activation lasts.
  • the mode trigger apparatus 127 can be configured on the operation apparatus (e.g. a switch on the stylus) as well. In this case, when the mode trigger apparatus 127 is activated, the operation apparatus 11 transmits a trigger signal to the matrix display apparatus 12 to control it to enter the touch input mode.
  • the mode trigger apparatus 127 can switch to touch input function when the mode trigger apparatus 127 is activated once by the user or requests the user to keep activating the mode trigger apparatus 127 to maintain in touch input function.
  • the user can trigger the mode trigger apparatus to transmit the encoded signal for authorization or personal identification to the corresponding data receiving device.
  • the mode trigger apparatus 127 can be, for example, a mechanical switch, a touch sensing switch, or the likes.
  • FIG. 7 is a schematic diagram showing the matrix display apparatus 12 and a user, as the operation apparatus 11 , of the visual interface system 1 according to the first embodiment of the invention.
  • the visual interface system 1 further includes a sensing apparatus 128 , which is electrically coupled with the matrix display apparatus 12 .
  • the transmission signal TS is transmitted to the matrix display apparatus 12 .
  • the user serves as a large conductor for transmitting the transmission signal TS to the matrix display apparatus 12 .
  • the user can use his/her right hand to operate on the display surface 121 , while use the left hand to press the sensing apparatus 128 .
  • the encoded signal ES can enter the user body through the right hand, and the transmission signal TS can be outputted from the left hand.
  • the sensing apparatus 128 may also contain the function of the mode trigger apparatus 127 . For example, only when the sensing apparatus 128 is pressed by hand, the operation mode will be enabled. This specific function can sufficiently reduce the power consumption and problem of unintentional touch.
  • FIG. 8 is a block diagram of a visual interface system 1 a according to a second embodiment of the invention.
  • the visual interface system 1 a includes an operation apparatus 11 and a matrix display apparatus 12 .
  • the visual interface system 1 a further includes at least one relay apparatus 13 , and the transmission signal TS is transmitted to the matrix display apparatus 12 or other apparatuses outside the visual interface system through the relay apparatus 13 .
  • Transmitting the transmission signal TS through user's hand to a relay apparatus 13 will be used to describe the implementation of this embodiment.
  • the relay apparatus 13 From the transmission signal TS, the relay apparatus 13 generates a relay processed signal IS and transmits back to the matrix display apparatus 12 .
  • the relay apparatus 13 is only for illustration and it is possible to configure multiple relay apparatuses.
  • the operation apparatus 11 When the operation apparatus 11 is a user, the user can transmit the transmission signal TS to the relay apparatus 13 instead of transmitting back to the matrix display apparatus 12 .
  • the relay apparatus 13 can be a portable communication device such as a cell phone. Accordingly, the user can be the transmission media for conducting the encoded signal ES outputted from the matrix display apparatus 12 to the relay apparatus 13 for the purpose of transmitting file information.
  • the relay apparatus 13 can process the transmission signal TS to generate a relay processed signal IS and then transmit the relay processed signal IS to the matrix display apparatus 12 .
  • the signal is processed by means, for example, amplification, decoding, modifying and/or interpretation, which can be implemented by all or either one of the operation apparatus 11 , the matrix display apparatus 12 and the relay apparatus 13 .
  • the transmission signal TS, the relay processed signal IS or the information signal can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the response signal RS of the first embodiment can also be applied to the operation apparatus, relay apparatus and/or matrix display apparatus of the second embodiment, thereby creating an interactive mechanism between the transmitting and receiving signals.
  • the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus, relay apparatus and matrix display apparatus.
  • the encoded signal when the operation apparatus is operated on the display surface, the encoded signal is coupled to the operation apparatus from the matrix substrate, and the operation apparatus receives the encoded signal to generate a transmission signal.
  • the transmission signal can be directly or indirectly transmitted to the matrix display apparatus.
  • the transmission signal can be processed by operation apparatus, at least one relay apparatus, and/or the matrix display apparatus, so that the matrix display apparatus can retrieve the information contained in the encoded signal and transmission signal, such as touch input information, instruction information, identification information, transaction information, file information or other information.
  • the visual interface system of the invention can be directly applied to the system containing matrix structure such as TFT LCD panel, OLED panel, LED panel, electrophoretic display panel, MEMS display panel, or the likes, thereby integrating display, touch input and data transmission functions together.
  • the products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness.
  • the encoded signal is coupled to the external operation apparatus instead of being directly read by the matrix substrate, so that it is unnecessary to modify the layout on the matrix substrate. For example, regarding to the touch input application, it is unnecessary to add the capacitance sensing component in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and time.

Abstract

A visual interface system includes an operation apparatus and a matrix display apparatus. The matrix display apparatus includes a display surface and a matrix substrate. The matrix substrate includes a substrate and a matrix which is disposed at one side of the substrate while the display surface is located at the other side of the substrate. When the operation apparatus is operated on the display surface, an encoded signal is coupled to the operation apparatus from the matrix substrate. The operation apparatus receives the encoded signal so as to generate a transmission signal.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of Invention
  • The present invention relates to a human-machine interface system and, in particular, to a visual interface system.
  • Related Art
  • Recently, touch panels have been widely applied to the commercial electronic products such as mobile phones, digital cameras, MP3, PDA, GPS, tablet PC, UMPC, and the likes. In these electronic products, the touch panel is bound with a screen to form a touch input display apparatus. A manufacturing method of a conventional touch input display apparatus is to dispose a touch panel on a display panel of a display module. However, due to the additional touch panel, this approach not only increases the weight and sized of the product, but also the cost.
  • In order to broaden the applications of the commercial electronic products, some products have been added with the new function of near field communication (NFC), which can be used to replace the conventional IC card (e.g. door card, credit card, ticket, and etc.), exchange information (e.g. music, image, name card, and etc.) between two electronic devices, or the likes. Accordingly, it is desired to create a product with a simple structure and more functions.
  • Therefore, it is an important subject to provide a visual interface system which can achieve the desired touch input function without configuring an additional touch panel, thereby making the product lighter and thinner, lowering the production cost, and providing the NFC function for broadening the application field.
  • SUMMARY OF THE INVENTION
  • An objective of the present invention is to provide a visual interface system that can achieve the touch input function without configuring an additional touch panel, and is equipped with a near field communication (NFC) function.
  • The present invention can be implemented by the following technical proposals.
  • A visual interface system of the invention includes an operation apparatus and a matrix display apparatus. The matrix display apparatus includes a display surface and a matrix substrate including a substrate and a matrix. The matrix is disposed at one side of the substrate while the display surface is located at the other side of the substrate. When the operation apparatus is operated on the display surface, an encoded signal is coupled to the operation apparatus from the matrix substrate, and the operation apparatus receives the encoded signal so as to generate a transmission signal.
  • In one embodiment, the encoded signal is capacitive coupled to the operation apparatus from the matrix substrate.
  • In one embodiment, the transmission signal is transmitted to the matrix display apparatus or other apparatuses outside the visual interface system. The transmission signal includes touch input information, instruction information, identification information, transaction information, file information or other information. Another apparatus outside the system or the matrix display apparatus processes the transmission signal to obtain an information signal, which may includes touch input information, instruction information, identification information, transaction information, file information or other information.
  • In one embodiment, the visual interface system further includes at least one relay apparatus for processing the transmission signal to generate a relay process signal. The relay process signal is transmitted to the matrix display apparatus or other apparatuses outside the visual interface system. The transmission signal may include touch input information, instruction information, identification information, transaction information, file information or other information. Besides, the relay process signal may also include touch input information, instruction information, identification information, transaction information, file information or other information. Another apparatus outside the system or the matrix display apparatus processes the relay process signal to obtain an information signal, which may includes touch input information, instruction information, identification information, transaction information, file information or other information.
  • In one embodiment, the visual interface system further includes a mode trigger apparatus for enabling the matrix display apparatus into an operating mode to output the encoded signal as the mode trigger apparatus is triggered by a user or the operation apparatus.
  • In one embodiment, when the operation apparatus is a user, the visual interface system further includes a sensing apparatus, and then when the user touches the display surface and the sensing apparatus simultaneously, the transmission signal is transmitted to the sensing apparatus. The sensing apparatus is electrically coupled with other apparatuses outside the visual interface system or the matrix display apparatus.
  • In one embodiment, the matrix further includes a plurality of row electrodes and a plurality of column electrodes. The row electrodes and the column electrodes are intersected, and the encoded signal is applied to the row electrodes or the column electrodes.
  • In one embodiment, the matrix further includes a plurality of transistors and a plurality of pixel electrodes, and the transistors are electrically connected with the row electrodes, the column electrodes and the pixel electrodes.
  • In the visual interface system of the invention, when the operation apparatus is operated on the display surface, the encoded signal is coupled to the operation apparatus from the matrix substrate, and the operation apparatus receives the encoded signal to generate a transmission signal. The transmission signal can be transmitted to other apparatuses outside the system or at least one relay apparatus, or be sent back to the matrix display apparatus. During this transmission procedure, the transmission signal can be processed by other apparatuses outside the system, and/or at least one relay apparatus, and/or the matrix display apparatus, so as to retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal/signal processed by the relay apparatus/transmission signal.
  • As mentioned above, the visual interface system of the invention can be directly applied to the system containing matrix structure such as TFT LCD panel, OLED panel, LED panel, electrophoretic display panel, MEMS display panel, or the likes, thereby integrating display, touch input and data transmission functions together. Thus, the manufactured products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness. Moreover, the encoded signal is coupled to the external operation apparatus instead of being directly read by the matrix substrate, so that it is unnecessary to modify the layout on the matrix substrate. For example, regarding the touch input application, it is unnecessary to add the capacitance sensing components in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and shrink the process time.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention will become more fully understood from the detailed description and accompanying drawings, which are given for illustration only, and thus are not limitative of the present invention, and wherein:
  • FIG. 1 is a block diagram of a visual interface system according to a first embodiment of the invention;
  • FIG. 2 is a side view of a matrix display apparatus according to the first embodiment of the invention;
  • FIG. 3 is a schematic diagram showing a TFT substrate used in the first embodiment of the invention;
  • FIG. 4 is a schematic diagram showing the signals for two row electrodes and two column electrodes of the TFT substrate of FIG. 3;
  • FIG. 5 is a timing chart of the encoded signal transmitted through each column electrode according to the first embodiment of the invention;
  • FIG. 6 is a perspective view of the matrix display apparatus of the visual interface system according to the first embodiment of the invention;
  • FIG. 7 is a schematic diagram showing the matrix display apparatus and a user, as the operation apparatus, of the visual interface system according to the first embodiment of the invention; and
  • FIG. 8 is a block diagram of a visual interface system according to a second embodiment of the invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • The present invention will be apparent from the following detailed description, which proceeds with reference to the accompanying drawings, wherein the same references relate to the same elements.
  • FIG. 1 is a block diagram of a visual interface system 1 according to a first embodiment of the invention. The visual interface system 1 includes an operation apparatus 11 and a matrix display apparatus 12, which are coupled with each other. For example, the operation apparatus 11 is capacitive coupled to the matrix display apparatus 12 for transmitting signals, which is a non-contact signal transmission.
  • In this embodiment, the operation apparatus 11 is, for example, a stylus, an IC card, an NFC reading apparatus, or a user (especially the hand of a user). When the operation apparatus 11 is an electronic apparatus, it may include some functional circuits such as a process control circuit, a storage circuit or a transmission circuit. Herein, any circuit can be composed of hardware, software or firmware, or their combinations. When the operation apparatus 11 is a user, the user (operation apparatus) can serve as a conductor for transmitting signals.
  • FIG. 2 is a side view of the matrix display apparatus 12. As shown in FIG. 2, the matrix display apparatus 12 includes a display surface 121 and a matrix substrate 122. The matrix substrate 122 includes a substrate 123 and a matrix 124. The matrix 124 is disposed at one side of the substrate 123, while the display surface 121 is located at the other side of the substrate 123. In this embodiment, the display surface 121 is the surface of the matrix display apparatus 12, which is closest to the viewer when the viewer is watching the images displayed on the matrix display apparatus 12. Besides, the matrix display apparatus 12 may further include a protect glass 125 disposed on one side of the substrate 123 opposite to the matrix 124. In this case, the display surface 121 is the surface of the protect glass closest to the viewer. Moreover, one side of the substrate 123 close to the protect glass 125 may be further configured with other components such as a polarizer, frame, or the likes.
  • In this embodiment, the matrix substrate 122 is a substrate configured with pixel matrix for displaying images, such as the TFT substrate of LCD panel, OLED panel, LED panel, electrophoretic panel, MEMS display panel, and the likes. The matrix 124 includes a plurality of row electrodes, a plurality of column electrodes, and a plurality of pixel electrodes, wherein the row electrodes and the column electrodes are intersected. Moreover, the matrix 124 can be an active matrix or a passive matrix. In this embodiment, the matrix 124 is an active matrix for example. Besides, the matrix 124 may further include a plurality of transistors electrically connected with the row electrodes, the column electrodes and the pixel electrodes, respectively.
  • The implementation of the embodiment used in the touch input purpose will be described hereinafter. Referring to FIGS. 1 and 2, when the operation apparatus 11 is operated on the display surface 121, an encoded signal ES is coupled to the operation apparatus 11 from the matrix substrate 122, and the operation apparatus 11 receives the encoded signal ES so as to generate a transmission signal TS. Herein, the encoded signal ES contains the coordinates of the display screen of the matrix display apparatus 12, and the transmission signal TS contains the coordinate information. When the encoded signal ES is transmitted form the matrix substrate 122 to the operation apparatus 11, they are wirelessly coupled so as to form a near field signal transmission. Of course, in other applications, the encoded signal can be composed of any information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information.
  • The encoded signal ES is applied to the matrix substrate 122, and additional display data signal is applied to the matrix substrate 122 for displaying images. The encoded signal ES is applied during the blanking time of the display data signals. For example, the encoded signal ES can be applied between two frames or scan operations of two row electrodes, or during the gap generated as shortening the input time of the display signals. Or, the encoded signal ES can have a higher frequency and be directly added to the display signal.
  • The encoded signal ES and the transmission signal TS will be further described hereinbelow, wherein the matrix substrate 122 is a TFT substrate of an LCD apparatus.
  • FIG. 3 is a schematic diagram showing a TFT substrate used in this embodiment. Referring to FIGS. 2 and 3, the matrix 124 includes a plurality of row electrodes S1˜SM, a plurality of column electrodes D1˜DN, and a plurality of pixel electrodes E11˜EMN. The row electrodes and the column electrodes are intersected and they are substantially perpendicular to each other or have an included angle. Moreover, the matrix 124 further includes a plurality of transistors for electrically connected with the row electrodes S1˜SM, column electrodes D1˜DN, and pixel electrodes E11˜EMN. The row electrodes S1˜SM are referred to scan lines, while the column electrodes D1˜DN are referred to data lines. Besides, the substrate 123 may further be configured with a driving module, which includes data driving circuit, scan driving circuit, timing control circuit (not shown), and gamma calibration circuit (not shown), for driving the LCD panel to display images. Since the function of the driving module is well known in this art, the detailed description thereof will be omitted here. To be noted, the above-mentioned matrix substrate is for illustrations only and is not to limit the invention. The point of this embodiment is that the encoded signal is transmitted from the matrix substrate to the operation apparatus through the row electrodes S1˜SM and/or the column electrodes D1˜DN so as to generate the transmission signal. The encoded signal may contain various information for different applications such as the reference coordinates of the display screen, the file information of different formats (e.g. personal data, music, images, and etc.), and the likes.
  • In this embodiment, the column electrodes D1˜DN can transmit not only the data signals for displaying images but also the encoded signal. For example, the display signal can be directly added to the encoded signal with higher frequency or be added to the blank period of the displayed data signal such as the period after the scan procedure of all row electrodes S1˜SM are finished and before the next scan procedure start (the blank period between frames). Or, the display signal can be inserted after one row electrode is scanned and before the scan of next row electrode, or within the scan period of row electrode by reducing the display data signal period and before sending the display data. Herein, the encoded signal can be provided by expending T-con circuit function and data or scan driving circuit, thereby simplifying the circuit design.
  • FIG. 4 is a schematic diagram showing the signals for two adjacent row electrodes and two adjacent column electrodes. The row electrodes S1˜SM transmit the scan signals SS, respectively, for sequentially turning on the transistors of each column. During the period that the transistors of each column are turned on, each of the column electrodes D1˜DN respectively transmits the corresponding encoded signal ES and the displayed data signal DS. The encoded signal ES will be described hereinafter by taking one dimension touch input perpendicular to the row electrode and sequentially encoded in time as an example. Of course, this method can also be applied to another dimension touch input perpendicular to the column electrode. Consequently, a complete two-dimensional touch input can be built. In this embodiment, as shown in FIG. 4, only one column electrode transmits the encoded signal ES when one row electrode transmits the scan signal. In this figure, the encoded signal ES is labeled with a level different from that of the displayed data signal DS; or, in practice, the encoded signal ES and the displayed data signal DS may have the same level.
  • FIG. 5 is a timing chart of the encoded signal transmitted through each column electrode, wherein the data signals for display are omitted. When the row electrodes transmit the scan signals, the column electrodes D1˜DN transmit the encoded signals ES1˜ESN, respectively. To be noted, the encoded signals can be transmitted through different column electrodes, respectively, or multiple column electrodes may transmit the same encoded signal. For example, the column electrodes D1˜D3 transmit the encoded signal ES1. This approach may also be applied to the transmission of encoded signals through the row electrodes. Alternatively, the encoded signals transmitted through the row electrodes and the column electrodes may be independent. Since the column electrodes transmit the encoded signals ES, respectively, it is necessary to provide a time reference point for determining the positions of the column electrodes by comparing with the reference point. This reference point can be a specific code and transmitted by the same manner. For example, all column electrodes may output the code “1” twice and then transmit the sequential signal. As mentioned above, if the encoded signal coupled to the operation apparatus is “110010000”, it represents that the operation apparatus is located on the third column electrode, thereby figuring out the coordinate (x-coordinate) of the operation apparatus. Similarly, the y-coordinate of the operation apparatus can be estimated according to another encoded signal applied to the row electrode. Since the scan signals from the row electrodes for driving the display signal are sequentially generated, they can also be used as the encoded signals of the row electrodes. The encoded signals of the row electrodes and the column electrodes may have a common reference point such as the horizontal or vertical sync signals for displaying images. Of course, the column electrodes D1˜DN and the row electrodes S1˜SM may have more complicated encoded signals, which will not be described in detail here.
  • The duty cycle of the encoded signal of this embodiment is smaller than that of the data signals so as to maintain the display quality.
  • When a user grabs the operation apparatus 11 and operates it on the display surface 121 of the matrix display apparatus 12 (e.g. to contact or approach the display surface), the encoded signal is capacitive coupled from the matrix substrate 122 to the operation apparatus 11. This embodiment takes the column electrodes D1˜DN for transmitting the encoded signals ES for an example, so the column electrode can serve as one of the capacitive coupling electrodes, and the operation apparatus 11 has the other capacitive coupling electrode. For example, when the operation apparatus 11 is a stylus, a conductor configured at the tip of the stylus functions as the other capacitive coupling electrode.
  • After receiving the encoded signal ES through the capacitive coupling, the operation apparatus 11 processes the received encoded signal ES to generate a transmission signal TS. This process includes amplifying and/or decoding the encoded signal ES so as to determine the touch position, the touch gesture (writing style), the corresponding function instruction, or which column electrode is touched or pressed. To be noted, the encoded signal ES is capacitive coupled to the operation apparatus 11, and the value of the capacitance relies upon the distance between the operation apparatus and the display surface, which means the amplitude of the signal can provide the z-axis information, so that the operation apparatus 11 can get not only the two-dimensional coordinates but also the z coordinate. Accordingly, the transmission signal TS stands for the result of processing the encoded signal ES, ranging from simple amplification to extract the information like commands of action.
  • After generating the transmission signal TS, the operation apparatus 11 can transmit the transmission signal TS to the matrix display apparatus 12, other relay apparatus, or other apparatuses outside the visual interface system through wire/wireless electrical coupling (including capacitive coupling) or optical coupling. In this embodiment, the transmission signal TS is directly transmitted to the matrix display apparatus 12.
  • When this invention is applied to other non-touch input applications, the information to be transmitted is encoded to generate an encoded signal ES based on a specific coding rule, and then the encoded signal ES is capacitive coupled from the matrix substrate 122 (e.g. configured as a cell phone or tablet computer) to the operation apparatus 11 (e.g. short distance wireless reading apparatus attached on the wall). Similarly, the operation apparatus 11 can process (decodes or modifies) the encoded signal ES based on the preset coding rule so as to obtain the transmission signal TS, and then uses the transmission signal TS on the corresponding application such as access control, payment, financial transaction, file transmission, and the likes.
  • In the above, the operation apparatus 11 processes the encoded signal ES to obtain the information contained in the transmission signal TS such as the touch input information, instruction information, identification information, transaction information, file information or other information. In other embodiments, the matrix display apparatus 12 may process the transmission signal TS to obtain an information signal, which contains the touch input information, instruction information, identification information, transaction information, file information or other information. In this case, the information signal, instead of the transmission signal TS, carries the complete information.
  • As mentioned above, referring to FIG. 1, in the procedures of coupling the encoded signal ES to the operation apparatus 11 to generate the transmission signal TS and transmitting the transmission signal TS to the matrix display apparatus 12 to obtain the information signal, the signal is processed by, for example, amplification and decoding, which can be handled by either one of the operation apparatus 11 and the matrix display apparatus 12 or among these units. Accordingly, the resulting transmission signal TS or the information signal can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • Besides, a response signal RS can also be transmitted between the operation apparatus 11 and the matrix display apparatus 12. Herein, the response signal RS is for providing the information of the receiving status of the operation apparatus 11 to the matrix display apparatus 12, announcing the operation apparatus 11 to get ready for receiving the signal, or synchronizing the operation apparatus 11 and the matrix display apparatus 12. This configuration can create an interactive mechanism between the transmitting and receiving signals. Moreover, the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11 and the matrix display apparatus 12.
  • FIG. 6 is a schematic drawing of the matrix display apparatus 12 of the visual interface system according to the first embodiment of the invention. Referring to FIG. 6, the visual interface system further includes a mode trigger apparatus 127. When a user or the operation apparatus triggers the mode trigger apparatus 127, the mode trigger apparatus 127 can enable the matrix display apparatus 12 into an operating mode to output the encoded signal ES. For example, when the user needs the touch input function, he/she activates the mode trigger apparatus 127 so as to enable the matrix display apparatus 12 into the touch input mode. Then, the row electrode or column electrode starts to transmit the encoded signal. Otherwise, the matrix display apparatus 12 does not enter the touch input mode and the touch input function of the matrix display apparatus 12 may be partially or totally shut down. This function can save power and prevent the abnormal operation caused by unintentionally contacting the screen. To be noted, the operation of the mode trigger apparatus 127 may have different operation modes. For example, after being activated, the mode trigger apparatus 127 may remain in the new state for a while and then return to the original state, or it may change the state while been activated each time, or it remains in the new state only when the activation lasts. The mode trigger apparatus 127 can be configured on the operation apparatus (e.g. a switch on the stylus) as well. In this case, when the mode trigger apparatus 127 is activated, the operation apparatus 11 transmits a trigger signal to the matrix display apparatus 12 to control it to enter the touch input mode. To be noted, it is possible to switch to touch input function when the mode trigger apparatus 127 is activated once by the user or requests the user to keep activating the mode trigger apparatus 127 to maintain in touch input function. Taking the access card, ticket, credit card or file transmission as examples, the user can trigger the mode trigger apparatus to transmit the encoded signal for authorization or personal identification to the corresponding data receiving device. The mode trigger apparatus 127 can be, for example, a mechanical switch, a touch sensing switch, or the likes.
  • FIG. 7 is a schematic diagram showing the matrix display apparatus 12 and a user, as the operation apparatus 11, of the visual interface system 1 according to the first embodiment of the invention. In this aspect, the visual interface system 1 further includes a sensing apparatus 128, which is electrically coupled with the matrix display apparatus 12. When the user touches or approaches the display surface 121 and the sensing apparatus 128 of the matrix display apparatus 12 simultaneously, the transmission signal TS is transmitted to the matrix display apparatus 12. The user serves as a large conductor for transmitting the transmission signal TS to the matrix display apparatus 12. In practice, the user can use his/her right hand to operate on the display surface 121, while use the left hand to press the sensing apparatus 128. Accordingly, the encoded signal ES can enter the user body through the right hand, and the transmission signal TS can be outputted from the left hand. The sensing apparatus 128 may also contain the function of the mode trigger apparatus 127. For example, only when the sensing apparatus 128 is pressed by hand, the operation mode will be enabled. This specific function can sufficiently reduce the power consumption and problem of unintentional touch.
  • FIG. 8 is a block diagram of a visual interface system 1 a according to a second embodiment of the invention. The visual interface system 1 a includes an operation apparatus 11 and a matrix display apparatus 12. Different from the first embodiment, the visual interface system 1 a further includes at least one relay apparatus 13, and the transmission signal TS is transmitted to the matrix display apparatus 12 or other apparatuses outside the visual interface system through the relay apparatus 13. Transmitting the transmission signal TS through user's hand to a relay apparatus 13 will be used to describe the implementation of this embodiment. From the transmission signal TS, the relay apparatus 13 generates a relay processed signal IS and transmits back to the matrix display apparatus 12. The relay apparatus 13 is only for illustration and it is possible to configure multiple relay apparatuses. When the operation apparatus 11 is a user, the user can transmit the transmission signal TS to the relay apparatus 13 instead of transmitting back to the matrix display apparatus 12. Herein, the relay apparatus 13 can be a portable communication device such as a cell phone. Accordingly, the user can be the transmission media for conducting the encoded signal ES outputted from the matrix display apparatus 12 to the relay apparatus 13 for the purpose of transmitting file information.
  • The relay apparatus 13 can process the transmission signal TS to generate a relay processed signal IS and then transmit the relay processed signal IS to the matrix display apparatus 12. In the procedures of coupling the encoded signal ES to the operation apparatus 11 to generate the transmission signal TS, processing the transmission signal TS by the relay apparatus 13 to generate the relay processed signal IS, and transmitting the relay processed signal IS to the matrix display apparatus 12 to obtain the information signal, the signal is processed by means, for example, amplification, decoding, modifying and/or interpretation, which can be implemented by all or either one of the operation apparatus 11, the matrix display apparatus 12 and the relay apparatus 13. Accordingly, the transmission signal TS, the relay processed signal IS or the information signal can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • Besides, the response signal RS of the first embodiment can also be applied to the operation apparatus, relay apparatus and/or matrix display apparatus of the second embodiment, thereby creating an interactive mechanism between the transmitting and receiving signals. Moreover, the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus, relay apparatus and matrix display apparatus.
  • In the visual interface system of the invention, when the operation apparatus is operated on the display surface, the encoded signal is coupled to the operation apparatus from the matrix substrate, and the operation apparatus receives the encoded signal to generate a transmission signal. In touch input application, the transmission signal can be directly or indirectly transmitted to the matrix display apparatus. During this transmission procedure, the transmission signal can be processed by operation apparatus, at least one relay apparatus, and/or the matrix display apparatus, so that the matrix display apparatus can retrieve the information contained in the encoded signal and transmission signal, such as touch input information, instruction information, identification information, transaction information, file information or other information.
  • As mentioned above, the visual interface system of the invention can be directly applied to the system containing matrix structure such as TFT LCD panel, OLED panel, LED panel, electrophoretic display panel, MEMS display panel, or the likes, thereby integrating display, touch input and data transmission functions together. Thus, the products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness. Moreover, the encoded signal is coupled to the external operation apparatus instead of being directly read by the matrix substrate, so that it is unnecessary to modify the layout on the matrix substrate. For example, regarding to the touch input application, it is unnecessary to add the capacitance sensing component in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and time.
  • Although the invention has been described with reference to specific embodiments, this description is not meant to be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternative embodiments, will be apparent to persons skilled in the art. It is, therefore, contemplated that the appended claims will cover all modifications that fall within the true scope of the invention.

Claims (18)

1. A visual interface system, comprising:
an operation apparatus; and
a matrix display apparatus, comprising:
a display surface; and
a matrix substrate including a substrate and a matrix, wherein the matrix is disposed at one side of the substrate while the display surface is located at the other side of the substrate;
wherein, when the operation apparatus is operated on the display surface, an encoded signal is coupled to the operation apparatus from the matrix substrate, and the operation apparatus receives the encoded signal so as to generate a transmission signal.
2. The visual interface system of claim 1, wherein the encoded signal is capacitive coupled to the operation apparatus from the matrix substrate.
3. The visual interface system of claim 1, wherein the transmission signal is transmitted to the matrix display apparatus.
4. The visual interface system of claim 1, wherein the transmission signal comprises touch input information, instruction information, identification information, transaction information, or file information.
5. The visual interface system of claim 3, wherein the matrix display apparatus processes the transmission signal to obtain an information signal, and the information signal comprises touch input information, instruction information, identification information, transaction information, or file information.
6. The visual interface system of claim 1, further comprising:
at least a relay apparatus for processing the transmission signal to generate a relay processed signal.
7. The visual interface system of claim 6, wherein the relay processed signal is transmitted to the matrix display apparatus.
8. The visual interface system of claim 6, wherein the transmission signal comprises touch input information, instruction information, identification information, transaction information, file information or other information.
9. The visual interface system of claim 6, wherein the relay processed signal comprises touch input information, instruction information, identification information, transaction information, or file information.
10. The visual interface system of claim 7, wherein the matrix display apparatus processes the relay processed signal to generate an information signal, and the information signal comprises touch input information, instruction information, identification information, transaction information, or file information.
11. The visual interface system of claim 1, further comprising:
a mode trigger apparatus for enabling the matrix display apparatus into an operating mode to output the encoded signal as the mode trigger apparatus is triggered by a user or the operation apparatus.
12. The visual interface system of claim 1, wherein when the operation apparatus is a user, the visual interface system further comprises a sensing apparatus, and then when the user touches the display surface and the sensing apparatus simultaneously, the transmission signal is transmitted to the sensing apparatus.
13. The visual interface system of claim 12, wherein the sensing apparatus has a mode trigger function, so the sensing apparatus enables the matrix display apparatus to an operating mode to output the encoded signal as the user activates the sensing apparatus.
14. The visual interface system of claim 1, wherein the matrix further comprises a plurality of row electrodes and a plurality of column electrodes, the row electrodes and the column electrodes are intersected, and the encoded signal is applied to the row electrodes or the column electrodes.
15. The visual interface system of claim 14, wherein the matrix further comprises a plurality of transistors and a plurality of pixel electrodes, and the transistors are electrically connected with the row electrodes, the column electrodes and the pixel electrodes.
16. The visual interface system of claim 3, wherein the transmission signal comprises touch input information, instruction information, identification information, transaction information, or file information.
17. The visual interface system of claim 6, further comprising:
a mode trigger apparatus for enabling the matrix display apparatus into an operating mode to output the encoded signal as the mode trigger apparatus is triggered by a user or the operation apparatus.
18. The visual interface system of claim 6, wherein when the operation apparatus is a user, the visual interface system further comprises a sensing apparatus, and then when the user touches the display surface and the sensing apparatus simultaneously, the transmission signal is transmitted to the sensing apparatus.
US14/344,462 2011-09-13 2011-09-13 Visual interface system Abandoned US20140340340A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/079576 WO2013037103A1 (en) 2011-09-13 2011-09-13 Visual interface system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/079576 A-371-Of-International WO2013037103A1 (en) 2011-09-13 2011-09-13 Visual interface system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/488,965 Continuation US20170220190A1 (en) 2011-09-13 2017-04-17 Visual interface system

Publications (1)

Publication Number Publication Date
US20140340340A1 true US20140340340A1 (en) 2014-11-20

Family

ID=47882523

Family Applications (4)

Application Number Title Priority Date Filing Date
US14/344,462 Abandoned US20140340340A1 (en) 2011-09-13 2011-09-13 Visual interface system
US14/344,596 Active US9335849B2 (en) 2011-09-13 2012-07-10 Visual interface system
US14/344,056 Active US9489071B2 (en) 2011-09-13 2012-09-10 Electronic apparatus and data transmission system
US15/488,965 Abandoned US20170220190A1 (en) 2011-09-13 2017-04-17 Visual interface system

Family Applications After (3)

Application Number Title Priority Date Filing Date
US14/344,596 Active US9335849B2 (en) 2011-09-13 2012-07-10 Visual interface system
US14/344,056 Active US9489071B2 (en) 2011-09-13 2012-09-10 Electronic apparatus and data transmission system
US15/488,965 Abandoned US20170220190A1 (en) 2011-09-13 2017-04-17 Visual interface system

Country Status (7)

Country Link
US (4) US20140340340A1 (en)
EP (3) EP2757444B1 (en)
JP (3) JP6142149B2 (en)
KR (3) KR101662413B1 (en)
CN (3) CN103797448B (en)
TW (2) TWI592841B (en)
WO (3) WO2013037103A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150261331A1 (en) * 2012-11-06 2015-09-17 Hewlett-Packard Development Company, L.P. Interactive Display
US20150301676A1 (en) * 2013-03-13 2015-10-22 Beijing Boe Opetoelectronics Technology Co., Ltd. Driving method and driving device of touch control display

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6023313B2 (en) 2012-05-25 2016-11-09 熊光 蔡 Non-display signal encoding method and matrix substrate
CN102916729B (en) * 2012-09-04 2014-12-10 深圳市汇顶科技股份有限公司 Near-field communication method and system of touch panel terminal as well as touch panel terminal
US9582186B2 (en) * 2013-12-20 2017-02-28 Mediatek Inc. Signature verification between a mobile device and a computing device
US9892628B2 (en) 2014-10-14 2018-02-13 Logitech Europe S.A. Method of controlling an electronic device
JP2020030884A (en) * 2016-12-26 2020-02-27 コニカミノルタ株式会社 Passive matrix type organic electroluminescent display and touch detection method
US20210014674A1 (en) * 2019-07-11 2021-01-14 Slim Hmi Technology Secure interaction system and communication display device
TWI726488B (en) 2019-11-19 2021-05-01 元太科技工業股份有限公司 Proximity smart card and a method for operating a proximity smart card
KR20220091700A (en) 2020-12-23 2022-07-01 삼성디스플레이 주식회사 Electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4841290A (en) * 1986-09-25 1989-06-20 Mitsubishi Denki Kabushiki Kaisha Display unit
US20020186341A1 (en) * 2001-06-08 2002-12-12 Kuni Yamamura IC chip and display device using the same
US20060000893A1 (en) * 2004-07-01 2006-01-05 American Express Travel Related Services Company, Inc. Method for biometric security using a smartcard-reader
US7777719B2 (en) * 2007-01-19 2010-08-17 Nokia Corporation System using a living body as a transmission medium
US20110007037A1 (en) * 2009-07-07 2011-01-13 Panasonic Corporation Electronic pen and electronic pen system

Family Cites Families (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03294919A (en) * 1990-04-12 1991-12-26 Nippon Telegr & Teleph Corp <Ntt> Display device with tablet function
US5117071A (en) * 1990-10-31 1992-05-26 International Business Machines Corporation Stylus sensing system
JPH06230884A (en) * 1993-02-03 1994-08-19 Matsushita Electric Ind Co Ltd Coordinate input device
US5491706A (en) * 1993-04-07 1996-02-13 Sharp Kabushiki Kaisha Display-integrated type tablet device capable of detecting correct coordinates at a tip end of a detection pen by detecting external noise
JP3421078B2 (en) * 1993-05-07 2003-06-30 シャープ株式会社 Information input / output device
JPH0720421A (en) * 1993-06-29 1995-01-24 Asahi Glass Co Ltd Liquid crystal display element
JP2653014B2 (en) * 1993-07-26 1997-09-10 日本電気株式会社 Active matrix liquid crystal display device
JPH08106358A (en) * 1994-08-10 1996-04-23 Fujitsu Ltd Liquid crystal display device with tablet function, active matrix type liquid crystal display device, and driving method for liquid crystal display device with tablet function
JP4939682B2 (en) * 1999-04-27 2012-05-30 エーユー オプトロニクス コーポレイション Display device
JP2001075074A (en) * 1999-08-18 2001-03-23 Internatl Business Mach Corp <Ibm> Touch sensor type liquid crystal display device
JP2001144661A (en) * 1999-11-17 2001-05-25 Sony Corp Data transmitter and data receiver
JP3319462B2 (en) * 2000-06-26 2002-09-03 松下電工株式会社 Data transmission system using human body as signal transmission path
JP2004005415A (en) * 2002-04-19 2004-01-08 Sharp Corp Input device and input/output integrated display
JP3966069B2 (en) * 2002-05-02 2007-08-29 セイコーエプソン株式会社 Data communication device and portable watch
JP3794411B2 (en) * 2003-03-14 2006-07-05 セイコーエプソン株式会社 Display device and electronic device
US7310779B2 (en) 2003-06-26 2007-12-18 International Business Machines Corporation Method for creating and selecting active regions on physical documents
JP5008823B2 (en) * 2004-03-19 2012-08-22 シャープ株式会社 Display device
CN1914664B (en) * 2004-04-01 2010-05-05 株式会社和冠 Surface and cordless transducer system
US7657242B2 (en) * 2004-09-27 2010-02-02 Qualcomm Mems Technologies, Inc. Selectable capacitance circuit
JP2006127190A (en) * 2004-10-29 2006-05-18 Citizen Watch Co Ltd Input device
US20060094411A1 (en) 2004-10-29 2006-05-04 Dupont Pierre B Mobile station telephony service applications for mobile station having integrated transponder readers
CN100374995C (en) * 2004-11-08 2008-03-12 英华达(南京)科技有限公司 Handwriting pen and handwriting pen system and control method thereof
JP2006195925A (en) * 2005-01-17 2006-07-27 Nippon Signal Co Ltd:The Touch panel device
WO2006087670A1 (en) * 2005-02-17 2006-08-24 Koninklijke Philips Electronics N.V. Device capable of being operated within a network, network system, method of operating a device within a network, program element, and computer-readable medium
JP2006238328A (en) 2005-02-28 2006-09-07 Sony Corp Conference system, conference terminal and portable terminal
CN2785540Y (en) * 2005-04-21 2006-06-07 周常安 Hand held device for physiological signal measuring and wireless transmission and receiving apparatus
CN101017419B (en) * 2005-06-30 2010-05-12 智点科技(深圳)有限公司 Touch control panel display
CN1716018A (en) * 2005-07-14 2006-01-04 深圳市联思精密机器有限公司 Plane display with touch control function
CN1904812A (en) * 2005-07-29 2007-01-31 姚华 Touch pen usable for display screen of common computer
KR100862578B1 (en) * 2006-05-16 2008-10-09 엘지전자 주식회사 Plasma Display Apparatus
WO2008025869A1 (en) 2006-08-29 2008-03-06 Nokia Corporation Use of intra-body communication
EP2127160A1 (en) * 2007-02-14 2009-12-02 Kaba AG System and portable device for transmitting identification signals
CN201707209U (en) * 2007-03-09 2011-01-12 营口方舟科技有限公司 Wrist strap display
EP2056186A1 (en) 2007-10-26 2009-05-06 Research In Motion Limited Touch screen and electronic device
JP2009146088A (en) * 2007-12-13 2009-07-02 Hitachi Displays Ltd Capacitive coupling-type signal transmission/reception circuit
JP2009253478A (en) * 2008-04-02 2009-10-29 Sony Ericsson Mobilecommunications Japan Inc Information communication device and control method of information communication device
JP5639473B2 (en) * 2008-09-12 2014-12-10 京セラディスプレイ株式会社 Capacitive touch panel and display device with capacitive touch panel function
US8482545B2 (en) * 2008-10-02 2013-07-09 Wacom Co., Ltd. Combination touch and transducer input system and method
TWM364503U (en) * 2009-03-23 2009-09-11 Astek Technology Ltd Wireless ring-type physiological detector
EP2435894A1 (en) * 2009-05-27 2012-04-04 Koninklijke Philips Electronics N.V. Touch- or proximity-sensitive interface
JP2010286895A (en) * 2009-06-09 2010-12-24 Toshiba Tec Corp Information input device and information processor
KR101562565B1 (en) * 2009-06-25 2015-10-22 삼성전자주식회사 A method for transmitting and receiving data using E-Field in a portable terminal and an apparatus thereof
TWM371930U (en) 2009-06-29 2010-01-01 Ming-Chang Wu Prompt system for object sensing
US20110001717A1 (en) 2009-07-06 2011-01-06 Charles Hayes Narrow Border for Capacitive Touch Panels
KR20110027572A (en) 2009-09-08 2011-03-16 한국전자통신연구원 Apparatus for communication using near field
US20110059692A1 (en) * 2009-09-08 2011-03-10 Electronics And Telecommunications Research Institute Communications device using near field
TWI428661B (en) 2009-11-09 2014-03-01 Silicon Integrated Sys Corp Touch display apparatus
KR101351413B1 (en) * 2009-12-11 2014-01-14 엘지디스플레이 주식회사 Touch Panel and Liquid Crystal Display Device Including Touch Panel
KR101107171B1 (en) * 2010-02-11 2012-01-25 삼성모바일디스플레이주식회사 Apparatus for touch sensing, display device and operating method for the same
JP5440376B2 (en) * 2010-05-18 2014-03-12 日本電気株式会社 Touch sensor, touch panel, and information transmission method using the touch sensor
CN201828896U (en) 2010-09-27 2011-05-11 南京点面光电有限公司 Capacitance type touch screen
CN102073409A (en) * 2010-12-29 2011-05-25 广东中显科技有限公司 Touch screen

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4841290A (en) * 1986-09-25 1989-06-20 Mitsubishi Denki Kabushiki Kaisha Display unit
US20020186341A1 (en) * 2001-06-08 2002-12-12 Kuni Yamamura IC chip and display device using the same
US20060000893A1 (en) * 2004-07-01 2006-01-05 American Express Travel Related Services Company, Inc. Method for biometric security using a smartcard-reader
US7777719B2 (en) * 2007-01-19 2010-08-17 Nokia Corporation System using a living body as a transmission medium
US20110007037A1 (en) * 2009-07-07 2011-01-13 Panasonic Corporation Electronic pen and electronic pen system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150261331A1 (en) * 2012-11-06 2015-09-17 Hewlett-Packard Development Company, L.P. Interactive Display
US10705631B2 (en) * 2012-11-06 2020-07-07 Hewlett-Packard Development Company, L.P. Interactive display
US20150301676A1 (en) * 2013-03-13 2015-10-22 Beijing Boe Opetoelectronics Technology Co., Ltd. Driving method and driving device of touch control display
US9958980B2 (en) * 2013-03-13 2018-05-01 Boe Technology Group Co., Ltd. Driving method and driving device of touch control display

Also Published As

Publication number Publication date
CN103797450B (en) 2018-03-23
TW201312366A (en) 2013-03-16
JP5951775B2 (en) 2016-07-13
US9489071B2 (en) 2016-11-08
EP2757538A4 (en) 2015-05-06
EP2757538B1 (en) 2019-09-11
CN103827934B (en) 2017-10-13
EP2757444A1 (en) 2014-07-23
CN103827934A (en) 2014-05-28
TW201312413A (en) 2013-03-16
TWI592841B (en) 2017-07-21
KR101662413B1 (en) 2016-10-04
US20140340357A1 (en) 2014-11-20
EP2757444B1 (en) 2017-04-19
KR20140074921A (en) 2014-06-18
KR101641802B1 (en) 2016-07-21
EP2757445B1 (en) 2017-10-04
JP2014531150A (en) 2014-11-20
CN103797448B (en) 2018-09-04
JP6033308B2 (en) 2016-11-30
WO2013037103A1 (en) 2013-03-21
US20140220892A1 (en) 2014-08-07
EP2757445A4 (en) 2015-07-15
WO2013037281A1 (en) 2013-03-21
EP2757444A4 (en) 2015-03-18
EP2757445A1 (en) 2014-07-23
KR20140074902A (en) 2014-06-18
WO2013037238A1 (en) 2013-03-21
US20170220190A1 (en) 2017-08-03
EP2757538A1 (en) 2014-07-23
CN103797450A (en) 2014-05-14
CN103797448A (en) 2014-05-14
KR20140075688A (en) 2014-06-19
JP6142149B2 (en) 2017-06-07
JP2014530404A (en) 2014-11-17
TWI485565B (en) 2015-05-21
JP2014529134A (en) 2014-10-30
KR101570309B1 (en) 2015-11-18
US9335849B2 (en) 2016-05-10

Similar Documents

Publication Publication Date Title
US20170220190A1 (en) Visual interface system
US10884619B2 (en) Character input method and display apparatus
US20180081463A1 (en) Touch control liquid crystal display device and electronic apparatus
US9158405B2 (en) Electronic device including touch-sensitive display and method of controlling same
KR20160046620A (en) Display driver circuit and display system
CN103135849A (en) Display apparatus switching between display mode and touch mode, and method and system thereof
KR102062724B1 (en) Mobile terminal and method for driving the same
US9141243B2 (en) Electronic device including touch-sensitive display and method of detecting touches
KR101323044B1 (en) Touch sensing apparatus and driving method thereof
US20200004375A1 (en) Visual interface system
US20180373387A1 (en) Visual interface system
EP4167582A1 (en) Electronic device and control method thereof
KR101668937B1 (en) Visual interface apparatus and data transmission system
EP2946269B1 (en) Electronic device with touch-sensitive display and gesture-detection, method for operating same, and computer-readable storage device
TWI492110B (en) Visual interface system
US11507218B2 (en) Dual interface smart device
US20150205372A1 (en) Method and apparatus for providing input interface for mobile terminal
US20230280858A1 (en) Electronic apparatus and control method thereof
EP2674838A1 (en) Electronic device including touch-sensitive display and method of controlling same
KR20240025212A (en) Electronic device for receiving touch input and method for controlling the same

Legal Events

Date Code Title Description
AS Assignment

Owner name: SLIM HMI TECHNOLOGY, TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TSAI, HSIUNG-KUANG;REEL/FRAME:041163/0341

Effective date: 20170113

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION