WO2013172768A2

WO2013172768A2 - Input system

Info

Publication number: WO2013172768A2
Application number: PCT/SE2013/050519
Authority: WO
Inventors: Malte ROTHHÄMEL
Original assignee: Scania Cv Ab
Priority date: 2012-05-14
Filing date: 2013-05-08
Publication date: 2013-11-21
Also published as: WO2013172768A3; SE537730C2; EP2850506A2; CN104508598A; SE1250488A1; RU2014150517A; BR112014028380A2; EP2850506A4

Abstract

An input system (2) for a vehicle, comprising a projector system (4) and a detector system (6), which are adapted so as to communicate with a control unit (8). The project system (4) is adapted so as to generate a virtual touchscreen (10) comprising an adjustable input menu adapted for inputting control instructions for controlling one or a plurality of systems for the vehicle, wherein the project system (4) is adapted so as to project the virtual touchscreen on a display surface in or at the vehicle. The input system (2) is adapted so as to be in at least two modes, a sleep mode and a use mode, wherein the input system (2) is adapted so as to: A - detect a first activation measure by means of said detector system (6), B - initiate the use mode, C - select and define a display surface for the virtual touchscreen (10), D - generate and project the virtual touchscreen on the selected display surface by means of said projector system (4), E - receive, by means of said detector system (6), input control instructions in the form of input activities via said projected input menu and generate an input signal (12) in dependence thereon, F - control one or a plurality of systems in dependence upon said input signal (12).

Description

Title

Input System

Technical field of the invention

The present invention concerns an input system, and a method associated with such an input system, according to the preambles to the independent claims.

The invention concerns in particular an input system and method for a vehicle, which system and method facilitate the control of systems and functions on the vehicle. Background of the invention

In a modern goods vehicle there is a plurality of systems or functions that the driver, or a passenger, desires to be able to use from the driver's seat, from the passenger seat or from other locations in and around the vehicle, such as from the bed or outside the vehicle. Examples of such systems or functions include lighting, heating systems, radio, TV and multimedia as well as, for example, the adjustment of the pneumatic suspension for the goods vehicle, for example in connection with the hitching of a trailer.

This desire is currently fulfilled by arranging buttons and controls in a number of locations in and in connection with the vehicle to enable the systems and the functions to be used even if the user is not sitting in the driver's seat. For example, the interior lighting can be controlled from a panel near the bed. Another example is a remote control for adjusting the pneumatic suspension, which control is accessible at the passenger seat so that it can be taken out when an inspection occurs. Such a remote control is often connected by means of a cable. There are numerous examples of input interfaces for use in vehicles, and a number of different systems will be discussed briefly below.

US 7,248,151 concerns a virtual keyboard for a vehicle, which keyboard is used in connection with controlling various functions for the vehicle, such as unlocking the vehicle. A keyboard is projected, for example, on a side window of the vehicle. A detector and a processor are arranged so as to detect gestures and identify the gestures that are performed on the keyboard. The detector can, for example, consist of a camera or an infrared detector.

US 7,050,606 concerns a system for detecting and identifying hand gestures that are particularly suitable for controlling various functions for a vehicle. These functions pertain to, for example, heating, air conditioning, lighting, CD/radio settings, etc.

US 2011/0286676 describes systems and related methods intended for vehicles in order to detect and identify gestures in three dimensions. According to one of the methods, the step is included of receiving one or a plurality of unprocessed frames of image data from a sensor, processing and combining a plurality of frames in order to identify body parts of the user in the vehicle and calculate the position of the end of the hand of the user, determining whether the hand has performed a dynamic or a static gesture, receiving a command that corresponds to a number of stored gestures, and performing the command.

Reference is also made here to the article "Natural and Intuitive Hand Gestures: A

Substitute for Traditional Vehicle Control" by A. Riener and M. Rossbory, which was published in AutomotiveUI '11, November 29-December 2, 2011, Salzburg, Austria, Adjunct Proceedings. The article describes a test in which a driver gives instructions by means of gestures to control a number of functions. In the test, much of the technology that is used in video games is utilized, and in particular Microsoft Kinect, which is used for the Xbox game console. In the testing, hand gestures performed when the hand is kept in proximity to the gearshift were identified. A detector in the form of a camera was mounted in the ceiling and adjusted so as to capture hand motions in the area around the gearshift.

Microsoft Kinect is thus a system that is adapted primarily for the game industry, and entails that sensors are arranged in connection with a display, wherein the sensors comprise a camera and a 3D sensor that can, with the help of special software, detect the motions of a user in three dimensions and identify, among other things, the face of the user. The Kinect system is thus used in the Xbox game console and elsewhere. The sensor for three dimensions consists of an infrared laser projector combined with a monochrome CMOS sensor, which can detect video data in three dimensions under daylight conditions. The sensing distance for the 3D sensor can be adjusted, and the software can automatically calibrate the sensor depending upon which game is being played, and upon the physical surroundings of the player, so that furniture and other obstacles can be taken into account. The system enables advanced motion recognition and can track the movements of two active players simultaneously, whereupon motion analysis can occur by evaluating motion steps from up to two joints per player.

The Kinect system sensor outputs a video signal with a frame rate of 30 Hz. The video streams with the RGB signal use an 8-bit VGA resolution (640 x 480 pixels) with a color filter, while the monochrome video streams for 3D effects have a VGA resolution (640 ^χ 480 pixels) of 11 bits, which offers sensitivity at 2,048 levels. The Kinect sensor functions at distances within the range of 1.2 to 3.5 meters when it is used in conjunction with the software for the Xbox, but can be given an expanded range of from 0.7 to 6.0 meters. The sensor has a horizontal detection angle of 57° and a vertical of 43°. The sensor can then be pivoted 27° in the horizontal direction.

To enable the driver of a vehicle to utilize the many different systems and functions that are currently found in a modern goods vehicle, numerous buttons and control are arranged in the vehicle, not only in connection with the driver's seat but, for example, by the bed and in the form of remote controls. These buttons and controls often require separate cable runs, which makes their installation complicated and entails high costs. In addition, it can sometimes be difficult for the driver of the vehicle to know where the buttons for a given function are located. The object of the present invention is to provide an improved input interface that is both more user-friendly and offers cost savings for the vehicle manufacturer.

Summary of the invention

The foregoing objects are achieved by the invention defined in the independent claims. Preferred embodiments are defined by the dependent claims.

A projector system and a detector system that is adapted so as to detect the body motions of a person are combined by means of the input system according to the invention.

In implementing the input system according to the invention, miniature projectors and camera systems are used that are also used in connection with, among other things, video games, such as Microsoft Kinect, which is used in the Xbox game console (as described above). According to the invention, a virtual touch screen is projected onto a desired surface in or outside the goods vehicle and used to input control instructions for systems and functions in the vehicle. The system is arranged, for example, in the ceiling of the goods vehicle so that the virtual screen can be projected in any conceivable position.

The touchscreen can, for example, be projected on the wall next to the bed, on the mattress, on the floor or on walls. If one is outside the vehicle, the virtual touchscreen can be projected on a plate held in the hand or, for example, on the inside of the door or on the step.

It is thus possible to replace a plurality of buttons in the goods vehicle for, for example, remote control of the pneumatic suspension, lighting buttons and the control unit for the heating system. It is also possible to define, by oneself, which systems and functions are to be controllable by means of the virtual touchscreen.

Through the application of the present invention, a system is achieved that is both more user-friendly in part because access for controlling the various vehicle systems is improved. It also offers cost savings for the vehicle manufacture because, for example, fewer cable runs are required and fewer buttons and control units are needed.

Brief description of the drawing

Figure 1 is a block diagram that schematically illustrates the present invention.

Figure 2 shows a flow diagram that illustrates the present invention. Detailed description of preferred embodiments of the invention

The present invention will now be described with reference to the accompanying drawings, and first with reference to the block diagram in Figure 1. The present invention concerns an input system 2 for a vehicle, preferably, a goods vehicle, a bus or a motor home, but also for cars. The input system comprises a projector system 4 and a detector system 6, which are adapted so as to communicate with a control unit 8.

The projector system 4 is adapted so as to generate a virtual touchscreen 10 comprising an adjustable input menu adapted so as to input control instructions to control one or a plurality of systems for the vehicle, which projector system 4 is adapted so as to project the virtual touchscreen on a display surface in or at the vehicle. The projector system 4 is preferably arranged in the ceiling of the vehicle cab.

The projector system 4 comprises at least one of an image generator, for example a cathode ray tube (CRT), a digital light processing unit, and an optical projecting unit that includes optical projection lenses for projecting a generated image. The projector system can also consist of a laser device that "draws" the virtual touchscreen.

In the embodiment shown in the figure, the projector system consists of three units that are disposed in various positions in and/or around the vehicle to enable projection in as many locations as possible. A system with only one unit is also possible, in which case the unit can, for example, be arranged for projection near the bed.

The detector system 6 is also preferably arranged in the ceiling of the vehicle cab and can suitably be arranged in connection to the projector system. In the embodiment shown in the figure, the detector system comprises three units, each of which comprises at least one of an optical data-gathering unit, such as a camera or an infrared detector. The detector system preferably also comprises a sound detector adapted so as to detect activation measures and inputting activities in the form of sound, for example from voices or tapping sounds.

In connection with the application of the invention, the input system 2 is adapted so as to be in at least two modes, a standby mode and a use mode. The input system is of course also in an entirely passive mode when the system is turned off.

The input system 2 is thus adapted so as to:

A - detect a first activation measure by means of said detector system 6 and, if such a first activation measure is detected, to

B - initiate the use mode.

In its use mode, the system has been opened for the user to choose where the virtual touchscreen is to be projected. The user accomplishes this by

C - selecting and defining a display surface for the virtual touchscreen 10.

According to one embodiment, the system waits for the user to confirm that the touchscreen is to be projected, which the user does by performing a second activation measure. The system according to this embodiment is adapted so as to

- detect a second activation measure by means of said detector system 6.

The input system is then ready to receive control instructions via the virtual touchscreen that is projected on the selected display surface. This occurs via the steps of:

D - generating and projecting the virtual touchscreen, using said projector system, on the selected display surface,

E - receiving, using said detector system 6, input control instructions in the form of input activities via said projected input menu and generating an input signal 12 in dependence thereon,

F - controlling one or a plurality of systems in dependence upon said input signal 12.

In the figure, the control of the systems and functions for the vehicle is indicated by a double arrow from the control unit 8. The control unit is preferably connected to the vehicle bus system, and the control signals that it generates are processed by the vehicle in the normal way, and consequently need not be described further here.

Examples of systems or functions that can suitably be controlled by means of the input system include the lighting, heating system, radio, TV and multimedia as well as, for example, settings of the pneumatic suspension for the goods vehicle, for example in connection with the hitching of a trailer.

The first and, in applicable cases, second activation measure comprise one or a plurality of a predetermined pattern of motion (a gesture); a finger snap or a tap. The first activation measure can, for example, consist of tapping two times to initiate the use mode and then, according to one embodiment, of causing the system to display the virtual touchscreen by identifying the selected display surface by distinctly pointing with one finger, which then constitutes the second activation measure.

In use mode, the input menu is displayed on the virtual touchscreen. For example, the start menu, i.e. the first input menu display, can be dependent upon where the virtual touchscreen is projected. If, for example, the touchscreen is to be projected near the bed, a menu for adjusting the lighting and the radio will be displayed.

The input menu preferably comprises a plurality of input menus arranged in a hierarchical system, wherein activation of a function occurs by means of a specified input activity. An input activity consists of, for example, pressing a predefined area on the input menu by keeping the hand/finger in the input area for at least a predetermined time (on the order of parts of a second up to several seconds).

In order to make it known that an input activity has been accepted by the system, the system is adapted so as to generate a predetermined acknowledgement that consists of one or a plurality changes of the color or shape of an input area (the button), and the generation of an acoustic signal.

The present invention further comprises a method in connection with an input system for a vehicle, wherein the input system comprises a projector system and a detector system, which are arranged so as to communicate with a control unit. The method will now be described briefly with reference to the flow diagram in Figure 2. Reference is also made to relevant parts of the foregoing description of the input system. A projector system is thus adapted so as to generate a virtual touchscreen comprising an adjustable input menu adapted for inputting control instructions for controlling one or a plurality of systems for the vehicle, whereupon the projector system is adapted so as to project the virtual touchscreen on a display surface in or at the vehicle.

The input system is adapted so as to be in at least two modes, a sleep mode and a use mode, wherein the method comprises the steps of:

A - detecting a first activation measure,

B - initiating the use mode,

C - selecting and defining a display surface for the virtual touchscreen,

D - generating and projecting the virtual touchscreen by means of said projector system on the selected display surface,

E - receiving, by means of said detector systems, input control instructions in the form of input activities via said projected input menu and generating an input signal in dependence thereon,

F - controlling one or a plurality of systems in dependence upon said input signal (12).

According to one embodiment, the method comprises detecting a second activation measure by means of said detector system, and performing step D, and the subsequent steps, only when said second activation measure has been detected. This elective step has been identified using broken lines in Figure 2.

The first and, where applicable, second activation measures comprise, for example, one or a plurality of predetermined patterns of movement (a gesture), a tap.

When the virtual touchscreen is activated and an input menu is displayed, various functions can be activated by generating various input activities that comprise touching a predefined input area by keeping a hand/finger in the input area for at least a

predetermined time. The input menu preferably comprises a plurality of input menus arranged in a hierarchical system, wherein the activation of a function is achieved by means of a specified input activity. An input activity is accepted by means of a predetermined acknowledgement that consists of one or a plurality of changes in the color or shape of the input area (the button), and the generation of an acoustic signal.

According to one application of the invention, the projector system and the detector system must be disposed so that the virtual touchscreen is displayed in such a way that the operator can stand outside the vehicle and adjust, for example, the pneumatic suspension for the rear axle.

In an additional variant of the data-gathering system according to the invention, it is possible to add to the functions that the system is to control, and to influence the appearance of the screen based on the functionality desired.

In connection with the projector system receiving instructions as to where the virtual touchscreen is to be projected, the projection can be adapted so that the touchscreen assumes a desired appearance. For example, consideration can be given to the

circumstance that the display surface is not perpendicular in relation to the generated image, so that the touchscreen is distorted. This can be achieved automatically by means of a correcting function.

The present invention is not limited to the preferred embodiments described above.

Various alternatives, modifications and equivalents can be used. The foregoing embodiments are consequently not to be viewed as limiting the protective scope of the invention as defined in the accompany claims.

Claims

1. An input system (2) for a vehicle, comprising a projector system (4), a detector system (6), which are adapted so as to communicate with a control unit (8), said projector system (4) being adapted so as to generate a virtual touchscreen (10) comprising an adjustable input menu adapted for inputting control instructions for controlling one or a plurality of systems for the vehicle, wherein the projector system (4) is adapted so as to project the virtual touchscreen on a display surface in or at the vehicle, c h a r a c t e r i z e d i n t h a t the input system (2) is adapted so as to be in at least two modes, a sleep mode and a use mode, wherein the input system (2) is adapted so as to: A - detect a first activation measure by means of said detector system (6),

B - initiate the use mode,

C - select and define a display surface for the virtual touchscreen (10),

D - generate and project the virtual touchscreen on the selected display surface by means of said projector system (4),

E - receive, by means of said detector system (6), input control instructions in the form of input activities via said project input menu and generate an input signal (12) in

dependence thereon,

F - control one or a plurality of systems in dependence upon said input signal (12).

2. The input system according to claim 1, wherein the input system is adapted so as to detect a second activation measure by means of said detector system (6), and to perform step D, and the subsequent steps, only when said second activation measure has been detected.

3. The input system according to claim 1 or 2, wherein said first and, in applicable cases, second activation measure comprise one or more of a predetermined pattern of movement (a gesture), and a tap.

4. The input system according to any of claims 1-3, wherein said input activities comprise touching a predefined input area by keeping a hand/finger in the input area for at least a predetermined time.

5. The input system according to any of claims 1-4, wherein said input menu comprises a plurality of input menus arranged in a hierarchical system, and wherein activation of a function is achieved by means of a specified input activity.

5 6. The input system according to any of claims 1-5, wherein an input activity is accepted by means of a predetermined acknowledgement that consists of one or a plurality of changes in the color or shape of the input area (the button), and the generation of an acoustic signal.

10 7. The input system according to any of the preceding claims, wherein said detector system (6) comprises at least one optical data-gathering unit, for example a camera or infrared detector.

8. The input system according to any of the preceding claims, wherein said 15 projector system (4) comprises at least one of an image generator, for example a cathode ray tube (CRT), a digital light-processing unit, and an optical projection unit that includes optical projection lenses for projecting the generated image.

9. The input system according to any of the preceding claims, wherein said 20 projector system (4) is arranged in the ceiling of the vehicle cab.

10. The input system according to any of the preceding claims, wherein said detector system (4) is arranged in the ceiling of the vehicle cab.

25 11. A method in connection with an input system for a vehicle, wherein the input system comprises a projector system and a detector system, which are arranged so as to communicate with a control unit, said projector system being arranged so as to generate a virtual touchscreen comprising an adjustable input menu adapted for inputting control instructions for controlling one or a plurality of systems for the vehicle, wherein the

30 projector system is adapted so as to project the virtual touchscreen on a display surface in or at the vehicle,

c h a r a c t e r i z e d i n t h a t the input system is adapted so as to be in at least two modes, a sleep mode and a use mode, wherein the method comprises the steps of:

A - detecting a first activation measure,

B - initiating the use mode,

C - selecting and defining a display surface for the virtual touchscreen,

D - generating and projecting the virtual touchscreen on the selected display surface by means of said projector system,

E - receiving, by means of said detector system, input control instructions in the form of input activities via said projected input menu and generating an input signal in dependence thereon,

12. The method according to claim 11, wherein the method comprises detecting a second activation measure by means of said detector system, and performing step D, and the subsequent steps, only when said second activation measure has been detected.

13. The method according to claim 11 or 12, wherein said first and, in applicable cases, second activation measure comprise one or a plurality of a predetermined pattern of movements (a gesture), a tap.

14. The method according to any of claims 11-13, wherein said input activities comprise pressing on a predefined input area by keeping a hand/finger in the input area for at least a predetermined time.

15. The method according to any of claims 11-14, wherein said input menu comprises a plurality of input menus arranged in a hierarchical system, and wherein activation of a function is achieved by means of a specified input activity.

16. The method according to any of claims 11-15, wherein an input activity is accepted by means of a predetermined acknowledgement that consists of one or a plurality of changes in the color or shape of the input area (the button), and the generation of an acoustic signal.