WO2016002145A1 - Vehicular display control apparatus, and vehicular display system - Google Patents

Vehicular display control apparatus, and vehicular display system Download PDF

Info

Publication number
WO2016002145A1
WO2016002145A1 PCT/JP2015/003010 JP2015003010W WO2016002145A1 WO 2016002145 A1 WO2016002145 A1 WO 2016002145A1 JP 2015003010 W JP2015003010 W JP 2015003010W WO 2016002145 A1 WO2016002145 A1 WO 2016002145A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
vehicle
user
information providing
captured image
Prior art date
Application number
PCT/JP2015/003010
Other languages
French (fr)
Japanese (ja)
Inventor
鈴木 孝光
加藤 香平
健史 山元
裕子 中村
Original Assignee
株式会社デンソー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社デンソー filed Critical 株式会社デンソー
Publication of WO2016002145A1 publication Critical patent/WO2016002145A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements

Definitions

  • the present disclosure relates to a vehicle display control device (Vehicular display control apparatus) and a vehicle display system.
  • Patent Document 1 it is conventionally known to provide a display device such as a liquid crystal display of a navigation device and an operation device such as an on-vehicle device operation device for operating an air conditioner unit on an instrument panel of a vehicle. . Further, it is known that a color or a pattern that can be distinguished from an instrument panel is used for an operation device provided on an instrument panel of a vehicle so that a user can easily grasp the position.
  • the color and pattern that can be used to distinguish the operation device provided on the instrument panel from the instrument panel is that it makes it easier to grasp the position of the operation device when the user needs to operate the operation device. Useful. However, when the user does not need to operate the controller, the colors and patterns that can be distinguished from the instrument panel give the user a cluttered impression and impair the design of the vehicle interior. There were cases where profits exceeded.
  • a display device such as a liquid crystal display of a navigation device
  • the black display surface does not match the instrument panel and the vehicle In some cases, the interior design was impaired.
  • An object of the present disclosure is to provide a vehicle display control device and a vehicle display system that can make it difficult to impair the design of a vehicle interior.
  • the display control device for a vehicle is mounted on a vehicle in which an operation device for a user to perform an operation is provided in the vehicle interior, and is provided on a surface facing the vehicle interior side of the operation device.
  • a display adjustment unit that adjusts the display on the film-like display whose display surface faces the vehicle interior side, and an imaging device that captures the surrounding interior where the operation unit is provided in the interior of the vehicle
  • a captured image acquisition unit that sequentially acquires the captured images and a determination unit that determines whether or not the user needs to operate the operating device, and the display adjustment unit is that the user does not need to operate the operating device.
  • the determination unit When determined by the determination unit, based on the captured image acquired by the captured image acquisition unit, while causing the film display to perform an assimilation display that looks assimilated to the surrounding interior provided with the operation device, It is determined that the user needs to operate the controller. If it is determined in parts it is to perform assimilation displayed in the form of a film display.
  • the vehicle display system is mounted on a vehicle in which an operation device for a user to perform an operation is provided in a vehicle interior, and is provided on a surface facing the vehicle interior side of the operation device.
  • a display device with a display surface facing the vehicle interior side, a display adjustment unit for adjusting the display on the film display device, and an operating device in the interior of the vehicle.
  • a vehicle display control device comprising: a captured image acquisition unit that sequentially acquires captured images in an imaging device that images the interior; and a determination unit that determines whether or not the user needs to operate the operating device.
  • the adjustment unit is based on the captured image acquired by the captured image acquisition unit, and is similar to the surrounding interior where the operation unit is provided.
  • Assimilation display that appears as a film-like display One cause it, when it is determined the operation of the operation unit in a determination unit user needs is characterized in that not performed whether display in the form of a film display.
  • the film-like display is made to perform assimilation display that looks assimilated to the interior based on the captured image of the surrounding interior where the operation device is provided, the operation device is provided. It is possible to make the film display display an assimilation display that looks similar to the actual appearance of the surrounding interior.
  • the film-like display is provided on the surface of the operation unit facing the vehicle interior side, the display surface faces the vehicle interior side, the operation device viewed from the passenger is hidden by this assimilation display. become.
  • the assimilation display is a display that looks similar to the actual appearance of the surrounding interior where the controller is provided, so the part that the controller appears to be hidden by the assimilation display is It seems that the surrounding interior where the vessel is provided continues.
  • the assimilation display is not performed when the determination unit determines that the operation of the operation device is required by the user, while it is performed when the determination unit determines that the operation of the operation device is not required by the user. Therefore, it is possible to prevent a situation that the user feels that the operating device is lifted from the surrounding interior, which is likely to occur when it is not necessary to operate the operating device. As a result, it becomes possible to make it difficult to impair the design of the vehicle interior.
  • the vehicle display control device is mounted on a vehicle in which an information providing display that is a display for providing information to a user is provided in a vehicle interior.
  • a display adjustment unit that adjusts display on the provided display, and a captured image acquisition unit that sequentially acquires captured images in an imaging device that captures the surrounding interior in which the information providing display is provided in the interior of the vehicle;
  • a determination unit that determines whether or not the user needs an information providing display for providing information to the user on the information providing display, and the display adjusting unit displays the information providing display on the information providing display If the determination unit determines that the user does not need the information, the assimilation display that appears assimilated to the surrounding interior where the information providing display is provided is based on the captured image acquired by the captured image acquisition unit. Let the provided display perform It is characterized in.
  • the information providing display is provided because the information providing display performs an assimilation display that looks assimilated to the interior based on the captured image of the surrounding interior where the information providing display is provided. It is possible to make the information providing display display an assimilation display that looks similar to the actual appearance of the surrounding interior. Since this information providing display is a display for providing information to the user, the information providing display viewed from the occupant is hidden by this assimilation display. Since the assimilation display is a display that looks similar to the actual appearance of the surrounding interior where the information providing display is provided, the information providing display appears to be hidden by the occupant from the assimilation display The part appears to be followed by a surrounding interior where an informational indicator is provided.
  • the assimilation display is performed when the determination unit determines that the information providing display on the information providing display is not required by the user. Therefore, it is possible to prevent a situation that is felt by the user when the information providing display is floating from the surrounding interior, which is likely to occur when the user does not need the information providing display. As a result, it becomes possible to make it difficult to impair the design of the vehicle interior.
  • the block diagram which shows an example of schematic structure of the display system for vehicles
  • the figure which shows the operation area with respect to the imaging area of an instrument panel imaging camera, and an instrument panel, a film-like display, and a guidance display arrangement
  • Block diagram showing an example of a schematic configuration of the HCU
  • the flowchart which shows an example of the flow of the display control related process in HCU
  • the figure for demonstrating an example of an assimilation display The figure for demonstrating an example at the time of canceling an assimilation display
  • the figure for demonstrating an example at the time of canceling an assimilation display The figure which shows an example in case the background displayed on a guidance display is set assimilation display
  • FIG. 1 is a diagram illustrating an example of a schematic configuration of a vehicle display system 100 to which the present disclosure is applied.
  • the vehicle display system 100 is mounted on a vehicle.
  • an HCU Human Machine Interface Control Unit
  • an operation unit 2 a film display 3
  • a guidance display 4 an instrument panel imaging camera 5
  • An occupant monitor camera 6 and a vehicle sensor group 7 are included.
  • a vehicle equipped with the vehicle display system 100 is hereinafter referred to as a host vehicle or a subject vehicle.
  • the operation device 2 is a switch provided on the instrument panel of the host vehicle, and is used by the user for operation.
  • Examples of the operation device 2 include a switch for an air conditioner, a switch for car audio, and a switch for an in-vehicle navigation device.
  • the film display 3 is a film display having a thickness of about 1 mm, for example.
  • the film-like display 3 is provided on the surface of the operation device 2 facing the vehicle interior side so that the display surface faces the vehicle interior side.
  • the film display 3 corresponds to a film display.
  • the film-like display 3 is provided on the entire surface of the operation unit 2 facing the vehicle interior side so as to cover the entire surface of the operation device 2 facing the vehicle interior side.
  • the film-like display 3 is a flexible display such as an organic EL display or a liquid crystal display on a plastic substrate so that it can cope with a case where the surface of the operation unit 2 facing the vehicle interior is a curved surface. Preferably there is.
  • the guidance display 4 is a display for providing information to the user.
  • the guidance display 4 corresponds to an information providing display. Examples of the guidance display 4 include a display of an in-vehicle navigation device and a display audio (DA) display.
  • the guidance display 4 is a 2DIN type provided in the 2DIN space of the instrument panel.
  • the guidance display 4 may be of a touch panel type or may be operated by a mechanical switch. However, when the operation is performed by a mechanical switch, the mechanical switch is It is assumed to be included in the operation device 2.
  • the instrument panel imaging camera 5 is a camera that images an area around the operation panel 2 and the guidance display 4 of the instrument panel of the host vehicle.
  • FIG. 2 a case where the left and right areas ArL and ArR sandwiching the operating device 2 and the guidance display 4 in the instrument panels 8a and 8b of the host vehicle are taken as an example and the following is taken as an example.
  • the instrument panels 8a and 8b correspond to interiors (also referred to as interior parts and interior surfaces), and the instrument panel imaging camera 5 corresponds to an imaging device.
  • the area on the left side of the operating device 2 and the guidance display 4 when viewed from the driver of the host vehicle is ArL, and the area on the right side is ArR.
  • the instrument panel 8a and the instrument panel 8b are different in color and pattern. In the example of the present embodiment, the instrument panel 8a has a brown wood pattern, whereas the instrument panel 8b has a black solid color.
  • the occupant monitor camera 6 is a camera that images passengers in the driver's seat and passenger seat.
  • the occupant monitor camera 6 includes a hand extended to the vicinity of the operation unit 2 and the guidance display 4 by the occupant in the driver's seat and the passenger's seat and the face of the occupant in the driver's seat and the passenger's seat. It is assumed that it is provided so as to image.
  • the vehicle sensor group 7 is a group of various sensors mounted on the host vehicle other than the instrument panel imaging camera 5 and the occupant monitor camera 6. It is assumed that the vehicle sensor group 7 includes, for example, a temperature sensor that detects the passenger compartment temperature of the host vehicle.
  • the HCU 1 is mainly configured as a microcomputer, and each includes a known CPU, a memory such as a ROM and a RAM, an I / O, and a bus connecting them.
  • the HCU 1 performs various processes such as display control related processing for controlling or adjusting the display on the film display 3 and the guidance display 4 based on various information input from the instrument panel imaging camera 5, the occupant monitor camera 6, and the vehicle sensor group 7. Execute the process.
  • the HCU 1 corresponds to a vehicle display control device.
  • HCU 1 may be configured in hardware by one or a plurality of ICs.
  • the HCU 1 (also referred to as a control circuit) includes a first captured image acquisition unit 11, a second captured image acquisition unit 12, a determination unit 13 (also referred to as a necessity determination unit), and a display.
  • An adjustment unit 14 (also referred to as a display control unit) is provided.
  • the first captured image acquisition unit 11 sequentially acquires the images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5.
  • the first captured image acquisition unit 11 corresponds to a captured image acquisition unit.
  • the second captured image acquisition unit 12 sequentially acquires occupant images captured by the occupant monitor camera 6.
  • the determination unit 13 and the display adjustment unit 14 will be described in detail in the following description of the display control related process.
  • each section is expressed as, for example, S1.
  • each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section.
  • each section can be referred to as a device, a module.
  • each of the above sections or a combination thereof includes not only (i) a section of software combined with a hardware unit (eg, a computer), but also (ii) hardware (eg, an integrated circuit, As a section of (wiring logic circuit), it can be realized with or without the function of related devices.
  • the hardware section can be included inside the microcomputer.
  • the first captured image acquisition unit 11 acquires images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5.
  • the display adjustment unit 14 causes the film display 3 and the guidance display 4 to perform an assimilation display that appears assimilated to the surrounding instrument panels 8a and 8b based on the image acquired in S1. More specifically, the display adjustment unit 14 changes the area between the captured image of the area ArL and the captured image of the area ArR acquired in S1 in the area where the operation device 2 and the guidance display 4 are provided. Also, when it is assumed that the instrument panels 8a and 8b continue, changes in the appearance of the instrument panels 8a and 8b are estimated. Then, the film-like display 3 and the guidance display 4 are caused to perform assimilation display along the estimated change in appearance.
  • the positional relationship between the operation device 2 and the guidance display 4 and the areas ArL and ArR, and the screen size of the film display 3 and the guidance display 4 provided in the operation device 2 are stored in advance in the nonvolatile memory of the HCU 1. It shall be.
  • the display adjustment unit 14 determines the width of the operation device 2 located in the left-right direction of the operation device 2 from the captured image of the region ArL.
  • the captured image of the minute region is extracted.
  • an area corresponding to the width of the operation device 2 located in the left-right direction of the operation device 2 is obtained from the captured image of the region ArR. It is good also as a structure which extracts a captured image.
  • an operation positioned in the left-right direction of the operation device 2 from the captured images of the regions ArL and ArR is good also as a structure which extracts the captured image of the area
  • the display adjustment unit 14 moves the extracted captured image left and right so as to fit the screen size. Expanding. If the extracted captured image is smaller than the screen size, the captured image may be cut out to fit the screen size.
  • the captured image processed to fit the screen size is hereinafter referred to as a processed image.
  • the display adjustment unit 14 estimates a change in luminance in the region sandwiched between the region ArL and the region ArR from the luminance of the captured image of the region ArL and the captured image of the region ArR. For example, the luminance change may be estimated to change linearly. Subsequently, the display adjustment unit 14 obtains the luminance in the region where the operation device 2 is located based on the estimated change in luminance and the positional relationship between the operation device 2 and the regions ArL and ArR. And the image (henceforth an assimilation display image) which performed image processing so that the brightness
  • luminance is displayed on the film-form display 3.
  • an image processing for adding gradation along the change in luminance is performed to obtain an assimilated display image. That's fine.
  • the significant difference mentioned here may be a difference that can be distinguished visually by the user.
  • the guidance display 4 may be configured to obtain an assimilated display image by performing the same processing as described for the operation device 2.
  • the assimilation display is performed according to the change in luminance in the region sandwiched between the region ArL and the region ArR estimated based on the luminance of the captured image of the region ArL and the captured image of the region ArR, Even when the appearance of the instrument panels 8a and 8b varies depending on the place due to sunlight, etc., the instrument panels 8a and 8b around the operation device 2 and the guide display 4 may be less likely to be shifted from the assimilation display. it can.
  • assimilation display when the instrument panel 8 a around the guidance display 4 has a brown wood pattern, the brown display is also displayed on the guidance display 4. Further, when the instrument panel 8b around the operation device 2 is a black solid color, the black solid color is also displayed on the film display 3 provided in the operation device 2.
  • the determination unit 13 displays whether or not the user needs to operate the operation device 2, and displays on the guidance display 4 for providing information to the user (hereinafter, information providing display). Determine if the user needs it.
  • the second captured image acquisition unit 12 can detect that the user's line of sight is facing the guidance display 4 based on the captured image acquired from the occupant monitor camera 6, information is provided on the guidance display 4. While it is determined that the user needs display, if it is not possible to detect that the user's line of sight is facing the guidance display 4, the information determination display on the guidance display 4 is determined not to be required by the user. do it.
  • the fact that the user's line of sight faces the guidance display 4 may be detected when the user's line of sight continues to face the guidance display 4 for a predetermined time such as 1 second or longer.
  • the user needs to provide information on the guidance display 4 when it is detected that the user has reached out to the vicinity of the guidance display 4. It may be configured to determine that
  • the determination unit 13 may determine which operating device 2 is required.
  • the user can display information on the guidance display 4 as to whether or not the user needs to operate the operating device 2. It is good also as a structure which determines whether it is required. As an example, when the temperature of the passenger compartment detected by the temperature sensor is in a temperature range that is estimated to require activation of the air conditioner or change in temperature setting, a switch for the air conditioner of the operating device 2 The operation may be determined to be necessary by the user.
  • the first captured image acquisition unit 11 acquires images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5.
  • the display adjustment unit 14 stops the assimilation display for the film display 3 and the guidance display 4 provided in the operation device 2 determined to be necessary by the determination unit 13.
  • the film display 3 provided in the operation device 2 may be configured to display nothing, but may be configured to display an icon or mark indicating the type of the operation device 2.
  • the guidance display 4 may be configured to display an operation screen of the guidance display 4 or a screen according to the operation of the guidance display 4.
  • the assimilation display is stopped when the determination unit 13 determines that only the operation of the operation device 2 out of the guidance display 4 and the operation device 2 is necessary, the associative display is continued on the guidance display 4 as shown in FIG. The assimilation display is stopped for the film-like display 3 provided in the operation device 2.
  • the determination unit 13 determines that only the operation of a part of the operation devices 2 of the guidance display 4 and the plurality of operation devices 2 is necessary, as shown in FIG. Assimilation display is continued for the film-like display 3 provided in the operation device 2 determined not to be necessary, while the assimilation display is stopped for the film-like display 3 provided to the operation device 2 determined to be necessary.
  • the first captured image acquisition unit 11 acquires images of the aforementioned areas ArL and ArR captured by the instrument panel imaging camera 5.
  • the display adjustment unit 14 causes the film display 3 and the guide display 4 to perform assimilation display, and continues the assimilation display.
  • the first captured image acquisition unit 11 acquires images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5.
  • the display adjustment unit 14 causes the film-like display 3 and the guidance display 4 to once perform assimilation display, and then the display control-related processing ends.
  • the film display 3 and the guidance display 4 provided in the operation device 2 are all assimilated and displayed simultaneously. Can improve the appearance. After performing the assimilation display all at once, the display itself on the film display 3 and the guidance display 4 may be terminated.
  • the assimilation display is continued until the getting-off is detected by a signal from a seating sensor or the like in the vehicle sensor group 7, and after the getting-off is detected, the display adjusting unit 14 displays on the film display 3 and the guidance display 4 itself. It is good also as a structure which complete
  • a film-like image obtained by processing the image color and pattern extracted from the captured images of the surrounding instrument panels 8a and 8b provided with the operation device 2 and the guidance display 4 as it is is used as a film. Since the display 3 and the guidance display 4 are made to perform, an assimilation display that looks similar to the actual appearance of the surrounding instrument panels 8a and 8b on which the operation device 2 and the guidance display 4 are provided is a film display. 3 and the guidance display 4 can be performed.
  • this film-like display 3 is provided on the surface of the operation device 2 facing the vehicle interior side with the display surface facing the vehicle interior side, the operation device 2 viewed from the occupant is hidden by this assimilation display. become.
  • the guidance display 4 is a display device for providing information to the user, the guidance display 4 viewed from the passenger is hidden by this assimilation display.
  • the assimilation display is a display that looks similar to the actual view of the surrounding instrument panels 8a and 8b provided with the controller 2 and the guidance display 4, and is therefore hidden from the passenger by the assimilation display. The part that is seen appears to be followed by the surrounding instrument panels 8a, 8b.
  • the film-like display 3 or the guidance display 4 performs assimilation display.
  • the operating device 2 and the guidance display 4 from being lifted from the surrounding instrument panels 8a and 8b. Details are as follows.
  • the operation device 2 When the user needs to operate the operation device 2, even if the operation device 2 has a color or pattern that can be distinguished from the instrument panel 8b, there is an advantage that the position of the operation device 2 can be easily grasped. It is thought that it is hard to feel that the vessel 2 is floating from the surrounding instrument panel 8b. On the other hand, when the user does not need to operate the operation device 2, if the operation device 2 has a color or a pattern that can be distinguished from the instrument panel 8b, the difference in appearance between the operation device 2 and the instrument panel 8b is It is considered that the user is likely to feel when the controller 2 is lifted from the surrounding instrument panel 8b.
  • the user's consciousness is suitable for the information providing display, so that the screen of the guidance display 4 is lifted from the surrounding instrument panel 8a. It is considered difficult.
  • the user does not need the information providing display on the guidance display 4, if the screen of the guidance display 4 has a color or pattern that can be distinguished from the instrument panel 8a, the screen of the guidance display 4 and the instrument panel 8a. It is considered that the user's consciousness is easily directed to the difference in appearance, and the user can easily feel when the guidance display 4 is lifted from the surrounding instrument panel 8a.
  • the film display 3 and the guidance display 4 provided in the operation device 2 are assimilated. By performing the display, it is possible to prevent the operating device 2 and the guidance display 4 from being lifted from the surrounding instrument panels 8a and 8b.
  • FIG. 8 shows an example in which a route guidance map is displayed on the guidance display 4.
  • the route guidance map is displayed on the guidance display 4, as shown in FIG. 8, the background of the road and the facility is assimilated to the instrument panel 8a on which the guidance display 4 is provided. What is necessary is just to make it the structure which performs a display.
  • (Modification 2) In the above-described embodiment, the configuration in which the instrument panel imaging camera 5 captures the left and right regions sandwiching the operation device 2 and the guidance display 4 is shown, but the configuration is not necessarily limited thereto. For example, it is good also as a structure which images the upper and lower area
  • a captured image of a region corresponding to the width of the operation device 2 or the guide display 4 is extracted from the captured image of the one region, and the extracted captured image is displayed on the film display 3.
  • a processed image that has been enlarged or cut out to fit the screen size of the guidance display 4 may be used as the aforementioned assimilation display image.
  • Modification 4 In the above-described embodiment, when it is detected that the user is reaching near the operating device 2 or the guidance display 4 based on the captured image acquired from the occupant monitor camera 6, the operation of the operating device 2 is performed.
  • the present invention is not necessarily limited thereto.
  • the present invention is not limited to this.
  • it is good also as a structure which detects using the object detection sensors, such as an infrared sensor provided in the vicinity of the operation device 2 or the guidance display 4, that the user has reached the vicinity of the operation device 2 or the guidance display 4. .
  • the operation device 2 that makes the instrument panel appear assimilated by the assimilation display of the film-like display 3 is not limited to a switch provided on the instrument panel.
  • other operating devices such as a steering wheel, a steering column, and a shift lever provided on the instrument panel may be used.
  • the determination unit 13 determines that the operation of these operation equipment is not necessary during automatic driving, and the display adjustment unit 14 What is necessary is just to set it as the structure etc. which perform the assimilation display on the film-like display 3.
  • the operating device 2 is not restricted to what is provided in an instrument panel.
  • any operation device material provided in the vehicle compartment such as an inner door switch and a power window switch can be used.
  • the operation device 2 provided other than the instrument panel may be configured so as to be assimilated with the interior in which the operation device 2 is provided by the assimilation display of the film display 3.
  • the guidance display 4 may be configured to use a display (for example, a liquid crystal meter) that displays a meter or the like in addition to the in-vehicle navigation device or the DA display.
  • a display for example, a liquid crystal meter

Abstract

This vehicular display control apparatus (1) is provided with: a display adjustment unit (14) for adjusting the display on a film-like display (3) which is provided to the entirety of an operation unit (2) surface facing the vehicle-interior side, and which has a display surface facing the vehicle-interior side; a first captured-image acquisition unit (11) which sequentially acquires captured images from an instrument panel image-capturing camera (5) for capturing images of left and right areas (ArL, ArR) of instrument panels (8a, 8b), said areas having the operation unit therebetween; and a determination unit (13) for determining whether a user needs to operate the operation unit. In cases when the determination unit determines that the user does not need to operate the operation unit, the display adjustment unit implements, on the film-like display, on the basis of the captured images acquired by the first captured-image acquisition unit, assimilated display which appears to assimilate to the surrounding instrument panel (8b) having the operation unit provided therein.

Description

車両用表示制御装置及び車両用表示システムVehicle display control device and vehicle display system 関連出願の相互参照Cross-reference of related applications
 本出願は、2014年7月1日に出願された日本出願番号2014-135941号に基づくもので、ここにその記載内容を援用する。 This application is based on Japanese Application No. 2014-135941 filed on July 1, 2014, the contents of which are incorporated herein by reference.
 本開示は、車両用表示制御装置(Vehicular display control apparatus)及び車両用表示システムに関するものである。 The present disclosure relates to a vehicle display control device (Vehicular display control apparatus) and a vehicle display system.
 特許文献1に開示されているように、車両のインストルメントパネルにナビゲーション装置の液晶ディスプレイといった表示器やエアコンユニットを操作するための車載機器用操作器といった操作器を設けることが従来知られている。また、車両のインストルメントパネルに設けられる操作器には、ユーザが位置を把握しやすいように、インストルメントパネルと区別できる色や模様などが用いられていることが知られている。 As disclosed in Patent Document 1, it is conventionally known to provide a display device such as a liquid crystal display of a navigation device and an operation device such as an on-vehicle device operation device for operating an air conditioner unit on an instrument panel of a vehicle. . Further, it is known that a color or a pattern that can be distinguished from an instrument panel is used for an operation device provided on an instrument panel of a vehicle so that a user can easily grasp the position.
JP 2010-30450 AJP 2010-30450 A
 インストルメントパネルに設けられる操作器をインストルメントパネルと区別できる色や模様などにすることは、ユーザが操作器を操作する必要がある場合には、操作器の位置を把握しやすくするという点で役立つ。しかしながら、ユーザが操作器を操作する必要のない場合には、インストルメントパネルと区別できる色や模様などになっていることで雑然とした印象をユーザに与え、車室内のデザイン性を損なうという不利益が上回ってしまう場合があった。 The color and pattern that can be used to distinguish the operation device provided on the instrument panel from the instrument panel is that it makes it easier to grasp the position of the operation device when the user needs to operate the operation device. Useful. However, when the user does not need to operate the controller, the colors and patterns that can be distinguished from the instrument panel give the user a cluttered impression and impair the design of the vehicle interior. There were cases where profits exceeded.
 また、ナビゲーション装置の液晶ディスプレイといった表示器についても、ユーザが案内情報の表示を必要とせずに表示をオフにしている場合には、黒くなった表示面がインストルメントパネルと調和せずに、車室内のデザイン性を損なってしまう場合があった。 In addition, for a display device such as a liquid crystal display of a navigation device, if the user turns off the display without needing to display guidance information, the black display surface does not match the instrument panel and the vehicle In some cases, the interior design was impaired.
 本開示の目的は、車室内のデザイン性を損ないにくくすることを可能にする車両用表示制御装置及び車両用表示システムを提供することにある。 An object of the present disclosure is to provide a vehicle display control device and a vehicle display system that can make it difficult to impair the design of a vehicle interior.
 本開示の例によれば、車両用表示制御装置は、ユーザが操作を行うための操作器が車室内に設けられている車両に搭載され、操作器の車室内側に向いた面に設けられた、表示面がその車室内側を向いているフィルム状表示器での表示を調整する表示調整部と、車両の内装のうちの操作器が設けられている周囲の内装を撮像する撮像装置での撮像画像を逐次取得する撮像画像取得部と、操作器の操作をユーザが必要としているか否かを判定する判定部とを備え、表示調整部は、操作器の操作をユーザが必要としていないと判定部で判定した場合には、撮像画像取得部で取得した撮像画像をもとに、操作器が設けられている周囲の内装に同化して見える同化表示をフィルム状表示器に行わせる一方、操作器の操作をユーザが必要としていると判定部で判定した場合には同化表示をフィルム状表示器に行わせる。 According to the example of the present disclosure, the display control device for a vehicle is mounted on a vehicle in which an operation device for a user to perform an operation is provided in the vehicle interior, and is provided on a surface facing the vehicle interior side of the operation device. In addition, a display adjustment unit that adjusts the display on the film-like display whose display surface faces the vehicle interior side, and an imaging device that captures the surrounding interior where the operation unit is provided in the interior of the vehicle A captured image acquisition unit that sequentially acquires the captured images and a determination unit that determines whether or not the user needs to operate the operating device, and the display adjustment unit is that the user does not need to operate the operating device. When determined by the determination unit, based on the captured image acquired by the captured image acquisition unit, while causing the film display to perform an assimilation display that looks assimilated to the surrounding interior provided with the operation device, It is determined that the user needs to operate the controller. If it is determined in parts it is to perform assimilation displayed in the form of a film display.
 また、本開示の例によれば、車両用表示システムは、ユーザが操作を行うための操作器が車室内に設けられている車両に搭載され、操作器の車室内側に向いた面に設けられた、表示面がその車室内側を向いているフィルム状表示器と、フィルム状表示器での表示を調整する表示調整部と、車両の内装のうちの操作器が設けられている周囲の内装を撮像する撮像装置での撮像画像を逐次取得する撮像画像取得部と、操作器の操作をユーザが必要としているか否かを判定する判定部とを備える車両用表示制御装置とを含み、表示調整部は、操作器の操作をユーザが必要としていないと判定部で判定した場合には、撮像画像取得部で取得した撮像画像をもとに、操作器が設けられている周囲の内装に同化して見える同化表示をフィルム状表示器に行わせる一方、操作器の操作をユーザが必要としていると判定部で判定した場合には同化表示をフィルム状表示器に行わせないことを特徴としている。 In addition, according to the example of the present disclosure, the vehicle display system is mounted on a vehicle in which an operation device for a user to perform an operation is provided in a vehicle interior, and is provided on a surface facing the vehicle interior side of the operation device. A display device with a display surface facing the vehicle interior side, a display adjustment unit for adjusting the display on the film display device, and an operating device in the interior of the vehicle. A vehicle display control device comprising: a captured image acquisition unit that sequentially acquires captured images in an imaging device that images the interior; and a determination unit that determines whether or not the user needs to operate the operating device. When the determination unit determines that the user does not need to operate the operation unit, the adjustment unit is based on the captured image acquired by the captured image acquisition unit, and is similar to the surrounding interior where the operation unit is provided. Assimilation display that appears as a film-like display One cause it, when it is determined the operation of the operation unit in a determination unit user needs is characterized in that not performed whether display in the form of a film display.
 これらの構成によれば、操作器が設けられている周囲の内装の撮像画像をもとに、その内装に同化して見える同化表示をフィルム状表示器に行わせるので、操作器が設けられている周囲の内装の実際の見え方と同じような見え方のする同化表示をフィルム状表示器に行わせることが可能になる。また、このフィルム状表示器は、操作器の車室内側に向いた面に、表示面がその車室内側を向いて設けられるので、乗員から見た操作器は、この同化表示によって隠されることになる。同化表示は、操作器が設けられている周囲の内装の実際の見え方と同じような見え方のする表示であるので、乗員からは、操作器が同化表示によって隠されて見える部分は、操作器が設けられている周囲の内装が続いているように見える。 According to these configurations, since the film-like display is made to perform assimilation display that looks assimilated to the interior based on the captured image of the surrounding interior where the operation device is provided, the operation device is provided. It is possible to make the film display display an assimilation display that looks similar to the actual appearance of the surrounding interior. In addition, since the film-like display is provided on the surface of the operation unit facing the vehicle interior side, the display surface faces the vehicle interior side, the operation device viewed from the passenger is hidden by this assimilation display. become. The assimilation display is a display that looks similar to the actual appearance of the surrounding interior where the controller is provided, so the part that the controller appears to be hidden by the assimilation display is It seems that the surrounding interior where the vessel is provided continues.
 また、同化表示は、操作器の操作をユーザが必要としていると判定部で判定した場合には行わない一方、操作器の操作をユーザが必要としていないと判定部で判定した場合に行う。よって、操作器を操作する必要がない場合により生じやすいと考えられる、操作器が周囲の内装から浮き立っているとユーザに感じられる状況を防ぐことが可能になる。その結果、車室内のデザイン性を損ないにくくすることが可能になる。 Further, the assimilation display is not performed when the determination unit determines that the operation of the operation device is required by the user, while it is performed when the determination unit determines that the operation of the operation device is not required by the user. Therefore, it is possible to prevent a situation that the user feels that the operating device is lifted from the surrounding interior, which is likely to occur when it is not necessary to operate the operating device. As a result, it becomes possible to make it difficult to impair the design of the vehicle interior.
 また、本開示のもう一つの例によれば、車両用表示制御装置は、ユーザに情報を提供するための表示器である情報提供表示器が車室内に設けられている車両に搭載され、情報提供表示器での表示を調整する表示調整部と、車両の内装のうちの情報提供表示器が設けられている周囲の内装を撮像する撮像装置での撮像画像を逐次取得する撮像画像取得部と、情報提供表示器でのユーザに情報を提供するための情報提供表示をユーザが必要としているか否かを判定する判定部とを備え、表示調整部は、情報提供表示器での情報提供表示をユーザが必要としていないと判定部で判定した場合には、撮像画像取得部で取得した撮像画像をもとに、情報提供表示器が設けられている周囲の内装に同化して見える同化表示を情報提供表示器に行わせることを特徴としている。 Further, according to another example of the present disclosure, the vehicle display control device is mounted on a vehicle in which an information providing display that is a display for providing information to a user is provided in a vehicle interior. A display adjustment unit that adjusts display on the provided display, and a captured image acquisition unit that sequentially acquires captured images in an imaging device that captures the surrounding interior in which the information providing display is provided in the interior of the vehicle; A determination unit that determines whether or not the user needs an information providing display for providing information to the user on the information providing display, and the display adjusting unit displays the information providing display on the information providing display If the determination unit determines that the user does not need the information, the assimilation display that appears assimilated to the surrounding interior where the information providing display is provided is based on the captured image acquired by the captured image acquisition unit. Let the provided display perform It is characterized in.
 これによれば、情報提供表示器が設けられている周囲の内装の撮像画像をもとに、その内装に同化して見える同化表示を情報提供表示器に行わせるので、情報提供表示器が設けられている周囲の内装の実際の見え方と同じような見え方のする同化表示を情報提供表示器に行わせることが可能になる。この情報提供表示器は、ユーザに情報を提供するための表示器であるので、乗員から見た情報提供表示器は、この同化表示によって隠されることになる。同化表示は、情報提供表示器が設けられている周囲の内装の実際の見え方と同じような見え方のする表示であるので、乗員からは、情報提供表示器が同化表示によって隠されて見える部分は、情報提供表示器が設けられている周囲の内装が続いているように見える。 According to this, the information providing display is provided because the information providing display performs an assimilation display that looks assimilated to the interior based on the captured image of the surrounding interior where the information providing display is provided. It is possible to make the information providing display display an assimilation display that looks similar to the actual appearance of the surrounding interior. Since this information providing display is a display for providing information to the user, the information providing display viewed from the occupant is hidden by this assimilation display. Since the assimilation display is a display that looks similar to the actual appearance of the surrounding interior where the information providing display is provided, the information providing display appears to be hidden by the occupant from the assimilation display The part appears to be followed by a surrounding interior where an informational indicator is provided.
 また、同化表示は、情報提供表示器での情報提供表示をユーザが必要としていないと判定部で判定した場合に行う。よって、情報提供表示をユーザが必要としていない場合により生じやすいと考えられる、情報提供表示器が周囲の内装から浮き立っているとユーザに感じられる状況を防ぐことが可能になる。その結果、車室内のデザイン性を損ないにくくすることが可能になる。 Also, the assimilation display is performed when the determination unit determines that the information providing display on the information providing display is not required by the user. Therefore, it is possible to prevent a situation that is felt by the user when the information providing display is floating from the surrounding interior, which is likely to occur when the user does not need the information providing display. As a result, it becomes possible to make it difficult to impair the design of the vehicle interior.
 本開示についての上記目的およびその他の目的、特徴や利点は、添付の図面を参照しながら下記の詳細な記述により、より明確になる。
車両用表示システムの概略的な構成の一例を示すブロック図 インパネ撮像カメラの撮像領域、及びインストルメントパネルに対する操作器、フィルム状ディスプレイ、案内ディスプレイ配置例を示す図 HCUの概略的な構成の一例を示すブロック図 HCUでの表示制御関連処理の流れの一例を示すフローチャート 同化表示の一例について説明するための図 同化表示を中止させた場合の一例について説明するための図 同化表示を中止させた場合の一例について説明するための図 案内ディスプレイに表示する背景を同化表示とする場合の一例を示す図
The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings.
The block diagram which shows an example of schematic structure of the display system for vehicles The figure which shows the operation area with respect to the imaging area of an instrument panel imaging camera, and an instrument panel, a film-like display, and a guidance display arrangement Block diagram showing an example of a schematic configuration of the HCU The flowchart which shows an example of the flow of the display control related process in HCU The figure for demonstrating an example of an assimilation display The figure for demonstrating an example at the time of canceling an assimilation display The figure for demonstrating an example at the time of canceling an assimilation display The figure which shows an example in case the background displayed on a guidance display is set assimilation display
 (実施形態1)
<車両用表示システム100の概略構成>
 図1は、本開示が適用された車両用表示システム100の概略的な構成の一例を示す図である。車両用表示システム100は、車両に搭載されるものであり、図1に示すようにHCU(Human Machine Interface Control Unit)1、操作器2、フィルム状ディスプレイ3、案内ディスプレイ4、インパネ撮像カメラ5、乗員モニタカメラ6、及び車両センサ群7を含んでいる。車両用表示システム100を搭載している車両を以降ではホスト車あるいはサブジャクトクト車と呼ぶ。
(Embodiment 1)
<Schematic configuration of vehicle display system 100>
FIG. 1 is a diagram illustrating an example of a schematic configuration of a vehicle display system 100 to which the present disclosure is applied. The vehicle display system 100 is mounted on a vehicle. As shown in FIG. 1, an HCU (Human Machine Interface Control Unit) 1, an operation unit 2, a film display 3, a guidance display 4, an instrument panel imaging camera 5, An occupant monitor camera 6 and a vehicle sensor group 7 are included. A vehicle equipped with the vehicle display system 100 is hereinafter referred to as a host vehicle or a subject vehicle.
 操作器2は、ホスト車のインストルメントパネルに設けられたスイッチであって、ユーザが操作を行うためのものである。操作器2としては、例えば、空調装置についてのスイッチやカーオーディオについてのスイッチや車載ナビゲーション装置についてのスイッチなどがある。 The operation device 2 is a switch provided on the instrument panel of the host vehicle, and is used by the user for operation. Examples of the operation device 2 include a switch for an air conditioner, a switch for car audio, and a switch for an in-vehicle navigation device.
 フィルム状ディスプレイ3は、例えば1mm程度の薄さのフィルム状のディスプレイである。フィルム状ディスプレイ3は、操作器2の車室内側に向いた面に、表示面がその車室内側を向くように設けられる。このフィルム状ディスプレイ3はフィルム状表示器に相当する。 The film display 3 is a film display having a thickness of about 1 mm, for example. The film-like display 3 is provided on the surface of the operation device 2 facing the vehicle interior side so that the display surface faces the vehicle interior side. The film display 3 corresponds to a film display.
 フィルム状ディスプレイ3は、操作器2の車室内側に向いた面の全てを覆い隠すように、操作器2の車室内側に向いた面の全面に設けられることがより好ましい。また、フィルム状ディスプレイ3は、操作器2の車室内側に向いた面が曲面であった場合にも対応できるように、プラスチック基板の有機ELディスプレイや液晶ディスプレイといった、可撓性を有するディスプレイであることが好ましい。 More preferably, the film-like display 3 is provided on the entire surface of the operation unit 2 facing the vehicle interior side so as to cover the entire surface of the operation device 2 facing the vehicle interior side. The film-like display 3 is a flexible display such as an organic EL display or a liquid crystal display on a plastic substrate so that it can cope with a case where the surface of the operation unit 2 facing the vehicle interior is a curved surface. Preferably there is.
 案内ディスプレイ4は、ユーザに情報を提供するためのディスプレイである。この案内ディスプレイ4は情報提供表示器に相当する。案内ディスプレイ4としては、車載ナビゲーション装置のディスプレイやディスプレイオーディオ(DA)のディスプレイなどがある。案内ディスプレイ4は、インストルメントパネルの2DINスペースに設けられる2DINタイプのものとする。 The guidance display 4 is a display for providing information to the user. The guidance display 4 corresponds to an information providing display. Examples of the guidance display 4 include a display of an in-vehicle navigation device and a display audio (DA) display. The guidance display 4 is a 2DIN type provided in the 2DIN space of the instrument panel.
 案内ディスプレイ4は、タッチパネル式のものであってもよいし、メカニカルなスイッチによって操作を行うものであってもよいが、メカニカルなスイッチによって操作を行うものである場合には、このメカニカルなスイッチは操作器2に含まれるものとする。 The guidance display 4 may be of a touch panel type or may be operated by a mechanical switch. However, when the operation is performed by a mechanical switch, the mechanical switch is It is assumed to be included in the operation device 2.
 インパネ撮像カメラ5は、ホスト車のインストルメントパネルのうちの操作器2や案内ディスプレイ4が設けられている周囲の領域を撮像するカメラである。本実施形態では、図2に示すように、ホスト車のインストルメントパネル8a、8bのうちの操作器2及び案内ディスプレイ4を挟む左右の領域ArL、ArRを撮像する場合を例に挙げて以降の説明を行う。このインストルメントパネル8a、8bは内装(内装部、内装面とも言及される)に相当し、インパネ撮像カメラ5は撮像装置に相当する。 The instrument panel imaging camera 5 is a camera that images an area around the operation panel 2 and the guidance display 4 of the instrument panel of the host vehicle. In the present embodiment, as shown in FIG. 2, a case where the left and right areas ArL and ArR sandwiching the operating device 2 and the guidance display 4 in the instrument panels 8a and 8b of the host vehicle are taken as an example and the following is taken as an example. Give an explanation. The instrument panels 8a and 8b correspond to interiors (also referred to as interior parts and interior surfaces), and the instrument panel imaging camera 5 corresponds to an imaging device.
 なお、ホスト車のドライバから見て操作器2及び案内ディスプレイ4の左側の領域をArL、右側の領域をArRとする。また、インストルメントパネル8aとインストルメントパネル8bとは、色や模様が異なっているものとする。本実施形態の例では、インストルメントパネル8aが茶色の木目模様であるのに対して、インストルメントパネル8bが黒色の無地であるものとする。 Note that the area on the left side of the operating device 2 and the guidance display 4 when viewed from the driver of the host vehicle is ArL, and the area on the right side is ArR. The instrument panel 8a and the instrument panel 8b are different in color and pattern. In the example of the present embodiment, the instrument panel 8a has a brown wood pattern, whereas the instrument panel 8b has a black solid color.
 乗員モニタカメラ6は、運転席や助手席の乗員を撮像するカメラである。乗員モニタカメラ6は、運転席や助手席の乗員が操作器2や案内ディスプレイ4を操作しようと操作器2や案内ディスプレイ4の付近にまで伸ばした手や運転席や助手席の乗員の顔などを撮像するように設けられているものとする。 The occupant monitor camera 6 is a camera that images passengers in the driver's seat and passenger seat. The occupant monitor camera 6 includes a hand extended to the vicinity of the operation unit 2 and the guidance display 4 by the occupant in the driver's seat and the passenger's seat and the face of the occupant in the driver's seat and the passenger's seat. It is assumed that it is provided so as to image.
 車両センサ群7は、インパネ撮像カメラ5や乗員モニタカメラ6以外の、ホスト車に搭載された各種センサ群である。車両センサ群7には、例えばホスト車の車室内温度を検出する温度センサなどが含まれるものとする。 The vehicle sensor group 7 is a group of various sensors mounted on the host vehicle other than the instrument panel imaging camera 5 and the occupant monitor camera 6. It is assumed that the vehicle sensor group 7 includes, for example, a temperature sensor that detects the passenger compartment temperature of the host vehicle.
 HCU1は、主にマイクロコンピュータとして構成され、いずれも周知のCPU、ROMやRAM等のメモリ、I/O、及びこれらを接続するバスによって構成される。HCU1は、インパネ撮像カメラ5、乗員モニタカメラ6、及び車両センサ群7から入力された各種情報に基づき、フィルム状ディスプレイ3や案内ディスプレイ4での表示を制御あるいは調整する表示制御関連処理等の各種処理を実行する。このHCU1は車両用表示制御装置に相当する。 The HCU 1 is mainly configured as a microcomputer, and each includes a known CPU, a memory such as a ROM and a RAM, an I / O, and a bus connecting them. The HCU 1 performs various processes such as display control related processing for controlling or adjusting the display on the film display 3 and the guidance display 4 based on various information input from the instrument panel imaging camera 5, the occupant monitor camera 6, and the vehicle sensor group 7. Execute the process. The HCU 1 corresponds to a vehicle display control device.
 なお、HCU1が実行する機能の一部又は全部を、一つ或いは複数のIC等によりハードウェア的に構成してもよい。 Note that some or all of the functions executed by the HCU 1 may be configured in hardware by one or a plurality of ICs.
 <HCU1の詳細構成>
 図3に示すように、HCU1(制御回路とも言及される)は、第1撮像画像取得部11、第2撮像画像取得部12、判定部13(要否判定部とも言及される)、及び表示調整部14(表示制御部とも言及される)を備えている。
<Detailed configuration of HCU1>
As shown in FIG. 3, the HCU 1 (also referred to as a control circuit) includes a first captured image acquisition unit 11, a second captured image acquisition unit 12, a determination unit 13 (also referred to as a necessity determination unit), and a display. An adjustment unit 14 (also referred to as a display control unit) is provided.
 第1撮像画像取得部11は、インパネ撮像カメラ5が撮像した前述の領域ArL、ArRの画像を逐次取得する。この第1撮像画像取得部11は撮像画像取得部に相当する。第2撮像画像取得部12は、乗員モニタカメラ6が撮像した乗員の画像を逐次取得する。 The first captured image acquisition unit 11 sequentially acquires the images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5. The first captured image acquisition unit 11 corresponds to a captured image acquisition unit. The second captured image acquisition unit 12 sequentially acquires occupant images captured by the occupant monitor camera 6.
 判定部13及び表示調整部14については、以下の表示制御関連処理の説明において詳述する。 The determination unit 13 and the display adjustment unit 14 will be described in detail in the following description of the display control related process.
 <表示制御関連処理>
 ここで、HCU1での表示制御関連処理について図4のフローチャートを用いて説明を行う。図4のフローチャートは、例えばホスト車のイグニッション電源がオンになったときに開始する。
<Display control related processing>
Here, the display control related processing in the HCU 1 will be described with reference to the flowchart of FIG. The flowchart in FIG. 4 starts when the ignition power of the host vehicle is turned on, for example.
 ここで、フローチャートの処理は、複数のセクション(あるいはステップと言及される)を含み、各セクションは、たとえば、S1と表現される。さらに、各セクションは、複数のサブセクションに分割されることができる、一方、複数のセクションが合わさって一つのセクションにすることも可能である。さらに、各セクションは、デバイス、モジュールして言及されることができる。また、上記の複数のセクションの各々あるいは組合わさったものは、(i)ハードウエアユニット(例えば、コンピュータ)と組み合わさったソフトウエアのセクションのみならず、(ii)ハードウエア(例えば、集積回路、配線論理回路)のセクションとして、関連する装置の機能を含みあるいは含まずに実現できる。さらに、ハードウエアのセクションは、マイクロコンピュータの内部に含まれることもできる。 Here, the processing of the flowchart includes a plurality of sections (or referred to as steps), and each section is expressed as, for example, S1. Further, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section. Further, each section can be referred to as a device, a module. In addition, each of the above sections or a combination thereof includes not only (i) a section of software combined with a hardware unit (eg, a computer), but also (ii) hardware (eg, an integrated circuit, As a section of (wiring logic circuit), it can be realized with or without the function of related devices. Furthermore, the hardware section can be included inside the microcomputer.
 まず、S1では、第1撮像画像取得部11が、インパネ撮像カメラ5が撮像した前述の領域ArL、ArRの画像を取得する。 First, in S <b> 1, the first captured image acquisition unit 11 acquires images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5.
 S2では、表示調整部14が、S1で取得した画像をもとに、周囲のインストルメントパネル8a、8bに同化して見える同化表示をフィルム状ディスプレイ3及び案内ディスプレイ4に行わせる。より詳しくは、表示調整部14は、S1で取得した領域ArLの撮像画像と領域ArRの撮像画像との間での画像の変化の具合から、操作器2や案内ディスプレイ4が設けられた領域にもインストルメントパネル8a、8bが続いていると仮定した場合におけるそのインストルメントパネル8a、8bの見た目の変化を推定する。そして、推定したその見た目の変化に沿った同化表示を、フィルム状ディスプレイ3及び案内ディスプレイ4に行わせる。 In S2, the display adjustment unit 14 causes the film display 3 and the guidance display 4 to perform an assimilation display that appears assimilated to the surrounding instrument panels 8a and 8b based on the image acquired in S1. More specifically, the display adjustment unit 14 changes the area between the captured image of the area ArL and the captured image of the area ArR acquired in S1 in the area where the operation device 2 and the guidance display 4 are provided. Also, when it is assumed that the instrument panels 8a and 8b continue, changes in the appearance of the instrument panels 8a and 8b are estimated. Then, the film-like display 3 and the guidance display 4 are caused to perform assimilation display along the estimated change in appearance.
 ここで、同化表示を行わせる処理の一例について説明を行う。まず、操作器2、案内ディスプレイ4と領域ArL、ArRとの位置関係や、操作器2に設けられたフィルム状ディスプレイ3、案内ディスプレイ4の画面サイズについては、予めHCU1の不揮発性メモリに格納してあるものとする。 Here, an example of processing for performing assimilation display will be described. First, the positional relationship between the operation device 2 and the guidance display 4 and the areas ArL and ArR, and the screen size of the film display 3 and the guidance display 4 provided in the operation device 2 are stored in advance in the nonvolatile memory of the HCU 1. It shall be.
 表示調整部14は、不揮発性メモリに格納されている操作器2と領域ArLとの位置関係をもとに、領域ArLの撮像画像から、操作器2の左右方向に位置する操作器2の幅分の領域の撮像画像を抽出する。なお、不揮発性メモリに格納されている操作器2と領域ArRとの位置関係をもとに、領域ArRの撮像画像から、操作器2の左右方向に位置する操作器2の幅分の領域の撮像画像を抽出する構成としてもよい。他にも、不揮発性メモリに格納されている操作器2と領域ArL、ArRとの位置関係をもとに、領域ArL、ArRのそれぞれの撮像画像から、操作器2の左右方向に位置する操作器2の幅分の領域の撮像画像を抽出する構成としてもよい。 Based on the positional relationship between the operation device 2 and the region ArL stored in the nonvolatile memory, the display adjustment unit 14 determines the width of the operation device 2 located in the left-right direction of the operation device 2 from the captured image of the region ArL. The captured image of the minute region is extracted. Based on the positional relationship between the operation device 2 and the region ArR stored in the non-volatile memory, an area corresponding to the width of the operation device 2 located in the left-right direction of the operation device 2 is obtained from the captured image of the region ArR. It is good also as a structure which extracts a captured image. In addition, based on the positional relationship between the operation device 2 stored in the non-volatile memory and the regions ArL and ArR, an operation positioned in the left-right direction of the operation device 2 from the captured images of the regions ArL and ArR. It is good also as a structure which extracts the captured image of the area | region for the width | variety of the device 2.
 続いて、表示調整部14は、不揮発性メモリに格納されている操作器2に設けられたフィルム状ディスプレイ3の画面サイズをもとに、抽出した撮像画像をその画面サイズに合わせるように左右に拡大する。抽出した撮像画像が画面サイズよりも小さい場合には、画面サイズに合わせるように撮像画像を切り出す構成とすればよい。画面サイズに合わせるように加工した撮像画像を以降では加工画像と呼ぶ。 Subsequently, based on the screen size of the film-like display 3 provided in the operation device 2 stored in the non-volatile memory, the display adjustment unit 14 moves the extracted captured image left and right so as to fit the screen size. Expanding. If the extracted captured image is smaller than the screen size, the captured image may be cut out to fit the screen size. The captured image processed to fit the screen size is hereinafter referred to as a processed image.
 また、表示調整部14は、領域ArLの撮像画像と領域ArRの撮像画像とのそれぞれの輝度から、領域ArLと領域ArRとに挟まれた領域における輝度の変化を推定する。輝度の変化は、例えば直線的に変化するものとして推定する構成とすればよい。続いて、表示調整部14は、推定した輝度の変化、及び操作器2と領域ArL、ArRとの位置関係をもとに、操作器2の位置する領域における輝度を求める。そして、前述の加工画像の輝度が求めた輝度となるように画像処理を行った画像(以下、同化表示画像)をフィルム状ディスプレイ3に表示させる。操作器2の位置する領域の左右の端部で、求めた輝度に有意な差がある場合には、輝度の変化に沿ったグラデーションを加える画像処理を行って、同化表示画像を得る構成とすればよい。ここで言うところの有意な差とは、ユーザが目で見て区別できる程度の差とすればよい。 Further, the display adjustment unit 14 estimates a change in luminance in the region sandwiched between the region ArL and the region ArR from the luminance of the captured image of the region ArL and the captured image of the region ArR. For example, the luminance change may be estimated to change linearly. Subsequently, the display adjustment unit 14 obtains the luminance in the region where the operation device 2 is located based on the estimated change in luminance and the positional relationship between the operation device 2 and the regions ArL and ArR. And the image (henceforth an assimilation display image) which performed image processing so that the brightness | luminance of the above-mentioned processed image may become the calculated | required brightness | luminance is displayed on the film-form display 3. FIG. In the case where there is a significant difference in the obtained luminance at the left and right ends of the area where the operation device 2 is located, an image processing for adding gradation along the change in luminance is performed to obtain an assimilated display image. That's fine. The significant difference mentioned here may be a difference that can be distinguished visually by the user.
 なお、操作器2が複数存在する場合には、個々の操作器2について上述の処理を行う構成とすればよい。また、案内ディスプレイ4についても、操作器2について説明したのと同様の処理を行うことで、同化表示画像を得る構成とすればよい。 In addition, what is necessary is just to set it as the structure which performs the above-mentioned process about each operation device 2, when there exist two or more operation devices 2. FIG. In addition, the guidance display 4 may be configured to obtain an assimilated display image by performing the same processing as described for the operation device 2.
 これによれば、操作器2や案内ディスプレイ4の左右方向に位置する操作器2や案内ディスプレイ4の幅分の領域の撮像画像を抽出し、左右方向にのみ拡大したり、切り出したりすることで、インストルメントパネル8a、8bに木目等の模様がある場合にも、操作器2や案内ディスプレイ4の周囲のインストルメントパネル8a、8bと同化表示との模様のずれを生じにくくすることができる。 According to this, by extracting a captured image of a region corresponding to the width of the operation device 2 or the guidance display 4 positioned in the left-right direction of the operation device 2 or the guidance display 4, and expanding or cutting out only in the left-right direction. Even when the instrument panels 8a and 8b have a pattern such as wood grain, it is possible to make it difficult for the instrument panel 8a and 8b around the operation unit 2 and the guidance display 4 to be shifted from the assimilation display.
 また、領域ArLの撮像画像と領域ArRの撮像画像とのそれぞれの輝度をもとに推定した、領域ArLと領域ArRとに挟まれた領域における輝度の変化に沿った同化表示を行わせるので、日差しの入り具合等でインストルメントパネル8a、8bの見え方が場所によって異なる場合でも、操作器2や案内ディスプレイ4の周囲のインストルメントパネル8a、8bと同化表示とのずれを生じにくくすることができる。 In addition, since the assimilation display is performed according to the change in luminance in the region sandwiched between the region ArL and the region ArR estimated based on the luminance of the captured image of the region ArL and the captured image of the region ArR, Even when the appearance of the instrument panels 8a and 8b varies depending on the place due to sunlight, etc., the instrument panels 8a and 8b around the operation device 2 and the guide display 4 may be less likely to be shifted from the assimilation display. it can.
 ここで、図5を用いて、同化表示の例についての説明を行う。例えば、案内ディスプレイ4の周囲のインストルメントパネル8aが茶色の木目模様である場合には、案内ディスプレイ4にも茶色の木目模様を表示することになる。また、操作器2の周囲のインストルメントパネル8bが黒色の無地である場合には、操作器2に設けられるフィルム状ディスプレイ3にも黒色の無地を表示することになる。 Here, an example of assimilation display will be described with reference to FIG. For example, when the instrument panel 8 a around the guidance display 4 has a brown wood pattern, the brown display is also displayed on the guidance display 4. Further, when the instrument panel 8b around the operation device 2 is a black solid color, the black solid color is also displayed on the film display 3 provided in the operation device 2.
 図4に戻って、S3では、判定部13が、操作器2の操作をユーザが必要としているか否か、案内ディスプレイ4でのユーザに情報を提供するための表示(以下、情報提供表示)をユーザが必要としているか否かを判定する。 Returning to FIG. 4, in S <b> 3, the determination unit 13 displays whether or not the user needs to operate the operation device 2, and displays on the guidance display 4 for providing information to the user (hereinafter, information providing display). Determine if the user needs it.
 一例として、第2撮像画像取得部12で乗員モニタカメラ6から取得した撮像画像をもとに、ユーザが操作器2の近辺に手を伸ばしていることを検出できた場合に、操作器2の操作をユーザが必要としていると判定する一方、ユーザが操作器2の近辺に手を伸ばしていることが検出できない場合には、操作器2の操作をユーザが必要としていないと判定する構成とすればよい。 As an example, when it can be detected that the user is reaching out in the vicinity of the operation device 2 based on the captured image acquired from the occupant monitor camera 6 by the second captured image acquisition unit 12, While it is determined that the user needs the operation, if it is not detected that the user is reaching near the operation device 2, it is determined that the operation of the operation device 2 is not required by the user. That's fine.
 また、第2撮像画像取得部12で乗員モニタカメラ6から取得した撮像画像をもとに、ユーザの視線が案内ディスプレイ4に向いていることを検出できた場合に、案内ディスプレイ4での情報提供表示をユーザが必要としていると判定する一方、ユーザの視線が案内ディスプレイ4に向いていることが検出できない場合には、案内ディスプレイ4での情報提供表示をユーザが必要としていないと判定する構成とすればよい。 In addition, when the second captured image acquisition unit 12 can detect that the user's line of sight is facing the guidance display 4 based on the captured image acquired from the occupant monitor camera 6, information is provided on the guidance display 4. While it is determined that the user needs display, if it is not possible to detect that the user's line of sight is facing the guidance display 4, the information determination display on the guidance display 4 is determined not to be required by the user. do it.
 なお、ユーザの視線が案内ディスプレイ4に向いていることは、ユーザの視線が案内ディスプレイ4に1秒以上等の所定時間以上継続して向いている場合に検出する構成としてもよい。 Note that the fact that the user's line of sight faces the guidance display 4 may be detected when the user's line of sight continues to face the guidance display 4 for a predetermined time such as 1 second or longer.
 他にも、ユーザが案内ディスプレイ4の近辺に手を伸ばしていることを検出できた場合に、案内ディスプレイ4での情報提供表示をユーザが必要としていると判定する一方、ユーザが案内ディスプレイ4の近辺に手を伸ばしていることが検出できない場合には、案内ディスプレイ4での情報提供表示をユーザが必要としていないと判定する構成としてもよい。 In addition, when it is detected that the user has reached his hand in the vicinity of the guidance display 4, it is determined that the user needs to provide information on the guidance display 4, while the user In the case where it is not possible to detect that the hand is reaching out in the vicinity, it may be determined that the information providing display on the guidance display 4 is not required by the user.
 また、ユーザの視線が案内ディスプレイ4に向いているのに加え、ユーザが案内ディスプレイ4の近辺に手を伸ばしていることを検出できた場合に、案内ディスプレイ4での情報提供表示をユーザが必要としていると判定する構成としてもよい。 In addition to the fact that the user's line of sight is directed to the guidance display 4, the user needs to provide information on the guidance display 4 when it is detected that the user has reached out to the vicinity of the guidance display 4. It may be configured to determine that
 なお、操作器2が複数存在する場合であって、第2撮像画像取得部12で取得した撮像画像をもとに、ユーザが複数の操作器2のうちのどの操作器2の近辺に手を伸ばしているかまで検出できる場合には、判定部13がどの操作器2を必要としているかまで判定する構成とすればよい。 In addition, it is a case where there are a plurality of operation devices 2, and based on the captured image acquired by the second captured image acquisition unit 12, the user places a hand near which of the operation devices 2 of the plurality of operation devices 2. In the case where it is possible to detect whether it is extended, the determination unit 13 may determine which operating device 2 is required.
 他にも、車両センサ群7から得られる、ホスト車に搭載された各種センサ群の信号から、操作器2の操作をユーザが必要としているか否か、案内ディスプレイ4での情報提供表示をユーザが必要としているか否かを判定する構成としてもよい。一例としては、温度センサで検出した車室内の温度が、空調装置の起動や温度設定の変更を必要とすると推定される温度範囲であった場合に、操作器2のうちの空調装置についてのスイッチの操作をユーザが必要としていると判定する構成とすればよい。 In addition, from the signals of the various sensor groups mounted on the host vehicle obtained from the vehicle sensor group 7, the user can display information on the guidance display 4 as to whether or not the user needs to operate the operating device 2. It is good also as a structure which determines whether it is required. As an example, when the temperature of the passenger compartment detected by the temperature sensor is in a temperature range that is estimated to require activation of the air conditioner or change in temperature setting, a switch for the air conditioner of the operating device 2 The operation may be determined to be necessary by the user.
 S4では、操作器2の操作、及び案内ディスプレイ4での情報提供表示のいずれかでもユーザが必要としていると判定部13で判定した場合(S4でYES)には、S5に移る。一方、操作器2の操作、及び案内ディスプレイ4での情報提供表示のいずれもユーザが必要としていないと判定部13で判定した場合(S4でNO)には、S7に移る。 In S4, if the determination unit 13 determines that the user needs either the operation device 2 or the information display on the guidance display 4 (YES in S4), the process proceeds to S5. On the other hand, when the determination unit 13 determines that neither the operation of the operation device 2 nor the information providing display on the guidance display 4 is required by the user (NO in S4), the process proceeds to S7.
 S5では、S1と同様にして、第1撮像画像取得部11が、インパネ撮像カメラ5が撮像した前述の領域ArL、ArRの画像を取得する。 In S5, as in S1, the first captured image acquisition unit 11 acquires images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5.
 S6では、表示調整部14が、判定部13で必要と判定した操作器2に設けられたフィルム状ディスプレイ3や案内ディスプレイ4については、同化表示を中止させる。 In S6, the display adjustment unit 14 stops the assimilation display for the film display 3 and the guidance display 4 provided in the operation device 2 determined to be necessary by the determination unit 13.
 同化表示を中止させる場合、操作器2に設けられたフィルム状ディスプレイ3については、何も表示させない構成としてもよいが、操作器2の種類を示すアイコンやマークを表示させる構成とすればよい。また、案内ディスプレイ4については、案内ディスプレイ4の操作画面や、案内ディスプレイ4の操作に従った画面を表示させる構成とすればよい。 When discontinuing the assimilation display, the film display 3 provided in the operation device 2 may be configured to display nothing, but may be configured to display an icon or mark indicating the type of the operation device 2. The guidance display 4 may be configured to display an operation screen of the guidance display 4 or a screen according to the operation of the guidance display 4.
 ここで、図6、図7を用いて、同化表示を中止させた場合の例についての説明を行う。例えば、案内ディスプレイ4と操作器2とのうちの操作器2の操作のみを判定部13で必要と判定した場合には、図6に示すように、案内ディスプレイ4については同化表示を継続させる一方、操作器2に設けられたフィルム状ディスプレイ3については同化表示を中止させる。 Here, an example when the assimilation display is stopped will be described with reference to FIGS. For example, when the determination unit 13 determines that only the operation of the operation device 2 out of the guidance display 4 and the operation device 2 is necessary, the associative display is continued on the guidance display 4 as shown in FIG. The assimilation display is stopped for the film-like display 3 provided in the operation device 2.
 例えば、案内ディスプレイ4と複数の操作器2とのうちの一部の操作器2の操作のみを判定部13で必要と判定した場合には、図7に示すように、案内ディスプレイ4と操作が必要でないと判定された操作器2に設けられたフィルム状ディスプレイ3については同化表示を継続させる一方、操作が必要と判定された操作器2に設けられたフィルム状ディスプレイ3については同化表示を中止させる。 For example, when the determination unit 13 determines that only the operation of a part of the operation devices 2 of the guidance display 4 and the plurality of operation devices 2 is necessary, as shown in FIG. Assimilation display is continued for the film-like display 3 provided in the operation device 2 determined not to be necessary, while the assimilation display is stopped for the film-like display 3 provided to the operation device 2 determined to be necessary. Let
 図4に戻って、S7では、S1と同様にして、第1撮像画像取得部11が、インパネ撮像カメラ5が撮像した前述の領域ArL、ArRの画像を取得する。S8では、S2と同様にして、表示調整部14が同化表示をフィルム状ディスプレイ3及び案内ディスプレイ4に行わせ、同化表示を継続させる。 Returning to FIG. 4, in S <b> 7, in the same manner as in S <b> 1, the first captured image acquisition unit 11 acquires images of the aforementioned areas ArL and ArR captured by the instrument panel imaging camera 5. In S8, as in S2, the display adjustment unit 14 causes the film display 3 and the guide display 4 to perform assimilation display, and continues the assimilation display.
 S9では、表示制御関連処理の終了タイミングである場合(S9でYES)には、S10に移る。一方、表示制御関連処理の終了タイミングでない場合(S9でNO)には、S3に戻って処理を繰り返す。表示制御関連処理の終了タイミングの一例としては、ホスト車のイグニッション電源がオフになったときなどがある。 In S9, when it is the end timing of the display control related process (YES in S9), the process proceeds to S10. On the other hand, if it is not the end timing of the display control related process (NO in S9), the process returns to S3 and is repeated. An example of the end timing of the display control related process is when the host vehicle ignition power is turned off.
 S10では、S1と同様にして、第1撮像画像取得部11が、インパネ撮像カメラ5が撮像した前述の領域ArL、ArRの画像を取得する。S11では、S2と同様にして、表示調整部14が同化表示をフィルム状ディスプレイ3及び案内ディスプレイ4に一旦行わせた後、表示制御関連処理を終了する。 In S10, as in S1, the first captured image acquisition unit 11 acquires images of the above-described areas ArL and ArR captured by the instrument panel imaging camera 5. In S11, similarly to S2, the display adjustment unit 14 causes the film-like display 3 and the guidance display 4 to once perform assimilation display, and then the display control-related processing ends.
 これによれば、ホスト車のイグニッション電源をユーザがオフにして降車する場合に、操作器2に設けられたフィルム状ディスプレイ3及び案内ディスプレイ4の全てに一斉に同化表示を行わせることで、内装の見栄えを良くすることができる。一斉に同化表示を行った後については、フィルム状ディスプレイ3及び案内ディスプレイ4での表示自体を終了させるなどすればよい。 According to this, when the user turns off the ignition power of the host vehicle, the film display 3 and the guidance display 4 provided in the operation device 2 are all assimilated and displayed simultaneously. Can improve the appearance. After performing the assimilation display all at once, the display itself on the film display 3 and the guidance display 4 may be terminated.
 また、車両センサ群7のうちの着座センサ等の信号によって降車を検出するまでは同化表示を継続させ、降車を検出した後に、表示調整部14がフィルム状ディスプレイ3及び案内ディスプレイ4での表示自体を終了させる構成としてもよい。 In addition, the assimilation display is continued until the getting-off is detected by a signal from a seating sensor or the like in the vehicle sensor group 7, and after the getting-off is detected, the display adjusting unit 14 displays on the film display 3 and the guidance display 4 itself. It is good also as a structure which complete | finishes.
 (実施形態1のまとめ)
 実施形態1の構成によれば、操作器2や案内ディスプレイ4が設けられている周囲のインストルメントパネル8a、8bの撮像画像から抽出した画像の色や模様自体はそのままに加工した画像をフィルム状ディスプレイ3や案内ディスプレイ4に行わせるので、操作器2や案内ディスプレイ4が設けられている周囲のインストルメントパネル8a、8bの実際の見え方と同じような見え方のする同化表示をフィルム状ディスプレイ3や案内ディスプレイ4に行わせることができる。
(Summary of Embodiment 1)
According to the configuration of the first embodiment, a film-like image obtained by processing the image color and pattern extracted from the captured images of the surrounding instrument panels 8a and 8b provided with the operation device 2 and the guidance display 4 as it is is used as a film. Since the display 3 and the guidance display 4 are made to perform, an assimilation display that looks similar to the actual appearance of the surrounding instrument panels 8a and 8b on which the operation device 2 and the guidance display 4 are provided is a film display. 3 and the guidance display 4 can be performed.
 このフィルム状ディスプレイ3は、操作器2の車室内側に向いた面に、表示面がその車室内側を向いて設けられるので、乗員から見た操作器2は、この同化表示によって隠されることになる。また、案内ディスプレイ4は、ユーザに情報を提供するための表示器であるので、乗員から見た案内ディスプレイ4は、この同化表示によって隠されることになる。同化表示は、操作器2や案内ディスプレイ4が設けられている周囲のインストルメントパネル8a、8bの実際の見え方と同じような見え方のする表示であるので、乗員からは、同化表示によって隠されて見える部分は、周囲のインストルメントパネル8a、8bが続いているように見える。 Since this film-like display 3 is provided on the surface of the operation device 2 facing the vehicle interior side with the display surface facing the vehicle interior side, the operation device 2 viewed from the occupant is hidden by this assimilation display. become. Moreover, since the guidance display 4 is a display device for providing information to the user, the guidance display 4 viewed from the passenger is hidden by this assimilation display. The assimilation display is a display that looks similar to the actual view of the surrounding instrument panels 8a and 8b provided with the controller 2 and the guidance display 4, and is therefore hidden from the passenger by the assimilation display. The part that is seen appears to be followed by the surrounding instrument panels 8a, 8b.
 また、実施形態1の構成によれば、操作器2や案内ディスプレイ4がユーザに必要とされていないと判定部13で判定される場合にフィルム状ディスプレイ3や案内ディスプレイ4に同化表示を行わせることによって、操作器2や案内ディスプレイ4が周囲のインストルメントパネル8a、8bから浮き立つ状況を防ぐことを可能にしている。詳しくは、以下の通りである。 In addition, according to the configuration of the first embodiment, when the determination unit 13 determines that the operation device 2 or the guidance display 4 is not required by the user, the film-like display 3 or the guidance display 4 performs assimilation display. Thus, it is possible to prevent the operating device 2 and the guidance display 4 from being lifted from the surrounding instrument panels 8a and 8b. Details are as follows.
 ユーザが操作器2の操作を必要としている場合には、操作器2がインストルメントパネル8bと区別できる色や模様であっても、操作器2の位置を把握しやすいという利点があるため、操作器2が周囲のインストルメントパネル8bから浮き立っているとは感じにくいと考えられる。一方、ユーザが操作器2の操作を必要としていない場合には、操作器2がインストルメントパネル8bと区別できる色や模様であると、操作器2とインストルメントパネル8bとの見た目の違いにユーザの意識が向けられやすく、操作器2が周囲のインストルメントパネル8bから浮き立っているとユーザに感じられやすいと考えられる。 When the user needs to operate the operation device 2, even if the operation device 2 has a color or pattern that can be distinguished from the instrument panel 8b, there is an advantage that the position of the operation device 2 can be easily grasped. It is thought that it is hard to feel that the vessel 2 is floating from the surrounding instrument panel 8b. On the other hand, when the user does not need to operate the operation device 2, if the operation device 2 has a color or a pattern that can be distinguished from the instrument panel 8b, the difference in appearance between the operation device 2 and the instrument panel 8b is It is considered that the user is likely to feel when the controller 2 is lifted from the surrounding instrument panel 8b.
 また、ユーザが案内ディスプレイ4での情報提供表示を必要としている場合には、情報提供表示にユーザの意識が向くので、案内ディスプレイ4の画面が周囲のインストルメントパネル8aから浮き立っているとは感じにくいと考えられる。一方、ユーザが案内ディスプレイ4での情報提供表示を必要としていない場合には、案内ディスプレイ4の画面がインストルメントパネル8aと区別できる色や模様であると、案内ディスプレイ4の画面とインストルメントパネル8aとの見た目の違いにユーザの意識が向けられやすく、案内ディスプレイ4が周囲のインストルメントパネル8aから浮き立っているとユーザに感じられやすいと考えられる。 In addition, when the user needs the information providing display on the guidance display 4, the user's consciousness is suitable for the information providing display, so that the screen of the guidance display 4 is lifted from the surrounding instrument panel 8a. It is considered difficult. On the other hand, when the user does not need the information providing display on the guidance display 4, if the screen of the guidance display 4 has a color or pattern that can be distinguished from the instrument panel 8a, the screen of the guidance display 4 and the instrument panel 8a. It is considered that the user's consciousness is easily directed to the difference in appearance, and the user can easily feel when the guidance display 4 is lifted from the surrounding instrument panel 8a.
 これに対して、実施形態1の構成によれば、操作器2や案内ディスプレイ4がユーザに必要とされていない場合に、その操作器2に設けられたフィルム状ディスプレイ3や案内ディスプレイ4に同化表示を行わせることで、操作器2や案内ディスプレイ4が周囲のインストルメントパネル8a、8bから浮き立つ状況を防ぐので、車室内のデザイン性を損ないにくくすることが可能になる。 On the other hand, according to the configuration of the first embodiment, when the operation device 2 and the guidance display 4 are not required by the user, the film display 3 and the guidance display 4 provided in the operation device 2 are assimilated. By performing the display, it is possible to prevent the operating device 2 and the guidance display 4 from being lifted from the surrounding instrument panels 8a and 8b.
 (変形例1)
 前述の実施形態では、案内ディスプレイ4での情報提供表示をユーザが必要としていると判定部13で判定した場合に、案内ディスプレイ4に同化表示を行わせない構成を示したが、必ずしもこれに限らない。例えば、案内ディスプレイ4が、ユーザに提供する情報を背景に重ねて表示する場合には、この背景を前述の同化表示とする構成としてもよい。
(Modification 1)
In the above-described embodiment, the configuration in which the assimilation display is not performed on the guidance display 4 when the determination unit 13 determines that the user needs information providing display on the guidance display 4 has been described. Absent. For example, when the guidance display 4 displays the information provided to the user so as to overlap the background, the background may be configured as the above-described assimilation display.
 ここで、図8を用いて、案内ディスプレイ4に表示する背景を同化表示とする場合の一例を示す。図8は、案内ディスプレイ4に経路案内の地図表示を行う場合の例を示している。例えば、案内ディスプレイ4に経路案内の地図表示を行う場合には、図8に示すように、道路や施設の背景については、案内ディスプレイ4が設けられているインストルメントパネル8aに同化して見える同化表示を行わせる構成とすればよい。 Here, an example in which the background to be displayed on the guidance display 4 is assimilated display is shown using FIG. FIG. 8 shows an example in which a route guidance map is displayed on the guidance display 4. For example, when the route guidance map is displayed on the guidance display 4, as shown in FIG. 8, the background of the road and the facility is assimilated to the instrument panel 8a on which the guidance display 4 is provided. What is necessary is just to make it the structure which performs a display.
 (変形例2)
 前述の実施形態では、インパネ撮像カメラ5が、操作器2や案内ディスプレイ4を挟む左右の領域を撮像する構成を示したが、必ずしもこれに限らない。例えば、操作器2や案内ディスプレイ4を挟む上下の領域を撮像する構成としてもよいし、操作器2や案内ディスプレイ4を挟む左右の領域に加え、上下の領域も撮像する構成としてもよい。操作器2や案内ディスプレイ4を挟む上下の領域を撮像した撮像画像を用いることで、インストルメントパネル8a、8bの色や模様が左右方向で切り替わっている場合にも、周囲のインストルメントパネル8a、8bに同化して見える同化表示を行わせることが可能になる。
(Modification 2)
In the above-described embodiment, the configuration in which the instrument panel imaging camera 5 captures the left and right regions sandwiching the operation device 2 and the guidance display 4 is shown, but the configuration is not necessarily limited thereto. For example, it is good also as a structure which images the upper and lower area | region which pinches | interposes the operation device 2 and the guidance display 4, and it is good also as a structure which images the upper and lower area | region in addition to the left and right area | region which pinches | interposes the operation device 2 and the guidance display 4. Even when the color and pattern of the instrument panels 8a and 8b are switched in the left-right direction by using captured images obtained by imaging the upper and lower regions sandwiching the operation device 2 and the guidance display 4, the surrounding instrument panels 8a, It is possible to display an assimilation display that appears assimilated to 8b.
 (変形例3)
 前述の実施形態では、インパネ撮像カメラ5が、操作器2や案内ディスプレイ4を挟む左右の領域(つまり、複数の領域)を撮像する構成を示したが、必ずしもこれに限らない。例えば、インパネ撮像カメラ5が、操作器2や案内ディスプレイ4の周囲の1つの領域のみを撮像する構成としてもよい。
(Modification 3)
In the above-described embodiment, the configuration in which the instrument panel imaging camera 5 captures the left and right areas (that is, a plurality of areas) sandwiching the operation device 2 and the guidance display 4 is shown, but the present invention is not necessarily limited thereto. For example, the instrument panel imaging camera 5 may be configured to capture only one area around the operation device 2 or the guidance display 4.
 この場合には、同化表示を行わせる際に、その1つの領域の撮像画像から、操作器2や案内ディスプレイ4の幅分の領域の撮像画像を抽出し、抽出した撮像画像をフィルム状ディスプレイ3や案内ディスプレイ4の画面サイズに合わせるように拡大したり、切り出したりした加工画像を、前述の同化表示画像として用いる構成とすればよい。 In this case, when the assimilation display is performed, a captured image of a region corresponding to the width of the operation device 2 or the guide display 4 is extracted from the captured image of the one region, and the extracted captured image is displayed on the film display 3. Or a processed image that has been enlarged or cut out to fit the screen size of the guidance display 4 may be used as the aforementioned assimilation display image.
 (変形例4)
 前述の実施形態では、乗員モニタカメラ6から取得した撮像画像をもとに、ユーザが操作器2や案内ディスプレイ4の近辺に手を伸ばしていることを検出できた場合に、操作器2の操作をユーザが必要としていると判定したり、案内ディスプレイ4での情報提供表示をユーザが必要としていると判定したりする構成を示したが、必ずしもこれに限らない。例えば、ユーザが操作器2や案内ディスプレイ4の近辺に手を伸ばしていることは、操作器2や案内ディスプレイ4の付近に設けた赤外線センサ等の物体検知センサを用いて検出する構成としてもよい。
(Modification 4)
In the above-described embodiment, when it is detected that the user is reaching near the operating device 2 or the guidance display 4 based on the captured image acquired from the occupant monitor camera 6, the operation of the operating device 2 is performed. However, the present invention is not necessarily limited thereto. However, the present invention is not limited to this. For example, it is good also as a structure which detects using the object detection sensors, such as an infrared sensor provided in the vicinity of the operation device 2 or the guidance display 4, that the user has reached the vicinity of the operation device 2 or the guidance display 4. .
 (変形例5)
 また、フィルム状ディスプレイ3の同化表示によってインストルメントパネルと同化して見えるようにする操作器2は、インストルメントパネルに設けられるスイッチに限られない。例えば、ステアリングホイールやステアリングコラム、シフトレバーなどの、インストルメントパネルに設けられる他の操作器材であってもよい。ステアリングホイールやステアリングコラム、シフトレバーなどの、運転操作に用いる操作器材については、自動運転中の場合に、これらの操作器材の操作を必要としていないと判定部13が判定し、表示調整部14がフィルム状ディスプレイ3に同化表示を行わせる構成などとすればよい。
(Modification 5)
Further, the operation device 2 that makes the instrument panel appear assimilated by the assimilation display of the film-like display 3 is not limited to a switch provided on the instrument panel. For example, other operating devices such as a steering wheel, a steering column, and a shift lever provided on the instrument panel may be used. Regarding the operation equipment used for driving operation such as a steering wheel, steering column, and shift lever, the determination unit 13 determines that the operation of these operation equipment is not necessary during automatic driving, and the display adjustment unit 14 What is necessary is just to set it as the structure etc. which perform the assimilation display on the film-like display 3.
 (変形例6)
 また、操作器2は、インストルメントパネルに設けられるものに限られない。操作器2としては、インナードアスイッチやパワーウインドウスイッチ等の車室内に設けられるあらゆる操作器材を用いることができる。インストルメントパネル以外に設けられる操作器2については、フィルム状ディスプレイ3の同化表示によって、操作器2が設けられている内装と同化して見えるようにする構成とすればよい。
(Modification 6)
Moreover, the operating device 2 is not restricted to what is provided in an instrument panel. As the operation device 2, any operation device material provided in the vehicle compartment such as an inner door switch and a power window switch can be used. The operation device 2 provided other than the instrument panel may be configured so as to be assimilated with the interior in which the operation device 2 is provided by the assimilation display of the film display 3.
 (変形例7)
 案内ディスプレイ4としては、車載ナビゲーション装置やDAのディスプレイの他にも、メータ等の表示を行うディスプレイ(例えば液晶メータ)を用いる構成としてもよい。
(Modification 7)
The guidance display 4 may be configured to use a display (for example, a liquid crystal meter) that displays a meter or the like in addition to the in-vehicle navigation device or the DA display.
 (変形例8)
 前述の実施形態では、操作器2に設けられたフィルム状ディスプレイ3と案内ディスプレイ4とのいずれについても同化表示を行うことができる構成を示したが、必ずしもこれに限らない。例えば、操作器2にフィルム状ディスプレイ3を設けず、案内ディスプレイ4についてのみ同化表示を行うことができる構成としてもよい。
(Modification 8)
In the above-described embodiment, the configuration in which assimilation display can be performed on both the film-like display 3 and the guidance display 4 provided in the operation device 2 has been described, but the configuration is not necessarily limited thereto. For example, it is good also as a structure which can provide an assimilation display only about the guidance display 4, without providing the operation device 2 with the film-like display 3. FIG.
 (変形例9)
 また、案内ディスプレイ4に同化表示を行わせず、操作器2に設けたフィルム状ディスプレイ3についてのみ同化表示を行うことができる構成としてもよい。
(Modification 9)
Moreover, it is good also as a structure which can perform an assimilation display only about the film-form display 3 provided in the operation device 2, without performing an assimilation display on the guidance display 4. FIG.
 本開示は、実施例に準拠して記述されたが、本開示は当該実施例や構造に限定されるものではないと理解される。本開示は、様々な変形例や均等範囲内の変形をも包含する。加えて、様々な組み合わせや形態、さらには、それらに一要素のみ、それ以上、あるいはそれ以下、を含む他の組み合わせや形態をも、本開示の範疇や思想範囲に入るものである。 Although the present disclosure has been described based on the embodiments, it is understood that the present disclosure is not limited to the embodiments and structures. The present disclosure includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more or less, are within the scope and spirit of the present disclosure.

Claims (9)

  1.  ユーザが操作を行うための操作器(2)が車室内に設けられている車両に搭載され、
     前記操作器の前記車室内側に向いた面に設けられた、表示面がその車室内側を向いているフィルム状表示器(3)での表示を調整する表示調整部(14)と、
     前記車両の内装のうちの前記操作器が設けられている周囲の内装を撮像する撮像装置(5)での撮像画像を逐次取得する撮像画像取得部(11)と、
     前記操作器の操作をユーザが必要としているか否かを判定する判定部(13)とを備え、
     前記表示調整部は、前記操作器の操作をユーザが必要としていないと前記判定部で判定した場合には、前記撮像画像取得部で取得した撮像画像をもとに、前記操作器が設けられている周囲の内装に同化して見える同化表示を前記フィルム状表示器に行わせる一方、前記操作器の操作をユーザが必要としていると前記判定部で判定した場合には前記同化表示を前記フィルム状表示器に行わせない
     車両用表示制御装置。
    An operating device (2) for a user to operate is mounted on a vehicle provided in the vehicle interior,
    A display adjustment unit (14) for adjusting the display on the film-like display (3) provided on the surface of the operation unit facing the vehicle interior side, the display surface facing the vehicle interior side;
    A captured image acquisition unit (11) that sequentially acquires captured images in an imaging device (5) that captures the surrounding interior of the vehicle where the operation unit is provided;
    A determination unit (13) for determining whether or not the user needs to operate the controller,
    When the determination unit determines that the user does not need to operate the operation device, the display adjustment unit is provided with the operation device based on the captured image acquired by the captured image acquisition unit. When the determination unit determines that the user needs to operate the operation device, the film display device displays the assimilation display assimilated to the surrounding interior. A display control device for a vehicle that is not operated by a display.
  2.  請求項1において、
     前記表示調整部は、前記車室内に設けられた、ユーザに情報を提供するための表示器である情報提供表示器(4)の表示も調整し、
     前記撮像画像取得部は、前記車両の内装のうちの前記情報提供表示器が設けられている周囲の内装を撮像する撮像装置での撮像画像も逐次取得し、
     前記判定部は、前記情報提供表示器でのユーザに情報を提供するための情報提供表示をユーザが必要としているか否かも判定し、
     前記表示調整部は、前記情報提供表示器での情報提供表示をユーザが必要としていないと前記判定部で判定した場合には、前記撮像画像取得部で取得した、前記情報提供表示器が設けられている周囲の内装を撮像した撮像画像をもとに、前記情報提供表示器が設けられている周囲の内装に同化して見える同化表示を前記情報提供表示器に行わせる
     車両用表示制御装置。
    In claim 1,
    The display adjustment unit also adjusts the display of the information providing display (4) that is provided in the vehicle interior and is a display for providing information to the user,
    The captured image acquisition unit sequentially acquires captured images in an imaging device that captures the surrounding interior in which the information providing display is provided in the interior of the vehicle,
    The determination unit also determines whether or not the user needs an information providing display for providing information to the user on the information providing display,
    The display adjustment unit is provided with the information provision display acquired by the captured image acquisition unit when the determination unit determines that the user does not need information provision display on the information provision display. A vehicle display control device that causes the information providing display to perform assimilation display that appears assimilated to the surrounding interior provided with the information providing display, based on a captured image obtained by imaging the surrounding interior.
  3.  請求項1又は2において、
     前記操作器は複数であって、
     前記判定部は、複数の前記操作器のうちのどの操作器の操作をユーザが必要としているかも判定するものであって、
     前記表示調整部は、複数の前記操作器のうち、ユーザが必要としていないと前記判定部で判定した操作器については、前記同化表示を前記フィルム状表示器に行わせる一方、ユーザが必要としていると前記判定部で判定した操作器については、前記同化表示を前記フィルム状表示器に行わせない
     車両用表示制御装置。
    In claim 1 or 2,
    The operating device is plural,
    The determination unit also determines which of the plurality of operation devices the user needs to operate,
    The display adjustment unit causes the film-like display to perform the assimilation display for the operation device determined by the determination unit that the user does not need among the plurality of operation devices, while the user needs For the operation device determined by the determination unit, the assimilation display is not performed on the film display device.
  4.  請求項1又は2において、
     前記撮像装置は、前記操作器を挟む複数領域を撮像するものであって、
     前記表示調整部は、前記同化表示を前記フィルム状表示器に行わせる場合に、前記撮像画像取得部で取得した、前記操作器を挟む複数領域の撮像画像間での画像の変化の具合から、前記操作器が設けられた領域にも前記内装が続いていると仮定した場合におけるその内装の見た目の変化を推定することで、推定したその見た目の変化に沿った前記同化表示を行わせる
     車両用表示制御装置。
    In claim 1 or 2,
    The imaging device captures a plurality of regions sandwiching the operation device,
    The display adjustment unit, when causing the film-like display to perform the assimilation display, acquired by the captured image acquisition unit, from the degree of image change between the captured images of a plurality of regions sandwiching the operation device, By estimating the change in appearance of the interior when it is assumed that the interior also continues in the area where the operation unit is provided, the assimilation display according to the estimated change in appearance is performed. Display control device.
  5.  ユーザに情報を提供するための表示器である情報提供表示器(4)が車室内に設けられている車両に搭載され、
     前記情報提供表示器での表示を調整する表示調整部(14)と、
     前記車両の内装のうちの前記情報提供表示器が設けられている周囲の内装を撮像する撮像装置での撮像画像を逐次取得する撮像画像取得部(11)と、
     前記情報提供表示器でのユーザに情報を提供するための情報提供表示をユーザが必要としているか否かを判定する判定部(13)とを備え、
     前記表示調整部は、前記情報提供表示器での情報提供表示をユーザが必要としていないと前記判定部で判定した場合には、前記撮像画像取得部で取得した撮像画像をもとに、前記情報提供表示器が設けられている周囲の内装に同化して見える同化表示を前記情報提供表示器に行わせる
     車両用表示制御装置。
    An information providing indicator (4), which is an indicator for providing information to the user, is mounted on a vehicle provided in the passenger compartment,
    A display adjustment unit (14) for adjusting the display on the information providing display;
    A captured image acquisition unit (11) that sequentially acquires captured images in an imaging device that captures the surrounding interior in which the information providing display is provided in the interior of the vehicle;
    A determination unit (13) for determining whether or not the user needs an information providing display for providing information to the user on the information providing display;
    When the determination unit determines that the user does not need information provision display on the information provision display, the display adjustment unit, based on the captured image acquired by the captured image acquisition unit, the information A vehicle display control device that causes the information providing display to perform assimilation display that appears assimilated to a surrounding interior provided with the providing display.
  6.  請求項2又は5において、
     前記表示調整部は、前記情報提供表示をユーザが必要としていると前記判定部で判定した場合には、前記同化表示を前記情報提供表示器に行わせない
     車両用表示制御装置。
    In claim 2 or 5,
    The display adjustment unit does not cause the information providing display to perform the assimilation display when the determining unit determines that the user needs the information providing display.
  7.  請求項2又は5において、
     前記情報提供表示器は、ユーザに提供する情報を背景に重ねて表示するものであって、
     前記表示調整部は、前記情報提供表示をユーザが必要としていると前記判定部で判定した場合には、前記撮像画像取得部で取得した撮像画像をもとに、前記情報提供表示器が設けられている周囲の内装に前記背景が同化して見えるように前記情報提供表示を前記情報提供表示器に行わせる
     車両用表示制御装置。
    In claim 2 or 5,
    The information providing indicator displays information to be provided to the user over the background,
    When the determination unit determines that the information providing display is required by the user, the display adjustment unit is provided with the information providing display based on the captured image acquired by the captured image acquisition unit. A vehicle display control device that causes the information providing display to perform the information providing display so that the background appears assimilated to the surrounding interior.
  8.  請求項2又は5において、
     前記撮像装置は、前記情報提供表示器を挟む複数領域を撮像するものであって、
     前記表示調整部は、前記同化表示を前記情報提供表示器に行わせる場合に、前記撮像画像取得部で取得した、前記情報提供表示器を挟む複数領域の撮像画像間での画像の変化の具合から、前記情報提供表示器が設けられた領域にも前記内装が続いていると仮定した場合におけるその内装の見た目の変化を推定することで、推定したその見た目の変化に沿った前記同化表示を行わせる
     車両用表示制御装置。
    In claim 2 or 5,
    The imaging device captures a plurality of areas sandwiching the information providing display,
    The display adjustment unit, when causing the information providing display to perform the assimilation display, the degree of image change between the captured images of a plurality of regions obtained by the captured image acquisition unit and sandwiching the information providing display. From this, it is possible to estimate the assimilation display according to the estimated change in appearance by estimating the change in appearance of the interior when it is assumed that the interior also continues in the area where the information providing indicator is provided. A vehicle display control device.
  9.  ユーザが操作を行うための操作器(2)が車室内に設けられている車両に搭載され、
     前記操作器の前記車室内側に向いた面に設けられた、表示面がその車室内側を向いているフィルム状の表示器であるフィルム状表示器(3)と、
     前記フィルム状表示器での表示を調整する表示調整部(14)と、
     前記車両の内装のうちの前記操作器が設けられている周囲の内装を撮像する撮像装置での撮像画像を逐次取得する撮像画像取得部(11)と、
     前記操作器の操作をユーザが必要としているか否かを判定する判定部(13)とを備える車両用表示制御装置(1)とを含み、
     前記表示調整部は、前記操作器の操作をユーザが必要としていないと前記判定部で判定した場合には、前記撮像画像取得部で取得した撮像画像をもとに、前記操作器が設けられている周囲の内装に同化して見える同化表示を前記フィルム状表示器に行わせる一方、前記操作器の操作をユーザが必要としていると前記判定部で判定した場合には前記同化表示を前記フィルム状表示器に行わせない
     車両用表示システム。

     
    An operating device (2) for a user to operate is mounted on a vehicle provided in the vehicle interior,
    A film-like indicator (3) which is a film-like indicator provided on a surface facing the vehicle interior side of the operation device, and whose display surface faces the vehicle interior side;
    A display adjustment unit (14) for adjusting display on the film-like display;
    A captured image acquisition unit (11) that sequentially acquires captured images in an imaging device that captures the surrounding interior of the vehicle where the operation device is provided;
    A vehicle display control device (1) comprising a determination unit (13) for determining whether or not the user needs to operate the operation device,
    When the determination unit determines that the user does not need to operate the operation device, the display adjustment unit is provided with the operation device based on the captured image acquired by the captured image acquisition unit. When the determination unit determines that the user needs to operate the operation device, the film display device displays the assimilation display assimilated to the surrounding interior. A display system for vehicles that is not used by the display unit.

PCT/JP2015/003010 2014-07-01 2015-06-16 Vehicular display control apparatus, and vehicular display system WO2016002145A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014135941A JP6274035B2 (en) 2014-07-01 2014-07-01 Vehicle display control device and vehicle display system
JP2014-135941 2014-07-01

Publications (1)

Publication Number Publication Date
WO2016002145A1 true WO2016002145A1 (en) 2016-01-07

Family

ID=55018726

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/003010 WO2016002145A1 (en) 2014-07-01 2015-06-16 Vehicular display control apparatus, and vehicular display system

Country Status (2)

Country Link
JP (1) JP6274035B2 (en)
WO (1) WO2016002145A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170313325A1 (en) * 2016-05-02 2017-11-02 Honda Motor Co., Ltd. Vehicle control system, vehicle control method, and vehicle control program
WO2018087972A1 (en) * 2016-11-14 2018-05-17 ソニー株式会社 Information processing device, information processing method, and recording medium
CN111112130A (en) * 2019-12-23 2020-05-08 中国电子科技集团公司第四十一研究所 Hose tail sealing quality detection device and method based on machine vision technology
CN111559245A (en) * 2019-02-13 2020-08-21 本田技研工业株式会社 Display device

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018008061A1 (en) * 2016-07-04 2018-01-11 日産自動車株式会社 Display control method and display control device
KR102647373B1 (en) * 2018-01-04 2024-03-13 하만 베커 오토모티브 시스템즈 게엠베하 Through material illumination
CN109203992A (en) * 2018-10-24 2019-01-15 大乘汽车有限公司 A kind of automatic controller
CN114208161A (en) 2019-08-02 2022-03-18 日产自动车株式会社 Image processing apparatus, image processing method, and program
JP2022154359A (en) * 2021-03-30 2022-10-13 株式会社デンソー Vehicle display system, vehicle display method and vehicle display program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090201436A1 (en) * 2008-01-28 2009-08-13 Strazzanti Michael A Display and Control Concealment Method and Apparatus
JP2009248641A (en) * 2008-04-02 2009-10-29 Toyota Motor Corp Operating device for vehicle
US20110006892A1 (en) * 2009-07-08 2011-01-13 Dmitry Karpinsky Bendable on-demand display

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090201436A1 (en) * 2008-01-28 2009-08-13 Strazzanti Michael A Display and Control Concealment Method and Apparatus
JP2009248641A (en) * 2008-04-02 2009-10-29 Toyota Motor Corp Operating device for vehicle
US20110006892A1 (en) * 2009-07-08 2011-01-13 Dmitry Karpinsky Bendable on-demand display

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170313325A1 (en) * 2016-05-02 2017-11-02 Honda Motor Co., Ltd. Vehicle control system, vehicle control method, and vehicle control program
JP2017200785A (en) * 2016-05-02 2017-11-09 本田技研工業株式会社 Vehicle control system, vehicle control method and vehicle control program
CN107415943A (en) * 2016-05-02 2017-12-01 本田技研工业株式会社 Vehicle control system, control method for vehicle and wagon control program
US10328951B2 (en) 2016-05-02 2019-06-25 Honda Motor Co., Ltd. Vehicle control system, vehicle control method, and vehicle control program
WO2018087972A1 (en) * 2016-11-14 2018-05-17 ソニー株式会社 Information processing device, information processing method, and recording medium
JPWO2018087972A1 (en) * 2016-11-14 2019-09-26 ソニー株式会社 Information processing apparatus, information processing method, and recording medium
US11094228B2 (en) 2016-11-14 2021-08-17 Sony Corporation Information processing device, information processing method, and recording medium
US20210327313A1 (en) * 2016-11-14 2021-10-21 Sony Group Corporation Information processing device, information processing method, and recording medium
JP7074066B2 (en) 2016-11-14 2022-05-24 ソニーグループ株式会社 Information processing equipment, information processing methods, recording media, and programs
US11594158B2 (en) 2016-11-14 2023-02-28 Sony Group Corporation Information processing device, information processing method, and recording medium
CN111559245A (en) * 2019-02-13 2020-08-21 本田技研工业株式会社 Display device
CN111112130A (en) * 2019-12-23 2020-05-08 中国电子科技集团公司第四十一研究所 Hose tail sealing quality detection device and method based on machine vision technology

Also Published As

Publication number Publication date
JP6274035B2 (en) 2018-02-07
JP2016013747A (en) 2016-01-28

Similar Documents

Publication Publication Date Title
WO2016002145A1 (en) Vehicular display control apparatus, and vehicular display system
US10410319B2 (en) Method and system for operating a touch-sensitive display device of a motor vehicle
JP6380410B2 (en) Image display control device and image display system
JP6056612B2 (en) Image display control device and image display system
EP2990265B1 (en) Vehicle control apparatus
JP6446925B2 (en) Image display control device and image display system
WO2019137959A3 (en) Autonomous vehicles and methods of using same
JP6565148B2 (en) Image display control device and image display system
US20150319608A1 (en) Method For Detecting Smart Device Use While Operating A Motor Vehicle
US11127152B2 (en) Indoor monitoring device
US20090256813A1 (en) Vehicle moving-image interface
JP6805223B2 (en) Vehicle display devices, vehicle display methods, and programs
US10793069B2 (en) Method for assisting the driver of a motor vehicle in maneuvering the motor vehicle with a trailer, driver assistance system as well as vehicle/trailer combination
JP6413477B2 (en) Image display control device and image display system
US9971494B2 (en) Touch switch module
GB2558379A (en) Vehicle display based on vehicle speed
JP2009176112A (en) Visual line detection apparatus for crew
JP2008265544A (en) On-vehicle touch panel
JP2009166612A (en) Parking support device
JP5666066B2 (en) Car navigation system
JP4977482B2 (en) Image providing apparatus, vehicle, and image providing method
WO2017057007A1 (en) Image processing device for vehicles
JP5342588B2 (en) Operation device for in-vehicle equipment in automobile
JP2008100622A (en) Vehicular display device
JP2009204354A (en) Navigation control device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15815369

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15815369

Country of ref document: EP

Kind code of ref document: A1