WO2005013115A1

WO2005013115A1 - Position-detecting system

Info

Publication number: WO2005013115A1
Application number: PCT/JP2004/010854
Authority: WO
Inventors: Yoshiaki Ogawara; Hidemi Takakuwa
Original assignee: Sony Corporation
Priority date: 2003-08-01
Filing date: 2004-07-29
Publication date: 2005-02-10
Also published as: JP2005052306A; TW200510040A

Abstract

When a desired position of an image on a display (2) is pointed by a position-detecting terminal (3) and a switch for starting positional detection is operated, a position pattern image (5) is inserted in the display (2). The position pattern image (5) is an image where position marks (6) having unique positional information are arranged. The position pattern image (5) images a predetermined imaging area (E) centering on a position (T) pointed by the position-detecting terminal (3), acquires positional information of position marks (6) within the imaging area (E), and obtains the position (T) pointed by the position-detecting terminal (3). A position pointed on an image can be detected independent of a kind of the display (2).

Description

Specification

Position detection system

Technical field

The present invention relates to a position detection system that obtains a pointed position on an image. Specifically, a position pattern image in which a plurality of position marks having unique position information is arranged is inserted, the position pattern image is photographed and the position of the position mark included in the captured image is recognized, thereby indicating the indicated position. Can be detected.

Background art

[0002] Conventionally, in video games and the like, a system has been devised that aims at an arbitrary position in an image with a game gun and detects a landing position when a trigger is pulled (for example, Japanese Patent Laid-Open No. Hei 9-1990). 313738).

[0003] An image position detection method in such a video game will be described as a conventional position detection system. FIG. 1 is a block diagram showing a configuration example of a conventional position detection system. In the following description, the game gun is referred to as an instruction terminal.

[0004] The conventional position detection system starts the position detection operation by closing the switch 101 built in the instruction terminal 100. When the game device main body 102 detects that the switch 101 of the instruction terminal 100 is closed, the game device main body 102 displays a white image on the display 103. The photosensor 104 built in the instruction terminal 100 aimed at the display 103 detects a change in luminance to white due to the running of the display 103. In the position detection block 105 in the instruction terminal 100, a position calculation process is performed. When the luminance change to white is detected by the photosensor 104, and the input video signal separated by the sync separation circuit 106 from the video signal to the display 103. The position indicated on the display 103 is calculated from the synchronization signal timing data. The position data is sent to the game machine main body 102, and an application “program” corresponding to the position data is executed by the game processor 107.

[0005] In the conventional position detection system, the synchronization of the input video signal of the white image to the display and the scanning of the display need to be the same method, and the delay amount of the video signal on the display needs to be constant. . For this reason, a scan conversion and a multi-image display The conventional position detection system cannot be used for displays that have an indefinite delay time between input and display of video signals, such as image size conversion in a multi-window.

[0006] Further, in order to detect the luminance change point of the scanning line of the display, the luminance change of a certain area is detected by a photo sensor. For this reason, the position detection accuracy deteriorates as the distance between the display and the photosensor increases. In addition, position detection accuracy is not guaranteed for small displays with small displays.

[0007] In a display using an afterimage type cathode ray tube, the white luminance changes in a frame period due to the inserted white video signal. The position is detected by detecting this white luminance change with a photo sensor. However, on a liquid crystal display, white brightness does not change with the frame period. For this reason, there is little change in white luminance, and the photosensor cannot detect luminance change, and as a result, position detection cannot be performed. In addition, since a white image is inserted to cause a change in luminance, a user with a large change in luminance of the display feels uncomfortable.

[0008] Further, when position detection is performed on the instruction terminal side, a cable for sending a synchronization signal to the instruction terminal is required, and it is difficult to make the instruction terminal wireless.

The present invention has been made to solve such a problem, and provides a position detection system capable of obtaining high position detection accuracy regardless of the distance to the display, the type of display, and the like. With the goal.

Disclosure of the invention

In order to solve the above-described problems, a position detection system according to the present invention includes a display unit that displays an image, and a position instruction unit that indicates an arbitrary position of the image displayed on the display unit, In a position detection system for obtaining the position of an image pointed by an instruction means, a plurality of position marks formed by combining circular rings having concentric and different diameters are arranged on the entire surface of a specified angle of view, and each position mark is Display control means for displaying a position pattern image having unique position information on the display means, display instruction means for instructing insertion of the position pattern image into the image displayed on the display means, and position indication means Detecting position information of a plurality of position marks from image capturing means for capturing a predetermined range indicated by the position instructing means, and image data captured by the image capturing means; From the position information of the location marks, Bei and an arithmetic means for calculating a position pointed by the position indicating means It is a thing.

[0011] In the position detection system according to the present invention, when the desired position of the image displayed on the display means is pointed by the position instruction means and the display instruction means is operated, the display of the position pattern image is instructed. When receiving the instruction to display the position pattern image, the display control means inserts several frames of the position pattern image instead of the image into the display means. When the position instructing unit issues an instruction to display the position pattern image, the image capturing unit captures an image in a predetermined range indicated by the position instructing unit.

[0012] The calculation means acquires position information of a plurality of position marks from the image data photographed by the photographing means. Since each position mark has unique position information, the position on the image can be recognized. Then, the calculating means obtains the position indicated by the position indicating means from the position information of the plurality of position marks.

Brief Description of Drawings

FIG. 1 is a block diagram showing a configuration example of a conventional position detection system.

FIG. 2A is an explanatory diagram showing an overview of the position detection system of the present embodiment.

FIG. 2B is an explanatory diagram showing an overview of the position detection system of the present embodiment.

FIG. 3 is a block diagram illustrating a configuration example of a position detection system according to the present embodiment.

FIG. 4 is an explanatory diagram showing a configuration example of a position pattern image.

FIG. 5 is an explanatory diagram showing a configuration example of a position mark ID.

FIG. 6 is an explanatory diagram showing a configuration example of a position mark.

FIG. 7 is an explanatory diagram showing an imaging range and coordinate examples of the camera.

FIG. 8 is an explanatory diagram showing an example of a captured image.

FIG. 9 is an explanatory diagram showing a running example of a two-dimensional image sensor.

FIG. 10A is an explanatory view showing a modification of the position pattern image.

FIG. 10B is an explanatory diagram showing a modification of the position pattern image.

FIG. 11 is a flowchart showing a flow of processing of position detection operation.

FIG. 12 is a time chart showing an example of position pattern image insertion timing.

FIG. 13 is an explanatory diagram showing an example of an image taken by a camera.

FIG. 14 is an explanatory diagram showing an example of data used in position detection processing. FIG. 15 is a flowchart showing an operation example of position mark detection processing.

FIG. 16 is a flowchart showing an operation example of data sampling processing.

FIG. 17 is a flowchart showing an operation example of position detection processing.

FIG. 18 is an explanatory diagram showing the principle of position mark detection.

FIG. 19 is a flowchart showing an operation example of a position mark candidate search process.

FIG. 20 is a flowchart showing an operation example of position mark ID data acquisition processing;

FIG. 21 is a flowchart showing an operation example of horizontal position acquisition processing of a position mark.

FIG. 22 is a flowchart showing an operation example of vertical position acquisition processing of a position mark.

FIG. 23 is a flowchart showing an operation example of deletion processing of non-corresponding candidates.

FIG. 24 is an explanatory diagram showing a selection example of position marks.

FIG. 25 is an explanatory diagram showing an example of coordinate conversion.

FIG. 26 is an explanatory view showing a modification of the position mark.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the position detection system of the present invention will be described with reference to the drawings.

[0015] <Outline of position detection system>

2A and 2B are explanatory diagrams showing an overview of the position detection system of the present embodiment. The position detection system 1 of the present embodiment is a system that obtains position data on the display 2 pointed by the position detection terminal 3 such as a laser pointer used in a computer presentation or a gun of a game machine by pattern recognition.

That is, as shown in FIG. 2A, when, for example, a desired position T of the game image G displayed on the display 2 is pointed by the position detection terminal 3 and a switch for starting position detection is operated, FIG. 2B As shown, the position pattern image 5 is inserted into the display 2. Since the position pattern image 5 has a plurality of position marks 6 having unique position information, a predetermined shooting range E including the position T indicated by the position detection terminal 3 is shot, and a plurality of positions within the shooting range E are captured. The position information of the mark 6 is acquired, and the position indicated by the position detection terminal 3 is obtained.

[0017] <Configuration of position detection system> FIG. 3 is a block diagram showing a configuration example of the position detection system of the present embodiment. The position detection system 1 includes a display 2, a position detection terminal 3, and a device body 4. The display 2 is an example of display means, and includes, for example, a liquid crystal display 2a (LCD: Liquid Crystal Display). The display may be a plasma display other than a liquid crystal display or other flat panel display such as an organic EL (electrometer) display. In the position detection system 1 of the present embodiment, the display running system used is not particularly limited. As a display means, a display using an afterimage type cathode ray tube is acceptable. Further, the display 2 may include an analog / digital conversion block 2b and a pixel number conversion block 2c so that the image size can be changed or the image position can be changed.

[0018] The position detection terminal 3 is an example of a position instruction means, and includes a two-dimensional image sensor 3a, a camera process block 3b, a position calculation process block 3c, an I / F block 3d, a switch 3e, and the like. The position detection terminal 3 is specifically a laser pointer or a game machine gun.

The switch 3e is an example of a display instruction unit, and generates a signal for starting a position detection operation. In the following description, the switch closing will be described as ON. The two-dimensional image sensor 3a is an example of an imaging unit, and is a CCD (Charge Coupled Device), for example, and images a predetermined range of the liquid crystal display 2a pointed to by the position detection terminal 3. The position detection terminal 3 is provided with a lens 3f for focusing on the two-dimensional image sensor 3a, and a camera 3g is constituted by the two-dimensional image sensor 3a and the lens 3f. Note that the two-dimensional image sensor 3a can be moved in a state asynchronous with the scanning of the liquid crystal display 2a. The camera process block 3b performs a well-known camera process such as binarization of captured image data.

[0020] The position calculation process block 3c is an example of a calculation unit, and obtains the position indicated by the position detection terminal 3 from the captured image data output from the camera process block 3b. In the following description, the position pointed to by the position detection terminal 3 is also called a target position. The position calculation process block 3c is realized by executing a program with a DSP (Digital Signal Processor) or the like.

[0021] The I / F block 3d transfers commands and data from the position detection terminal 3 to the apparatus body 4. That is, the position pattern insertion command is generated by closing the switch 3e of the position detection terminal 3. Is output to the device body 4. This position pattern insertion command includes data specifying the number of position marks included in the position pattern image. Further, the position data of the target position obtained in the position calculation process block 3c is output to the apparatus body 4 as transfer data.

[0022] The position detection terminal 3 may include a laser pointer 3h for irradiating the target position. The laser pointer 3h includes a pointer switch 3i. When the pointer switch 3i is closed, the laser pointer 3h emits light and irradiates a predetermined position. In order to recognize the irradiation position of this laser pointer 3h as the target position, the output force of the camera process block 3b is also detected by the position calculation process block 3c at the initial setting, and the position data of the target position is detected. Record.

[0023] The device body 4 includes a processor 4a and a display lZF4b. The processor 4a executes an application program such as a game. The processor 4a has an image insertion function for image data as display control means by executing the application 'program. When the processor 4a receives a position pattern insertion command from the position detection terminal 3, the number of position marks included in the command is The position pattern image corresponding to is sent to display 2 through display I / F4b. Further, when the processor 4a receives the target position data as transfer data from the position detection terminal 3, the processor 4a executes an application program corresponding thereto. Further, a controller 4c is connected to the apparatus body 4. The controller 4c operates various application programs executed by the processor 4a.

Next, the configuration of the position pattern image displayed on the display 2 will be described. FIG. 4 is an explanatory diagram showing a configuration example of a position pattern image. The position pattern image 5 is a circular barcode-like position mark with an ID so that the position pointed to by the display 2 can be reliably identified even if the shooting angle or shooting distance of the camera 3g to be shot changes. 6 is an image arranged at equal intervals. For example, a plurality of position marks 6 are arranged on the entire surface at equal intervals both vertically and horizontally. Normally, since the image is displayed on the entire surface of the display 2 as shown in FIG. 2A, the position pattern image 5 is also displayed on the entire surface of the display 2. Also, in a configuration that can implement multi-window, the position is detected over the entire angle of view of the specified image. The pattern image 5 is displayed. The position mark 6 is formed by combining concentric circular rings with different diameters. Here, Fig. 4 shows the force when the position mark 6 is written with a black ring against a white background. The change in luminance when the position pattern image 5 is inserted into the image displayed on the display 2 shown in Fig. 3 is shown. In order to suppress this, it is better to have a position mark 6 with a white ring on a black background. In this example, in order to prevent complication of the drawing, an explanation will be given using an example in which the position mark 6 is provided with a black ring against a white background.

FIG. 5 is an explanatory diagram showing a configuration example of the position mark ID. Each of the plurality of position marks 6 displayed in the position pattern image 5 has unique position information. That is, the position mark 6 includes an ID code as position information, and the ID of each position mark 6 is a unique code for specifying the position on the position pattern image 5. In the example of FIG. 5, the ID of the position mark 6 at the upper left of the position pattern image 5 is the origin, and the ID is an [L, M] matrix of vertical and horizontal numbers.

FIG. 6 is an explanatory diagram showing a configuration example of the position mark. The position mark 6 is composed of a plurality of rings, and the two rings from the outermost periphery of the position mark 6 are a synchronization ring 7 for generating a sampling pulse for sampling an ID code in a circle described later. The radius difference between the two synchronization rings 7 represents the sampling 'clock period.

[0027] From the synchronization ring 7 toward the inner periphery, for example, six rings are an ID ring 8 as a code ring, which represents an ID code. The three outer rings of ID ring 8 represent the ID vertical number bit (L), and the inner three rings represent the ID horizontal number bit (M).

[0028] An innermost ring 9 is provided as a central ring inside the ID ring 8 and at the center of the position mark 6. This innermost ring 9 is a circle that is used for the center position detection and ID detection of the position mark 6 and has a hollow inside.

[0029] The width of the synchronization ring 7 is half that of the ID ring 8, and the rising period of the pulse of the synchronization ring 7 is the sampling period Ts. The sampling point of ID ring 8 following this synchronization ring 7 is the center of the width of each ID ring. The innermost ring 9 has a radius of 1.5 sampling periods.

[0030] The center of the innermost ring 9 coincides with the sampling point. In Fig. 6, the twelfth rising edge of the sampling pulse is the center of the position mark 6 during the run. Here, the position mark 6 in FIG. 6 is a force S representing a 6-bit ID, and when the number of position marks 6 displayed in the position pattern image 5 is increased to represent an ID of 6 bits or more, Use position marks with an increased number of ID rings 8. In order to prevent data errors when detecting IDs, a configuration that includes IDs that include data error correction codes is also conceivable.

In this example, the center position of the innermost ring 9 is the twelfth sampling number. When the number of ID rings 8 is increased, the number of samples at the center position of the innermost ring 9 is Change. Even in such a case, if the center of the innermost ring 9 is arranged at the position where the number of sampling times is fixed by counting the outer peripheral force of the circle, the center of the position mark 6 can be obtained. In this case, the fixed number of times of sampling includes non-integer numbers. As an example of the case where the falling edge of the sampling pulse is set to the center position of the innermost circumference, the number of times of sampling may be 12.5.

[0033] <Captured image and target position>

FIG. 7 is an explanatory diagram showing a shooting range and coordinate examples of the camera. An example of the shooting range when the position pattern image 5 is shot by the camera 3g described in FIG. 3 is shown. The angle of view of the camera 3g described in FIG. 3 is set so that a predetermined range indicated by the position detection terminal 3 can be photographed. The plane of the liquid crystal display 2a, which is the screen of the display 2, and the shooting plane of the two-dimensional image sensor 3a of the camera 3g have a three-dimensional relationship, so the shooting range E is various squares. The shooting range E is indicated by a rectangle. In addition, the photographing range E may be parallel to the position mark array as shown in FIG. 2B, or may be inclined with respect to the position mark 6 array as shown in FIG. In the following description, an example is given in which the shooting range E is inclined with respect to the position mark 6 array. The XY coordinate system shown in Fig. 7 is called the position pattern coordinate system.

FIG. 8 is an explanatory diagram showing an example of a captured image. When the position pattern image 5 is photographed with the camera 3g, photographed image data including a plurality of position marks 6 is obtained. FIG. 9 is an explanatory diagram showing a running example of a 2D image sensor. The two-dimensional image sensor 3a constituting the camera 3g sequentially outputs the captured image data by horizontal scanning as indicated by solid arrows. The axis along this horizontal scan is coordinate B. A coordinate axis orthogonal to the coordinate B is defined as a coordinate A. The origin of this AB coordinate system is the starting point (0, 0) of the 2D image sensor 3a. Up to coordinates, H) When scanned, for example, captured image data as shown in FIG. 8 can be acquired. Then, the vertical coordinate A12 and the horizontal coordinate B12 of the center of the arbitrary position mark 6 shown in FIG. 8 are obtained by the AB coordinate system shown in FIG. This AB coordinate system is called the camera coordinate system.

[0035] Default Settings>

In FIG. 7, the target position pointed to by the position detection terminal 3 is indicated by an asterisk. In the position detection terminal 3 equipped with the laser pointer 3h, at the initial setting, the reflected light from the display 2 due to the irradiation of the laser pointer 3h is received by the camera 3g, and the target position T ( Record as a, b). In the position detection terminal 3 that does not include the laser pointer 3h, the center of the captured image is set as the target position T. Alternatively, when the position detection terminal 3 is manufactured, the display 2 is irradiated with laser from the position where the position detection terminal 3 aims the target, and the irradiated position is recorded as the target position T.

[0036] Depending on the size of the display 2 and the distance between the display 2 and the position detection terminal 3, the number of position marks 6 that fall within the angle of view of the camera 3g of the position detection terminal 3 varies. For this reason, as shown in FIGS. 10A and 10B, several types of position pattern images in which the diameters of the position marks 6 are changed and the numbers thereof are different are recorded in the memory, not shown in the drawing of the apparatus body 4. Fig. 1 OA and Fig. 10B show variations of the position pattern image.For example, the position pattern image 5 in Fig. 10A is displayed when the distance between the display 2 and the position detection terminal 3 is long, and the position pattern in Fig. 10B is displayed. Image 5 is displayed when the distance between display 2 and position detection terminal 3 is short. At the initial setting, the position detection terminal 3 performs the shooting operation of the display 2 to determine the number of position marks. Then, a position pattern image in which the number of displayed position marks 6 is optimum is selected. In order to use the position pattern image with the optimum number of position marks, data indicating the number of position marks is added to the position pattern insertion command output to the main unit 4. As described above, the adjusting means is realized by the function of executing the program in the position detection terminal 3 and the apparatus body 4.

[0037] Position detection operation>

FIG. 11 is a flowchart showing the flow of processing of the position detection operation. First, the overall flow of the position detection operation will be described. Step SA1 is the operation of the position detection terminal 3. First, the desired position of the image displayed on the display 2 is set to the position detection terminal 3. By pointing at 3 and closing switch 3e, the position detection operation is started.

Step SA 2 is an operation of the apparatus body 4. When the switch 3 e of the position detection terminal 3 is closed, several frames of the position pattern image 5 described with reference to FIG.

Step SA3 is an operation of the position detection terminal 3, and a predetermined range of the display 2 is photographed by the camera 3g, and image data including a plurality of position marks 6 is acquired. Step SA4 is the operation of the position detection terminal 3, and detects a plurality of position marks 6 from the image data photographed by the camera 3g, and obtains the position and ID of each position mark 6.

[0040] Step SA5 is an operation of the position detection terminal 3, and two or more position marks close to the target position are selected from the position marks detected in step SA4. Step SA6 is the operation of the position detection terminal 3, and the position mark position obtained in the camera coordinate system is converted into the position pattern coordinate system. Step SA7 is the operation of the position detection terminal 3, and obtains the target position on the display 2.

Step SA 8 is an operation of the position detection terminal 3, and the position data of the target position is transferred to the apparatus body 4. Step SA9 is an operation of the apparatus body 4 and executes an application program corresponding to the target position indicated by the position detection terminal 3.

[0042] Details of each processing step will be described below. In step SA1, the position detection terminal 3 indicates a desired position of an image displayed on the display 2, for example, a game image, by an application program executed in the apparatus body 4. Then, when the switch 3e is closed, the position detection terminal 3 outputs a position pattern insertion command to the apparatus main body 4.

[0043] In step SA2, when the apparatus body 4 receives the position pattern insertion command from the position detection terminal 3, the processor 4a can display, for example, a 2-frame position pattern image 5 from the next game image currently displayed. , Output the data to display 2.

[0044] The position pattern insertion command includes a command for designating the number of position marks displayed at the time of initial setting. In addition, the apparatus main body 4 records a position pattern image in a memory, not shown, with a program or the like. As a result, the processor 4a displays the position pattern image 5 including the number of position marks 6 designated by the position pattern insertion command on the display 2. FIG. 12 is a time chart showing an example of timing for inserting the position pattern image. When the switch 3e is closed, two frames of the position pattern image 5 are inserted into the game image. When the position detection terminal 3 is provided with the laser pointer 3h, when the switch 3e is closed, the laser pointer 3h stops emitting light regardless of the state of the pointer switch 3i, and can be re-emitted after the target position data is output.

In step SA3, the position detection terminal 3 captures the display 2 with the camera 3g immediately after the switch 3e is closed. When the position detection terminal 3 is equipped with the laser pointer 3h, the image is taken within a predetermined angle of view centered on the position indicated by the laser beam of the laser pointer 3h. If the laser pointer 3h is not provided, the image is taken within the specified angle of view pointed by the position detection terminal 3. Image data photographed by the two-dimensional image sensor 3a is subjected to binarization and the like by the camera process block 3b, and sequentially output to the position calculation process block 3c.

FIG. 13 is an explanatory view showing an example of an image taken by a camera. FIG. 13 shows a photographed image example and time chart when an IT (interline transfer) type CCD is used as the two-dimensional image sensor 3a.

[0048] Here, the scanning cycle of the two-dimensional image sensor 3a is set longer than the scanning cycle of the display 2. That is, as described above, by closing the switch 3e of the position detection terminal 3, the force S at which two frames of the position pattern image 5 described in FIG. 4 and the like are inserted, the image scanning of the display 2 and the two-dimensional image sensor 3a For example, in the frame 1 of the photographed image, the image before the inserted position pattern image 5 is displayed below. On the other hand, in the image of frame 2, the position mark 6 is photographed on the entire surface within the angle of view. In this example, since it is necessary to detect at least two position marks in the captured image data, it is desirable that image data in which the position mark 6 is entirely captured can be acquired as shown in frame 2. ,. According to the processing procedure described later, two position marks 6 can be detected even from the captured image data of frame 1.

[0049] In step SA4, processing for searching for a position mark from captured image data, processing for determining the ID of the position mark, and processing for determining the center position of the position mark are performed. Figure 14 shows an example of data used in the position detection process, and executes the position calculation process block 3c shown in Figure 3. The example of a structure of the counter and register which SP uses is shown. The contents of the counter and register will be described with reference to the flowchart described later.

[0050] <Definition of position mark structure>

In the photographed image data, there are a plurality of position marks 6 as shown in FIG. Then, it is necessary to process data of a plurality of position marks 6 for each horizontal running of the photographed image shown in FIG. Therefore, a position mark structure that stores various parameters for each position mark 6 is created and managed. The status mark parameter collection status is indicated by the 3-bit status F of the component of the position mark structure. Finally, a plurality of position mark structures whose status F is set to 111 are obtained.

[0051] The data structure of the position mark structure is shown below.

F: Status

IDcomp: ID detection status

Bl 2m: Horizontal position with 12 samplings (camera AB coordinate system)

Ah: Uppermost vertical position of innermost ring 9 (camera AB coordinate system)

A1: Lowermost vertical position of innermost ring 9 (camera AB coordinate system)

CENTb: Position mark center horizontal position (camera AB coordinate system)

CENTa: Position mark center vertical position (camera AB coordinate system)

ID: Position mark ID

[0052] The 3 bits of F in the position mark structure are used as the following statuses.

F = 000: Previously position mark candidate

F = 001: Continue position mark candidate

F = 010: Position mark ID detection completed previously

F = 011: Position mark ID detection complete

F = l l l: Position mark position and ID detection complete

[0053] <Find position mark>

The captured image scanning is performed from the top of the image captured by the two-dimensional image sensor 3a, and the position calculation process block 3c determines whether the data from the captured image is position mark data for each horizontal scanning. In this process, the data in the data output from the camera process block 3b The Nores interval is measured, data is sampled at the measured pulse interval to generate sampling data, and the position mark 6 is detected by scanning near the center of the position mark. In the following example, a configuration in which the 12th rise of the sampling noise is the center of the position mark 6 as described in FIG. 6 will be described as an example.

FIG. 15 is a flowchart showing an example of the operation of the position mark detection process. Details of the process for searching for a position mark will be described below with reference to FIG. 14 and the like as appropriate. In step SB1, a sufficiently long sampling period Ts is set in the register for setting the sampling period. Next, in step SB2, the rising period T is counted from the captured image data by the rising period counter. In the next step SB3 and step SB4, it is determined whether the rising period T is smaller than 10% increase of the sampling period Ts and larger than 10% decrease.

[0055] That is, if it is determined in step SB3 that the rising period T is smaller than 10% increase of the sampling period Ts, and it is determined in step SB4 that the rising period T is smaller than 10% decrease of the sampling period Ts, step SB5 Rise period T is set as a new sampling period Ts. In order to reset the count value N of the sampling counter, sampling EN = 0 is set in the register in step SB6.

The above operation is performed in order to obtain the sampling period Ts from the synchronization ring 7 of the position mark 6 described in FIG. That is, the minimum value of the rising period of the ID ring 8 of the position mark 6 is set to twice the rising period of the synchronization ring 7, that is, the sampling period. Therefore, the sampling period Ts can be obtained from the synchronization ring 7 by always monitoring the rising period S of the captured image data and always setting the minimum value of the rising period in the register as the sampling period Ts. .

[0057] If it is determined in step SB3 that the rising period T is greater than or equal to 10% of the sampling period Ts, sampling E N = l is set in the register in step SB7 to capture data.

[0058] In step SB8, it is determined whether or not the number of times of sampling, that is, the number of times of sampling pulses is counted. If the number of times of sampling is 12, the number of times of sampling is 12th in step SB9. The vertical running position data of the captured image data is A Temporarily store in the 12 register and temporarily store the horizontal scan position data in the B12 register. In the following description, the vertical scanning position data of the captured image data whose sampling number is 12 is referred to as vertical scanning position data A12, and the horizontal scanning position data is referred to as horizontal scanning position data B12. Then, sampling 12comp = 1, which is a status indicating that sampling has been performed 12 times in the register at step SB10, is set, and the temporarily stored data is set as a sample data candidate.

[0059] Here, in the notation of the flowchart, the count value N of the sampling counter is incremented by "0". Therefore, for example, in the determination of if (N = ll) in step SB9, the sampling count is 12th. Show whether or not.

[0060] If it is determined in step SB8 that the number of samplings is not 12, it is determined in step SB11 whether the number of samplings is 23 or more. If it is determined in step SB11 that the sampling count is 23 or more, it is determined that the captured image data is not a position mark, sampling EN = 0 is set in the register, and sampling is stopped. If the number of samplings is not the 12th time at step SB8 and the number of samplings is not more than 23 at step SB11, the process returns to step SB2 and continues to monitor the rise cycle.

[0061] If it is determined in step SB3 that the rising period T is smaller than 10% increase of the sampling period Ts, and it is determined in step SB4 that the rising period T is larger than 10% decrease of the sampling period Ts, sampling is performed in step SB14. Determine whether the number is 23.

That is, the coincidence between the rising period of the captured image data and the sampling period Ts is within ± 10%. In step SB14, when the number of samplings is the 23rd, and the coincidence between the rising period of the captured image data and the sampling period Ts is detected, the period of the synchronization ring 7 of the position mark 6 is detected. As a result, sampling 23comp = l is set in the register in step SB15, sampling EN is reset in step SB6, and sampling is completed. Here, “sampling 23comp = l” indicates the center of the position mark 6, that is, the situation where K-1 K ′ is being crushed in FIG.

[0063] If it is determined in step SB14 that the number of samplings is not 23, the captured image data is determined not to be a position mark, and sampling 12comp is reset in step SB16. [0064] <Data sampling>

FIG. 16 is a flowchart showing an operation example of the data sampling process. Next, the sampling counter update and the data sampling process will be described. The sampled image data is sampled every sampling period Ts set in the register. In step SC1, reset the count value N of the sampling counter. In step SC2, the count value of the sampling period counter is reset.

[0065] At step SC3, while sampling EN = 0, the process returns to step SC1 to repeat resetting of the count value N of the sampling counter and the sampling period count. When sampling E N = l, the process proceeds to step SC4 and sampling cycle counting is started.

[0066] In step SC4, the sampling period counter is incremented. If it is determined in step SC5 that the sampling period Ts set in the sampled period force register is reached, the count value N of the sampling counter is incremented in step SC6.

[0067] When the count value N of the sampling counter is incremented in step SC6, it is determined in step SC7 whether sampling EN = 1 is set in the register. If it is determined in step SC7 that sampling EN = 0 is set, the process returns to step SC1 and

[0068] If it is determined in step SC7 that sampling EN = 1 is set, it is determined in step SC8 whether the count value N of the sampling counter is within 3-19. If it is determined in step SC8 that the count value N of the sampling counter is not within 3-19, the process returns to step SC2 and continues to count the sampling counter.

[0069] When it is determined in step SC8 that the count value N of the sampling counter is within 3-19, in step SC9, the sampling 4 times force converted from the captured image data into binary sampling data is also 20 times. The collected data is recorded in the sampling data S [3] S [l 9] of the register.

[0070] <Position mark position detection>

FIG. 17 is a flowchart showing an example of the operation of the position detection process. First, the overall operation of the ID detection process will be described. In step SD1, select `` Sampling EN

When it is determined that “Sampling 12comp = 1” has been established in Step SD2, the flow process of FIG. 17 is performed.

[0071] In step SD3, a position mark candidate is searched. The processing of step SD3 is described in detail in FIG. 19, but the position mark structure is searched from position data A12 and B12 whose number of samplings is recorded in step SB9 of FIG. 15 and the corresponding position mark is searched.

[0072] The ID of the position mark 6 is detected in step SD4, the horizontal position of the position mark is obtained in step SD5, the vertical position of the position mark is obtained in step SD6, and the non-corresponding candidate is deleted in step SD7.

[0073] The deletion of non-corresponding candidates can be performed by detecting the position mark data within the corresponding horizontal scan in the horizontal scanning feedback section after the processing of the maximum pixel (right end) of the two-dimensional image sensor 3a horizontal scanning described in FIG. Delete the missing position mark structure. However, the position mark whose structure status F is 1 11 is not deleted because detection is complete.

When the position of the position mark is detected by the above processing, sampling 12 comp force S is reset at step SD8, sampling 23comp force S is reset at step SD9, and sampling data is reset at step SD10.

[0075] <Search for position mark candidates>

FIG. 18 is an explanatory diagram showing the principle of detecting a position mark. To determine whether the sampling data is position mark data, as shown in Fig. 18, the position data whose sampling number is 12 is drawn by drawing a continuous trajectory for each scan. That is, in FIG. 18, horizontal scanning is performed sequentially from the upper left of the position mark 6, and the locus of the 12th position of the sampling pulse generated with the period obtained by the synchronization ring 7 is parabolic. Therefore, a search is performed to search for a position mark structure having a B12 component close to the horizontal strike position data with the 12th sampling number from the list of position mark structures.

FIG. 19 is a flowchart showing an example of operation of position mark candidate search processing. Next, details of processing for searching for position mark candidates will be described. In step SE1, the sampling cycle when the horizontal strike position data B12 is acquired is Ts and the position mark M mouth list is used for the 12th horizontal strike position data B12. If the horizontal scanning position data at the 12th sampling is B12m, search for a position mark structure with B12-Ts <B 12m and B12 + Ts, and status F is 000 or 010.

[0077] In step SE2, it is determined whether or not there is a corresponding position mark structure in the position mark M [] list. If a position mark structure that records horizontal anchor position data B 12m included between the front and rear soil Ts of the horizontal anchor position data B12 to be searched is found in step SE2, the highest status F status is detected in step SE3. Set the lower bit to 1. For example, in a position mark structure with a status F of 000, F = 001 is updated. In the position mark structure with status F 010, F is updated to 011.

[0078] If it is determined in step SE2 that there is no corresponding position mark structure between ± Ts before and after the horizontal running position data B12 to be searched, the data S [ll ] Is set to “0” with “1” set. That is, it is determined whether the data for the 12th sampling is black or white.

[0079] If it is determined in step SE4 that the data S [11] = 0, that is, the 12th sampling data is “white”, a new position mark structure is created in step SE5. . In this new position mark structure, the least significant bit of status F is set to 1.

[0080] The reason why it is determined in step SE4 whether the data at the twelfth sampling is black or white is that the start point of the continuous locus of position data when the sampling is the twelfth This is because the locus tracking of the position data whose sampling frequency is the 12th is started from the location where the data is “white” as the “white” location.

That is, if the data at the tracking start point of the position data whose sampling number is the 12th is “black”, the tracking start point of the position data is in the innermost ring 9 of the position mark 6, and this This is because the vertical position of the position mark 6 cannot be detected in the inner ring 9.

[0082] Therefore, if it is determined in step SE4 that the data S [ll] = l, that is, the number of sampling times is 1 and the second data is “black”, the vertical position of the position mark and the ID of the position mark are detected. The processing block for deleting the horizontal position of the position mark and the non-corresponding candidate is passed, and the position data of the 12th sampling recorded in the register is discarded. [0083] <Acquire ID data of position mark>

The ID data of the position mark can be acquired by scanning including the innermost ring 9 of the position mark 6 shown in FIG. 18, for example, KK ′ scanning. In the state of “sampling 23comp = l” indicating that the center of the position mark 6 has been scanned, the ID ring 8 data of the position mark 6 is symmetrical with respect to the center of the position mark 6. Confirm and get the ID data. This increases the accuracy of ID data acquisition.

FIG. 20 is a flowchart showing an operation example of position mark ID data acquisition processing. Next, details of ID acquisition processing will be described. First, in step SF1, a position mark structure in which the status F is 001, that is, the ID is not detected is searched in the position mark M mouth list.

[0085] If it is determined in step SF1 that there is a position mark structure with a status F of 001, it is determined in step SF2 whether sampling 23comp = l. If it is determined in step SF2 that the approximate center of the position mark 6 has been scanned, it is determined in step SF3 whether the 11th, 1st, and 13th data are both “black”.

[0086] In the present embodiment, the radius of the innermost ring 9 of the position mark 6 is composed of 1.5 sampling periods, so that the approximate center of the position mark 6, for example, the vicinity of the KK 'line in Fig. 18 is scanned. Then, the data at the 11th sampling, the data at the 12th sampling, and the data at the 13th sampling should both be “1”. Therefore, the ID detection accuracy is improved by confirming that both the 11th sampling force and 13th sampling data are “1” and the innermost ring 9 can be detected.

[0087] If it is determined in step SF3 that the innermost ring 9 has been detected, it is checked in step SF4 whether the data at symmetrical positions with respect to the innermost ring 9 are equal. In this step SF4, it is confirmed that the data force position mark 6 of the ID ring 8 is symmetrical with respect to the center of the position mark 6. For example, the fourth and twentieth sampling positions are symmetrical with respect to the innermost ring 9. In step SF4, if the ID ring 8 data is symmetrical with respect to the center of the position mark 6, IDdet = l is set as the ID acquisition status.

[0088] If it is determined in step SF5 that IDdet = 1 is set, the corresponding position mark structure Record body ID data, update status F to 011, and set IDcomp = l.

[0089] <Get horizontal position of position mark>

The center horizontal position of the position mark 6 is the center horizontal position data of the position mark 6 of the position trajectory in which the number of times of sampling in the innermost ring 9 is 12th. In addition, the confirmation of the innermost ring 9 of the position mark 6 and the conditions for ID detection are added to improve the position data detection reliability.

FIG. 21 is a flowchart showing an operation example of the position mark horizontal position acquisition process. Next, details of the process of acquiring the horizontal position of the position mark 6 will be described. Here, as described above, each ring of the position mark 6 is configured such that the center of the position mark 6 is the period of the synchronization ring 7 and the 12th position is the center of the position mark 6.

[0091] First, in step SG1, a position mark structure having a status F of 001 or 0011 is searched from the position mark M mouth list. That is, the target position mark structure in FIG. 19 is the target.

Next, in step SG2, it is determined whether or not IDcomp = 1 is set, that is, whether or not ID detection has been completed. If it is determined in step SG2 that IDcomp = 1 is set, it is determined in step SG3 whether or not the horizontal position data B12 at the 12th sampling is smaller than the horizontal position data Bl 2m of the position mark structure. In step SG3, if it is determined that the horizontal position data B12 whose sampling count is 12th is smaller than the horizontal position data Bl 2m of the position mark structure, the horizontal position data B12m of the position structure is searched in step SG4. Update to By this process, the position trajectory with the number of sampling times of 12 moves toward the minimum value of the horizontal position. Finally, the value of horizontal position data B12m is the minimum value of the horizontal position at the 12th sampling.

[0093] If it is determined in step SG3 that the horizontal position data Bl 2m force S of the position mark structure is equal to or less than the 12th horizontal position data B12, the sampling number is 12th in step SG5. It is determined whether or not the data at the time is “0”.

[0094] If it is determined in step SG5 that the data at the 12th sampling is “0”, that is, “white” is detected, the position locus of the 12th sampling is the innermost position mark 6. It will come out of the lap ring 9. Therefore, in step SG6, the horizontal position data Bl 2m is determined as the center horizontal position data CENTb of the position mark.

[0095] <Vertical position of position mark>

The vertical position of the center of the position mark 6 is obtained as an arithmetic average from the vertical positions of the upper and lower edges of the innermost ring 9. In addition, the confirmation of the innermost ring 9 of the position mark 6 and the conditions for ID detection are added to improve the position data detection reliability.

FIG. 22 is a flowchart showing an operation example of the vertical position acquisition process of the position mark. Next, details of the process of acquiring the vertical position of the position mark 6 will be described. First, in step SH1, a position mark structure with a status F of 001 or 011 is searched from the position mark M mouth list. In other words, the position mark structures that are candidates in FIG. 19 are targeted.

[0097] Next, in step SH2, whether IDcomp = l is set, that is, whether or not ID detection has been completed is determined. If it is determined in step SH2 that IDcomp = l is not set, it is determined in step SH3 whether the data at the 12th sampling is “1”.

[0098] If it is determined in step SH3 that the data at the twelfth sampling count is “0”, that is, a “white” portion has been detected, the upper vertical position data Ah is detected in step SH4 and the sampling count is 12. Update to the new vertical position data A12 for the second time. On the other hand, if it is determined in step SH3 that the data at the twelfth sampling time is “1”, that is, “black” is detected, the processing based on the corresponding vertical position data is passed.

In FIG. 18, the locus of the twelfth sampling before the ID is detected is shown in the upper right part of the position mark 6 by taking J 1] ′ scanning as an example. In the position trajectory where the number of sampling times is 1 in Fig. 18, the data S [11] where the number of sampling times is 12th is white (sampling data = 0). Update to A1 2 + 1, and update of position data is interrupted in the black part (sampling data = 1). As a result, the vertical position data is updated toward the innermost ring 9 of the position mark 6 and the vertical position data Ah of the uppermost ring 9 of the innermost ring 9 is determined at the position locus of the twelfth sampling. .

[0100] If it is determined in step SH2 that IDcomp = l is set, step SH5 Determine whether the data at the 12th pulling is “1”.

[0101] If it is determined in step SH5 that the data at the twelfth sampling is “1”, that is, “black” is detected, the vertical position data A1 of the lowermost inner ring 9 is detected in step SH6. Is determined to be greater than or equal to the camera vertical maximum value.

[0102] If it is determined in step SH6 that the lowermost vertical position data A1 of the innermost ring 9 is smaller than the camera vertical maximum value, that is, within the angle of view of the camera, the lowermost vertical position data is determined in step SH7. A1 is updated to the new vertical position data A12 when the sampling count is the 12th. As will be described later, when S [11] = 0 is detected, the lowermost vertical position A1 of the innermost ring 9 is determined.

[0103] If it is determined in step SH6 that the lowermost vertical position data A1 of the innermost ring 9 has reached the maximum value of the scanned image, the lowermost vertical position of the innermost ring 9 cannot be obtained. In step SI8, reset the least significant bit of status F of the position mark structure. This position mark structure is deleted in the non-corresponding candidate deletion flow of FIG. 23 described later.

[0104] If it is determined in step SH5 that the data when the number of sampling times is 12 is "0", that is, the portion of "white" is detected, the lower vertical position A1 of the innermost ring 9 is determined. Thus, the vertical position CENTa of the center of the position mark 6 is obtained in step SH9.

[0105] That is, by obtaining the average value of the upper eyelid vertical position Ah and the lower eyelid vertical position A1, the vertical position CENTa of the center of the position mark 6 can be obtained, and the upper eyelid vertical position Ah and the lower eyelid vertical position Set the average value of position A1 to the center vertical position CENTa.

[0106] Then, in step SH10, the status F of the corresponding position mark structure is set to 111.

Record the position mark ID and ID.

[0107] <Delete non-applicable candidate>

When horizontal scanning is performed up to the maximum pixel (right end) on an arbitrary line and the processing is completed, the position mark structure for which position mark data could not be detected in the corresponding horizontal scanning is deleted during the horizontal scanning feedback section. .

FIG. 23 is a flowchart showing an operation example of deletion processing of a non-corresponding candidate. Next, details of processing for deleting a non-corresponding candidate will be described. First, in step SJ1, the horizontal scanning feedback section In step SJ2, in the position mark M [] list, the least significant bit of status F is "0", that is, the position mark structure with status F of 000 and status F of 010. Delete the position mark structure. As a result, the position mark structure for which position mark data could not be detected during the corresponding horizontal scan is deleted.

[0109] Further, in order to process the position mark data for the horizontal scanning of the next line, in step SJ3, the status mark of the position mark structure of status mark 001 and 011 in the position mark M list port is displayed. Reset the least significant bit. However, for the position mark structure whose status F is 111, the position mark position and ID have been detected, so the status F of the corresponding position mark structure is unchanged.

[0110] The center positions and IDs of a plurality of position marks can be acquired by the processes shown in FIGS. 15, 17 and 19 and 23 described above.

Returning to FIG. 11, in step SA5, two or more position marks 6 close to the target position are selected from the plurality of position marks 6 for which the center position and the ID have been acquired. In other words, a position mark structure having a status F of 111 is searched, and two or more position marks close to the coordinates of the target position on the image data in which the vertical position CENTa and the horizontal position CENTb are set in advance are selected.

[0112] FIG. 24 is an explanatory diagram showing an example of selecting a position mark. When the position mark 6 has the arrangement shown in FIG. 5, for example, the position mark 6 of ID (1, 2) and the ID (1, 3) The position mark 6 is selected. In the AB coordinate system, which is the camera coordinate system, the coordinates of the target position T are (a, b). If the center vertical position of the position mark 6 of ID (l, 2) is CENTa and the horizontal center position is CENTb, the A coordinate of the target position T when the position mark 6 of ID (1, 2) is the origin is Al. = a -CENTa, B coordinate is Bl = b—CENTb.

[0113] In this example, the position of the two-dimensional image sensor 3a is asynchronous with the scanning of the display 2, and therefore, some position marks may not be captured in the captured image data. If there is only one position mark 6 for which the center position and ID can be obtained, the process ends.

[0114] In step SA6, the camera coordinate system is converted into a position pattern coordinate system using the center positions and IDs of two or more position marks selected in step SA5. FIG. 25 is an explanatory diagram showing an example of coordinate conversion, and an example when two position marks 6 are detected will be described. This example Use when the shooting distance between display 2 and position detection terminal 3 is sufficiently large compared to the distance between position marks 6 on spray 2. The coordinate system with one of the recorded position marks 6 as the origin is the CD coordinate system. The CD coordinate system is a coordinate system in which the position pattern coordinates XY shown in Fig. 7 are translated.

[0115] When M is the same between the origin position mark 6 and the ID [L, M] of the other position mark 6 and there is a change in L, the axis passing through the center of the two position marks is set as the C coordinate axis. The axis that is perpendicular to the C coordinate and passes through the origin position mark 6 is the D coordinate axis.

[0116] When L is the same between IDs [L, M] and there is a change in M, the axis passing through the center of the two position marks is set as the D coordinate axis. The axis that is perpendicular to the D coordinate and passes through the origin position mark 6 is the C coordinate axis. If both L and M change between IDs [L, M], the C and D coordinate axes are determined according to the difference between L and M for both position marks.

Then, the target position T expressed by the camera coordinates A and B shown in FIG. 24 is converted into C and D coordinates passing through the position mark 6. The scale of the CD coordinate system is the pitch of the position mark 6 developed on the C and D coordinates, and is markP, which is the position mark interval on the position pattern coordinates. While maintaining the positional relationship between the target position T and the position mark 6, the target position T is converted to the CD coordinate system, which is the AB coordinate system force position pattern coordinate, which is the camera coordinate.

[0118] For example, the target position T (A1

, B1) is a position pattern coordinate with coordinate scale adjustment at the position mark interval

Approximate as target position T (c, d) in CD coordinate system.

[0119] Although not shown, if 4 position marks can be detected and L and m of each position mark ID [L, M] are different, perform 3D calculation and use one position mark as the origin. The position of the target in the C, D coordinate system can be obtained.

In step SA7, as shown in FIG. 7, the position of the position mark center and the target position T (x, y) on the position T (c, d) force position pattern coordinates are obtained.

[0121] where

T (x, y): Target position on the display 2 position pattern image

offset y: Horizontal position mark start position offset x: Vertical position mark start position

markPP: Position mark pixel interval

ID (Io): ID of the position mark at the coordinate origin of the target position (c, d)

Vertical number

ID (mo): ID of the position mark at the coordinate origin of the target position (c, d)

Horizontal number

d: Target horizontal position from the position mark of ID (Io, mo) c: Target vertical position from the position mark of ID (Io, mo).

[0122] The target position is obtained by the following equations (1) and (2).

y = offset y + markPP X ID (mo) + ά

x = offset x + markPP X ID (Io) + c---(2)

In step SA8, the target position data T (x, y) obtained by the position detection terminal 3 is transferred to the main body. In step SA9, the processor 4a of the apparatus body 4 executes the application program corresponding to the target position data T (x, y).

[0123] In the above-described example, the position marks 6 are arranged at equal intervals. However, when the position marks 6 are arranged in a pine pattern, the position marks 6 are arranged in high density, and the position detection accuracy is improved.

As a modification of the above-described position detection system, it is possible to reduce the detection of visual position marks by inserting a position pattern image that is black and white inverted immediately after the position pattern image is inserted.

[0125] As a modification of the position pattern image 5, the position pattern image 5 is inserted into the average brightness of the image immediately before the position pattern image 5 is inserted and the average brightness of the position pattern image 5 is inserted. The detection of the correct position mark 6 can be reduced.

[0126] Further, as a modification of the position pattern image 5, several frames of an image obtained by multiplexing each position mark 6 constituting the position pattern image are inserted into the image immediately before the insertion of the position pattern image is instructed. Display on display 2. This display is imaged by the camera 3g of the position detection terminal 3, and based on the captured image data immediately before the position mark is inserted, the data with the frame correlation is removed from the multiplexed image of the position mark 6, and the position mark 6 Play the data By using imaging data, the detection of the visual position mark 6 can be further reduced.

[0127] Further, since it is not necessary to send and receive a synchronization signal between the position detection terminal 3 and the apparatus body 4, commands and position data can be transferred wirelessly such as Bluetooth communication.

FIG. 26 shows a modification of the position mark. For example, the synchronization ring 7 is a blue ring, the ID ring 8 is a green ring, the innermost ring 9 is a red ring, and the position detection terminal 3 uses a color sensor as a two-dimensional image sensor. The detection accuracy of mark 6 is improved. In addition, immediately after the color position mark is inserted, a color position mark composed of complementary colors can be inserted to reduce visual position mark detection.

[0129] The present invention captures a position pattern image composed of circular position marks and detects the position indicated by the position indicating means, so that high position detection accuracy is maintained regardless of the direction of the position indicating means. be able to.

[0130] In addition, even when the screen size of the display means is changed, or when the distance between the screen and the position indicating means changes, the position mark arrangement such as the size of the diameter of the position mark and the number of display marks is displayed. By changing the position detection accuracy can be maintained.

[0131] Furthermore, since the position detection is performed by photographing the position pattern image displayed on the display means, high-precision position detection can be performed without selecting the scanning method of the display means, and a display using a liquid crystal display or a cathode ray tube It is possible to operate with various display means.

[0132] Even when the image size is changed by image processing in the display means, the position pattern image is simply displayed as an image, so the position can be detected by photographing with the photographing means. . And since the synchronization signal is not used, the position indicating means can be wireless. By configuring the position pattern image as a screen with a black background, the luminance change of the inserted image can be suppressed to a minimum, and the user does not feel uncomfortable.

Industrial applicability

[0133] The present invention is a system that uses a large-screen display means by a projector, and enables position designation using a laser pointer and processing according to the designated position.

Claims

The scope of the claims

[1] A position detection system comprising: a display unit that displays an image; and a position instruction unit that points to an arbitrary position of the image displayed on the display unit, and obtains the position of the image pointed to by the position instruction unit. Les

A plurality of position marks formed by combining concentric circular rings with different diameters are arranged on the entire surface of the designated angle of view, and each position mark displays a position pattern image having unique position information on the display means. Display control means;

Display instruction means for instructing insertion of the position pattern image into the image displayed on the display means;

An imaging unit provided in the position instruction unit, for imaging a predetermined range indicated by the position instruction unit;

Calculating means for detecting position information of the plurality of position marks from the image data photographed by the photographing means and obtaining positions indicated by the position indicating means from the position information of the plurality of position marks;

A position detection system comprising:

[2] The display control means multiplexes and displays each position mark constituting the position pattern image on the image immediately before the insertion of the position pattern image is instructed.

The position detection system according to claim 1, wherein:

[3] Provided with adjusting means for changing the arrangement of position marks displayed in the position pattern image

The position detection system according to claim 1, wherein:

[4] The adjusting means changes the arrangement of the position marks according to the distance between the position indicating means and the display means.

The position detection system according to claim 3.

[5] The adjustment unit changes the arrangement of the position marks according to the size of the image displayed on the display unit.

The position detection system according to claim 3.

[6] The calculation means may calculate the corresponding position from the image data scanned near the center of the position mark. Detect position information

The position detection system according to claim 1, wherein:

[7] In the position pattern image, the position marks are arranged at equal intervals in the vertical and horizontal directions.

The position detection system according to claim 1, wherein:

[8] The position mark has a synchronization ring for generating a sampling pulse on the outer periphery, a code ring indicating the position information on the inner side of the synchronization ring, and a center ring for specifying a center position on the innermost periphery. Have

The position detection system according to claim 1, wherein:

[9] The arithmetic means confirms the symmetry of the code ring with respect to the center ring, and detects position information.

The position detection system according to claim 8, wherein:

[10] The calculation means generates the synchronous ring force sampling pulse, and detects the code ring and the center ring at a cycle of the sampling pulse.

The position detection system according to claim 8, wherein:

[11] The calculation means detects the position of the position mark from image data that scans the center ring.

The position detection system according to claim 8, wherein:

12. The position detection system according to claim 1, wherein the position pattern image is displayed with a white ring on a black background.

[13] The position pattern image is multiplexed with the position pattern image and the position pattern image is multiplexed to remove the frame-correlated data from the photographed image immediately before the insertion and reproduce the position pattern.

The position detection system according to claim 2, wherein:

[14] The average luminance of the position pattern image is adjusted to the average luminance of the image immediately before the insertion of the position pattern image.

The position detection system according to claim 1, wherein:

[15] The display means is a flat panel display.

The position detection system according to claim 1, wherein: