CN101116608B - Image display device - Google Patents

Image display device Download PDF

Info

Publication number
CN101116608B
CN101116608B CN2007101431724A CN200710143172A CN101116608B CN 101116608 B CN101116608 B CN 101116608B CN 2007101431724 A CN2007101431724 A CN 2007101431724A CN 200710143172 A CN200710143172 A CN 200710143172A CN 101116608 B CN101116608 B CN 101116608B
Authority
CN
China
Prior art keywords
image
pathological changes
mentioned
display
hemorrhage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN2007101431724A
Other languages
Chinese (zh)
Other versions
CN101116608A (en
Inventor
平川克己
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Medical Systems Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2006240384A external-priority patent/JP4914680B2/en
Application filed by Olympus Medical Systems Corp filed Critical Olympus Medical Systems Corp
Publication of CN101116608A publication Critical patent/CN101116608A/en
Application granted granted Critical
Publication of CN101116608B publication Critical patent/CN101116608B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A device for displaying in vivo images picked up inside a subject in a time series. The device automatically detects lesion images contained in all in vivo images picked up over the time series. The device displays an elongated display area having a time scale assigned along a longitudinal direction thereof and an indicator which moves along the time scale to indicate a time position in the time scale which corresponds to a current in vivo image currently displayed in a main display area. In response to a detection of the lesion image, the device makes pixels located at a time position in the elongated display area which position corresponds to the lesion image to emit light in a predetermined pixel-display mode. The display mode of the indicator is controlled in response to information on a lesion that is possible to be contained in the current in vivo image.

Description

Image display device
Technical field
The present invention relates to the display image device of a kind of demonstration along each image that comprises in the tested intravital group of pictures of time series shooting.
Background technology
In the past, in the endoscope field, proposition possesses the capsule type endoscope of the deglutition type of camera function and radio communication function, has developed the in-examiner information acquisition system that the internal organs inside of this capsule type endoscope importing subject is obtained the group of pictures of internal organs inside.For observe (inspection) internal organs inner and from patient's subject of etc.ing mouthful swallowable capsule type endoscope.Afterwards, capsule type endoscope is during till discharging naturally from subject, move in internal organs inside such as stomach, small intestinals according to wriggling, and for example 0.5 second to serve as the image (below be sometimes referred to as tested intravital image) of taking subject internal organs inside at interval along time series successively.
Capsule type endoscope the internal organs inside of subject move during, the image of the internal organs inside of being taken by this capsule type endoscope is sent to reception device external successively by radio communication.This receiving system has reception antenna and storage medium, receives from the image of the internal organs inside that above-mentioned capsule type endoscope sends, and the image of the internal organs inside that receives is saved in the storage medium successively.Subject is by carrying above-mentioned receiving system, can be till discharging to nature after the swallowable capsule type endoscope whole during action freely.
After capsule type endoscope is discharged naturally from subject, the group of pictures that user such as doctor or nurse will be kept at the internal organs inside in the storage medium of above-mentioned receiving system is taken into image display device, shows the group of pictures of internal organs inside on the display of this image display device successively.The user can observe the tested intravital group of pictures that is presented in the above-mentioned image display device successively, carries out the diagnosis (for example, opening the 2003-19111 communique with reference to the spy) of this subject.
In this image display device, show the time bar of capsule type endoscope along all time locations of time series internal organs internal image of taking and the group of pictures of representing internal organs inside, in above-mentioned internal organs internal image group, comprise under the situation of bleeding part image (below be called hemorrhage image), the labelling of time location of the above-mentioned hemorrhage image of expression is attached on the time bar (for example, opens the 2004-337596 communique) with reference to the spy.The image display device of record detects the color information of the group of pictures of internal organs inside in this patent documentation 2, according to detected color information, detects hemorrhage image from the group of pictures of this internal organs inside.Above-mentioned image display device is with like this from the group of pictures of internal organs inside on the position on the detected hemorrhage image time corresponding bar, shows the labelling (below be sometimes referred to as the pathological changes labelling) of this hemorrhage image temporal position of expression.User such as doctor or nurse is presented at pathological changes labelling on the above-mentioned time bar by observation, can infer easily that the hemorrhage image that comprises in the group of pictures of internal organs inside is the image of taking in tested intravital which internal organs.
On the other hand, also have following image display device: the pictorial display of the bleeding part that will extract out from tested intravital group of pictures is in the viewing area, and near the image of this bleeding part, show the labelling of regulation, the meaning that the current image that is presented in the viewing area is the bleeding part image is informed users such as doctor or nurse.
In addition, common pixel group by the shape that is arranged in a straight line forms above-mentioned time bar.Form 1 interior pixel of pixel group of above-mentioned time bar, representative is presented at the consecutive image group of each the specified image quantity that comprises in the group of pictures of the internal organs inside in the image display device successively.For example, by 1000 pixel formation time bars that are arranged as linearity, represent that at the time of above-mentioned 1000 pixels bar 1 pixel of the time bar of above-mentioned 1000 pixels is represented 60 consecutive image groups that comprise in the group of pictures of 60,000 internal organs inside under the situation of the time location that the group of pictures of 60,000 internal organs inside being taken by capsule type endoscope is all.
Be attached to labelling on the above-mentioned time bar and only represent to represent the time location of the tested intravital parts of images group's who comprises hemorrhage image image.Therefore, following problem is arranged: slide block is moved under the locational situation of additional labelling on the above-mentioned time bar, and whether the some of parts of images group that is difficult to determine to be presented in the viewing area is hemorrhage image.
In addition, near the current hemorrhage image that is presented in the above-mentioned viewing area, append and to have shown that expression is under the situation of labelling of the meaning of hemorrhage image, this labelling enters users' such as doctor or nurse visual angle and flicker, may hinder to observe the tested intravital image that is presented in the above-mentioned viewing area.
On the other hand, the time location on this time bar (that is, with 1 position that pixel is corresponding of time bar) is gone up the pathological changes labelling that shows, represents the interior hemorrhage image more than 1 of 60 consecutive image groups of 1 pixel representative of above-mentioned time bar.That is, in above-mentioned 60 consecutive image groups, comprise at least under the situation of 1 hemorrhage image, irrespectively similarly show this pathological changes labelling with this hemorrhage amount of images.Therefore, following problem is arranged: by above-mentioned pathological changes labelling, can understand the time location of the hemorrhage image that comprises in the group of pictures of internal organs inside, but the distribution of the locational hemorrhage amount of images of All Time of the group of pictures of indigestion internal organs inside.
Summary of the invention
According to the present invention, utilize to show according to time series and take in the subject and the image display device of the in-vivo image that obtains solves above-described problem.This image display device possesses: image detection portion, and it detects the pathological changes image that comprises as in all whole in-vivo images of in-vivo image; The basis display part, its demonstration: the elongated viewing area and the indicator of having distributed the time series time corresponding position during the whole photography with whole in-vivo images in the longitudinal direction, this indicator moves along the length direction of above-mentioned viewing area, represents among whole in-vivo images and the current time location that is presented on the corresponding above-mentioned elongated viewing area of current in-vivo image on the main viewing area; The pathological changes display part, it detects under the situation of pathological changes image in image detection portion, make in above-mentioned elongated viewing area, be in the locational above-mentioned elongated viewing area of pathological changes image time corresponding on pixel luminous with the pattern of regulation; And display control unit, its according to the relevant information of pathological changes of current in-vivo image, the Show Styles of above-mentioned indicator is changed.
In illustrated embodiments, this image display device comprises: the icon display part, it shows below icon, this icon can allow user about the current current in-vivo image that is presented on the main viewing area, send with picture divide a word with a hyphen at the end of a line, play continuously, contrary picture is divided a word with a hyphen at the end of a line, contrary each display packing of playing continuously is corresponding demonstration indication; The in-vivo image display part, it is in response to an operation of icon, carries out demonstration to above-mentioned main viewing area with the display packing corresponding with operated icon; And mode selection part, it can allow user select whole in-vivo images as the ordinary playing pattern of display object or only with the pathological changes play mode of pathological changes image as display object, the in-vivo image display part comprises as lower unit: under the situation of having selected the ordinary playing pattern, with the object of whole in-vivo images as action, under the situation of having selected the pathological changes play mode, from whole in-vivo images, extract the pathological changes image out, only with the pathological changes image extracted out object as action.
And, the basis display part preferably includes as lower unit: under the total A of the whole in-vivo images situation greater than the pixel count L of the length direction of above-mentioned elongated viewing area, make and cut apart above-mentioned total A with above-mentioned pixel count L and obtain, L the consecutive image group who is made of successive in-vivo image is corresponding with the time location of the L of the length direction of above-mentioned elongated viewing area, with the above-mentioned consecutive image group time corresponding position that comprises current in-vivo image on display indicator; the pathological changes display part possesses pathological changes labelling display part; this pathological changes labelling display part is for each time location of number L, makes pixel column on this time location that is in above-mentioned elongated viewing area according to the number of the pathological changes image among the consecutive image group corresponding with this time location and luminous quantitatively.
Except more than, various favourable (advantageous) technical features are disclosed.
Use accompanying drawing, according to describing the next clear and definite above-described situation of following invention and other purposes of the present invention, feature, advantage in detail.
Description of drawings
Fig. 1 carries out illustrative sketch map with a structure example with in-examiner information acquisition system of the image display device relevant with embodiments of the present invention 1.
Fig. 2 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 1.
Fig. 3 is the sketch map of a concrete example of the Show Styles of expression display part.
The flow chart of the processing procedure of Fig. 4 control part that to be illustration detect the a kind of pathological changes image that comprises in the tested intravital group of pictures.
Fig. 5 is the flow chart of processing procedure of the control part of the explanation image display device relevant with embodiment 1.
Fig. 6 is the sketch map of action that is used to illustrate the control part of the pathological changes color that the demonstration complexion changed of slide block is more corresponding with the bleeding part.
Fig. 7 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 2.
Fig. 8 is the sketch map of the Show Styles of the illustration display part that shows a plurality of pathological changes labellings with the pathological changes color different by the kind of pathological changes.
The flow chart of the processing procedure of Fig. 9 control part that to be illustration detect the multiple pathological changes image that comprises in the tested intravital group of pictures.
Figure 10 is the flow chart of processing procedure of the control part of the explanation image display device relevant with embodiment 2.
Figure 11 is the sketch map that is used to illustrate the control part action of the pathological changes color that demonstration complexion changed with slide block is more hemorrhage or fade.
Figure 12 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 3.
Figure 13 is that illustration further shows the sketch map as the Show Styles of the display part of the pathological changes selection portion of the GUI that selects the expectation pathological changes.
Figure 14 is the sketch map of expression by a concrete example of the choice menus shown in the pathological changes selection portion.
Figure 15 is the flow chart of processing procedure of the control part of the explanation image display device relevant with embodiment 3.
Figure 16 be used to illustrate will be corresponding with the object pathological changes the pathological changes labelling and the sketch map of the action of the control part that shows of the pathological changes color of slide block.
Figure 17 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 4.
Figure 18 is that illustration further shows the sketch map as the Show Styles of the display part of the mode selection part of the GUI that selects image display mode.
Figure 19 is the processing procedure of the control part of the control of pathological changes image in main viewing area shows subject is carried out in explanation according to the pathological changes play mode a flow chart.
Figure 20 is used for illustrating showing the sketch map of action that the object pathological changes in the multiple pathological changes image is included in the control part of the pathological changes image in the subject in main viewing area.
Figure 21 is the sketch map of a structure example of the in-examiner information acquisition system of illustration with image display device relevant with embodiments of the present invention 5.
Figure 22 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 5.
The sketch map of the displaying contents of the display part of Figure 23 image display device that to be illustration relevant with embodiment 5.
Figure 24 is the sketch map that the display control unit of the expression image display device relevant with embodiment 5 is presented at a concrete example of the pathological changes labelling on the labelling display part.
The flow chart of the processing procedure of Figure 25 control part that to be illustration detect the more than one hemorrhage image that comprises in the tested intravital group of pictures.
Figure 26 is that expression is carried out showing the flow chart of an example of processing procedure of the control part of the control that the pathological changes labelling of color shows accordingly with having count results with hemorrhage image.
Figure 27 is used to specifically describe carry out the sketch map of action that shows the display control unit of the control that the pathological changes labelling of color shows accordingly with hemorrhage picture number with having.
Figure 28 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 6.
The sketch map of the displaying contents of the display part of Figure 29 image display device that to be illustration relevant with embodiment 6.
Figure 30 is the sketch map that the display control unit of the expression image display device relevant with embodiment 6 is presented at a concrete example of the pathological changes labelling on the labelling display part.
Figure 31 is that expression is carried out showing the flow chart of an example of processing procedure of the control part of the control that the pathological changes labelling of size shows accordingly with having count results with hemorrhage image.
Figure 32 is used to specifically describe carry out the sketch map of action of display control unit that shows the control that shows of pathological changes labelling of size accordingly with hemorrhage picture number with having.
Figure 33 is that illustration will have with the pathological changes labelling group of the corresponding Show Styles of pathological changes picture number and is changed to the sketch map of displaying contents of the display part of the image display device that the slide block of pathological changes color shows.
The specific embodiment
Below, with reference to the preferred forms of the accompanying drawing detailed description image display device relevant with the present invention.In addition, this embodiment does not limit the present invention.
Embodiment 1
Fig. 1 is the sketch map of a structure example of the in-examiner information acquisition system of illustration with image display device relevant with embodiments of the present invention 1.As shown in Figure 1, the in-examiner information acquisition system relevant with embodiments of the present invention 1 possesses: capsule type endoscope 2, and it takes the image in subject 1; Receiving system 3, it receives the image in the subject of being taken by capsule type endoscope 21; Image display device 4, it shows the image in the received subject 1 of receiving system 3; And pocket recording medium 5, it is used to carry out the exchanges data between above-mentioned receiving system 3 and the image display device 4.
Capsule type endoscope 2 is used to take tested intravital image (internal organs internal image specifically).This capsule type endoscope 2 has the inside that imports subject 1 and takes the camera function of the image in the subject 1 and the radio communication function that the group of pictures in the subject of taking 1 is wirelessly sent to reception device external 3 successively by the time sequence.Specifically, after capsule type endoscope 2 is swallowed by subject 1, move in the internal organs inside of this subject 1 according to the internal organs wriggling in this subject 1 etc.Meanwhile, capsule type endoscope 2 is for example taken image in the subject 1 in 0.5 second interval one by one with predetermined distance, will comprise that the wireless signal of the image in the subject 1 of shooting sends to receiving system 3 one by one.
Receiving system 3 is connected with for example a plurality of reception antenna 3a～3h of decentralized configuration on the body surface of subject 1, by the wireless signal of any reception among above-mentioned a plurality of reception antenna 3a～3h from capsule type endoscope 2.Then, receiving system 3 obtains the group of pictures in the subject 1 according to the wireless signal from capsule type endoscope 2 that receives.In addition, receiving system 3 can insert with mounting and dismounting installs pocket recording medium 5, will be kept in the pocket recording medium 5 by the subject 1 interior group of pictures that capsule type endoscope 2 is taken.In this case, receiving system 3 will represent each image of comprising in the group of pictures in the above-mentioned subject 1 shooting constantly or each interior pixel of the temporal information of time of reception etc. and this group of pictures be saved in accordingly in the pocket recording medium 5.
Reception antenna 3a～3h for example uses loop aerial to realize, receives the wireless signal that is sent by capsule type endoscope 2.As shown in Figure 1, the assigned position of reception antenna 3a～3h decentralized configuration on the body surface of subject 1, for example on the position corresponding with the mobile route (being digestive tube) of capsule type endoscope 2 in the subject 1.In addition, reception antenna 3a～3h also can decentralized configuration on the assigned position of the jacket that subject 1 is dressed.In this case, by dressing this jacket, reception antenna 3a～3h is configured on the assigned position on the body surface of the subject 1 corresponding with the mobile route of capsule type endoscope 2 in the subject 1 by subject 1.As long as to this reception antenna of subject 1 configuration more than 1, its configuration quantity is not particularly limited in 8.
Pocket recording medium 5 is compact flash (コ Application パ Network ト Off ラ Star シ ユ) portable recording mediums such as (registered trade marks).Pocket recording medium 5 can mount and dismount with respect to receiving system 3 and image display device 4, has both are inserted the structure that can carry out data output and record when installing.Specifically, insert under the situation about being installed on the receiving system 3, preserve the group of pictures in the received subject 1 of receiving system 3 and the various data such as temporal information of each image one by one at pocket recording medium 5.On the other hand, insert under the situation about being installed on the image display device 4, the preservation data of the group of pictures in the subject 1 and the temporal information of each image etc. are outputed to image display device 4 at pocket recording medium 5.Like this, the preservation data with above-mentioned pocket recording medium 5 are taken into image display device 4.In addition, by image display device 4 patient information relevant with the subject 1 that imports capsule type endoscope 2 etc. is written to pocket recording medium 5.
Image display device 4 is used to show the image in the subject of being taken by capsule type endoscope 21 etc.Specifically, image display device 4 has such structures such as following work station: described work station is by being taken into the preservation data of above-mentioned pocket recording medium 5, obtain the various data such as group of pictures in the subject of taking by capsule type endoscope 21, show each image that comprises in the group of pictures in the above-mentioned subject 1.This image display device 4 has following processing capacity: the user who is used to make doctor or nurse etc. observes (inspections) thereby the image in the subject 1 is diagnosed subject 1.In this case, the user shows successively that on image display device 4 image in the subject 1 observes organism part for example esophagus, stomach, small intestinal and the large intestine etc. in (inspection) subject 1, can diagnose subject 1 in view of the above.
The structure of the image display device 4 relevant with embodiments of the present invention 1 then, is described.Fig. 2 is the block diagram that schematically shows a structure example of the image display device 4 relevant with embodiments of the present invention 1.As shown in Figure 2, the image display device 4 relevant with this embodiment 1 has: input part 11, and it imports various information; Display part 12, it is with the image in the subject 1 and GUI (Graphical User Interface: graphic user interface) wait and carry out the picture demonstration; And clamping mouth (I/F) 13, it reads the preservation data (group of pictures in the subject 1 etc.) of pocket recording medium 5.In addition, image display device 4 has: storage part 14, and it preserves the various data such as group of pictures of subject 1; And control part 15, each structural portion of its control image display device 4.
Input part 11 uses input equipments such as keyboard and mouse to realize, imports various information by user's input operation to control part 15.For example, input part 11 is input to control part 15 with various indication informations that control part 15 is indicated, patient information relevant with subject 1 etc.In addition, the patient information by above-mentioned input part 11 inputs for example is patient's name, sex, birthdate and the patient ID etc. of subject 1.
The display that display part 12 uses CRT monitor or liquid crystal display etc. can carry out pictorial display realizes that demonstration is shown the various information of indication etc. by control part 15.Specifically, display part 12 show the various information that are used to observe subject 1 and diagnose, the group of pictures in the subject 1 for example taken by capsule type endoscope 2 etc.In addition, display part 12 show with the interior group of pictures of above-mentioned subject 1 in the relevant GUI of demonstration of each image of comprising.This display part 12 has the main viewing area 100 that shows each image that comprises in the group of pictures in the above-mentioned subject 1.In addition, display part 12 has: time bar 110, the temporal position (time location) of each image that comprises in the group of pictures in its expression subject 1; And slide block 111, the time location of the image (current display image) in the current subject 1 that is presented in the main viewing area 100 of its expression.And display part 12 has the labelling display part 120 of lesions showed labelling, and described pathological changes labelling is represented the time location of the pathological changes image that comprises in the group of pictures in the above-mentioned subject 1.
Card I/F13 can insert with mounting and dismounting above-mentioned pocket recording medium 5 is installed, and read the preservation data of above-mentioned pocket recording medium 5, and the preservation data that will obtain is transferred to control part 15.In addition, the pocket recording medium 5 of 13 pairs of insertion installations of card I/F writes by control part 15 and writes the information of indication, the patient information of for example subject 1 etc.
Storage part 14 uses jumbo recording mediums such as RAM, EEPROM or hard disk to realize, preserves the various data etc. that write indication by control part 15, will send to control part 15 by the preservation data that control part 15 has carried out reading indication.This storage part 14 is preserved the patient information of all (hereinafter referred to as whole in-vivo image AI), demonstration color information CL1 and the subject 1 of the image in the subject of being taken by capsule type endoscope 21, wherein, described demonstration color information CL1 is used to set the demonstration color of the demonstration normal complexion slide block 111 of the pathological changes labelling that the labelling display part 120 by display part 12 shows.In this case, in each image in the whole in-vivo image AI that preserve in above-mentioned storage part 14, the temporal information of the shooting moment or the time of reception etc. is corresponding respectively.
Each structural portion of control part 15 control image display devices 4.Specifically, control part 15 is controlled input part 11, display part 12, card I/F13 and storage part 14 respectively, controls the input and output of the information between above-mentioned each structural portion.This control part 15 from insertion be installed to pocket recording medium 5 the card I/F13 obtain whole in-vivo image AI and with these whole in-vivo image AI in the corresponding temporal information of each image.Control part 15 is kept at storage part 14 with above-mentioned whole in-vivo image AI and temporal information accordingly by each image.Control part 15 is according to the indication information by input part 11 inputs, with each pictorial display of comprising in the group of pictures in the above-mentioned subject 1 main viewing area 100 at display part 12.
This control part 15 has display control unit 15a and the 15b of lesion detection portion.Display control unit 15a carries out following control: will be kept at each pictorial display of comprising among the whole in-vivo image AI in the storage part 14 main viewing area 100 to display part 12.In this case, if comprise the pathological changes image in above-mentioned whole in-vivo image AI, then display control unit 15a carries out the control of pathological changes pictorial display in the main viewing area 100 of display part 12 in the above-mentioned subject 1.In addition, display control unit 15a is presented in the labelling display part 120 of display part 12 the pathological changes labelling of the time location of the pathological changes image in the whole in-vivo image AI of expression.In this case, display control unit 15a carries out following control: be kept at the pathological changes color that the demonstration color information CL1 in the storage part 14 sets, lesions showed labelling with utilization.
In addition, display control unit 15a controls the demonstration color of the slide block 111 of display part 12 according to the demonstration color information CL1 that is kept in the storage part 14.Specifically, in main viewing area 100 the current display image of current demonstration be subject 1 normal internal organs image (promptly, do not find the image in the subject 1 of pathological changes) situation under, display control unit 15a carries out following control: with the acquiescence color show expression deserve before the slide block 111 of time location of display image.On the other hand, the current display image of current demonstration is that display control unit 15a carries out following control under the situation of pathological changes image of subject 1 in main viewing area 100: the demonstration color of slide block 111 of time location that will represent this pathological changes image is from acquiescence complexion changed pathological changes color more.
In addition, said here pathological changes image is that the hemorrhage diseased region that waits is included in image in the subject 1 in the subject.In addition, the acquiescence color of above-mentioned slide block 111 is as the demonstration color of slide block 111 and the color of initial setting (for example Lycoperdon polymorphum Vitt etc.), the above-mentioned slide block 111 and the pathological changes color of pathological changes labelling be with subject 1 in the corresponding color of pathological changes of pathological changes graphical representation, be and the different color of acquiescence color.For example, under the situation of the image (hereinafter referred to as hemorrhage image) that above-mentioned pathological changes image is the bleeding part, as with as the corresponding pathological changes color in a kind of bleeding part of this pathological changes and set redness.Set this acquiescence color and pathological changes color by the demonstration color information CL1 that is kept in the storage part 14.
The 15b of lesion detection portion detects the pathological changes image that comprises among whole in-vivo image AI.Specifically, the 15b of lesion detection portion detects the color information of the image of the process object that comprises among whole in-vivo image AI, according to the color information of detected image, judges whether the image of this process object is the pathological changes image.In addition, as color information, for example can enumerate the value etc. of the key element of all kinds of the average color of image, red (R), green (G) that form image, blue (B) by the detected image of the above-mentioned lesion detection 15b of portion.At the image that is judged as this process object is under the situation of pathological changes image, and the 15b of lesion detection portion detects this pathological changes image from whole in-vivo image AI.The 15b of lesion detection portion handles the detection that whole in-vivo image AI carry out this pathological changes image, detects the pathological changes image that comprises among these whole in-vivo image AI.Under the situation of the pathological changes image of the 15b of lesion detection portion in detecting these whole in-vivo image AI, be that the signature (pathological changes sign) of the meaning of pathological changes image appends on this detected pathological changes image with expression.The pathological changes image that has added above-mentioned pathological changes sign is saved to storage part 14 as the part of whole in-vivo image AI.
Then, the Show Styles of illustration display part 12 particularly illustrates the GUI that shows in the display part 12 and the action of display control unit 15a that the display action of display part 12 is controlled.Fig. 3 is the sketch map of a concrete example of the Show Styles of expression display part 12.Under the situation of the location registration process of having been carried out regulation by control part 15, display control unit 15a is presented at window W1 as shown in Figure 3 on the display part 12.
As shown in Figure 3, in window W1, form above-mentioned main viewing area 100, time bar 110, slide block 111 and labelling display part 120.In addition, in window W1, form: display operation icon group 130, the various display operations when it is used to carry out show image in the subject 1 on main viewing area 100; Secondary viewing area 140, the downscaled images of the desired image of selecting in the group of pictures in the subject 1 of its demonstration from be presented at main viewing area 100; And rolling operation portion 141, it is used for being presented at the rolling operation of a plurality of downscaled images of secondary viewing area 140.In addition, in window W1, form: cursor K, it is used for carrying out the clicking operation of various GUI or drag operation etc. by the operation of input part 11; And close icon 150, it is used to close above-mentioned window W1.
Main viewing area 100 is the image display area that show each image that comprises among whole in-vivo image AI of display process object.Display control unit 15a carries out the control of each pictorial display in whole in-vivo image AI in main viewing area 100 according to the indication information by input part 11 inputs.By the control of above-mentioned display control unit 15a, the image P that main viewing area 100 shows in whole in-vivo image AI n(frame number n=1,2,3...).In addition, display control unit 15a carries out following control: current display image (the image P for example that shows this main viewing area 100 in above-mentioned main viewing area 100 n) the shooting date and shooting constantly and the patient information (patient's name, patient ID, sex, birthdate) of this subject 1.
Time bar 110 and slide block 111 are the GUI of time location that are used to represent the current display image of main viewing area 100.Specifically, time bar 110 has alongst shone upon whole in-vivo image AI as having taken the in-vivo image at the two ends of its length direction at first and at last by the time sequence order.Like this, the time scale in the elapsed time that time bar 110 is expressions till the photography of initial in-vivo image to the end the photography constantly of in-vivo image constantly, therefore, each in-vivo image be represented as with whole in-vivo image AI in time series position time corresponding bar 110 on the position.In this manual, the position on the time bar 110 of this each in-vivo image is called time location.Slide block 111 is represented the time location of the current display image of main viewing area 100 on above-mentioned time bar 110.In this case, slide block 111 moves along above-mentioned time bar 110, the time location on the current display image time corresponding bar 110 of expression and main viewing area 100.Control moving of above-mentioned slide block 111 by display control unit 15a.Promptly, display control unit 15a controls the demonstration change action of the current display image of moving of slide block 111 on the above-mentioned time bar 110 and main viewing area 100, makes slide block 111 show the time location of the current display image (image in the subject 1) of main viewing area 100 all the time.
As mentioned above, labelling display part 120 lesions showed labellings, this pathological changes labelling are represented the time location of the pathological changes image that comprises among whole in-vivo image AI.Specifically, labelling display part 120 forms strip along above-mentioned time bar 110, shows the pathological changes labelling of above-mentioned pathological changes color according to the control of display control unit 15a.For example, in whole in-vivo image AI, comprise under the situation of the hemorrhage image that comprises the bleeding part in a plurality of subjects (pathological changes image a kind of), display control unit 15a carries out following control: on each time location in the labelling display part 120 corresponding with above-mentioned a plurality of hemorrhage images difference, show pathological changes labelling 120a, the 120b of the pathological changes color corresponding with the bleeding part (for example red) respectively.Above-mentioned pathological changes labelling 120a, 120b represent the time location of a plurality of hemorrhage images of comprising in the group of pictures in the subject 1 respectively.Show the pathological changes labelling 120a of above-mentioned pathological changes color, the labelling display part 120 of 120b, represent the time location of the pathological changes image in whole in-vivo image AI along time bar 110, and represent to be presented at the pathological changes kind (bleeding part etc.) of the pathological changes graphical representation on the main viewing area 100 by Show Styles.
At this, current display image (the image P in the subject 1 in main viewing area 100 n) be that bleeding part BS is included under the situation of the hemorrhage image in the subject, slide block 111 moves to the position of the pathological changes labelling 120a of the time location of representing above-mentioned hemorrhage image, and should show that color turned to the pathological changes color from the acquiescence complexion changed.In this case, represent that the pathological changes labelling 120a and the slide block 111 of the time location of above-mentioned hemorrhage image is the pathological changes color (for example red) corresponding with the bleeding part, mutually with mutually homochromy demonstration.Make the slide block 111 that shows that color (example of Show Styles) changes like this, the time location that comprises each image of the pathological changes image in whole in-vivo image AI along 110 expressions of time bar, and bring into play function as time location display unit with following demonstration color (acquiescence color or pathological changes color), wherein, whether the current display image of described demonstration colour specification master viewing area 100 is pathological changes images.In addition, by the information (whether the current display image of promptly representing main viewing area 100 is the information of pathological changes image) of the demonstration colour specification of above-mentioned slide block 111 be be presented at main viewing area 100 on the relevant information of demonstration of pathological changes image.
Display operation icon group 130 is GUI of the display operation when being used for carrying out each pictorial display that whole in-vivo image AI are comprised to main viewing area 100.In above-mentioned display operation icon group 130, for example comprise and play that icon 131, picture are play icon 132, sought tail icon 133, contraryly play icon 134, contrary picture is play icon 135, sought Head icon 136.Input part 11 is input to control part 15 by the expectation icon among the above-mentioned display operation icon of the clicking operation group 130 with the demonstration indication information corresponding with the icon of above-mentioned expectation.Display control unit 15a carries out the image P in whole in-vivo image AI according to the demonstration indication information by above-mentioned input part 11 inputs nBe presented at the control on the main viewing area 100.
Specifically, display control unit 15a under the situation of the clicking operation of having carried out playing icon 131, shows image P in the subject 1 successively in the suitable direction of main 100 rise time of viewing area sequence n, play under the situation of clicking operation of icon 132 having carried out picture, show image P subject 1 in along seasonal effect in time series along the direction frame by frame in main viewing area 100 at every turn nIn addition, display control unit 15a shows in the other direction image P in the subject 1 in main viewing area 100 along seasonal effect in time series successively under the situation of the clicking operation of having carried out contrary broadcast icon 134 n, play under the situation of clicking operation of icon 135 having carried out contrary picture, at every turn in main viewing area 100 along seasonal effect in time series in the other direction frame by frame show image P in the subject 1 n
On the other hand, under the situation of the clicking operation of having carried out seeking tail icon 133, display control unit 15a with the pictorial display of the last afterbody of whole in-vivo image AI on main viewing area 100.In addition, under the situation of the clicking operation of having carried out seeking Head icon 136, display control unit 15a with the pictorial display of the beginning of whole in-vivo image AI on main viewing area 100.
The action of the control part 15 that detects the pathological changes image that comprises among whole in-vivo image AI then, is described.The flow chart of the processing procedure of Fig. 4 control part 15 that to be illustration detect the a kind of pathological changes image that comprises among whole in-vivo image AI.Control part 15 is taken into whole in-vivo image AI from insertion is installed to pocket recording medium 5 the card I/F13, and detect the color information of each image in whole in-vivo image AI, under the situation that detects pathological changes image (for example hemorrhage image) according to detected color information, additional pathological changes sign on this pathological changes image.In this case, control part 15 whole in-vivo image AI that will comprise the pathological changes image that has added above-mentioned pathological changes sign are saved in the storage part 14.
Specifically, as shown in Figure 4, control part 15 reads in the image (step S101) of process object from be kept at the whole in-vivo image AI that insert in the pocket recording medium 5 that is installed to the card I/F13.In this case, control part 15 for example reads in image P in whole in-vivo image AI successively along time series n(frame number n=1,2,3 ...).
Then, control part 15 judges whether the image in the subject 1 that reads in as the image of process object is pathological changes image (step S102).In this case, the 15b of lesion detection portion detects the color information as the image in the subject 1 of above-mentioned process object image, judges whether it is the pathological changes image according to detected color information.Specifically, the 15b of lesion detection portion is under the situation of the average color that detects image as above-mentioned color information, if the average color of the approximate pathological changes image of the average color of detected image then is judged as the image of this process object the pathological changes image in the subject 1.In addition; the 15b of lesion detection portion is under the situation of the value of the key element of all kinds that detects the RGB that forms image as above-mentioned color information; if the value of the key element of all kinds of detected RGB in the numerical range of the key element of all kinds of pathological changes image, then is judged as the image of this process object the pathological changes image in the subject 1.Like this, the 15b of lesion detection portion detects the pathological changes image (for example hemorrhage image) that comprises among whole in-vivo image AI.
Control part 15 is (step S102, "Yes") under the situation of pathological changes image at the image that is judged as above-mentioned process object, to the additional pathological changes sign (step S103) of the pathological changes image in this subject 1.In this case, if detected pathological changes image is hemorrhage image, then the 15b of lesion detection portion is that the pathological changes sign of the meaning of hemorrhage image appends on the pathological changes image in this subject 1 with expression.
Then, the control part 15 pathological changes image that will add in the subject 1 of above-mentioned pathological changes sign is saved in (step S104) in the storage part 14.In this case, the pathological changes image that has added in the subject 1 of above-mentioned pathological changes sign is saved in the storage part 14 as the part of this whole in-vivo image AI.
Afterwards, control part 15 judges whether all images that comprises among above-mentioned whole in-vivo image AI has been finished processing (step S105).Specifically, in insertion is installed to pocket recording medium 5 on the card I/F13 under the residual situation that image in the subject 1 that also is not read into arranged or in pocket recording medium 5 under the residual situation that image in the subject 1 that also is not kept in the storage part 14 arranged, (step S105 is not finished in the processing that is judged as above-mentioned whole in-vivo image AI, "No"), return above-mentioned steps S101, repeat this step S101 processing procedure afterwards.
Each image that comprises among 15 couples of whole in-vivo image AI of control part repeats the processing procedure of above-mentioned steps S101～S105, and whole in-vivo image AI that will comprise the pathological changes image that has added above-mentioned pathological changes sign are kept in the storage part 14.
On the other hand, control part 15 is under the situation that the pocket recording medium 5 that is installed to from insertion the card I/F13 all reads in whole in-vivo image AI or will be kept at whole in-vivo image AI in the above-mentioned pocket recording medium 5 and all be kept under the situation in the storage part 14, be judged as all images in whole in-vivo image AI is finished processing (step S105, "Yes"), the detection that finishes the pathological changes image in whole in-vivo image AI is handled.
In addition, control part 15 is judged as process object in above-mentioned steps S102 image is not (step S102, a "No") under the situation of pathological changes image, enters above-mentioned steps S104, repeats the later processing procedure of this step S104.In this case, the 15b of lesion detection portion is not to being the additional pathological changes sign of image (being the image of normal internal organs) in the subject 1 of above-mentioned pathological changes image.That is, be not image in the subject 1 of above-mentioned pathological changes image not by additional pathological changes sign, and be saved in storage part 14 as the part of whole in-vivo image AI.
Then, the action of the control part 15 that carries out following control is described: this control part 15 carries out the control of each pictorial display in main viewing area 100 that will comprise among whole in-vivo image AI, and the demonstration color of the slide block 111 of the current display image time location of this main viewing area 100 of control expression.Fig. 5 is the flow chart of processing procedure of the control part 15 of the explanation image display device 4 relevant with embodiment 1.
As shown in Figure 5, at first control part 15 is presented under the state on the display part 12 above-mentioned window W1 (with reference to Fig. 3), and the frame number n of the whole in-vivo image AI on the main viewing area 100 that is presented at this window W1 is carried out initialization (step S201).In this case, display control unit 15a carries out initialization (for example n=1) to frame number n, wherein, determines to be presented at the image of the display process object on the main viewing area 100 in each image that described frame number n comprises from these whole in-vivo image AI.
Then, control part 15 is judged the pictorial display indication (step S202) that unmatchful main viewing area 100 is arranged.Specifically, input part 11 will be input to control part 15 with the corresponding demonstration indication information of any icon (for example, playing icon 131, picture plays icon 132, contraryly plays icon 134 or contrary picture is play icon 135) of comprising among the above-mentioned display operation icon group 130.If by the above-mentioned demonstration indication information of input part 11 inputs, then display control unit 15a is not judged as not to the pictorial display indication (step S202, "No") of main viewing area 100, repeats this step S202.That is, display control unit 15a repeats this step S202 till importing above-mentioned demonstration indication information by input part 11.
On the other hand, import by input part 11 under the situation of above-mentioned demonstration indication information, control part 15 is judged as pictorial display indication (the step S202 to main viewing area 100, "Yes"), read in the image (step S203) of numbering as the present frame of the image in the subject 1 of display process object.In this case, read in the image of present frame numbering among whole in-vivo image AI of control part 15 from be kept at storage part 14.
Then, control part 15 judges whether the image (that is the image in the subject 1 of display process object) of the present frame numbering of reading in is pathological changes image (step S204).In this case, display control unit 15a judges in the image of present frame numbering whether added the pathological changes sign, if not additional pathological changes sign, the image that then is judged as this current frame number is not the pathological changes image.
Like this, be judged as (step S204 under the situation that is not the pathological changes image at image with the present frame numbering, "No"), control part 15 carries out following control: the image that will represent this current frame number is that the slide block 111 that diseased region is not included in the time location of image in the subject (normal internal organs image) shows (step S205) with the acquiescence color.In this case, display control unit 15a carries out following control: make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame numbering of normal internal organs image, and will represent that slide block 111 as the time location of the image of the present frame numbering of above-mentioned normal internal organs image is with the demonstration of acquiescence color.
On the other hand, in step S204, if added the pathological changes sign in the image of present frame numbering, then to be judged as the image of this current frame number be the pathological changes image to display control unit 15a.(step S204 under the situation that like this image of present frame numbering is judged as the pathological changes image, "Yes"), control part 15 carries out following control: the image that will represent this current frame number is that the slide block 111 of the time location of pathological changes image shows (step S206) with the pathological changes color.In this case, display control unit 15a carries out following control: make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame of pathological changes image numbering, and will represent that the slide block 111 of the time location of the image of numbering as the present frame of above-mentioned pathological changes image shows with the pathological changes color.
Afterwards, control part 15 carries out showing the control (step S207) of the image that present frame is numbered on main viewing area 100.In addition, being presented at the frame number (that is, present frame numbering) of the image on the main viewing area 100 in this step S207, is initialized frame number or the frame number upgraded in step S208 described later in above-mentioned steps S201.
In this step S207, not under the situation of pathological changes image (that is, being normal internal organs image) at the image of present frame numbering, the normal internal organs pictorial display that display control unit 15a will this current frame number is in main viewing area 100.In this case, normal internal organs pictorial display in the above-mentioned subject 1 is in main viewing area 100, and show slide block 111 with the acquiescence color, the time location of the normal internal organs image in the current subject 1 that is presented in this main viewing area 100 of these slide block 111 expressions.
On the other hand, be under the situation of pathological changes image at the image of present frame numbering, the pathological changes pictorial display that display control unit 15a will this current frame number is in main viewing area 100.In this case, the pathological changes pictorial display in the above-mentioned subject 1 and represents that the slide block 111 of the time location of the pathological changes image in the subject 1 of current demonstration in this main viewing area 100 shows with the pathological changes color in main viewing area 100.At this, the pathological changes color of this slide block 111 is and the corresponding color of pathological changes as the pathological changes graphical representation of the current display image of this main viewing area 100, be the pathological changes labelling (for example pathological changes labelling 120a) in the labelling display part 120 with the time location of this pathological changes image of expression the pathological changes form and aspect with color.
Then, the frame number (step S208) of whole in-vivo image AI of control part 15 update displayed process object.In this case, add on the frame number n of display control unit 15a by for example image in the current subject 1 that is presented in the main viewing area 100+1, upgrade the frame number n of whole in-vivo image AI of this display process object.
What afterwards, control part 15 was judged the image that has or not in the current subject 1 that is presented in the main viewing area 100 temporarily stops indication (step S209).Specifically, play icon 132 or contrary picture with above-mentioned picture and play under the situation of the corresponding demonstration indication information of icon 135 having imported by input part 11, control part 15 has been judged as and has temporarily stopped indication (step S209, "Yes").In this case, control part 15 returns above-mentioned steps S202, repeats the later processing procedure of this step S202.
On the other hand, if not having input and above-mentioned picture plays under the situation of the corresponding demonstration indication information of icon 132 or contrary picture broadcast icon 135, control part 15 is judged as and does not temporarily stop indication (step S209, "No"), judge the pictorial display of pictorial display on main viewing area 100 that will comprise among whole in-vivo image AI handles whether finish (step S210).
Specifically, under the situation of the frame number n that in above-mentioned steps S208, upgrades above the frame number of whole in-vivo image AI of display process object, the pictorial display processing that control part 15 is judged as these whole in-vivo image AI finishes (step S210, "Yes"), the pictorial display that finishes above-mentioned whole in-vivo image AI is handled.On the other hand, the frame number n that upgrades in above-mentioned steps S208 is under the situation below the frame number of whole in-vivo image AI of display process object, control part 15 is judged as the pictorial display of this image PG and handles not end (step S210, "No"), return above-mentioned steps S203, repeat the later processing procedure of this step S203.
Then, be illustrated in the main viewing area 100 and show and to be included in the situation of the pathological changes image (being hemorrhage image) in the subject as the bleeding part of an example of pathological changes, specify the action of control part 15, this control part 15 carries out following control: the demonstration color of slide block 111 of time location that will represent above-mentioned hemorrhage image is from acquiescence complexion changed pathological changes color more.Fig. 6 is the sketch map of action that is used to illustrate the control part 15 of the pathological changes color that the demonstration complexion changed of slide block 111 of the hemorrhage image temporal position that will represent current demonstration is more corresponding with the bleeding part.
Each pictorial display that control part 15 comprises in whole in-vivo image AI is presented at labelling display part 120 with the pathological changes labelling of the time location of the hemorrhage image that comprises among these whole in-vivo image AI of expression before the main viewing area 100.Specifically, the hemorrhage image P that for example in detecting whole in-vivo image AI, comprises of control part 15 12, P 13Situation under, will represent above-mentioned hemorrhage image P 12, P 13The pathological changes labelling 120a of time location be presented on the labelling display part 120.In this case, display control unit 15a carries out following control: with hemorrhage image P 12, P 13The pathological changes color of the bleeding part correspondence of expression (for example red) comes lesions showed labelling 120a.
For example as shown in Figure 6, this pathological changes labelling 120a with hemorrhage image P 12, P 13Be shown as strip on the time location in the corresponding labelling display part 120.The pathological changes labelling 120a that is shown as strip like this represents the hemorrhage image P that comprises among whole in-vivo image AI 12, P 13The parts of images group.In such parts of images group, for example comprise hemorrhage image P 12, P 13With image P 11, P 14In addition, the image P in the above-mentioned subject 1 11, P 14Be and hemorrhage image P 12, P 13Near the approaching image of frame number, be the image of having taken normal internal organs inside.
Afterwards, control part 15 carries out the image P that comprises in the group of pictures in the subject 1 according to the demonstration indication information by input part 11 inputs n(n=1,2,3 ...) be presented at the control in the main viewing area 100, make slide block 111 move the current time location that is presented at the current display image in the main viewing area 100 of feasible expression along time bar 110.In this case, if the current display image of above-mentioned main viewing area 100 is not the pathological changes image, then control part 15 carries out the slide block 111 of time location that will this current display image of expression with the control that shows of acquiescence color, if the current display image of above-mentioned main viewing area 100 is pathological changes images, then carry out will this pathological changes image of expression the control that shows with the pathological changes color of the slide block 111 of time location.
Specifically, as shown in Figure 6, if the current display image of main viewing area 100 is image P 11Perhaps image P 14Even, then being positioned under the situation of indication range of pathological changes labelling 120a at slide block 111, control part 15 also carries out showing with the acquiescence color control of this slide block 111.On the other hand, if the current display image of main viewing area 100 is hemorrhage image P 12Perhaps hemorrhage image P 13, then control part 15 carries out following control: more corresponding with the bleeding part pathological changes color of acquiescence complexion changed of slide block 111 that will be positioned at the indication range of above-mentioned pathological changes labelling 120a.In this case, control part 15 will be represented above-mentioned hemorrhage image P 12, P 13The pathological changes color of slide block 111 of time location be made as with the pathological changes form and aspect of pathological changes labelling 120a with color (for example red).
Like this, control part 15 is by the demonstration color of control slide block 111, make the time location of the current display image among the whole in-vivo image AI of slide block 111 expression, and can show that by this demonstration color (giving tacit consent to color or pathological changes color) whether this current display image is the pathological changes image of hemorrhage image etc.In addition, above-mentioned slide block 111 is presented on the position of the current display image that leaves main viewing area 100.Therefore, above-mentioned slide block 111 will show that complexion changed turns under the situation of pathological changes color or acquiescence color, does not hinder the current display image of observing this main viewing area 100 yet.
Thereby, user such as doctor or nurse can not be subjected to the demonstration complexion changed obstruction ground of above-mentioned slide block 111 to observe the current display image of main viewing area 100, and by discerning the pathological changes color of above-mentioned slide block 111, can understand this current display image easily the meaning that is the pathological changes image.Its result, the user is positioned at slide block 111 under the state of indication range of the pathological changes labelling that is shown by labelling display part 120, can easily determine the pathological changes image of hemorrhage image etc. from the parts of images group in the subject being presented at main viewing area 100 successively 1.
Specifically, the user is positioned at slide block 111 under the state of indication range of the pathological changes labelling 120a that is shown as strip, easily determines hemorrhage image P the parts of images group (each image of frame number n=11～14) in the subject 1 that can show successively from main viewing area 100 12, P 13Thus, can be with above-mentioned hemorrhage image P 12, P 13Easily be presented in the main viewing area 100, and can easily observe above-mentioned hemorrhage image P 12, P 13Subject in bleeding part BS in the subject that comprises 1.
More than, as mentioned above, in embodiments of the present invention 1, with each pictorial display of comprising in the tested intravital group of pictures in main viewing area, and the slide block that moves on the time bar of the time location of each image of utilization in this group of pictures of expression, represent the current time location that is presented at the current display image in this main viewing area, the current display image in this main viewing area is under the situation of pathological changes image, with the acquiescence complexion changed of this slide block pathological changes color more.Therefore, by the demonstration color (pathological changes color or acquiescence color) of discerning above-mentioned slide block, can judge easily whether the current display image of this main viewing area is the pathological changes image.Its result, the image display device that can be achieved as follows: do not hinder the tested intravital image observation that is presented on the main viewing area, can be from the group of pictures being presented at above-mentioned main viewing area successively easily determine the pathological changes image of tested intravital bleeding part etc.
By using the image display device relevant with embodiments of the present invention 1, can from tested intravital group of pictures, easily search the pathological changes image of hemorrhage image etc., can easily observe the interior pathological changes image of above-mentioned subject.
Embodiment 2
Then, embodiments of the present invention 2 are described.In above-mentioned embodiment 1, detected the a kind of pathological changes image (for example hemorrhage image) that comprises among whole in-vivo image AI, but in this embodiment 2, the multiple pathological changes image that comprises among whole in-vivo image AI is detected, by each pathological changes of representing respectively by above-mentioned multiple pathological changes image, the pathological changes color of slide block 111 is made as different colors.In addition, below as the multiple pathological changes image that comprises among whole in-vivo image AI, illustration has been taken the hemorrhage image of the bleeding part in the subject 1 and has been taken the image that fades at the position of fading in the subject 1.
Fig. 7 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 2.As shown in Figure 7, the image display device 24 relevant with this embodiment 2 replaces the control part 15 of the image display device 4 relevant with above-mentioned embodiment 1 and has control part 25.In above-mentioned image display device 24, the labelling display part 120 of display part 12 shows a plurality of pathological changes labellings, and described a plurality of pathological changes labellings are represented each time location of multiple pathological changes image respectively.Storage part 14 is preserved and is shown that color information CL2 replaces above-mentioned demonstration color information CL1.In addition, the in-examiner information acquisition system relevant with embodiments of the present invention 2 replaces the image display device 4 of the in-examiner information acquisition system (with reference to Fig. 1) relevant with above-mentioned embodiment 1 and has image display device 24.Other structure is identical with embodiment 1, for same structure part labelling same-sign.
As mentioned above, storage part 14 is preserved and is shown that color information CL2 replaces showing color information CL1.Show that color information CL2 is used to set a plurality of pathological changes normal complexion above-mentioned acquiescence color corresponding respectively with multiple pathological changes.As a plurality of pathological changes colors that utilize above-mentioned demonstration color information CL2 to set, for example can enumerate pathological changes color corresponding (hereinafter referred to as the hemorrhagic disease variable color) and the pathological changes color (hereinafter referred to as the pathological changes color that fade) corresponding with the position of fading with the bleeding part.By the demonstration color (acquiescence color and a plurality of pathological changes color) that above-mentioned demonstration color information CL2 sets, be used for the demonstration color of the demonstration normal complexion slide block 111 of the pathological changes labelling in the above-mentioned labelling display part 120.
The control part 15 of the image display device 4 that control part 25 and above-mentioned embodiment 1 are relevant is roughly similarly controlled input part 11, display part 12, card I/F13 and storage part 14 respectively, controls the input and output of the information between above-mentioned each structural portion.In addition, control part 25 obtains whole in-vivo image AI from insertion is installed to pocket recording medium 5 the card I/F13, detect the multiple pathological changes image (for example hemorrhage image and the image that fades) that comprises among these whole in-vivo image AI.In this case, control part 25 carries out the control of each pictorial display in main viewing area 100 that will comprise in whole in-vivo image AI of above-mentioned multiple pathological changes image, and the pathological changes color of the pathological changes color of slide block 11 and pathological changes labelling is controlled to be different colors by the kind of the pathological changes image kind of the represented pathological changes of pathological changes image (that is, by).This control part 25 replace above-mentioned embodiment 1 control part 15 display control unit 15a and have display control unit 25a, replace the lesion detection 15b of portion and have the 25b of lesion detection portion.
Display control unit 25a has the function roughly same with the display control unit 15a of above-mentioned control part 15.Specifically, display control unit 25a carries out the control of each pictorial display in main viewing area 100 that will for example comprise in whole in-vivo image AI of the hemorrhage image and the image that fades, meanwhile, along the time bar 110 moving sliders 111 feasible time locations of representing the current display image of these main viewing areas 100.(that is, normal internal organs image under) the situation, display control unit 25a carries out the control that the slide block 111 of time location that will this current display image of expression shows with the acquiescence color beyond the current display image of this main viewing area 100 is the pathological changes image.On the other hand, current display image in this main viewing area 100 is under the situation of hemorrhage image, display control unit 25a carries out the control of the pathological changes color that the demonstration complexion changed of the slide block 111 of the time location of this hemorrhage image of expression is more hemorrhage, at the current display image of this main viewing area 100 is to fade under the situation of image, carries out the control of the pathological changes color that the demonstration complexion changed with the slide block 111 of the time location of this image that fades of expression more fades.
In addition, display control unit 25a makes a plurality of pathological changes labellings be presented at labelling display part 120, wherein, described a plurality of pathological changes labelling is represented each time location of the multiple pathological changes image (for example hemorrhage image and the image that fades) that comprises among above-mentioned whole in-vivo image AI respectively.Specifically, display control unit 25a carries out pathological changes labelling with the time location of the hemorrhage image in the expression subject 1 with the control that hemorrhage pathological changes color shows, carries out the control that the pathological changes labelling of the time location of the image that fades in will expression subject 1 shows with the pathological changes color that fades.In this case, the pathological changes of above-mentioned hemorrhage image is marked on the time location in the labelling display part 120 corresponding with hemorrhage image in the subject 1, shows with hemorrhage pathological changes color (for example red).The pathological changes of the above-mentioned image that fades is marked on the time location in the labelling display part 120 corresponding with the image that fades in the subject 1, shows with the pathological changes color (for example white) that fades.
In addition, set above-mentioned acquiescence color, hemorrhage pathological changes color and the pathological changes color that fades by the demonstration color information CL2 that is kept in the storage part 14.In this case, above-mentioned acquiescence color, hemorrhage pathological changes color and the pathological changes color that fades are set at different mutually colors for example Lycoperdon polymorphum Vitt, redness, white respectively.
The 15b of lesion detection portion of 25b of lesion detection portion and above-mentioned control part 15 similarly detects the color information of the image that comprises among whole in-vivo image AI, and according to the color information of detected image, whether the image of judgment processing object is the pathological changes image.In this case, the 25b of lesion detection portion detects the multiple pathological changes image that comprises among whole in-vivo image AI.By the detected multiple pathological changes image of the above-mentioned lesion detection 25b of portion for example is the hemorrhage image and the image that fades in the subject 1.The 25b of lesion detection portion is additional respectively by the different pathological changes sign of pathological changes to the above-mentioned hemorrhage image and the image that fades.The hemorrhage image and the image that fades of above-mentioned pathological changes sign by pathological changes have been added respectively, as the part of whole in-vivo image AI and be kept in the storage part 14.
Then, the Show Styles of particular instantiation display part 12 illustrates the GUI that is presented in the display part 12 and the action of display control unit 25a that the display action of display part 12 is controlled.Fig. 8 is an illustration with the sketch map of the Show Styles of the display part 12 that shows a plurality of pathological changes labellings by the different pathological changes color of pathological changes.As shown in Figure 8, on the display part 12 of this image display device 24 among the window displayed W1, show multiple pathological changes labelling, for example represent the fade pathological changes labelling 120c of time location of image of pathological changes labelling 120a, the 120b of each time location of a plurality of hemorrhage images and expression respectively by labelling display part 120.In addition, being presented at pathological changes image in the subject 1 in the main viewing area 100 has multiplely, for example is that the bleeding part BS in the subject 1 is included in hemorrhage image in the subject, the position E that fades in the subject 1 is included in the image that fades in the subject.Other Show Styles of above-mentioned window W1 are identical with the situation of above-mentioned embodiment 1.
As shown in Figure 8, labelling display part 120 shows pathological changes labelling 120a, 120b, the 120c that presses the diverse pathological changes color of pathological changes.In this case, display control unit 25a carries out following control: with whole in-vivo image AI on each time location in the corresponding respectively labelling display part 120 of a plurality of hemorrhage image that comprises, show pathological changes labelling 120a, the 120b of hemorrhage pathological changes color (for example redness).In addition, display control unit 25a carries out following control: on the time location in the labelling display part 120 corresponding with the image that fades that comprises among whole in-vivo image AI, show the pathological changes labelling 120c of the pathological changes color (for example white) that fades.Like this to show the labelling display part 120 of a plurality of pathological changes labellings by the different pathological changes color of each pathological changes (example of Show Styles), time location along a plurality of pathological changes images in the whole in-vivo image AI of time bar 110 expressions, and bring into play function as time location display unit with following Show Styles, wherein, described Show Styles represents to be presented at the kind of the pathological changes of the pathological changes graphical representation in the main viewing area 100.In addition, the information that the pathological changes color of each pathological changes labelling that utilization is shown by above-mentioned labelling display part 120 is represented (promptly, expression is presented at the pathological changes kinds of information of each the pathological changes graphical representation in the main viewing area 100), be be presented at main viewing area 100 in the relevant information of demonstration of pathological changes image.
In addition, slide block 111 move to make the time location of current display image of the main viewing area 100 of expression on time bar 110, and shows acquiescence color, hemorrhage pathological changes color or the pathological changes color that fades some.In this case, if the current display image of main viewing area 100 is (normal internal organs images) beyond the pathological changes image, then display control unit 25a is made as the acquiescence color with the demonstration color of this slide block 111, if the current display image of main viewing area 100 is hemorrhage images, then the demonstration color with this slide block 111 is made as and pathological changes labelling 120a, the pathological changes color of 120b same color (hemorrhage pathological changes color), if the current display image of main viewing area 100 is the images that fade, then the demonstration color of this slide block 111 is made as pathological changes color (the pathological changes color that fades) with pathological changes labelling 120c same color.
The action of the control part 25 that the hemorrhage image that comprises among whole in-vivo image AI and the image that fades are detected then, is described.The flow chart of the processing procedure of Fig. 9 control part 25 that to be illustration detect the multiple pathological changes image that comprises among whole in-vivo image AI.Control part 25 is taken into whole in-vivo image AI from the pocket recording medium 5 that insertion is installed to the card I/F13, and detects the hemorrhage image that comprises among whole in-vivo image AI and the image that fades.In this case, control part 25 whole in-vivo image AI that will comprise the above-mentioned hemorrhage image and the image that fades are kept at storage part 14.
Specifically, as shown in Figure 9, control part 25 and above-mentioned steps S101 similarly read in the image (step S301) of process object from be kept at the whole in-vivo image AI that insert the pocket recording medium 5 that is installed on the card I/F13.
Then, control part 25 judges whether image is hemorrhage image (step S302) in the subject 1 that reads in as the image of process object.In this case, the 25b of lesion detection portion detects the color information as image in the subject 1 of the image of above-mentioned process object, according to detected color information, judges whether it is hemorrhage image.Specifically, the 25b of lesion detection portion is under the situation of the average color that detects image as above-mentioned color information, if the average color of the approximate hemorrhage image of the average color of detected image then is judged as the image of this process object the hemorrhage image in the subject 1.In addition; the 25b of lesion detection portion is under the situation of the value of the key element of all kinds that detects the RGB that forms image as above-mentioned color information; if the value of the key element of all kinds of detected RGB in the numerical range of the key element of all kinds of hemorrhage image, then is judged as the image of this process object the hemorrhage image in the subject 1.Like this, the 25b of lesion detection portion detects the hemorrhage image that comprises among whole in-vivo image AI.
Control part 25 is (step S302, "Yes") under the situation of hemorrhage image at the image that is judged as above-mentioned process object, to the additional pathological changes sign (step S303) of the hemorrhage image in this subject 1.In this case, the 25b of lesion detection portion will represent that it is that the hemorrhage pathological changes sign of the meaning of hemorrhage image appends on the hemorrhage image in this subject 1.
Then, control part 25 judges whether the image of above-mentioned process object is the image (step S304) that fades.In this case, the 25b of lesion detection portion detects the color information as the image in the subject 1 of the image of above-mentioned process object, according to detected color information, judges whether it is the image that fades.Specifically; the 25b of lesion detection portion is under the situation of the average color that detects image as above-mentioned color information; if the average color of the approximate image that fades of the average color of detected image then is judged as the image of this process object the image that fades in the subject 1.In addition; the 25b of lesion detection portion is under the situation of the value of the key element of all kinds that detects the RGB that forms image as above-mentioned color information; if the value of the key element of all kinds of detected RGB in the numerical range of the key element of all kinds of the image that fades, then is judged as the image of this process object the image that fades in the subject 1.Like this, the 25b of lesion detection portion detects the image that fades that comprises among whole in-vivo image AI.
Control part 25 is to fade (step S304, "Yes") under the situation of image at the image that is judged as above-mentioned process object, to the additional pathological changes sign (step S305) of the image that fades in this subject 1.In this case, the 25b of lesion detection portion will represent that it is that the fade pathological changes sign that fades of the meaning of image appends on the image that fades in this subject 1.
Then, control part 25 image that fades that will add the hemorrhage image of hemorrhage pathological changes sign or add the pathological changes sign that fades is saved in storage part 14 (step S306).In this case, the above-mentioned hemorrhage image or the image that fades are saved in storage part 14 as the part of this whole in-vivo image AI.
Afterwards, control part 25 and above-mentioned steps S105 similarly judge whether all images that comprises among above-mentioned whole in-vivo image AI has been finished processing (step S307).Control part 25 is (step S307, "No") under the situation that the processing that is judged as above-mentioned whole in-vivo image AI is not finished, and returns above-mentioned steps S301, repeats this step S301 processing procedure afterwards.On the other hand, control part 25 has been finished all images in whole in-vivo image AI under the situation about handling (step S307, "Yes") being judged as, and finishes the detection of the multiple pathological changes image that comprises among whole in-vivo image AI and handles.
Control part 25 repeats the processing procedure of above-mentioned steps S301～S307 by each image that comprises among whole in-vivo image AI, and whole in-vivo image AI that will comprise the hemorrhage image and the image that fades are saved in storage part 14.
In addition, control part 25 is judged as process object in above-mentioned steps S302 image is not (step S302, a "No") under the situation of hemorrhage image, enters above-mentioned steps S304, repeats the later processing procedure of this step S304.In this case, the 25b of lesion detection portion is for not being image in the subject 1 of above-mentioned hemorrhage image, additional hemorrhage pathological changes sign.
In addition, control part 25 is judged as process object in above-mentioned steps S304 image is not to fade (step S304, "No") under the situation of image, enters above-mentioned steps S306, repeats the later processing procedure of this step S306.In this case, the 25b of lesion detection portion is for not being image in the subject 1 of the above-mentioned image that fades, the additional pathological changes sign that fades.
Like this, additional hemorrhage pathological changes sign on the hemorrhage image in subject 1, the additional pathological changes sign that fades on the image that fades in subject 1.On the other hand, in the image in any one subject 1 that is not the hemorrhage image and the image that fades (being normal internal organs image), not additional any pathological changes sign.This hemorrhage image, fade image and normal internal organs image are saved in storage part 14 as whole in-vivo image AI.
Then, the action of control part 25 is described, this control part 25 carry out each pictorial display that will comprise among whole in-vivo image AI on main viewing area 100 control and the demonstration color of the slide block 111 of the time location of the current display image of representing this main viewing area 100 controlled.Figure 10 is the flow chart of processing procedure of the control part 25 of the explanation image display device 24 relevant with embodiment 2.
The control part 15 of the image display device 4 that control part 25 and above-mentioned embodiment 1 are related roughly similarly, carry out the control of each pictorial display on main viewing area 100 that to comprise among whole in-vivo image AI, and the demonstration color of the slide block 111 of the time location of the current display image of representing this main viewing area 100 is controlled.In this case, if current display image is beyond the pathological changes image, then control part 25 is made as the acquiescence color with the demonstration color of this slide block 111, if current display image is hemorrhage image, then the demonstration color with this slide block 111 is made as hemorrhage pathological changes color, if current display image is the image that fades, then the demonstration color with this slide block 111 is made as the pathological changes color that fades.
Promptly, as shown in figure 10, control part 25 carries out the same processing procedure with above-mentioned steps S201～S203 (with reference to Fig. 5), the frame number n of the whole in-vivo image AI of initialization, judge and have or not the pictorial display indication, having under the situation of pictorial display indication, reading in image (the step S401～S403) of the present frame numbering in these whole in-vivo image AI.
Then, control part 25 judges whether the image (that is the image in the subject 1 of display process object) of the present frame numbering of reading in is hemorrhage image (step S404).In this case, display control unit 25a judges in the image of present frame numbering whether added hemorrhage pathological changes sign, if not additional hemorrhage pathological changes sign, the image that then is judged as this current frame number is not hemorrhage image.
Not that control part 25 judges whether the image of this current frame number is the image (step S405) that fades under the situation of hemorrhage image (step S404, "No") at the image that is judged as present frame numbering like this.In this case, display control unit 25a judges whether added the pathological changes sign that fades on the image of this current frame number, if there is not the additional pathological changes sign that fades, then being judged as this current frame number image is not the image that fades.
Be judged as (step S405 under the situation of the image that is not to fade at image (being judged as the image that is not hemorrhage image) that will this current frame number, "No"), control part 25 carries out following control: the image that will represent this current frame number promptly is not that the slide block 111 of the time location of any one normal internal organs image in the hemorrhage image and the image that fades shows (step S408) with the acquiescence color.
On the other hand, in step S404, if added hemorrhage pathological changes sign in the image of present frame numbering, then to be judged as the image of this current frame number be hemorrhage image to display control unit 25a.(step S404 under the situation that like this image of present frame numbering is judged as hemorrhage image, "Yes"), control part 25 carry out will this current frame number of expression image be the control (step S406) that the slide block 111 of the time location of hemorrhage image shows with hemorrhage pathological changes color.In this case, display control unit 25a make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame of hemorrhage image numbering, and carry out the control that will expression shows with hemorrhage pathological changes color (for example red) as the slide block 111 of the time location of the image of the present frame numbering of above-mentioned hemorrhage image.
In addition, in step S405, if added the pathological changes sign that fades on the image of present frame numbering, then to be judged as the image of this current frame number be the image that fades to display control unit 25a.(step S405 under the situation that like this image of present frame numbering is judged as the image that fades, "Yes"), control part 25 carry out will this current frame number of expression the image control (step S407) that the slide block 111 of time location of image shows with the pathological changes color that fades of promptly fading.In this case, display control unit 25a make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame numbering of the image that fades, and carry out control that expression is shown with the pathological changes color (for example white) that fades as the slide block 111 of the time location of the present frame numbering image of the above-mentioned image that fades.
Afterwards, control part 25 carries out showing the control (step S409) of the image that present frame is numbered in main viewing area 100.In addition, being presented at the frame number (that is, present frame numbering) of the image in the main viewing area 100 in this step S409, is initialized frame number or the frame number upgraded in step S410 described later in above-mentioned steps S401.
In this step S409, be under the situation of normal internal organs image at the image of present frame numbering, the normal internal organs pictorial display that display control unit 25a will this current frame number is in main viewing area 100.In this case, normal internal organs pictorial display in the above-mentioned subject 1 is on main viewing area 100, and show slide block 111 with the acquiescence color, wherein, the time location of the normal internal organs image in these slide block 111 these main viewing areas 100 of expression in the subject 1 of current demonstration.
On the other hand, be under the situation of hemorrhage image at the image of present frame numbering, the hemorrhage pictorial display that display control unit 25a will this current frame number is in main viewing area 100.In this case, the hemorrhage pictorial display in the above-mentioned subject 1 and represents that the slide block 111 of the time location of the hemorrhage image in the subject 1 of current demonstration in this main viewing area 100 shows with hemorrhage pathological changes color on main viewing area 100.At this, the hemorrhage pathological changes color that shows on this slide block 111 is and the corresponding color of pathological changes (being the bleeding part) as the hemorrhage graphical representation of the current display image of this main viewing area 100, is the same color of pathological changes form and aspect of the pathological changes labelling (for example pathological changes labelling 120a) in the labelling display part 120 with the time location of this hemorrhage image of expression.
In addition, be to fade under the situation of image at the image of present frame numbering, what display control unit 25a will this current frame number fades pictorial display on main viewing area 100.In this case, fade pictorial display on main viewing area 100 in the above-mentioned subject 1, and represent that the slide block 111 of the time location of the image that fades in the subject 1 of current demonstration in this main viewing area 100 shows with the pathological changes color that fades.At this, the pathological changes color that fades that shows on this slide block 111, be and the corresponding color of pathological changes (position of promptly fading) as the graphical representation of fading of the current display image of this main viewing area 100, be the pathological changes labelling (for example pathological changes labelling 120c) in the labelling display part 120 with the time location of this image that fades of expression the pathological changes form and aspect with color.
Afterwards, control part 25 and above-mentioned steps S208 similarly, the frame number n (step S410) of whole in-vivo image AI of update displayed process object.And, control part 25 and above-mentioned steps S209 similarly, that judges image that dereliction viewing area 100 is arranged temporarily stops indication (step S411), (step S411 under the situation that temporarily stops to indicate is being arranged, "Yes"), returns step S402, repeat the later processing procedure of this step S402.
On the other hand, (step S411 under the situation that does not temporarily stop to indicate, "No"), control part 25 and above-mentioned steps S210 similarly, the pictorial display of pictorial display on main viewing area 100 that will comprise among whole in-vivo image AI that judge whether to be through with handled (step S412).Handle (step S412 under the situation not have end being judged as pictorial display, "No"), control part 25 returns step S403, repeat the later processing procedure of this step S403, handle (step S412 under the situation about being through with being judged as pictorial display, "Yes"), the pictorial display that finishes the image in the above-mentioned subject 1 is handled.
Then, illustration will be as the bleeding part and the situation of pictorial display on main viewing area 100 of fading of an example of multiple pathological changes image, specify the action of the control part 25 that carries out following control, this control part 25 will be represented the more hemorrhage pathological changes color of demonstration complexion changed of slide block 111 of the time location of hemorrhage image, with the expression pathological changes color that the demonstration complexion changed of slide block 111 of time location of image more fades that fades.Figure 11 is the sketch map that is used to illustrate the action of control part 25, and this control part 25 is corresponding to the hemorrhage image of current demonstration or fade image and the pathological changes color demonstration complexion changed of slide block 111 is more hemorrhage or that fade.
Each pictorial display that control part 25 comprises in whole in-vivo image AI shows the fade pathological changes labelling of time location of image of the pathological changes labelling of time location of the hemorrhage image that comprises among these whole in-vivo image AI of expression and expression respectively before the main viewing area 100 in labelling display part 120.
Specifically, the image P that fades that control part 25 for example comprises in detecting whole in-vivo image AI 34, P 36Situation under, will represent the above-mentioned image P that fades 34, P 36The pathological changes labelling 120c of time location be presented at labelling display part 120.In this case, display control unit 25a carries out following control: with the image P that fades 34, P 36The pathological changes color of the position correspondence of fading of expression (for example white) comes lesions showed labelling 120c.In addition, the situation of control part 25 and above-mentioned embodiment 1 similarly, with the hemorrhage image P in the expression subject 1 12, P 13The pathological changes labelling 120a of time location be presented on the labelling display part 120 with hemorrhage pathological changes color (for example red).
This pathological changes labelling 120a, 120c are for example shown in Figure 6, with hemorrhage image P 12, P 13Time location in the corresponding labelling display part 120 and with the image P that fades 34, P 36Be shown as strip respectively on the time location in the corresponding labelling display part 120.As mentioned above, the pathological changes labelling 120a of above-mentioned strip representative comprises the image P in the subject 1 11, P 14With hemorrhage image P 12, P 13The parts of images group.On the other hand, the pathological changes labelling 120c of above-mentioned strip representative comprises the image P that fades among whole in-vivo image AI 34, P 36The parts of images group.In this parts of images group, for example comprise the image P that fades 34, P 36With image P 31, P 32, P 33, P 35, P 37In addition, the image P in the above-mentioned subject 1 31, P 32, P 33, P 35, P 37, be near fading image P 34, P 36Near the image of frame number is an image of having taken normal internal organs inside.
Afterwards, control part 25 carries out the image P that comprises in the group of pictures in the subject 1 according to the demonstration indication information by input part 11 inputs n(n=1,2,3 ...) be presented at the control on the main viewing area 100, and along the time bar 110 moving sliders 111 feasible time locations of representing the current display image of current demonstration in the main viewing area 100.In this case, if the current display image of above-mentioned main viewing area 100 is not the pathological changes image, then control part 25 carries out the control that the slide block 111 of time location that will this current display image of expression shows with the acquiescence color.On the other hand, if the current display image of above-mentioned main viewing area 100 is hemorrhage images, then control part 25 carries out the control that the slide block 111 of time location that will this hemorrhage image of expression shows with hemorrhage pathological changes color, if this current display image is the image that fades, then carry out the control that the slide block 111 of time location that will this image that fades of expression shows with the pathological changes color that fades.
Specifically, as shown in figure 11, if the current display image of main viewing area 100 is hemorrhage image P 12Perhaps hemorrhage image P 13, the then control of the pathological changes color that the control part 25 acquiescence complexion changed of slide block 111 of indication range that carries out being positioned at above-mentioned pathological changes labelling 120a is more hemorrhage.In this case, control part 25 will be represented above-mentioned hemorrhage image P 12, P 13The demonstration color of slide block 111 of time location be made as hemorrhage pathological changes color (for example red) with pathological changes labelling 120a same color.In addition, if the current display image of main viewing area 100 is image P 11, P 14Etc. normal internal organs image, even then be positioned under the situation of indication range of pathological changes labelling 120a at slide block 111, control part 25 also is made as the acquiescence color with the demonstration color of this slide block 111.
In addition, if the current display image of main viewing area 100 is image P 31, P 32, P 33, P 35, P 37Etc. normal internal organs image, even then be positioned under the situation of indication range of pathological changes labelling 120c at slide block 111, control part 25 also is made as the acquiescence color with the demonstration color of this slide block 111.On the other hand, if the current display image of main viewing area 100 is the image P that fade 34Perhaps P 36, the then control of the pathological changes color that more fades of the control part 25 acquiescence complexion changed of slide block 111 that carries out to be positioned at the indication range of above-mentioned pathological changes sign 120c.In this case, control part 25 will be represented the above-mentioned image P that fades 34, P 36The demonstration color of slide block 111 of time location be made as the pathological changes color that fades (for example white) with pathological changes labelling 120c same color.
Like this, control part 25 is by the demonstration color of control slide block 111, the time location of the current display image among the whole in-vivo image AI of slide block 111 expressions, and can utilize this demonstration color (for example, acquiescence color, hemorrhage pathological changes color, the pathological changes color that fades) to show whether this current display image is which of the hemorrhage image or the image that fades pathological changes image and this pathological changes image are.In addition, above-mentioned slide block 111 is presented on the position of the current display image that leaves main viewing area 100.Therefore, above-mentioned slide block 111 will show that complexion changed turns under the situation of multiple pathological changes color or acquiescence color, does not hinder the current display image of observing this main viewing area 100 yet.
Thereby, user such as doctor or nurse can not be subjected to the obstruction ground of the demonstration complexion changedization of above-mentioned slide block 111 to observe the current display image of main viewing area 100, and by the pathological changes color of the above-mentioned slide block 111 of identification, the kind (bleeding part or the position of fading) of the meaning that can easily to understand this current display image be the pathological changes image and the pathological changes of this pathological changes graphical representation.Its result, the user is all comprising under the situation of multiple pathological changes image among the in-vivo image AI, be positioned at slide block 111 under the state of indication range of the pathological changes labelling that shows by labelling display part 120, also can from the parts of images group in the subject on being presented at main viewing area 100 successively 1, easily find out and the lesions showed image, and can easily determine the kind (bleeding part or the position of fading) of the pathological changes of this pathological changes graphical representation.
Specifically, the user is positioned at slide block 111 under the state of indication range of the pathological changes labelling 120a that is shown as strip, can easily determine hemorrhage image P from the parts of images group (each image of frame number n=11～14) in the subject on being presented at main viewing area 100 successively 1 12, P 13Thus, can be with above-mentioned hemorrhage image P 12, P 13Easily be presented at main viewing area 100, and can easily observe above-mentioned hemorrhage image P 12, P 13Subject in bleeding part BS in the subject that comprises 1.
In addition, the user is positioned at slide block 111 under the state of indication range of the pathological changes labelling 120c that is shown as strip, can easily determine the image P that fades from the parts of images group (each image of frame number n=31～37) in the subject on being presented at main viewing area 100 successively 1 34, P 36Thus, can be with the above-mentioned image P that fades 34, P 36Easily be presented on the main viewing area 100, and can easily observe the above-mentioned image P that fades 34, P 36Subject in the position E that fades in the subject that comprises 1.
More than, as mentioned above, in embodiments of the present invention 2, except the function of above-mentioned embodiment 1, detect the multiple pathological changes image that comprises in the tested intravital group of pictures, a plurality of pathological changes labellings of representing each time location of above-mentioned multiple pathological changes image are shown with the pathological changes color different by the kind of pathological changes.In addition, the slide block that shows the time location of the current display image that shows in the main viewing area of expression with the acquiescence color, under the current display image of this main viewing area is some situations in the multiple pathological changes image, with the acquiescence complexion changed of this slide block different pathological changes color more by the kind of this pathological changes image.Therefore, even in the tested intravital group of pictures of display process object, comprise under the situation of multiple pathological changes image, also pass through the demonstration color (pathological changes color or acquiescence color) of the above-mentioned slide block of identification, whether the current display image that can easily judge this main viewing area is the pathological changes image, and can easily judge the kind of the pathological changes of this pathological changes graphical representation.Its result, the image display device that can be achieved as follows: the action effect of enjoying above-mentioned embodiment 1, and can easily determine the kind of the multiple pathological changes image that comprises in the tested intravital group of pictures, can easily show the pathological changes image of expectation from above-mentioned tested intravital group of pictures.
According to the image display device relevant with embodiments of the present invention 2, exist under the situation of multiple pathological changes image even in tested intravital group of pictures, mix, also can from above-mentioned multiple pathological changes image, easily search the pathological changes image of having taken expectation pathological changes (for example, bleeding part, the position etc. of fading).Its result can easily observe the multiple pathological changes image that comprises in the above-mentioned tested intravital group of pictures.
Embodiment 3
Then, embodiments of the present invention 3 are described.In above-mentioned embodiment 2, the multiple pathological changes image that comprises among whole in-vivo image AI is detected, in order to represent respectively with above-mentioned multiple pathological changes image different pathological changes colors shows slide block 111 by each pathological changes, but in present embodiment 3, further from the multiple pathological changes of above-mentioned multiple pathological changes graphical representation, select the pathological changes of expectation, show the pathological changes labelling corresponding and the pathological changes color of slide block 111 with the expectation pathological changes of selecting.
Figure 12 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 3.As shown in figure 12, the image display device 34 relevant with present embodiment 3 replaces the control part 25 of the image display device 24 relevant with above-mentioned embodiment 2 and has control part 35.In above-mentioned image display device 34, display part 12 further shows and is used to select to expect that the GUI of pathological changes is a pathological changes selection portion 160.In addition, the in-examiner information acquisition system relevant with embodiments of the present invention 3 replaces the image display device 24 of the in-examiner information acquisition system relevant with above-mentioned embodiment 2 and has image display device 34.Other structure is identical with embodiment 2, to same structure part labelling same-sign.
The control part 25 of the image display device 24 that control part 35 and above-mentioned embodiment 2 are related is roughly similarly controlled input part 11, display part 12, card I/F13 and storage part 14 respectively, and is controlled the input and output of the information between above-mentioned each structural portion.Except this control function, control part 35 control mark display parts 120 feasible pathological changes labellings that only show the pathological changes color corresponding with the pathological changes of selecting by the pathological changes selection portion 160 that shows in the display part 12.In addition, be displayed under the situation on the main viewing area 100 will being included in pathological changes image in the subject by the pathological changes that above-mentioned pathological changes selection portion 160 is selected, control part 35 carries out showing with the pathological changes color corresponding with the pathological changes of this selection the control of slide block 111.This control part 35 has the above-mentioned lesion detection 25b of portion, and replace embodiment 2 control part 25 display control unit 25a and have display control unit 35a.And control part 35 has object pathological changes configuration part 35c, and this object pathological changes configuration part 35c will be set at the pathological changes (object pathological changes) of process object by the pathological changes that above-mentioned pathological changes selection portion 160 is selected.
Display control unit 35a has the function roughly same with the display control unit 25a of above-mentioned control part 25.Specifically, display control unit 35a carries out following control: will for example comprise each pictorial display in whole in-vivo image AI of the hemorrhage image and the image that fades on main viewing area 100.Meanwhile, along the time bar 110 moving sliders 111 feasible time locations of representing the current display image of these main viewing areas 100.Beyond the current display image of this main viewing area 100 is the pathological changes image under the situation of (being normal internal organs image), display control unit 35a carries out the control that the slide block 111 of time location that will this current display image of expression shows with the acquiescence color.On the other hand, the bleeding part is being set under the situation of object pathological changes by object pathological changes configuration part 35c, if the current display image of this main viewing area 100 is hemorrhage images, then display control unit 35a carries out the control of the pathological changes color that the demonstration complexion changed of slide block 111 of the time location of this hemorrhage image of expression is more hemorrhage.In addition, be set under the situation of object pathological changes at the position of will fading by object pathological changes configuration part 35c, if the current display image of this main viewing area 100 is the images that fade, then display control unit 35a carries out the control of the pathological changes color that the demonstration complexion changed of slide block 111 with the time location of this image that fades of expression more fades.
In addition, display control unit 35a with whole in-vivo image AI among the corresponding respectively a plurality of pathological changes labellings of the multiple pathological changes image (for example hemorrhage image and the image that fades) that comprises, the pathological changes labelling 1 or more corresponding with the pathological changes more than 1 that is set at the object pathological changes by object pathological changes configuration part 35c is presented on the labelling display part 120.Specifically, the bleeding part is being set under the situation of object pathological changes by object pathological changes configuration part 35c, display control unit 35a control mark display part 120 makes and comes the lesions showed labelling with hemorrhage pathological changes color that this pathological changes labelling is represented the time location by the hemorrhage image in the detected whole in-vivo image AI of the 25b of lesion detection portion.On the other hand, be set under the situation of object pathological changes at the position of will fading by object pathological changes configuration part 35c, display control unit 35a control mark display part 120 makes and comes the lesions showed labelling with the pathological changes color that fades that this pathological changes labelling is represented the time location by the image that fades in the detected whole in-vivo image AI of the 25b of lesion detection portion.In addition, by object pathological changes configuration part 35c the bleeding part and the position of fading are being set under the situation of object pathological changes, display control unit 35a control mark display part 120 makes will be represented that pathological changes labelling by the time location of the hemorrhage image in the detected whole in-vivo image AI of the 25b of lesion detection portion shows with hemorrhage pathological changes color and will represent that the pathological changes labelling of the time location of the image that fades in whole in-vivo image AI shows with the pathological changes color that fades.
Object pathological changes configuration part 35c will be set at the object pathological changes by the pathological changes of selecting as the pathological changes selection portion 160 of the GUI that shows on the display part 12 more than 1.The object pathological changes of being set by above-mentioned object pathological changes configuration part 35c is the pathological changes of the corresponding display process object of the pathological changes labelling that shows with labelling display part 120, and is to be the pathological changes that is presented at the corresponding display process object of pathological changes color on the slide block 111 under the situation of pathological changes image with current display image in main viewing area 100.Specifically, selecting under the situation of bleeding part by above-mentioned pathological changes selection portion 160, object pathological changes configuration part 35c is set at the object pathological changes with the bleeding part, and under the situation at position of having selected by above-mentioned pathological changes selection portion 160 to fade, the position of will fading is set at the object pathological changes.In addition, selecting by above-mentioned pathological changes selection portion 160 under the situation at the bleeding part and the position of fading, object pathological changes configuration part 35c is set at the object pathological changes with the bleeding part and the position of fading.
Then, the Show Styles of illustration display part 12 illustrates the action of the display control unit 35a of GUI that shows in the display part 12 and the display action of controlling display part 12 particularly.Figure 13 is that illustration will be expected the sketch map of the Show Styles of the display parts 12 that the pathological changes selection portion 160 of the GUI of pathological changes further shows as selection.
As shown in figure 13, on the display part 12 of this image display device 34, among the window displayed W1, append to form and select to expect that the GUI of pathological changes is a pathological changes selection portion 160.In addition, current display image in main viewing area 100 is under the situation of pathological changes image, if the pathological changes of this pathological changes graphical representation is the pathological changes of selecting by pathological changes selection portion 160, then slide block 111 shows the pathological changes color corresponding with the pathological changes of this selection, if the pathological changes of this pathological changes graphical representation is not the pathological changes of selecting by pathological changes selection portion 160,, then current display image also shows the acquiescence color even being the pathological changes image.Labelling display part 120 show with by the corresponding pathological changes labelling more than 1 of the pathological changes of these pathological changes selection portion 160 selections, for example above-mentioned pathological changes labelling 120a, 120b, 120c.Other Show Styles of above-mentioned window W1 are identical with the situation of above-mentioned embodiment 2.
As mentioned above, pathological changes selection portion 160 is to select the GUI of expectation pathological changes from multiple pathological changes (for example bleeding part, the position etc. of fading), and for example the pattern with button is presented on the display part 12.Above-mentioned pathological changes selection portion 160 clicking operation by having used input part 11 etc. is selected the expectation pathological changes more than 1.Specifically, pathological changes selection portion 160 waits the choice menus of opening regulation by the clicking operation of having used input part 11, is presented at the pathological changes of selecting the multiple pathological changes on this choice menus more than 1 from guide look.The pathological changes of selecting by above-mentioned pathological changes selection portion 160 more than 1 is set to object pathological changes more than 1 by above-mentioned object pathological changes configuration part 35c.
Figure 14 is the sketch map of expression by a concrete example of the choice menus of pathological changes selection portion 160 expressions.As shown in figure 14, pathological changes selection portion 160 is opened and is for example had a guide look of the choice menus 161 that shows hemorrhage (position) and fade (position) as pathological changes.In above-mentioned choice menus 161, comprise: be used for as the pathological changes of process object and select the hemorrhage selection portion 162 of bleeding part and be used for as the pathological changes of process object and the selection portion 163 of fading at the position of selecting to fade.
Specifically, the clicking operation of hemorrhage selection portion 162 by having used input part 11 etc. are selected the bleeding part as the pathological changes of expectation, and show that expression selected the labelling (レ symbol for example shown in Figure 14) of the meaning of bleeding part.In this case, input part 11 will select the selection information of the meaning of bleeding part to be input to control part 35.Above-mentioned object pathological changes configuration part 35c is set at the object pathological changes according to the selection information of the bleeding part of importing by above-mentioned input part 11 with the bleeding part.
The clicking operation of the selection portion of fading 163 by having used input part 11 etc. as the pathological changes of expectation and the position of selecting to fade, and show expression selected the to fade labelling (レ symbol for example shown in Figure 14) of the meaning at position.In this case, input part 11 is input to control part 35 with the selection information of the meaning at the position of selecting to fade.Above-mentioned object pathological changes configuration part 35c is according to the selection information at the position of importing by above-mentioned input part 11 of fading, and the position of will fading is set at the object pathological changes.
On the other hand, in above-mentioned choice menus 161, also comprising does not as shown in figure 14 have the selection portion 164 of demonstration.Do not have to show that selection portion 164 selects not show the state of pathological changes labelling of whole pathological changes at the bleeding part and the position of fading etc.Specifically, do not have to show that the clicking operation of selection portion 164 by having used input part 11 etc. select the no show state of pathological changes labelling, and show that expression selected the labelling (for example レ symbol) of the meaning of above-mentioned no show state, expression has selected the labelling of the meaning of bleeding part and expression selected the to fade labelling of the meaning at position to become non-demonstration.In addition, when having selected the bleeding part or fade the position, expression has selected the labelling of the meaning of no show state to become non-demonstration.In this case, input part 11 will select the selection information of the meaning of no show state to be input to control part 35.Display control unit 35a does not show the control of the pathological changes labelling (pathological changes labelling 120a, 120b, 120c for example shown in Figure 13) of whole pathological changes according to the selection information of the no show state of importing by above-mentioned input part 11.By the control of above-mentioned display control unit 35a, even detecting under the situation of the pathological changes image in whole in-vivo image AI by the above-mentioned lesion detection 25b of portion, the pathological changes labelling is not presented in the labelling display part 120 yet.In addition, display control unit 35a carries out also can not showing the pathological changes labelling of whole pathological changes thus to the not control of show tags display part 120 of display part 12 according to the selection information of the no show state of importing by above-mentioned input part 11.
Then, the action of control part 35 is described, this control part 35 carries out the control of each pictorial display on main viewing area 100 that will comprise among whole in-vivo image AI, and the demonstration color of the slide block 111 of the time location of the current display image of representing this main viewing area 100 is controlled.Figure 15 is the flow chart of processing procedure of the control part 35 of the explanation image display device 34 relevant with embodiment 3.
The control part 25 of the image display device 24 that control part 35 and above-mentioned embodiment 2 are related roughly similarly, carry out the control of each pictorial display on main viewing area 100 that to comprise among whole in-vivo image AI, and the demonstration color of the slide block 111 of the time location of the current display image of representing this main viewing area 100 is controlled.In this case, if current display image is beyond the pathological changes image, then control part 35 is made as the acquiescence color with the demonstration color of this slide block 111.On the other hand, be set in the bleeding part under the state of object pathological changes, if current display image is hemorrhage image, then control part 35 is made as hemorrhage pathological changes color with the demonstration color of this slide block 111.In addition, be set at the position of fading under the state of object pathological changes, if current display image is the image that fades, then control part 35 is made as the pathological changes color that fades with the demonstration color of this slide block 111.
Promptly, as shown in figure 15, control part 35 carries out the same processing procedure with above-mentioned steps S401～S403 (with reference to Figure 10), the frame number n of the whole in-vivo image AI of initialization, judge and have or not the pictorial display indication, having under the situation of pictorial display indication, reading in image (the step S501～S503) of the present frame numbering in these whole in-vivo image AI.
Then, control part 35 is judged the pathological changes of selecting by above-mentioned pathological changes selection portion 160 (being the object pathological changes).In this case, control part 35 for example judges whether the bleeding part is object pathological changes (step S504).Specifically, selected by pathological changes selection portion 160 under the situation of bleeding part, object pathological changes configuration part 35c is set at the object pathological changes according to the selection information of the bleeding part of importing by input part 11 with the bleeding part.Like this, if object pathological changes configuration part 35c is set at the object pathological changes with the bleeding part, then control part 35 judges that the bleeding part is object pathological changes (step S504, "Yes"), whether the image (being the image in the subject 1 of display process object) of judging the present frame numbering read in step S503 is hemorrhage image (step S505).In this case, display control unit 35a and above-mentioned step S404 are similarly, if the image to the present frame numbering has added hemorrhage pathological changes sign, the image that then is judged as this current frame number is hemorrhage image, if not additional hemorrhage pathological changes sign, the image that then is judged as this current frame number is not hemorrhage image.
Be under the state of object pathological changes in the bleeding part like this, at the image that is judged as present frame numbering (step S505 under the situation of hemorrhage image, "Yes"), control part 35 and above-mentioned step S406 similarly, carry out following control: the image that will represent this current frame number is that the slide block 111 of the time location of hemorrhage image shows (step S506) with hemorrhage pathological changes color.In this case, display control unit 35a make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame of hemorrhage image numbering, and carry out the control that will expression shows with hemorrhage pathological changes color (for example red) as the slide block 111 of the time location of the image of the present frame numbering of above-mentioned hemorrhage image.
On the other hand, if do not select the bleeding part by pathological changes selection portion 160, then object pathological changes configuration part 35c is not set at the bleeding part object pathological changes.Like this, if object pathological changes configuration part 35c is not set at the bleeding part object pathological changes, then to be judged as the bleeding part be not object pathological changes (step S504, "No") to control part 35, and judge whether the position of fading is object pathological changes (step S507).Specifically, under the situation at position of having selected by pathological changes selection portion 160 to fade, object pathological changes configuration part 35c is according to the selection information by the position of fading of input part 11 inputs, and the position of will fading is set at the object pathological changes.Like this, the position is set at the object pathological changes if object pathological changes configuration part 35c will fade, then to be judged as the position of fading be object pathological changes (step S507, "Yes") to control part 35, judges whether the image of the present frame numbering of reading in step S503 is the image (step S508) that fades.In this case, display control unit 35a and above-mentioned steps S405 are similarly, if the image to the present frame numbering has added the pathological changes sign that fades, the image that then is judged as this current frame number is the image that fades, if there is not the additional pathological changes sign that fades, the image that then is judged as this current frame number is not the image that fades.
Be under the state of object pathological changes at the position of fading like this, control part 35 is (the step S508 under the situation of image that fades at the image that is judged as present frame numbering, "Yes"), with above-mentioned step S407 similarly, carry out will this current frame number of expression the image control (step S509) that the slide block 111 of time location of image shows with the pathological changes color that fades of promptly fading.In this case, display control unit 35a make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame numbering of the image that fades, and carry out the control that will expression shows with the pathological changes color (for example white) that fades as the slide block 111 of the time location of the image of the present frame numbering of the above-mentioned image that fades.
On the other hand, if do not utilize pathological changes selection portion 160 to select to fade the position, then the 35c position of will not fading in object pathological changes configuration part is set at the object pathological changes.Like this, the position is not set at the object pathological changes if object pathological changes configuration part 35c will not fade, then to be judged as the position of fading be not object pathological changes (step S507 to control part 35, "No"), with above-mentioned steps S408 similarly, carry out slide block 111 with the time location of the image of this current frame number of expression with the control (step S510) that shows of acquiescence color.
In addition, control part 35 is judged as present frame numbering in above-mentioned steps S505 image is not (step S505, a "No") under the situation of hemorrhage image, enters step S507, repeats the later processing procedure of this step S507.In addition, control part 35 is judged as present frame numbering in above-mentioned steps S508 image is not to fade (step S508, "No") under the situation of image, enters step S510, repeats the later processing procedure of this step S510.
That is, if any one of the bleeding part and the position of fading is not the object pathological changes, then display control unit 35a carries out in step S510 representing that the slide block 111 of the time location of the image that present frame is numbered is shown as the control of giving tacit consent to color (for example Lycoperdon polymorphum Vitt).In this case, the picture material (that is, being normal internal organs image or pathological changes image) of display control unit 35a and this current frame number irrespectively is made as the acquiescence color with the demonstration color of above-mentioned slide block 111.In addition, only the bleeding part among the bleeding part and the position of fading is under the situation of object pathological changes, if the image of present frame numbering is not hemorrhage image, then display control unit 35a carries out following control in step S510: the slide block 111 that will represent the time location of the image that present frame is numbered is shown as the acquiescence color.In this case, even the image of this current frame number is the image that fades, display control unit 35a also is made as the acquiescence color with the demonstration color of above-mentioned slide block 111.In addition, only the position of fading among the bleeding part and the position of fading is under the situation of object pathological changes, if the image of present frame numbering is not the image that fades, then display control unit 35a carries out following control in step S510: the slide block 111 that will represent the time location of the image that present frame is numbered is shown as acquiescence color (for example Lycoperdon polymorphum Vitt).In this case, even the image of this current frame number is hemorrhage image, display control unit 35a also is made as the acquiescence color with the demonstration color of above-mentioned slide block 111.
Afterwards, control part 35 and above-mentioned steps S409 similarly carry out showing in main viewing area 100 control (step S511) of the image of present frames numbering.In this case, if the image of present frame numbering is normal internal organs image, then the normal internal organs pictorial display that display control unit 35a will this current frame number is in main viewing area 100, if the image of present frame numbering is hemorrhage image, hemorrhage pictorial display that then will this current frame number is in main viewing area 100, if the image of present frame numbering is the image that fades, the pictorial display that fades that then will this current frame number is in main viewing area 100.
In addition, being presented at the frame number (be present frame numbering) of the image on the main viewing area 100 in this step S511, is initialized frame number or the frame number upgraded in step S512 described later in above-mentioned steps S501.
Then, control part 35 and above-mentioned steps S410 similarly, the frame number n (step S512) of whole in-vivo image AI of update displayed process object.And, control part 35 and above-mentioned steps S411 similarly, that judges image that dereliction viewing area 100 is arranged temporarily stops indication (step S513), (step S513 under the situation that temporarily stops to indicate is being arranged, "Yes"), returns step S502, repeat the later processing procedure of this step S502.
On the other hand, (step S513 under the situation that does not temporarily stop to indicate, "No"), with above-mentioned steps S412 similarly, control part 35 pictorial display that will comprise among the whole in-vivo image AI pictorial display on main viewing area 100 that judges whether to be through with is handled (step S514).Handle (step S514 under the situation not have end being judged as pictorial display, "No"), control part 35 returns step S503, repeat the later processing procedure of this step S503, handle (step S514 under the situation about being through with being judged as pictorial display, "Yes"), the pictorial display that finishes the image in the above-mentioned subject 1 is handled.
Then, illustration will specify the action of the control part 35 that carries out following control as the bleeding part and the situation of pictorial display on main viewing area 100 of fading of an example of multiple pathological changes image: show with by the pathological changes more than 1 of pathological changes selection portion 160 selections, promptly be set at the pathological changes more than 1 (for example at least one in the bleeding part and the position of fading) the corresponding pathological changes labelling and the pathological changes color of slide block 111 of object pathological changes by object pathological changes configuration part 35c.Figure 16 is used to illustrate the sketch map of the demonstration pathological changes labelling corresponding with the pathological changes that is set at the object pathological changes with the action of the control part 35 of the pathological changes color of slide block 111.
At first, specify the action of the control part 35 that carries out following control: show the pathological changes labelling 1 or more corresponding with the pathological changes more than 1 that is set at above-mentioned object pathological changes.Each pictorial display that control part 35 comprises in whole in-vivo image AI is before on the main viewing area 100, and pathological changes labelling that will be corresponding with the pathological changes that is set at the object pathological changes is presented on the labelling display part 120.For example, the situation of control part 35 and above-mentioned embodiment 2 similarly detects the hemorrhage image P that comprises among whole in-vivo image AI 12, P 13With the image P that fades 34, P 36
At this, in the bleeding part and the position of fading be under the situation of object pathological changes, as shown in figure 16, control part 35 is presented at pathological changes labelling 120a on the labelling display part 120 with hemorrhage pathological changes color (for example red), and pathological changes labelling 120c is presented on the labelling display part 120 with the pathological changes color (for example white) that fades, wherein, described pathological changes labelling 120a represents to be included in as the bleeding part of object pathological changes the hemorrhage image P in the subject 12, P 13Time location, described pathological changes labelling 120c represents to be included in as the position of fading of object pathological changes the image P that fades in the subject 34, P 36Time location.
On the other hand, only the bleeding part among the bleeding part and the position of fading is under the situation of object pathological changes, as shown in figure 16, control part 35 is presented at pathological changes labelling 120a on the labelling display part 120 with hemorrhage pathological changes color, wherein, described pathological changes labelling 120a represents to be included in as the bleeding part of object pathological changes the hemorrhage image P in the subject 12, P 13Time location.Relative therewith, control part 35 is not presented at pathological changes labelling 120c on the labelling display part 120, and wherein, described pathological changes labelling 120c represents not comprise in the subject image P that fades of above-mentioned object pathological changes (bleeding part) 34, P 36Time location.
On the other hand, only the position of fading among the bleeding part and the position of fading is under the situation of object pathological changes, as shown in figure 16, control part 35 is presented at pathological changes labelling 120c on the labelling display part 120 with the pathological changes color that fades, wherein, described pathological changes labelling 120c represents to be included in as the position of fading of object pathological changes the image P that fades in the subject 34, P 36Time location.Relative therewith, control part 35 is not presented at pathological changes labelling 120a on the labelling display part 120, and wherein, described pathological changes labelling 120a represents not comprise in the subject the hemorrhage image P of above-mentioned object pathological changes (position of fading) 12, P 13Time location.
Then, specify the action of carrying out the pathological changes color corresponding with the pathological changes that is set at above-mentioned object pathological changes is presented at the control part 35 of the control on the slide block 111.Control part 35 carries out the image P that comprises in the group of pictures in the subject 1 according to the demonstration indication information by input part 11 inputs n(n=1,2,3 ...) be presented at the control on the main viewing area 100, and along the time bar 110 moving sliders 111 feasible time locations of representing the current display image of current demonstration in the main viewing area 100.
At this, in the bleeding part and the position of fading be under the situation of object pathological changes, control part 35 shows pathological changes labelling 120a, the 120c of strip on labelling display part 120 as mentioned above.In addition, above-mentioned pathological changes labelling 120a represents the image P in the subject 1 11, P 14With hemorrhage image P 12, P 13The parts of images group who comprises (that is the parts of images group of frame number n=11～14).In addition, above-mentioned pathological changes labelling 120c representative is with the image P that fades in the subject 1 34, P 36With image P 31, P 32, P 33, P 35, P 37The parts of images group who comprises (that is the parts of images group of frame number n=31～37).
Current display image in main viewing area 100 is under the situation of normal internal organs image, and control part 35 carries out representing the control of the slide block 111 of this normal internal organs image temporal position with the demonstration of acquiescence color.Relative therewith, in the bleeding part and the position of fading be under the state of object pathological changes, if the current display image of main viewing area 100 is hemorrhage image P 12Perhaps hemorrhage image P 13, then control part 35 carries out and will be positioned at the more control of hemorrhagic disease variable color of acquiescence complexion changed of slide block 111 of the indication range of above-mentioned pathological changes labelling 120a.In this case, control part 35 will be represented the hemorrhage image P corresponding with above-mentioned object pathological changes 12, P 13The demonstration color of slide block 111 of time location be made as hemorrhage pathological changes color (for example red) with pathological changes labelling 120a same color.
In addition, in the bleeding part and the position of fading be under the state of object pathological changes, if the current display image of main viewing area 100 is the image P that fade 34Image P perhaps fades 36, then control part 35 carries out following control: will be positioned at the pathological changes color that the acquiescence complexion changed of slide block 111 of the indication range of above-mentioned pathological changes labelling 120c more fades.In this case, control part 35 will be represented the fade image P corresponding with above-mentioned object pathological changes 34, P 36The demonstration color of slide block 111 of time location be made as the pathological changes color that fades (for example white) with pathological changes labelling 120c same color.
In addition, if the current display image of main viewing area 100 is image P 11, P 14Deng normal internal organs image, even then be positioned under the situation of indication range of pathological changes labelling 120a at slide block 111, control part 35 also is made as the acquiescence color with the demonstration color of this slide block 111.Identical therewith, if the current display image of main viewing area 100 is image P 31, P 32, P 33, P 35, P 37Deng normal internal organs image, even then be positioned under the situation of indication range of pathological changes labelling 120c at slide block 111, control part 35 also is made as the acquiescence color with the demonstration color of this slide block 111.
On the other hand, only the bleeding part among the bleeding part and the position of fading is under the situation of object pathological changes, and as shown in figure 16, control part 35 shows the pathological changes labelling 120a of strip, not lesions showed labelling 120c on labelling display part 120.Current display image in main viewing area 100 is under the situation of normal internal organs image, and the ground, position that control part 35 does not rely on the time bar 110 carries out following control: the slide block 111 that will represent the time location of this normal internal organs image shows with the acquiescence color.
Be under the state of object pathological changes only, if the current display image of main viewing area 100 is hemorrhage image P in the bleeding part 12Perhaps hemorrhage image P 13, then with the bleeding part and the position of fading be the object pathological changes situation similarly, the control of the pathological changes color that the acquiescence complexion changed of slide block 111 of indication range that this control part 35 carries out being positioned at above-mentioned pathological changes labelling 120a is more hemorrhage.Relative therewith and since the position of fading be not the object pathological changes and only the bleeding part be the object pathological changes, therefore even the current display image of main viewing area 100 is the image P that fade 34Image P perhaps fades 36, control part 35 also will be represented the above-mentioned image P that fades 34, P 36The demonstration color of slide block 111 of time location be made as the acquiescence color.Promptly, be under the situation of object pathological changes only in the bleeding part, 35 of control parts will represent that the slide block 111 that the bleeding part as this object pathological changes is included in the state of the hemorrhage image temporal position in the subject shows with hemorrhage pathological changes color, and show the slide block 111 of state in addition with the acquiescence color.
On the other hand, only the position of fading among the bleeding part and the position of fading is under the situation of object pathological changes, and as shown in figure 16, control part 35 will show the pathological changes labelling 120c of strip, not lesions showed labelling 120a on labelling display part 120.Current display image in main viewing area 100 is under the situation of normal internal organs image, and the ground, position that control part 35 does not rely on the time bar 110 carries out following control: the slide block 111 that will represent the time location of this normal internal organs image shows with the acquiescence color.
Be under the state of object pathological changes only, if the current display image of main viewing area 100 is the image P that fade at the position of fading 34Image P perhaps fades 36, then with the bleeding part and the position of fading be the object pathological changes situation similarly, the control of the pathological changes color that the acquiescence complexion changed of slide block 111 that this control part 35 carries out being positioned at the indication range of above-mentioned pathological changes labelling 120c more fades.Relative therewith, because the bleeding part is not an object pathological changes and the position of only fading is the object pathological changes, even therefore the current display image of main viewing area 100 is hemorrhage image P 12Perhaps hemorrhage image P 13, control part 35 also will be represented above-mentioned hemorrhage image P 12, P 13The demonstration color of slide block 111 of time location be made as the acquiescence color.Promptly, be under the situation of object pathological changes only at the position of fading, 35 of control parts will represent that the slide block 111 of state that the position of fading as this object pathological changes is included in the time location of the image that fades in the subject shows with the pathological changes color that fades, and the slide block 111 of in addition state is shown with the acquiescence color.
Like this, control part 35 is by the demonstration of control pathological changes labelling, and labelling display part 120 can only show and the corresponding pathological changes labelling of selecting by pathological changes selection portion 160 of expectation pathological changes.Therefore, can be in the subject 1 that multiple pathological changes image blend exists whole in-vivo image AI, the time location of the pathological changes image at expectation pathological changes (for example bleeding part, the position etc. of fading) has been taken in expression.Its result exists under the situation of multiple pathological changes image even mixes in whole in-vivo image AI, does not also disturb the pathological changes labelling of the time location of representing other pathological changes images, and can easily confirm the time location of the expectation pathological changes image that observe.
In addition, control part 35 is by the demonstration color of control slide block 111 like this, slide block 111 does not similarly hinder the current display image of observing main viewing area 100 with the situation of above-mentioned embodiment 2, and can show that color shows whether this current display image is that pathological changes image and this pathological changes image are hemorrhage images or fade image according to this.
And, only under the current situation about being presented on the main viewing area 100 of pathological changes image of the expectation pathological changes that will represent to select by pathological changes selection portion 160, above-mentioned slide block 111 shows the pathological changes color corresponding with the pathological changes of this pathological changes graphical representation, so whether the current display image that can easily represent main viewing area 100 is the pathological changes image of the expectation that observe.Its result exists under the situation of multiple pathological changes image even mix in whole in-vivo image AI, also can easily represent the current meaning that is presented on the main viewing area 100 of the expectation pathological changes image that observe.
Thereby, user such as doctor or nurse can not be subjected to the obstruction ground of the demonstration complexion changedization of above-mentioned slide block 111 to observe the current display image of main viewing area 100, and, can understand this current display image easily and be the kind (bleeding part or the position of fading) of the pathological changes of the meaning of pathological changes image of the expectation that observe and this pathological changes graphical representation by the pathological changes color of identification slide block 111.Its result, the user is all comprising under the situation of multiple pathological changes image among the in-vivo image AI, also can easily find out the expectation pathological changes image that observe from the group of pictures in the subject on being presented at main viewing area 100 successively 1 shows, and can easily determine the kind (bleeding part or the position of fading) of the pathological changes of this pathological changes graphical representation, can observe the pathological changes image of above-mentioned expectation effectively.
More than, as mentioned above, in embodiments of the present invention 3, except the function of above-mentioned embodiment 2, from multiple pathological changes, select the expectation pathological changes more than 1, the pathological changes labelling of time location of pathological changes image of expression having been taken the pathological changes (object pathological changes) of this selection shows, be under the situation of current display image of main viewing area at the pathological changes image of above-mentioned object pathological changes, the demonstration color of the slide block of the time location of this current display image of expression pathological changes image that is above-mentioned object pathological changes is shown with the pathological changes color corresponding with this object pathological changes.Therefore, even in the tested intravital group of pictures of display process object, comprise under the situation of multiple pathological changes image, also can easily show the time location of the expectation pathological changes image in the above-mentioned multiple pathological changes image, and can judge easily whether the image that is presented on this main viewing area is the pathological changes image of expectation.Its result, the image display device that can be achieved as follows: the action effect of enjoying above-mentioned embodiment 2, and select the expectation pathological changes image observe in the multiple pathological changes image that can in subject, comprise the group of pictures, can easily observe the expectation pathological changes image of selection.
Embodiment 4
Then, embodiments of the present invention 4 are described.In above-mentioned embodiment 3, from multiple pathological changes, select the pathological changes of expectation, show the pathological changes labelling corresponding and the pathological changes color of slide block 111 with the expectation pathological changes of selecting, but in this embodiment 4, further select display mode, whole in-vivo image AI are presented at main viewing area 100 with the display mode of selecting to the image of main viewing area 100.
Figure 17 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 4.As shown in figure 17, the image display device 44 relevant with this embodiment 4 replaces the control part 35 of the image display device 34 relevant with above-mentioned embodiment 3 and has control part 45.In above-mentioned image display device 44, display part 12 shows that also the GUI that is used to select to the image display mode of main viewing area 100 is a mode selection part 170.In addition, the in-examiner information acquisition system relevant with embodiments of the present invention 4 replaces the image display device 34 of the in-examiner information acquisition system relevant with above-mentioned embodiment 3 and has image display device 44.Other structure is identical with embodiment 3, to same structure part labelling same-sign.
The control part 35 of the image display device 34 that control part 45 and above-mentioned embodiment 3 are related is roughly similarly controlled input part 11, display part 12, card I/F13 and storage part 14 respectively, controls the input and output of the information between above-mentioned each structural portion.In addition, control part 45 have with the same object pathological changes set-up function of above-mentioned control part 35 and with the presentation control function of the pathological changes color of corresponding pathological changes labelling of object pathological changes and slide block 111.Except this control function, control part 45 is set by being presented at the display mode that mode selection part 170 on the display part 12 has carried out the image selected, the pictorial display control of the display mode that sets.This control part 45 has above-mentioned 25b of lesion detection portion and object pathological changes configuration part 35c, replace embodiment 3 control part 35 display control unit 35a and have display control unit 45a.Control part 45 also has mode setting part 45d, and this mode setting part 45d will be set at the image display mode to main viewing area 100 by the display mode that above-mentioned mode selection part 170 is selected.
The display control unit 35a of display control unit 45a and above-mentioned control part 35 similarly, have the pathological changes labelling corresponding with the object pathological changes presentation control function and with the presentation control function of the pathological changes color of the corresponding slide block 111 of object pathological changes.And display control unit 45a carries out the demonstration control of image according to the display mode of the image of setting by mode setting part 45d.In the display mode of the image of setting by above-mentioned mode setting part 45d, comprise: the pathological changes play mode that whole in-vivo image AI of display process object are presented at the ordinary playing pattern on the main viewing area 100 and show the pathological changes image corresponding with the object pathological changes among these whole in-vivo image AI.Setting by mode setting part 45d under the situation of ordinary playing pattern, display control unit 45a carries out the control of each pictorial display on main viewing area 100 that will comprise among whole in-vivo image AI according to above-mentioned ordinary playing pattern.On the other hand, setting by mode setting part 45d under the situation of pathological changes play mode, display control unit 45a is according to above-mentioned pathological changes play mode, carry out following control: extract the pathological changes image corresponding in the multiple pathological changes image that comprises among whole in-vivo image AI out with the object pathological changes, with the pathological changes pictorial display extracted out on main viewing area 100.
Mode setting part 45d will be set at the image display mode to main viewing area 100 by the display mode that the mode selection part 170 that is presented on the display part 12 is selected.In this case, mode setting part 45d sets any in above-mentioned ordinary playing pattern and the pathological changes play mode as the image display mode to above-mentioned main viewing area 100.
Then, the Show Styles of particular instantiation display part 12 illustrates the action of the display control unit 45a of GUI that shows in the display part 12 and the display action of controlling display part 12.Figure 18 is that will to select GUI to the image display mode of main viewing area 100 be the sketch map that mode selection part 170 has further carried out the Show Styles of the display part 12 that shows to illustration.
As shown in figure 18, among the window displayed W1, appending the GUI that forms selection ordinary playing pattern or pathological changes play mode is mode selection part 170 in the display part 12 of this image display device 44.In addition, selecting by mode selection part 170 under the situation of ordinary playing pattern, the main viewing area 100 of above-mentioned window W1 shows each image that comprises among whole in-vivo image AI, selecting by mode selection part 170 under the situation of pathological changes play mode, showing the pathological changes image corresponding in the multiple pathological changes image that comprises among these whole in-vivo image AI with the object pathological changes.Other Show Styles of above-mentioned window W1 is identical with the situation of above-mentioned embodiment 3.
Mode selection part 170 has: the GUI that is used to select the ordinary playing pattern is an ordinary playing selection portion 171 and to be used to select the GUI of pathological changes play mode be that pathological changes is play selection portion 172.Above-mentioned ordinary playing selection portion 171 and pathological changes are play selection portion 172 and for example are presented on the display part 12 with the pattern of button.
Ordinary playing selection portion 171 waits the ordinary playing pattern of selecting by the clicking operation of having used input part 11.In this case, input part 11 will select the selection information of the meaning of ordinary playing pattern to be input to control part 45.Above-mentioned mode setting part 45d will be set at the ordinary playing pattern to the image display mode of main viewing area 100 according to the selection information of the ordinary playing pattern of being imported by above-mentioned input part 11.
Pathological changes broadcast selection portion 172 waits by the clicking operation of having used input part 11 selects the pathological changes play mode.In this case, input part 11 will select the selection information of the meaning of pathological changes play mode to be input to control part 45.Above-mentioned mode setting part 45d is according to the selection information by the pathological changes play mode of above-mentioned input part 11 inputs, will be set at the pathological changes play mode to the display mode of the image of main viewing area 100.
Then, the action of control part 45 is described, whole in-vivo image AI that this control part 45 will comprise multiple pathological changes image (for example hemorrhage image and the image that fades) are made as the group of pictures of display process object, carry out the control of pathological changes pictorial display on main viewing area 100 in these whole in-vivo image AI according to the pathological changes play mode, and the demonstration color of the slide block 111 of the time location of the current display image of representing this main viewing area 100 is controlled.Figure 19 is the flow chart of processing procedure of control part 45 that explanation carries out showing on main viewing area 100 according to the pathological changes play mode control of the pathological changes image in the subject 1.
Selecting under the situation of pathological changes play mode by mode selection part 170 (specifically pathological changes is play selection portion 172), control part 45 is according to above-mentioned pathological changes play mode, carry out pathological changes pictorial display the control on main viewing area 100 corresponding in the multiple pathological changes image in whole in-vivo image AI, and the demonstration color of representing the slide block 111 of the pathological changes image temporal position of current demonstration in this main viewing area 100 is controlled with the object pathological changes.In this case, control part 45 carries out following control: the slide block 111 that will represent the time location of above-mentioned pathological changes image shows with the pathological changes color corresponding with this object pathological changes.
Specifically, as shown in figure 19, control part 45 is at first set the pathological changes play mode of selecting by mode selection part 170 (step S601).In this case, mode setting part 45d is according to the selection information by the pathological changes play mode of input part 11 input, will be set at the pathological changes play mode to the display mode of the image of main viewing area 100.
Then, control part 45 carries out the same processing procedure with above-mentioned steps S501～S503 (with reference to Figure 15), the frame number n of the whole in-vivo image AI of initialization, and judgement has or not the pictorial display indication, having under the situation of pictorial display indication, reading in image (the step S602～S604) of the present frame numbering in these whole in-vivo image AI.
Then, control part 45 is judged the pathological changes (being the object pathological changes) by above-mentioned pathological changes selection portion 160 selections, in this case, control part 45 for example with above-mentioned steps S504 similarly, judge whether the bleeding part is object pathological changes (step S605).Be judged as (step S605, "Yes") under the situation that the bleeding part is the object pathological changes in this step S605, control part 45 judges whether the image of the present frame numbering of reading in is hemorrhage image (step S606) in step S604.In this case, display control unit 45a and above-mentioned step S505 are similarly, when on the image of present frame numbering, adding hemorrhage pathological changes sign, the image that is judged as this current frame number is hemorrhage image, if not additional hemorrhage pathological changes sign, the image that then is judged as this current frame number is not hemorrhage image.
Like this, in the bleeding part is under the state of object pathological changes, be judged as (step S606 under the situation that image when frame number is hemorrhage image, "Yes"), control part 45 and above-mentioned steps S506 similarly carry out following control: the slide block 111 that will represent the time location of the hemorrhage image that the image of this current frame number is promptly corresponding with the object pathological changes shows (step S607) with hemorrhage pathological changes color.In this case, display control unit 45a make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame of hemorrhage image numbering, and carry out the control that will expression shows with hemorrhage pathological changes color (for example red) as the slide block 111 of the time location of the image of the present frame numbering of above-mentioned hemorrhage image.
On the other hand, be judged as in above-mentioned steps S605 (step S605, "No") under the situation that the bleeding part is not the object pathological changes, control part 45 and above-mentioned steps S507 similarly judge whether the image that fades is object pathological changes (step S608).Be judged as (step S608, "Yes") under the situation that the position of fading is the object pathological changes in this step S608, control part 45 judges whether the image of the present frame numbering of reading in is the image (step S609) that fades in step S604.In this case, display control unit 45a and above-mentioned step S508 are similarly, if on the image of present frame numbering, added the pathological changes sign that fades, the image that then is judged as this current frame number is the image that fades, if there is not the additional pathological changes sign that fades, the image that then is judged as this current frame number is not the image that fades.
Like this, at the position of fading is under the state of object pathological changes, control part 45 is (the step S609 under the situation of image that fades at the image that is judged as present frame numbering, "Yes"), with above-mentioned step S509 similarly, carry out the i.e. control (step S610) that shows with the pathological changes color that fades of the slide block 111 of the time location of the fade image corresponding of the image of this current frame number of expression with the object pathological changes.In this case, display control unit 45a make slide block 111 move to as on the time location on the image time corresponding bar 110 of the present frame numbering of the image that fades, and carry out following control: will represent to show with the pathological changes color (for example white) that fades as the slide block 111 of the time location of the image of the present frame numbering of the above-mentioned image that fades.
Afterwards, carry out will be as the control (step S611) in main viewing area 100 of the pictorial display of the present frame of the pathological changes image corresponding with object pathological changes numbering for control part 35.Specifically, in the bleeding part and the position of fading be under the situation of object pathological changes, if the image of present frame numbering is hemorrhage image, then the hemorrhage pictorial display that display control unit 45a will this current frame number is on main viewing area 100, if the image of present frame numbering is the image that fades, then will this current frame number fade pictorial display on main viewing area 100.On the other hand, only the bleeding part in the bleeding part and the position of fading is under the situation of object pathological changes, if the image of present frame numbering is hemorrhage image, then the hemorrhage pictorial display that display control unit 45a will this current frame number is on main viewing area 100.In addition, only the position of fading in the bleeding part and the position of fading is under the situation of object pathological changes, if the image of present frame numbering is the image that fades, what then display control unit 45a will this current frame number fades pictorial display on main viewing area 100.
Like this, be presented under the situation on the main viewing area 100 at the pathological changes image corresponding with the object pathological changes (the hemorrhage image or the image that fades), slide block 111 shows the corresponding pathological changes color of pathological changes (being the object pathological changes) with the pathological changes graphical representation of this main viewing area 100.As mentioned above, the pathological changes color of above-mentioned slide block 111 is the identical colors of pathological changes labelling of time location with the pathological changes image of this main viewing area 100 of expression.
In addition, being presented at the frame number (be present frame numbering) of the pathological changes image on the main viewing area 100 in this step S611, is initialized frame number or the frame number upgraded in step S612 described later in above-mentioned steps S602.
Then, control part 45 and above-mentioned steps S512 similarly, the frame number n (step S612) of whole in-vivo image AI of update displayed process object.And control part 45 and above-mentioned steps S514 similarly judge the pictorial display of the pathological changes play mode of pathological changes pictorial display on main viewing area 100 that will comprise among whole in-vivo image AI handles whether finish (step S613).
Handle under the situation that does not have to finish (step S613, "No") at the pictorial display that is judged as above-mentioned pathological changes play mode, control part 45 returns step S604, repeats the later processing procedure of this step S604.On the other hand, under the situation that the pictorial display processing that is judged as above-mentioned pathological changes play mode finishes (step S613, "Yes"), control part 45 finishes the pictorial display of above-mentioned pathological changes play mode to be handled.
On the other hand, the image that is judged as present frame numbering in above-mentioned steps S606 is not (step S606, a "No") under the situation of hemorrhage image, and control part 45 enters step S608, repeats the later processing procedure of this step S608.In addition, in above-mentioned steps S608, be judged as (step S608 under the situation that the position of fading is not the object pathological changes, "No") or the image that in above-mentioned steps S609, is judged as present frame numbering be not (the step S609 under the situation of image that fades, "No"), control part 45 enters step S612, repeats the later processing procedure of this step S612.
That is, any in the bleeding part and the position of fading is not under the situation of object pathological changes, and control part 45 is not presented at whole in-vivo image AI on the main viewing area 100 and the pictorial display that finishes above-mentioned pathological changes play mode is handled.In addition, in the bleeding part and the position of fading be under the situation of object pathological changes, if the image of present frame numbering is not any one (for example if normal internal organs image) in the hemorrhage image and the image that fades, then control part 45 is skipped above-mentioned step S611, and pictorial display that will this current frame number is in main viewing area 100.And, only the bleeding part in the bleeding part and the position of fading is under the situation of object pathological changes, if the image of present frame numbering is not hemorrhage image (for example if the normal internal organs image or the image that fades), then control part 45 is skipped above-mentioned step S611, and pictorial display that will this current frame number is on main viewing area 100.In addition, only the position of fading in the bleeding part and the position of fading is under the situation of object pathological changes, if the image of present frame numbering is not the image (for example if normal internal organs image or hemorrhage image) that fades, then control part 45 is skipped above-mentioned step S611, and pictorial display that will this current frame number is on main viewing area 100.
This control part 45 can be play the pathological changes image simulation animation ground of the object pathological changes in the multiple pathological changes image that comprises among whole in-vivo image AI on main viewing area 100 by repeating the processing procedure of above-mentioned step S601～S613.
In addition, selecting under the situation of ordinary playing pattern by mode selection part 170 (specifically the ordinary playing selection portion 171), this as mentioned above control part 45 will be set at the ordinary playing pattern to the image display mode of main viewing area 100, carry out the control in main viewing area 100 of each pictorial display that will comprise among whole in-vivo image AI according to the ordinary playing pattern of setting.In this case, control part 45 repeats the processing procedure of above-mentioned steps S501～S514, and carry out the pictorial display of above-mentioned ordinary playing pattern and handle, and the demonstration color of control slide block 111.
Then, illustration comprises the whole in-vivo image AI as the bleeding part of an example of multiple pathological changes image and the image that fades, and specifies according to the pathological changes play mode to carry out action with the control part 45 of the control of pathological changes pictorial display on main viewing area 100 in these whole in-vivo image AI.Figure 20 is used for illustrating that on main viewing area 100 the object pathological changes that shows multiple pathological changes image is included in the sketch map of action of the control part 45 of the pathological changes image in the subject.
As shown in figure 20, control part 45 for example detects the hemorrhage image P that comprises among whole in-vivo image AI 12, P 13With the image P that fades 34, P 36Selecting by mode selection part 170 under the situation of pathological changes play mode, control part 45 carries out following control: extract out from whole in-vivo image AI and will be included in the pathological changes image in the subject by the pathological changes (being the object pathological changes) that pathological changes selection portion 160 is selected, the pathological changes image of extracting out is presented on the main viewing area 100 successively along time series.
Specifically, in the bleeding part and the position of fading be under the situation of object pathological changes, as shown in figure 20, control part 45 carries out following control: extract the hemorrhage image P will be included in as the bleeding part of object pathological changes in the subject from whole in-vivo image AI out 12, P 13, and will be included in the image P that fades in the subject as the position of fading of object pathological changes 34, P 36, with the hemorrhage image P that extracts out 12, P 13With the image P that fades 34, P 36Be presented at successively on the main viewing area 100 along time series.By the control of above-mentioned control part 45,100 simulation animation ground, main viewing area show the hemorrhage image P corresponding with above-mentioned object pathological changes successively 12, P 13With the image P that fades 34, P 36
In addition, control part 45 makes along time bar 110 moving sliders 111 and represents pathological changes image (the hemorrhage image P that shows successively on the above-mentioned main viewing area 100 successively 12, P 13With the image P that fades 34, P 36) time location, and control the pathological changes color of above-mentioned slide block 111.Specifically, on main viewing area 100, show hemorrhage image P 12, P 13Any situation under, control part 45 is made as hemorrhage pathological changes color (for example red) with the demonstration color of slide block 111, shows the image P that fades on main viewing area 100 34, P 36In any situation under, the demonstration color of slide block 111 is made as the pathological changes color (for example white) that fades.
On the other hand, only the bleeding part in the bleeding part and the position of fading is under the situation of object pathological changes, as shown in figure 20, control part 45 carries out following control: extract the hemorrhage image P that will be included in as the bleeding part of object pathological changes in the subject from whole in-vivo image AI out 12, P 13, with the hemorrhage image P that extracts out 12, P 13Be presented at successively on the main viewing area 100 along time series.By the control of above-mentioned control part 45,100 simulation animation ground, main viewing area show the hemorrhage image P corresponding with above-mentioned object pathological changes successively 12, P 13
In addition, control part 45 makes along time bar 110 moving sliders 111 and represents the hemorrhage image P that shows successively on the above-mentioned main viewing area 100 successively 12, P 13Time location, and control the pathological changes color of above-mentioned slide block 111.Specifically, on main viewing area 100, show hemorrhage image P 12, P 13Any situation under, control part 45 is made as hemorrhage pathological changes color with the demonstration color of slide block 111.
On the other hand, only the position of fading in the bleeding part and the position of fading is under the situation of object pathological changes, as shown in figure 20, control part 45 carries out following control: extract the image P that fades that will be included in as the position, position of fading of object pathological changes in the subject from whole in-vivo image AI out 34, P 36, with the image P that fades that extracts out 34, P 36Be presented at successively on the main viewing area 100 along time series.By the control of above-mentioned control part 45,100 simulation animation ground, main viewing area show the fade image P corresponding with above-mentioned object pathological changes successively 34, P 36
In addition, control part 45 makes along time bar 110 moving sliders 111 and represents the image P that fades that shows successively on the above-mentioned main viewing area 100 successively 34, P 36Time location, and control the pathological changes color of above-mentioned slide block 111.Specifically, on main viewing area 100, show the image P that fades 34, P 36Any situation under, control part 45 is made as the pathological changes color that fades with the demonstration color of slide block 111.
Thus, carry out the control of the pathological changes image of display object pathological changes by control part 45, main viewing area 100 can be selected a ground and be shown the pathological changes image that will be included in by the expectation pathological changes that pathological changes selection portion 160 is selected in the subject.Therefore, from whole in-vivo image AI that multiple pathological changes image blend exists, can easily show the pathological changes image more than 1 of having taken expectation pathological changes (for example bleeding part, the position etc. of fading).Its result exists under the situation of multiple pathological changes image even mix in whole in-vivo image AI, also can show the expectation pathological changes image that observe along time series simulation animation ground.
Thereby, user such as doctor or nurse can not be subjected to the obstruction ground of the demonstration complexion changedization of above-mentioned slide block 111, easily observe the current pathological changes image that is presented at the expectation on the main viewing area 100, and, can easily judge on this main viewing area 100 kind (bleeding part, the position etc. of fading) of each pathological changes that the multiple pathological changes image that shows is successively represented respectively by the pathological changes color of identification slide block 111.Its result, even the user is all comprising under the situation of multiple pathological changes image among the in-vivo image AI, also the expectation pathological changes image that can should observe from the group of pictures in the subject 1 is presented on the main viewing area 100 easily and in short time, and can easily determine the kind of the pathological changes that above-mentioned pathological changes image is represented, can more effectively observe above-mentioned expectation pathological changes image.
More than, as mentioned above, in embodiments of the present invention 4, except the function of above-mentioned embodiment 3, select a ground select each pictorial display that will comprise in the tested intravital group of pictures in main viewing area the ordinary playing pattern and with the pathological changes play mode of pathological changes pictorial display in main viewing area that comprises in the tested intravital group of pictures, under the situation of having selected above-mentioned pathological changes play mode, from tested intravital group of pictures, extract the pathological changes image of the expectation pathological changes (object pathological changes) from multiple pathological changes, select out, the pathological changes image of the object pathological changes of extracting out is presented on the main viewing area successively along time series.Therefore, even in the tested intravital group of pictures of display process object, comprise under the situation of multiple pathological changes image, also can select a ground and show expectation pathological changes image in the above-mentioned multiple pathological changes image.Its result, the image display device that can be achieved as follows: the action effect of enjoying above-mentioned embodiment 3, and can show the expectation pathological changes image in the multiple pathological changes image that comprises in the tested intravital group of pictures short time, can more effectively observe expectation pathological changes image.
Embodiment 5
Then, embodiments of the present invention 5 are described.Figure 21 is the sketch map of a structure example of the in-examiner information acquisition system of illustration with image display device relevant with embodiments of the present invention 5.As shown in figure 21, the in-examiner information acquisition system relevant with embodiments of the present invention 5 possesses: capsule type endoscope 202, and it takes the image in subject 1; Receiving system 203, it receives the image in the subject of being taken by capsule type endoscope 202 1; Image display device 204, its demonstration receive the image in the subject 1 in the receiving system 203; And pocket recording medium 205, it is used to carry out the exchanges data between above-mentioned receiving system 203 and the image display device 204.
Capsule type endoscope 202 is used to take the device of tested intravital image (image of internal organs inside specifically).This capsule type endoscope 202 has: import to the inside of subject 1 and take the camera function of the image in the subject 1 and the radio communication function that the group of pictures in the subject of taking 1 is wirelessly transmitted to reception device external 203 successively along time series.Specifically, after the swallowable capsule type endoscope 202, capsule type endoscope 202 waits by wriggling and moves in the internal organs inside of this subject 1 from the mouth of subject 1.Meanwhile, the image that capsule type endoscope 202 was for example taken at interval in the subject 1 with predetermined distance in 0.5 second one by one, the wireless signal that will comprise the image in the subject 1 of shooting sends to receiving system 203 one by one.
Receiving system 203 has for example a plurality of reception antenna 203a～203hs of decentralized configuration on the body surface of subject 1, by the wireless signal of at least one reception among above-mentioned a plurality of reception antenna 203a～203h from capsule type endoscope 202.And receiving system 203 obtains the group of pictures in the subject 1 according to the wireless signal from capsule type endoscope 202 that receives.In addition, in receiving system 203, can insert with mounting and dismounting pocket recording medium 205 is installed, will be kept in the pocket recording medium 205 by the subject 1 interior group of pictures that capsule type endoscope 202 is taken.In this case, receiving system 203 will represent each image of comprising in the group of pictures in the above-mentioned subject 1 shooting constantly or each interior image of the temporal information of time of reception etc. and this group of pictures be saved in pocket recording medium 205 accordingly.
Reception antenna 203a～203h for example uses loop aerial to realize, is connected on the above-mentioned receiving system 203.As shown in figure 21, on the reception antenna 203a～assigned position of 203h decentralized configuration on the body surface of subject 1 on for example corresponding position with the mobile route (being digestive tube) of capsule type endoscope 202 in the subject 1.Above-mentioned reception antenna 203a～203h catches from the wireless signal that imports to the capsule type endoscope 202 of internal organs inside in the subject 1, and the wireless signal of catching is sent to receiving system 203.In addition, reception antenna 203a～203h also can decentralized configuration on the assigned position of the jacket of subject 1 dress.In this case, wearing this jacket, reception antenna 203a～203h is being configured on the assigned position on the body surface of the subject 1 corresponding with the mobile route of capsule type endoscope 202 in the subject 1 by making subject 1.As long as to this reception antenna of subject 1 configuration more than 1, its configurable number is not particularly limited in 8.
Pocket recording medium 205 is small-sized flicker portable recording mediums such as (registered trade marks).Pocket recording medium 205 can mount and dismount for receiving system 203 and image display device 204, has both are inserted the structure that can carry out data output and record when installing.Specifically, insert under the situation about being installed on the receiving system 203, preserve the group of pictures in the subject 1 that receives by receiving system 203 and the various data such as temporal information of each image one by one at pocket recording medium 205.On the other hand, insert under the situation about being installed on the image display device 204, the group of pictures in the subject 1 and the preservation data such as temporal information of each image are outputed to image display device 204 at pocket recording medium 205.In this case, the preservation data of above-mentioned pocket recording medium 205 are taken into image display device 204.Like this, pocket recording medium 205 carries out the exchanges data between above-mentioned receiving system 203 and the image display device 204.In addition, by image display device 204 patient information relevant with the subject 1 that imports capsule type endoscope 202 etc. is written to pocket recording medium 205.
Image display device 204 is used to show the image in the subject of being taken by capsule type endoscope 202 1 etc.Specifically, image display device 204 has such structures such as following work station: by being taken into the preservation data of above-mentioned pocket recording medium 205, obtain the various data such as group of pictures in the subject of taking by capsule type endoscope 202 1, show each image that comprises in the group of pictures in the above-mentioned subject 1.This image display device 204 has following processing capacity: the image that is used to users such as doctor or nurse are observed in (inspection) subject 1 is diagnosed subject 1.In this case, observe organism part for example esophagus, stomach, small intestinal and the large intestine etc. in (inspection) subject 1, can diagnose subject 1 in view of the above thereby the user shows image in the subject 1 successively on image display device 204.
The structure of the image display device 204 relevant with embodiments of the present invention 5 then, is described.Figure 22 is the block diagram that schematically shows a structure example of the image display device 204 relevant with embodiments of the present invention 5.As shown in figure 22, the image display device 204 relevant with this embodiment 5 has: input part 211, and it imports various information; Display part 212, it is with the image in the subject 1 and GUI (Graphical User Interface: graphic user interface) wait and carry out the picture demonstration; And clamping mouth (I/F) 213, it reads the preservation data (group of pictures in the subject 1 etc.) of pocket recording medium 205.In addition, image display device 204 has: storage part 214, and it preserves the various data such as group of pictures of subject 1; And control part 215, each structural portion of its control image display device 204.
Input part 211 uses input equipments such as keyboard and mouse to realize, imports various information by user's input operation to control part 215.For example, input part 211 is input to control part 215 with various indication informations that control part 215 is indicated, patient information relevant with subject 1 etc.In addition, by the patient information of above-mentioned input part 211 inputs, for example be patient's name, sex, birthdate and the patient ID etc. of subject 1.
The display that display part 212 uses CRT monitor or liquid crystal display etc. can carry out pictorial display realizes that demonstration is shown the various information of indication etc. by control part 215.Specifically, display part 212 show the internal organs inside that is used for observing (inspections) subject 1 diagnose the various information of subject 1, for example by the interior group of pictures of the subject 1 of capsule type endoscope 202 shootings etc.In addition, display part 212 shows the various GUI that are used to observe the group of pictures in the above-mentioned subject 1.This display part 212 has: main viewing area 300, and it is used for showing each image that the group of pictures in the above-mentioned subject 1 comprises; Time bar 310, all time locations of group of pictures in its subject 1 of representing to show on the main viewing area 300; Slide block 311, the time location of the image (current display image) in its subject 1 of representing to show on the current main viewing area 100; And labelling display part 320, its lesions showed labelling, this pathological changes labelling are represented the time location of the pathological changes image that comprises in the group of pictures in the above-mentioned subject 1.And display part 212 has: display operation icon group 330, the various display operations when it is used to carry out show image in the subject 1 on main viewing area 300; And secondary viewing area 340, it is used for appending the desired image that demonstration is selected from the group of pictures that is presented in the subject 1 on the main viewing area 300.
In card I/F213, can insert with mounting and dismounting above-mentioned pocket recording medium 205 is installed, read the preservation data of above-mentioned pocket recording medium 205, and the preservation data that will obtain be transferred to control part 215.In addition, card I/F213 writes by control part 215 the pocket recording medium 205 that inserts installation and has carried out writing the information of indication, the patient information of for example subject 1 etc.
Storage part 214 uses jumbo recording mediums such as RAM, EEPROM or hard disk to realize, preserves the various data etc. of having been carried out writing indication by control part 215, will send to control part 215 by the preservation data that control part 215 has carried out reading indication.This storage part 214 is preserved the whole in-vivo image AI that taken by capsule type endoscope 202, the temporal information of each image in whole in-vivo image AI and the patient information of subject 1 etc.In this case, the temporal information that is kept at each image in the above-mentioned storage part 214 is appended to respectively on each view data of whole in-vivo image AI.
Each structural portion of control part 215 control image display devices 204.Specifically, control part 215 is controlled input part 211, display part 212, card I/F213 and storage part 214 respectively, controls the input and output of the information between above-mentioned each structural portion.This control part 215 from insertion is installed to the pocket recording medium 205 of card I/F213, obtain whole in-vivo image AI and with these whole in-vivo image AI in the corresponding temporal information of each image.Control part 215 is kept at above-mentioned whole in-vivo image AI and temporal information in the storage part 214 accordingly by each image.Control part 215 is according to the indication information by input part 211 inputs, with each pictorial display of comprising in the group of pictures in the above-mentioned subject 1 main viewing area 300 at display part 212.
This control part 215 has 215a of image detection portion and display control unit 215b.The 215a of image detection portion detects 1 the above pathological changes image that comprises among whole in-vivo image AI.Specifically, the 215a of image detection portion detects the color information of the image of the process object that comprises among whole in-vivo image AI, according to the color information of detected image, judges whether the image of this process object is the pathological changes image.At the image that is judged as this process object is under the situation of pathological changes image, and the 215a of image detection portion is that the signature (pathological changes sign) of the meaning of pathological changes image appends on the image (being the pathological changes image) of this process object with expression.Like this, the 215a of image detection portion detects the pathological changes image that comprises among whole in-vivo image AI.The pathological changes image that has added above-mentioned pathological changes sign is saved to storage part 214 as the part of whole in-vivo image AI.The 215a of image detection portion handles the detection that the full images of whole in-vivo image AI is carried out this pathological changes image.In addition, as color information, for example can enumerate the value (R value, G-value, B value) etc. of the key element of all kinds of the average color of image, red (R), green (G) that form image, blue (B) by the detected image of the above-mentioned image detection 215a of portion.
Display control unit 215b carries out following control: will be kept at each pictorial display of comprising among the whole in-vivo image AI in the storage part 214 on the main viewing area 300 of display part 212.In this case, if all do not comprise the pathological changes image in the in-vivo image AI, then display control unit 215b carries out the control of pathological changes pictorial display on the main viewing area 300 of display part 212 in the above-mentioned subject 1.In addition, display control unit 215b carries out following control: the desired image of selecting will the whole in-vivo image AI on being presented at above-mentioned main viewing area 300 appends on the secondary viewing area 340 that is shown to display part 212.In this case, the display control unit 215b downscaled images (for example compact image) that will dwindle the desired image of such selection is presented on the secondary viewing area 340.
In addition, display control unit 215b carries out following control: the pathological changes labelling that will represent the time location of the pathological changes image more than 1 that comprises among whole in-vivo image AI is presented on the labelling display part 320 of display part 12.In this case, display control unit 215b is according to the picture number of whole in-vivo image AI of demonstration on the pixel count of the time-axis direction of the time bar 310 that is formed by a plurality of pixels and the main viewing area 300, calculate the picture number of the per unit pixel of time bar 310, to the consecutive image group in the successive whole in-vivo image AI of image of the picture number of this per unit pixel each, will count by the pathological changes picture number of the detected pathological changes image of the above-mentioned image detection 215a of portion.And, display control unit 215b carries out following control: to as each of the consecutive image group who comprises the pathological changes image more than 1 of the consecutive image group in whole in-vivo image AI, the pathological changes labelling that will have with the corresponding Show Styles of count results of this pathological changes picture number is presented on the labelling display part 320.This display control unit 215b carries out following control: for example make the demonstration complexion changedization of pathological changes labelling according to the count results of this pathological changes picture number, will show that accordingly the pathological changes labelling of color is presented on the labelling display part 320 with above-mentioned pathological changes picture number.
In addition, display control unit 215b will be presented on the display part 212 as time bar 310, slide block 311 and the display operation icon group 330 of various GUI.In this case, display control unit 215b is according to the temporal information of each image in above-mentioned whole in-vivo image AI, carry out the control that the time bar 310 to the All Time position of representing these whole in-vivo image AI shows, carry out in these whole in-vivo image AI with the current subject 1 that on main viewing area 300, shows in image (being current display image) time corresponding bar 310 on time location on the control of demonstration slide block 311.
In addition, by the detected pathological changes image of the above-mentioned image detection 215a of portion, be that the diseased region that generates in the internal organs inside with subject 1 is included in the image in the subject.As an example of above-mentioned pathological changes image, for example can enumerate the bleeding part is included in hemorrhage image in the subject.
Then, the pathological changes image that comprises among the whole in-vivo image AI of illustration is the situation of hemorrhage image, specifies the displaying contents of the display part 212 of the image display device 204 relevant with embodiments of the present invention 5.The sketch map of the displaying contents of the display part 212 of Figure 23 image display device 204 that to be illustration relevant with embodiment 5.Under the situation of the location registration process of having carried out regulation by control part 215, display control unit 215b is presented at window W2 as shown in figure 23 on the display part 212.
As shown in figure 23, form main viewing area 300, time bar 310, slide block 311, labelling display part 320, display operation icon group 330 and secondary viewing area 340 among the window W2.In addition, in window W2, form: rolling operation portion 341, it is used to carry out the rolling operation of a plurality of downscaled images of demonstration on the secondary viewing area 340; Cursor K, it is used for carrying out the clicking operation of various GUI or drag operation etc. by the operation of input part 211; And close icon 350, it is used to close above-mentioned window W2.
Main viewing area 300 is the image display area that are used for showing each image that whole in-vivo image AI of display process object comprise.Display control unit 215b carries out the control of each pictorial display on main viewing area 300 in whole in-vivo image AI of display process object according to the indication information by input part 211 inputs.By the control of above-mentioned display control unit 215b, the image P that main viewing area 300 shows in whole in-vivo image AI n(frame number n=1,2,3..., A).At this, A is the sum of whole in-vivo image AI.In addition, display control unit 215b carries out following control: current display image (the image P for example that shows this main viewing area 300 in above-mentioned main viewing area 300 n) the shooting date and shooting constantly and the patient information (patient's name, patient ID, sex, birthdate) of this subject 1.
Time bar 310 and slide block 311 are the GUI of time location that are used to represent the current display image of main viewing area 300.Time bar 310 has alongst shone upon whole in-vivo image AI as having taken the in-vivo image at the two ends of its length direction at first and at last by the time sequence order.Like this, the time scale in the elapsed time that time bar 110 is expressions till the photography of initial in-vivo image to the end the photography constantly of in-vivo image constantly, thus each in-vivo image be represented as with whole in-vivo image AI in time series position time corresponding bar 110 on the position.In this manual, the position on the time bar 110 of this each in-vivo image is called time location.
At this, be made as the L pixel if will constitute the length (size of length direction) of the image of time bar 310, then should time bar 310 can show the time location of L.Thereby, suppose that the total A of whole in-vivo image AI is L, then all in-vivo image AI is corresponding one by one with whole pixels of time bar 310.Under the situation of total A less than length L of whole in-vivo image AI, all in-vivo image AI become to the mapping of time bar 310 and are full of, and also have the pixel not corresponding with the time location of in-vivo image in the pixel of time bar 310.On the contrary, describe in detail, under the situation of total A of whole in-vivo image AI, in each pixel of time bar 310 is distributed a plurality of successive bodies, shine upon greater than length L as the back.
For example, in order to make explanation simple, if establish the total A of whole in-vivo image AI and be time bar 310 length L N doubly (promptly, A=N.L), then L the group of pictures (perhaps consecutive image group) that constitute of N the continuous images that obtains by whole in-vivo image AI are carried out the L five equilibrium is corresponding one by one with whole pixels (that is All Time position) of time bar 310.
Slide block 311 moves along above-mentioned time bar 310, the time location on the current display image time corresponding bar 310 of expression and main viewing area 300.Slide block 311 expression is a time location on the time bar 310 that distributes of the consecutive image group of N to the picture number of the current display image that comprises main viewing area 300.Display control unit 215b controls the demonstration change action of the current display image of moving of slide block 311 on the above-mentioned time bar 310 and main viewing area 300, makes the time location of current display image (image in the subject 1) of the main viewing area 300 of slide block 311 expressions.
Labelling display part 320 is identical and parallel with time bar 310 viewing areas of the length with time bar 310.Specifically, labelling display part 320 has the length L of time-axis direction and with respect to the width W (unit be pixel) of time-axis direction in vertical direction, cancellate by being arranged as in the rectangular area of length L and the width W regulation (pixel group of the individual pixel of L * W) and forming.Thereby time bar 310 and labelling display part 320 pairing positions are on identical time location.
At this, actual and simple in order to make explanation, the total A that supposes whole in-vivo image AI be time bar 310 and labelling display part 320 length in pixels L N doubly.In this case, display control unit 215b is for each time location (each pixel) of time bar 310, in corresponding with this time location (by a successive N image construction) consecutive image group, comprise under the situation of pathological changes image, show on the time location on the labelling display part 320 corresponding with this group of pictures with this consecutive image group in the corresponding quantitative pathological changes labelling of quantity of the pathological changes image that comprises.
For example, display control unit 215b with whole in-vivo image AI on the time location on (in the example at Figure 23 being two) hemorrhage group of pictures time corresponding bar 310 of comprising, pathological changes labelling group 320a, 320b are presented at respectively on the labelling display part 320.In addition, pathological changes labelling group 320a, 320b comprise a plurality of pathological changes labellings that show corresponding to the unit picture element of above-mentioned time bar 310 respectively.The picture number that labelling display part 320 comprises the hemorrhage image more than 1 by representative is each unit picture element of time bar 310 of the consecutive image group (promptly being presented at the consecutive image group in the whole in-vivo image AI on the main viewing area 300) of N, shows each the pathological changes labelling in above-mentioned pathological changes labelling group 320a, the 320b respectively.In this case, labelling display part 320 for example comes each the pathological changes labelling in lesions showed labelling group 320a, the 320b with the color corresponding with the pathological changes (being the bleeding part) of hemorrhage graphical representation (for example red).And in detail, labelling display part 320 is the picture number of the hemorrhage image that comprises among the consecutive image group of N according to above-mentioned picture number, shows different pathological changes labelling group 320a, the 320b of the depth of the demonstration color (for example corresponding with bleeding part redness) that makes each pathological changes labelling.
The labelling display part 320 that shows the pathological changes labelling more than 1 with above-mentioned Show Styles is brought into play function as following time location display unit: this time location display unit is along the time location of each the pathological changes image in the whole in-vivo image AI of time bar 310 expressions, and represents the distribution of the pathological changes picture number in all time locations all time locations of 310 expressions of time bar (promptly by) of whole in-vivo image AI.Promptly, labelling display part 320 utilizes above-mentioned pathological changes labelling group 320a, the illustrative pathological changes labelling more than 1 of 320b that the time location of the pathological changes image more than 1 in whole in-vivo image AI is illustrated on the time bar 310, and utilizes the Show Styles (depth that for example shows color) of above-mentioned pathological changes labelling to represent the distribution of the pathological changes picture number in all time locations.
Like this, shown under the state of pathological changes labelling group 320a, 320b current display image (the image P in the subject 1 at labelling display part 320 in main viewing area 300 n) be that bleeding part BS is included under the situation of the hemorrhage image in the subject, slide block 311 moves on the pathological changes mark position in the pathological changes labelling group 320a of time location of this hemorrhage image of expression, promptly comprise on consecutive image group's the unit picture element time corresponding position of time bar 310 of this hemorrhage image with representative.
Display operation icon group 330 is the GUI that are used for carrying out each pictorial display that whole in-vivo image AI are comprised display operation when main viewing area 300.For example as shown in figure 23, in above-mentioned display operation icon group 330, comprise and play that icon 331, picture are play icon 332, sought tail icon 333, contraryly play icon 334, contrary picture is play icon 335, sought Head icon 336.In addition, broadcast icon 331 is the GUI that are used for playing along the suitable direction of seasonal effect in time series each image of whole in-vivo image AI, and it is the GUI that are used for each image of whole in-vivo image AI being carried out along direction along time series picture transmission broadcast that picture is play icon 332.Contrary broadcast icon 334 is the GUI that are used for playing along time series against direction each image of whole in-vivo image AI, and it is the GUI that are used for along the contrary direction of seasonal effect in time series each image of whole in-vivo image AI being carried out picture transmission broadcast that contrary picture is play icon 335.In addition, seek tail icon 333 and be the GUI of the image of the last shooting that is used to show whole in-vivo image AI, seek an image 336 and be the GUI of the image of the initial shooting that is used to show whole in-vivo image AI.
Then, the pathological changes labelling group 320a in the above-mentioned labelling display part 320 of illustration describes the pathological changes labelling that labelling display part 320 shows according to the control of display control unit 215b in detail.Figure 24 is the sketch map that the display control unit 215b of the related image display device 204 of expression embodiment 5 is presented at a concrete example of the pathological changes labelling on the labelling display part 320.In addition, figure 24 illustrates the enlarged drawing of the pathological changes labelling group 320a that shows by labelling display part 320.
As shown in figure 24, pathological changes labelling group 320a for example comprises the labelling group of 5 pathological changes labelling M1～M5 that show along the pixel column of time-axis direction of formation time bar 310.Each lesions showed labelling M1～M5 accordingly with the unit picture element 312a～312e of time bar 310.This pathological changes labelling M1～M5 represents by the picture number in whole in-vivo image AI of each representative of above-mentioned unit picture element 312a～312e to be the time location of the hemorrhage image more than 1 that comprises respectively among each consecutive image group of N respectively.
Specifically; pathological changes labelling M1～M5 is a labelling of distinguishing orthogonal strip with the time shaft of the time bar 310 that is formed by the group of pictures that is arranged on the time-axis direction, it is formed respectively by the time shaft pixel group that one dimension is arranged on vertical direction with respect to above-mentioned time bar 310.In this case, with the unit picture element 312a of time bar 310 accordingly one dimension arrange the pixel group that forms above-mentioned pathological changes labelling M1.Therewith similarly, respectively with the unit picture element 312b～312e of time bar 310 accordingly one dimension arrange each pixel group that forms above-mentioned pathological changes labelling M2～M5 respectively.In addition, form each the pixel count of each pixel group of above-mentioned pathological changes labelling M1～M5, be equivalent to the width W of above-mentioned labelling display part 320.
This pathological changes labelling M1 representative is by the hemorrhage image more than 1 that comprises among the consecutive image group (above-mentioned picture number is the consecutive image group of N) in whole in-vivo image AI of the unit picture element 312a representative of time bar 310, and represents the time location of the hemorrhage image in the consecutive image group of above-mentioned unit picture element 312a representative in the lump.Therewith similarly; it is the hemorrhage image more than 1 in each consecutive image group of N that pathological changes labelling M2～M5 represents picture number by each representative of the unit picture element 312b～312e of time bar 310 respectively, and represent time location respectively in the lump by the hemorrhage image in each consecutive image group of each representative of above-mentioned unit picture element 312b～312e.
In addition, the demonstration color of this pathological changes labelling M1～M5 is hemorrhage picture number in each consecutive image group of N and difference according to the picture number by each representative of the unit picture element 312a～312e of time bar 310.Specifically, under the situation that pathological changes labelling M1～M5 shows with homology color (for example red colour system) corresponding to the represented pathological changes of hemorrhage image (being the bleeding part), above-mentioned pathological changes labelling M1～M5 respectively shows color, along with by unit picture element 312a～312e respectively the picture number of representative be that the increase of the hemorrhage picture number in each consecutive image group of N deepens, be accompanied by the minimizing of above-mentioned hemorrhage picture number and thin out.
This pathological changes labelling M1～M5 is the time location of the hemorrhage image of each consecutive image group representation of N to the picture number in the whole in-vivo image AI that comprise the hemorrhage image more than 1, and utilizes it to show that color (for example depth of red colour system) is the distribution of the hemorrhage picture number of each consecutive image group representation of N to above-mentioned picture number.Above situation is also identical for above-mentioned pathological changes labelling group 320b.
In addition, show the lightness of the background (i.e. the rectangular area of stipulating) of the labelling display part 320 of this pathological changes labelling by length L and width W, preferably be worth near the centre of pathological changes labelling and window W2 background, the preferably relative pathological changes labelling of the background colour of above-mentioned labelling display part 320 is a complementary color.Thus, the background that can clear and definite above-mentioned labelling display part 320 and the border of pathological changes labelling, its result, labelling display part 320 can show the pathological changes labelling of easy identification pattern to users such as doctor or nurses.
Then, comprise situation among the whole in-vivo image AI of illustration, the action of the control part 215 that detects the hemorrhage image in these whole in-vivo image AI is described as the hemorrhage image of an example of pathological changes image.The flow chart of the processing procedure of Figure 25 control part 215 that to be illustration detect the hemorrhage image more than 1 that comprises among whole in-vivo image AI.
As shown in figure 25, control part 215 at first reads in the image (step S1101) of process object from whole in-vivo image AI.In this case, control part 215 for example is installed to the image P that reads in process object whole in-vivo image AI in the pocket recording medium 205 on the card I/F213 successively along time series from insertion n(frame number n=1,2,3 ...).
Then, control part 215 judges whether the image in the subject 1 that the image as process object reads in is hemorrhage image (step S1102).In this case, the 215a of image detection portion detects the color information of the image of the process object of reading in, and according to detected color information, judges whether the image of this process object is hemorrhage image.Specifically, the 215a of image detection portion is as the color information of the image of this process object and detect under the situation of average color of image, if the average color of the approximate hemorrhage image of the average color of detected image then is judged as the image of this process object the hemorrhage image in the subject 1.On the other hand, the 215a of image detection portion is under the situation of the value (R value, G-value, B value) of the key element of all kinds that detects the RGB that forms image as the color information of the image of this process object, if the value of the key element of all kinds of detected RGB in the numerical range of the key element of all kinds of hemorrhage image, then is judged as the image of this process object the hemorrhage image in the subject 1.
Control part 215 is (step S1102, "Yes") under the situation of hemorrhage image at the image that is judged as this process object, is the additional hemorrhage sign (step S1103) of image of this hemorrhage treatment of picture object to being judged as.In this case, the 215a of image detection portion is that image (being the hemorrhage image in the subject 1) additional representation of hemorrhage treatment of picture object is the hemorrhage sign of the meaning of hemorrhage image to being judged as in above-mentioned steps S1102.Like this, the 215a of image detection portion detects the hemorrhage image that comprises among whole in-vivo image AI.In addition, appending to the hemorrhage sign on the hemorrhage image in the above-mentioned subject 1, is an example of above-mentioned pathological changes sign, is that expression is the signature of the meaning of hemorrhage image.
Then, the control part 215 process object image (being hemorrhage image) that will add above-mentioned hemorrhage sign is saved in storage part 214 (step S1104).In this case, the control part 215 hemorrhage image that will add above-mentioned hemorrhage sign is kept at storage part 214 as the part of whole in-vivo image AI.
Afterwards, control part 215 judges whether all images that comprises among above-mentioned whole in-vivo image AI has been finished processing (step S1105).Specifically, have under the situation that also is not read into image in the subject 1 that inserts in the pocket recording medium 205 be installed on the card I/F213 or in pocket recording medium 205 under the residual situation that image in the subject 1 that also is not kept in the storage part 214 arranged residual, control part 215 is judged as the processing of above-mentioned whole in-vivo image AI and does not also finish (step S1105, "No"), return above-mentioned steps S1101, repeat this step S1101 processing procedure afterwards.
Repeat the processing procedure of above-mentioned steps S1101～S1105 in each image that comprises among 215 couples of whole in-vivo image AI of control part, whole in-vivo image AI that will comprise the hemorrhage image that has added above-mentioned hemorrhage sign are saved in storage part 214.
On the other hand, under the situation that control part 215 all reads in whole in-vivo image AI the pocket recording medium 205 that is installed to from insertion on the card I/F213 or will be kept at whole in-vivo image AI in the above-mentioned pocket recording medium 205 and all be kept under the situation in the storage part 214, be judged as all images in whole in-vivo image AI has been finished processing (step S1105, "Yes"), the detection that finishes the hemorrhage image in whole in-vivo image AI is handled.
In addition, the image that is judged as process object in above-mentioned steps S1102 is not (step S1102, a "No") under the situation of hemorrhage image, and control part 215 enters above-mentioned step S1104, repeats the later processing procedure of this step S1104.In this case, the 215a of image detection portion is not to being judged as the additional hemorrhage sign of image (being normal internal organs image) in the subject 1 that is not hemorrhage image in step S1102.Control part 215 will be that the image of normal internal organs is kept at storage part 214 less than the image in the subject 1 of additional this hemorrhage sign.That is, not the additional hemorrhage sign of image in the subject 1 of above-mentioned hemorrhage image, be kept at storage part 214 as the part of whole in-vivo image AI.
Then, comprise situation among the whole in-vivo image AI of illustration, the action of the control part 215 that carries out the control that the pathological changes labelling to the time location of representing the hemorrhage image in whole in-vivo image AI shows is described as the hemorrhage image of an example of pathological changes image.Figure 26 is that expression is carried out showing the flow chart of an example of processing procedure of the control part 215 of the control that the pathological changes labelling of color shows accordingly to having count results with hemorrhage image.
The picture number that comprises among the whole in-vivo image AI that show in 215 pairs of main viewing areas 300 of control part is that each consecutive image group of N counts hemorrhage picture number, to the picture number that comprises by the detected hemorrhage image (promptly having added the image of hemorrhage sign) more than 1 of the 215a of image detection portion is each consecutive image group of N, and the count results that will have with above-mentioned hemorrhage picture number shows that accordingly the pathological changes labelling of color is presented on the labelling display part 320.
That is, as shown in figure 26, control part 215 is at first calculated the picture number N (step S1201) of each unit picture element of time bar 310.Specifically, the display control unit 215b all images that detects on the main viewing area 300 the whole in-vivo image AI that show is counted the A[frame] and the length L [pixel] of time bar 310.Here, as mentioned above, the length L of above-mentioned time bar 310 is the identical values with the pixel count of the pixel group (pixel column) of the time-axis direction of formation time bar 310.Display control unit 215b counts A divided by length L (being the L pixel) with above-mentioned all images, calculates the picture number N[frame/unit picture element of each unit picture element of time bar 310].In addition, the picture number N of above-mentioned each unit picture element is the picture number by the consecutive image group in whole in-vivo image AI of the unit picture element representative of time bar 310.
Then, the frame number n (step S1202) of the whole in-vivo image AI that show on the control part 215 initialization master viewing areas 300.In this case, display control unit 215b will be used for determining that the picture number that these whole in-vivo image AI comprise is that the frame number of the beginning image in the consecutive image group of N is made as initial value (for example n=1).
Afterwards, the consecutive image group (step S1203) of the process object that the counting of hemorrhage picture number handles has been carried out in control part 215 decision from whole in-vivo image AI that main viewing area 300 shows.In this case, the image that display control unit 215b numbers n with present frame is made as the beginning image, is that consecutive image group (being that picture number is the consecutive image group of the N) decision in the successive whole in-vivo image AI of image of N is the consecutive image group of this process object with picture number.
In addition, determining that the picture number that determines among the consecutive image group of above-mentioned process object is the consecutive image group's of N the present frame numbering n of beginning image, is initialized frame number or the frame number upgraded in step S1209 described later in above-mentioned steps S1202.
Then, the hemorrhage sign (step S1204) in the consecutive image group of the picture number N that determines among the consecutive image group of control part 215 retrievals process object in step S1203.In this case, each image that comprises among the consecutive image group of display control unit 215b with this picture number N reads in successively by frame number, to the hemorrhage sign of each image retrieval that reads in.Here, comprise under the situation of hemorrhage image in this picture number is the consecutive image group of N, display control unit 215b reads in the hemorrhage image in the above-mentioned consecutive image group, and reads in the hemorrhage sign that appends on this hemorrhage image.Display control unit 215b detects the hemorrhage sign that appends on this hemorrhage image by reading in hemorrhage image and hemorrhage sign like this.That is, comprise under the situation of the hemorrhage image more than 1 in this picture number is the consecutive image group of N, display control unit 215b detects the hemorrhage sign with hemorrhage picture number equal number from this picture number is the consecutive image group of N.
Then, control part 215 is according to the result for retrieval that has carried out the hemorrhage sign of retrieval process in step S1204, judges that this picture number is the having or not of hemorrhage sign (step S1205) among the consecutive image group of N.Specifically, detect under the situation of the hemorrhage sign more than 1 from this picture number is the consecutive image group of N in above-mentioned steps S1204, display control unit 215b is judged as in this picture number is the consecutive image group of N hemorrhage sign.
Be judged as (step S1205 under the situation that hemorrhage sign is arranged like this in the picture number as the consecutive image group of process object is the consecutive image group of N, "Yes"), the hemorrhage image that comprises among the consecutive image group of 215 pairs of these process object of control part is counted (step S1206).In this case, display control unit 215b is to being that detected hemorrhage sign is counted the consecutive image group of N from the picture number as the consecutive image group of this process object.Here, as mentioned above, the detection number of above-mentioned hemorrhage sign and this picture number are that the hemorrhage picture number in the consecutive image group of N is identical.Thereby display control unit 215b obtains the hemorrhage picture number x[frame of the hemorrhage image that comprises among the consecutive image group of this picture number N by the detection number of the above-mentioned hemorrhage sign of counting].
Then, control part 215 is corresponding to the hemorrhage picture number x that obtains in step S1206, sets this picture number of expression and be the demonstration color (step S1207) of pathological changes labelling of the time location of the hemorrhage image more than 1 that comprises among the consecutive image group of N.In this case, display control unit 215b uses this picture number to calculate the color key element of pathological changes labelling as the hemorrhage picture number x in the consecutive image group of N, and the color settings that will be formed by resulting color key element is the demonstration color of this pathological changes labelling.
Specifically, display control unit 215b is for example according to this picture number being the following formula (1) that comprises as variable of the hemorrhage picture number x in the consecutive image group of N and following formula (2), (3), calculate this picture number of expression and be the color key element of pathological changes labelling of the time location of the hemorrhage image more than 1 that comprises among the consecutive image group of N, the color settings that will be formed by resulting color key element is the demonstration color of this pathological changes labelling.
R value=64+2 * hemorrhage picture number x ... (1)
G-value=0 ... (2)
B value=0 ... (3)
Here, the color that forms by the color key element of calculating according to this formula (1)～(3), be pathological changes (be bleeding part) the corresponding red colour system represented with hemorrhage image, the increase that along with this picture number is the hemorrhage picture number x in the consecutive image group of N is changed to dark color, is changed to light color along with the minimizing of this hemorrhage picture number x.Display control unit 215b is by setting the demonstration color of pathological changes labelling according to above-mentioned formula (1)～(3), be that hemorrhage picture number x in the consecutive image group of N changes according to this picture number thereby make the depth of the demonstration color of this pathological changes labelling.
Then, 215 pairs of display parts of control part 212 carry out following control: show the pathological changes labelling (step S1208) with demonstration color of setting in step S1207.In this case, display control unit 215b carries out following control: be on the time location in the corresponding labelling display part 320 of consecutive image group's the unit picture element of time bar 310 of N with representing this picture number, show have with this picture number be hemorrhage picture number x in the consecutive image group of N shows color (the demonstration color of promptly setting) accordingly in step S1207 pathological changes labelling.Control according to above-mentioned display control unit 215b, labelling display part 320 utilizes with this picture number and comes the lesions showed labelling for the hemorrhage picture number x in the consecutive image group of N shows color accordingly being on consecutive image group's the pixel column of unit picture element time corresponding position of time bar 310 of N with representing this picture number.
Then, control part 215 upgrades the frame number n (step S1209) of the whole in-vivo image AI that show on the main viewing area 300.In this case, display control unit 215b utilizes the value that obtains to upgrade frame number n to the present frame numbering n addition picture number N (picture number of calculating in above-mentioned steps S1201) of the beginning image in the consecutive image group who determines current process object.The frame number n of Geng Xining determines the beginning image among next consecutive image group in whole in-vivo image AI of consecutive image group of follow-up current process object like this.
Afterwards, control part 215 judges whether all images of whole in-vivo image AI of demonstration in the main viewing area 300 has been finished processing (step S1210).Specifically, the frame number n that upgrades in above-mentioned steps S1209 is that all images of whole in-vivo image AI is counted under the situation below the A, display control unit 215b is judged as that at least one does not finish processing (step S1210 in the image that comprises among these whole in-vivo image AI, "No"), return above-mentioned steps S1203, repeat the later processing procedure of this step S1203.
On the other hand, the frame number n that upgrades in above-mentioned steps S1209 has surpassed all images of whole in-vivo image AI and has counted under the situation of A, display control unit 215b is judged as all images of these whole in-vivo image AI has been finished processing (step S1210, "Yes"), finish the pathological changes labelling display process relevant with these whole in-vivo image AI.Under this state, 320 pairs of labelling display parts comprise each consecutive image group of the hemorrhage image more than 1 among each consecutive image group that the picture number that is comprised among whole in-vivo image AI is N, show to have the pathological changes labelling that shows color with hemorrhage picture number x accordingly.
In addition, in above-mentioned steps S1205, be judged as (step S1205 under the situation that in the picture number as the consecutive image group of this process object is the consecutive image group of N, does not have hemorrhage sign, "No"), do not carry out the processing procedure of step S1206～S1208 and enter step S1209.In this case, display control unit 215b is not to detect hemorrhage sign the consecutive image group of N from this picture number in above-mentioned steps S1204.That is, in being the consecutive image group of N, this picture number do not comprise hemorrhage image.In being the consecutive image group of N, this picture number do not comprise under the situation of hemorrhage image, display control unit 215b is being on the time location in the corresponding labelling display part 320 of consecutive image group's the unit picture element of time bar 310 of N with representing this picture number, not the lesions showed labelling.
Then, illustration is represented the pathological changes labelling M1～M5 (with reference to Figure 23,24) of the time location of the hemorrhage image that comprises among whole in-vivo image AI, specify the action of the display control unit 215b that carries out following control:, show to have the pathological changes labelling that shows color with hemorrhage picture number x accordingly to each the consecutive image group in the whole in-vivo image AI that comprise the hemorrhage image more than 1.Figure 27 is the sketch map that is used to specify the action of the display control unit 215b that carries out following control: show to have the pathological changes labelling that shows color with hemorrhage picture number x accordingly.
Should be presented at the whole in-vivo image AI on the main viewing area 300, for example, comprise a plurality of hemorrhage images by the image construction (the total A that is in-vivo image is 60,000 frames) of 60,000 frames.Here, in the length L of time bar 310 (promptly, the pixel count of the time-axis direction of formation time bar 310) be under the situation of 1000 pixels, display control unit 215b calculates the picture number N (=60 frame) of each unit picture element of this time bar 310 with the total A (=6 ten thousand frame) of the in-vivo image length L (=1000 pixel) divided by time bar 310.
Afterwards, display control unit 215b determines the continuous images group of image institute of the picture number N of each unit picture element successively in whole in-vivo image AI, each the consecutive image group who determines is counted hemorrhage picture number x.And display control unit 215b carries out following control: to comprising each consecutive image group of the hemorrhage image more than 1, show to have the pathological changes labelling that shows color with hemorrhage picture number x accordingly.
Specifically, as shown in figure 27, display control unit 215b from whole in-vivo image AI, determine each unit picture element picture number N (=60 frame) image the consecutive image group Gr1 of successive 60 frames.In addition, the unit picture element 312a by time bar 310 represents this consecutive image group Gr1.That is, the time location of this consecutive image group Gr1 is corresponding to this unit picture element 312a.
Display control unit 215b carries out the retrieval process of hemorrhage sign to this consecutive image group Gr1, according to the result for retrieval of this hemorrhage sign, the hemorrhage picture number x of consecutive image group Gr1 is counted.For example in this consecutive image group Gr1, comprise under the situation of hemorrhage image of 10 frames, display control unit 215b detects 10 hemorrhage signs from this consecutive image group Gr1, with the detection number (=10) of this hemorrhage sign as the hemorrhage picture number x of consecutive image group Gr1 and count.Like this, display control unit 215b obtains the hemorrhage picture number x=10 of this consecutive image group Gr1.
Comprise in this consecutive image group Gr1 under the situation of hemorrhage image of 10 frames, display control unit 215b sets the demonstration color with the corresponding pathological changes labelling of hemorrhage picture number x=10 of this consecutive image group Gr1.Specifically, display control unit 215b calculates and the corresponding color key element of hemorrhage picture number x=10 (R value=84, G-value=0, B value=0) according to above-mentioned formula (1)～(3), sets the demonstration color of the pathological changes labelling that is formed by resulting color key element.
Display control unit 215b carries out following control: the pathological changes labelling M1 that will have a demonstration color (R value=84, G-value=0, B value=0) of such setting is presented on the time location in the labelling display part corresponding with unit picture element 312a 320.According to the control of above-mentioned display control unit 215b, labelling display part 320 with unit picture element 312a time corresponding position on lesions showed labelling M1.
Afterwards, the situation of display control unit 215b and above-mentioned consecutive image group Gr1 roughly similarly, the picture number that determines each unit picture element of time bar 310 successively is the consecutive image group Gr2～Gr5 in the successive whole in-vivo image AI of the image of N, and each hemorrhage picture number x of the consecutive image group Gr2～Gr5 of decision is counted respectively.And the situation of display control unit 215b and above-mentioned pathological changes labelling M1 is roughly similarly carried out following control: show to have the pathological changes labelling M2～M5 that respectively shows color with each hemorrhage picture number x of above-mentioned consecutive image group Gr2～Gr5 accordingly respectively.
Specifically, consecutive image group Gr2～Gr5 be above-mentioned picture number N=60 frame image the consecutive image group of 60 frames in successive whole in-vivo image AI, comprise the hemorrhage image more than 1 respectively.In addition, consecutive image group Gr2～Gr5 is successively continuously after above-mentioned consecutive image group Gr1.That is, consecutive image group Gr2 is follow-up to consecutive image group Gr1, and consecutive image group Gr3 is follow-up to consecutive image group Gr2, and consecutive image group Gr4 is follow-up to consecutive image group Gr3, and consecutive image group Gr5 is follow-up to consecutive image group Gr4.Unit picture element 312b～312e by time bar 310 represents this consecutive image group Gr2～Gr5 respectively.That is, the unit picture element 312b～312e of bar of above-mentioned time 310 corresponds respectively to each time location of consecutive image group Gr2～Gr5.
In addition, display control unit 215b counts successively to the detection number of each the hemorrhage sign in consecutive image group Gr2～Gr5, obtains the hemorrhage picture number x=15 of hemorrhage picture number x=50, consecutive image group Gr4 of hemorrhage picture number x=25, consecutive image group Gr3 of consecutive image group Gr2 and the hemorrhage picture number x=5 of consecutive image group Gr5 successively.This display control unit 215b is according to above-mentioned formula (1)～(3), set successively: with demonstration color (R value=114 of the corresponding pathological changes labelling of the hemorrhage picture number x=25 M2 of consecutive image group Gr2, G-value=0, B value=0), demonstration color (R value=164 with the corresponding pathological changes labelling of the hemorrhage picture number x=50 M3 of consecutive image group Gr3, G-value=0, B value=0), demonstration color (R value=94 with the corresponding pathological changes labelling of the hemorrhage picture number x=15 M4 of consecutive image group Gr4, G-value=0, B value=0), and with demonstration color (R value=74 of the corresponding pathological changes labelling of the hemorrhage picture number x=5 M5 of consecutive image group Gr5, G-value=0, B value=0).
Display control unit 215b carries out following control: will have with above-mentioned hemorrhage picture number x show accordingly the pathological changes labelling M2～M5 of color be presented at successively with interior each time location of the corresponding respectively labelling display part of unit picture element 312b～312e 320 on.According to the control of above-mentioned display control unit 215b, labelling display part 320 with each corresponding respectively time location of unit picture element 312b～312e on lesions showed labelling M2～M5 successively.
Here, the pathological changes labelling M1～M5 that shows according to the control of above-mentioned display control unit 215b, represent each hemorrhage group of pictures that each comprised of consecutive image group Gr1～Gr5 respectively, form by each pixel column in the labelling display part corresponding 320 respectively with the unit picture element 312a～312e of time bar 310.In addition; the hemorrhage picture number x=10 that pathological changes labelling M1 has with consecutive image group Gr1 shows color (R value=84; G-value=0; B value=0) accordingly, the hemorrhage picture number x=25 that has with consecutive image group Gr2 of pathological changes labelling M2 shows color (R value=114, G-value=0; B value=0) accordingly; the hemorrhage picture number x=50 that pathological changes labelling M3 has with consecutive image group Gr3 shows color (R value=164, G-value=0, B value=0) accordingly.The hemorrhage picture number x=15 that pathological changes labelling M4 has with consecutive image group Gr4 shows color (R value=94 accordingly, G-value=0, B value=0), the hemorrhage picture number x=5 that has with consecutive image group Gr5 of pathological changes labelling M5 shows color (R value=74 accordingly, G-value=0, B value=0).
The color that respectively shows of above-mentioned pathological changes labelling M1～M5 is the bleeding part corresponding redness (promptly easily associate the color of bleeding part) represented with hemorrhage image, along with the increase of each hemorrhage picture number x of above-mentioned consecutive image group Gr1～Gr5 and deepen.Specifically, representing the demonstration color of pathological changes labelling M3 of the hemorrhage image of hemorrhage picture number x=50, is the pathological changes labelling M1, M2, M4 than the hemorrhage image of representing less than 50 frames, the redness that M5 is dark.Representing the demonstration color of pathological changes labelling M2 of the hemorrhage image of hemorrhage picture number x=25, is the pathological changes labelling M1 than the hemorrhage image of representing less than 25 frames, the redness that M4, M5 are dark.Representing the demonstration color of pathological changes labelling M4 of the hemorrhage image of hemorrhage picture number x=15, is the pathological changes labelling M1 than the hemorrhage image of representing less than 15 frames, the redness that M5 is dark.Representing the demonstration color of pathological changes labelling M1 of the hemorrhage image of hemorrhage picture number x=10, is the dark redness of pathological changes labelling M5 than the hemorrhage image of representing less than 10 frames.
This pathological changes labelling M1～M5 is along each time location of the hemorrhage image that each comprised of time bar 310 expression consecutive image group Gr1～Gr5, and can represent the distribution of each hemorrhage picture number of consecutive image group Gr1～Gr5 along time bar 310 according to each concentration that show color (specifically red).In this case, pathological changes labelling M1～M5 can be according to the concentration difference of the demonstration color between each pathological changes labelling, and the hemorrhage picture number that compares between consecutive image group Gr1～Gr5 what are illustrated in.
User such as doctor or nurse can understand hemorrhage image distribution on which time location on all time locations of whole in-vivo image AI according to the display position of the pathological changes labelling M1～M5 that shows along time bar 310.Meanwhile, the user can be by the demonstration color of above-mentioned pathological changes labelling M1～M5, understand easily the distribution of the hemorrhage picture number in all time locations of whole in-vivo image AI, and the hemorrhage picture number that between the time location of above-mentioned hemorrhage image, compares what can understand easily.
In addition, above-mentioned display control unit 215b carries out showing the image P in whole in-vivo image AI according to the demonstration indication information of importing by display operation icon group's 330 shown in Figure 23 operation on main viewing area 300 n(frame number n=1,2,3 ...) and control.Specifically, input part 211 is input to control part 215 by the expectation icon among the above-mentioned display operation icon group 330 is carried out clicking operation with the demonstration indication information corresponding with above-mentioned expectation icon.Display control unit 215b carries out the image P in whole in-vivo image AI according to the demonstration indication information by above-mentioned input part 211 inputs nBe presented at the control on the main viewing area 300.
For example, under the situation of the clicking operation of having carried out playing icon 331, display control unit 215b shows image P in the subject 1 successively in the suitable direction of main 300 rise time of viewing area sequence n, under the situation of the clicking operation of having carried out picture broadcast icon 332, each suitable direction frame by frame in main 300 rise time of viewing area sequence shows the image P in the subject 1 nIn addition, under the situation of the clicking operation of having carried out contrary broadcast icon 334, display control unit 215b shows image P in the subject 1 successively in the contrary direction of main 300 rise time of viewing area sequence n, under the situation of the clicking operation of having carried out contrary picture broadcast icon 335, each contrary direction frame by frame in main 300 rise time of viewing area sequence shows the image P in the subject 1 n
On the other hand, under the situation of the clicking operation of having carried out seeking tail icon 333, display control unit 215b with the pictorial display of the last shooting among whole in-vivo image AI in main viewing area 300.In addition, under the situation of the clicking operation of having carried out seeking Head icon 336, display control unit 215b with the pictorial display of the initial shooting among whole in-vivo image AI in main viewing area 300.
More than, as mentioned above, in embodiments of the present invention 5, the hemorrhage image more than 1 that comprises in the tested intravital group of pictures of internal organs inside has been taken in detection along time series, to form the pixel count of time-axis direction of time bar of all time locations of this tested intravital group of pictures of expression divided by all images number of this tested intravital group of pictures, calculate the picture number of each unit picture element of this time bar, in this tested intravital group of pictures, successive each consecutive image group of image to the picture number of this each unit picture element counts hemorrhage picture number, to comprising each consecutive image group of the hemorrhage image more than 1, with the pathological changes labelling of the time location of the hemorrhage image in the expression consecutive image group to show accordingly that with this consecutive image group's hemorrhage picture number color (for example according to hemorrhage picture number and the demonstration color of different concentration) shows.Therefore, display position according to the pathological changes labelling more than 1 that shows along above-mentioned time bar, can represent the time location of the hemorrhage image in all time locations of tested intravital group of pictures, and can utilize the demonstration color of above-mentioned pathological changes labelling more than 1 to represent the distribution of the hemorrhage picture number in this all time location.Its result, the image display device that can be achieved as follows: can understand along the time location of the pathological changes images such as hemorrhage image that comprise in the group of pictures of the internal organs inside that time series is taken, can understand the distribution of the pathological changes picture number on all time locations of group of pictures of internal organs inside easily.
By using the image display device relevant with embodiment 5, the user can understand the time location of the pathological changes image more than 1 that comprises in the tested intravital group of pictures, can infer the tested intravital internal organs of having taken the pathological changes image easily according to above-mentioned time location.In addition, the user can easily understand the distribution of the pathological changes picture number on all time locations of tested intravital group of pictures, can easily infer the pathological changes picture number of the real image number of the pathological changes image that comprises in approximate this tested intravital group of pictures.
Embodiment 6
Then, embodiments of the present invention 6 are described.In above-mentioned embodiment 5, according to the picture number to each unit picture element of time bar 310 is the hemorrhage picture number x that successive each consecutive image group of image of N counts, make the demonstration complexion changedization of pathological changes labelling, but in present embodiment 6, according to above-mentioned hemorrhage picture number x, make the demonstration size variation of pathological changes labelling.
Figure 28 is the block diagram that schematically shows a structure example of the image display device relevant with embodiments of the present invention 6.As shown in figure 28, the image display device 220 relevant with present embodiment 6 replaces the control part 215 of the related image display device 204 of above-mentioned embodiment 5, and has control part 225.In above-mentioned image display device 220, the labelling display part 320 of display part 212 replaces making the pathological changes labelling that shows complexion changedization according to the hemorrhage picture number x that each the consecutive image group who to the picture number in whole in-vivo image AI is N counts, and shows according to above-mentioned hemorrhage picture number x to make the pathological changes labelling that shows size variation.In addition, the in-examiner information acquisition system relevant with embodiments of the present invention 6 replaces the image display device 204 of the in-examiner information acquisition system (with reference to Figure 21) relevant with above-mentioned embodiment 5 and has image display device 220.Other structures are identical with embodiment 5, to same structure part labelling same-sign.
Control part 225 is that each consecutive image group of N shows with hemorrhage picture number x and shows accordingly the labelling presentation control function of control of pathological changes labelling of size except carrying out the picture number in the whole in-vivo image AI that comprise the hemorrhage image more than 1, also has the function same with the control part 215 of the related image display device 204 of above-mentioned embodiment 5.The control part 215 of the image display device 204 that this control part 225 and embodiment 5 are related similarly has the 215a of image detection portion, replaces above-mentioned display control unit 215b to have display control unit 225b.
The pathological changes labelling that display control unit 225b carries out the time location of the pathological changes image more than 1 (for example hemorrhage image) that will expression comprises among whole in-vivo image AI is presented at the control on the labelling display part 320 of display part 212.Specifically, the display control unit 215b of display control unit 225b and above-mentioned embodiment 5 similarly, calculating the picture number N of each unit picture element of time bar 310, is that each the consecutive image group in the successive whole in-vivo image AI of image of N counts hemorrhage picture number x to above-mentioned picture number.Under the hemorrhage picture number x that each the consecutive image group who to above-mentioned picture number is N counts is situation more than 1, promptly comprise under the situation of the hemorrhage image more than 1 in above-mentioned picture number is the consecutive image group of N, display control unit 225b will have with the hemorrhage picture number x that comprises the consecutive image group of this hemorrhage image more than 1 at every turn and show that accordingly the pathological changes labelling of size is presented on the labelling display part 320.In this case, display control unit 225b will the red colour system (easily associate the color of bleeding part) corresponding with the represented bleeding part of hemorrhage image be set at the demonstration color of pathological changes labelling, makes the demonstration size of the pathological changes labelling of the demonstration color with this red colour system follow the increase of hemorrhage picture number x and become big.
In addition, display control unit 225b also has the display control unit 215b identical functions with above-mentioned embodiment 5 except will be like this according to hemorrhage picture number x the pathological changes labelling that shows size variation being presented at the labelling presentation control function on the labelling display part 320.
Then, the pathological changes image that comprises among whole in-vivo image AI of illustration subject 1 is the situation of hemorrhage image, specifies the displaying contents of the display part 212 of the image display device 220 relevant with embodiments of the present invention 6.The sketch map of the displaying contents of the display part 212 of Figure 29 image display device 220 that to be illustration relevant with embodiment 6.
As shown in figure 29, on the display part 212 of this image display device 220 among the window displayed W2, labelling display part 320 replace having with picture number be the pathological changes labelling more than 1 (for example above-mentioned pathological changes labelling group 320a, 320b) that the consecutive image group's of N hemorrhage picture number x shows color accordingly, show to comprise to have pathological changes labelling group 420a, the 420b that shows the pathological changes labelling more than 1 of size with above-mentioned hemorrhage picture number x accordingly.In addition, the labelling display part 320 that shows above-mentioned pathological changes labelling group 420,420b and the situation of above-mentioned embodiment 5 similarly, cancellate (L * W) pixel group of pixel forms by being arranged as in the rectangular area of stipulating perpendicular to the width W [pixel] of time-axis direction according to the length L [pixel] and the direction of time-axis direction.Other displaying contents of window W2 that comprise above-mentioned labelling display part 320 are identical with the situation of above-mentioned embodiment 5.
Pathological changes labelling group 420a, 420b comprise a plurality of pathological changes labellings that show corresponding to the unit picture element of time bar 310 respectively.Each of a plurality of pathological changes labellings that comprise among above-mentioned pathological changes labelling group 420a, the 420b, form by the pixel more than 1 that comprises in the vertical pixel column in the labelling display part 320 pixel column of the orthogonal direction of time shaft of time bar 310 (promptly with), have with each the consecutive image group who to the picture number in whole in-vivo image AI is N and show size accordingly by the hemorrhage picture number x that display control unit 225b has carried out counting.
Show labelling display part 320 with pathological changes labelling more than 1 of illustrative Show Styles among above-mentioned pathological changes labelling group 420a, the 420b, along the time location of each the pathological changes image in the whole in-vivo image AI of time bar 310 expression, and the time location display unit that distributes as the pathological changes picture number on all time locations of the whole in-vivo image AI of expression all time locations of 310 expressions of time bar (promptly by) and bring into play function.Promptly, above-mentioned labelling display part 320 is illustrated on the time bar 310 by the time location of illustrative pathological changes labelling more than 1 among above-mentioned pathological changes labelling group 420a, the 420b with the pathological changes image more than 1 in whole in-vivo image AI, utilizes the distribution of the pathological changes picture number in all time locations of Show Styles (for example according to the pathological changes picture number and different demonstration sizes) expression of above-mentioned pathological changes labelling.
Then, the pathological changes labelling group 420a in the above-mentioned labelling display part 320 of illustration describes the pathological changes labelling that labelling display part 320 shows according to the control of display control unit 225b in detail.Figure 30 is the sketch map that the display control unit 225b of the expression image display device 220 relevant with embodiment 6 is presented at a concrete example of the pathological changes labelling on the labelling display part 320.In addition, the enlarged drawing of the pathological changes labelling group 420a that expression is shown by labelling display part 320 among Figure 30.
As shown in figure 30, pathological changes labelling group 420a for example comprises 5 pathological changes labelling M6～M10 that show along the pixel column of the time-axis direction of formation time bar 310.Each of the unit picture element 312a～312e of pathological changes labelling M6～M10 and time bar 310 shows accordingly.This pathological changes labelling M6～M10 represents by the picture number in whole in-vivo image AI of each representative of above-mentioned unit picture element 312a～312e to be the time location of the hemorrhage image more than 1 that comprises respectively among each consecutive image group of N respectively.
Specifically, the pixel more than 1 that comprises in the pixel group in the labelling display part of being arranged by one dimension on the vertical direction of time-axis direction 320 pixel column of the orthogonal direction of time shaft of time bar 310 (promptly with) forms pathological changes labelling M6～M10 respectively.In this case, the unit picture element 312a that forms 1 the above pixel of above-mentioned pathological changes labelling M6 and time bar 310 is arranged in from a base of labelling display part 320 on the vertical direction (being the longitudinal direction of labelling display part 320) of time-axis direction accordingly.Therewith similarly, each pixel more than 1 that forms above-mentioned pathological changes labelling M7～M10 respectively respectively with the unit picture element 312b～312e of time bar 310 accordingly, be arranged on the vertical direction of time-axis direction from a base of labelling display part 320.
This pathological changes labelling M6 represents the hemorrhage image more than 1 that comprises by among the consecutive image group (above-mentioned picture number is the consecutive image group of N) in whole in-vivo image AI of the unit picture element 312a representative of time bar 310, and represents the time location by the hemorrhage image in the consecutive image group of above-mentioned unit picture element 312a representative in the lump.Therewith similarly; pathological changes labelling M7～M10 represent respectively by the unit picture element 312b～312e of time bar 310 respectively the picture number of representative be the hemorrhage image more than 1 in each consecutive image group of N, and the time location of the hemorrhage image in each the consecutive image group who represents in the lump respectively to represent respectively by above-mentioned unit picture element 312b～312e.
In addition, the demonstration size of this pathological changes labelling M6～M10 is hemorrhage picture number x in each consecutive image group of N and difference according to the picture number by each representative of the unit picture element 312a～312e of time bar 310.Specifically, each of above-mentioned pathological changes labelling M6～M10 shows that picture number that size follows unit picture element 312a～312e to represent respectively is that the increase of the hemorrhage picture number x in each consecutive image group of N becomes greatly, follows the minimizing of above-mentioned hemorrhage picture number x and diminishes.Promptly, each pixel count with the orthogonal pathological changes labelling of the time shaft of time bar 310 M6～M10, the picture number of following unit picture element 312a～312e to represent respectively is that the increase of the hemorrhage picture number x in each consecutive image group of N increases, and follows the minimizing of above-mentioned hemorrhage picture number x and reduces.In this case, the higher limit of each pixel count of above-mentioned pathological changes labelling M6～M10 is the identical value of width W [pixel] with labelling display part 320.
This pathological changes labelling M6～M10 is the time location that each consecutive image group of N represents hemorrhage image by the picture number in the whole in-vivo image AI that comprise the hemorrhage image more than 1, and shows size (pixel count of the pathological changes labelling that width W is changed as higher limit) and be the distribution of the hemorrhage picture number of each consecutive image group representation of N to above-mentioned picture number according to it.Above situation for above-mentioned pathological changes labelling group 420b too.
In addition, as mentioned above, show that (for example the demonstration color of pathological changes labelling M6～M10) also can be a desired color to the pathological changes labelling that size changes according to hemorrhage picture number x, but preferably represented with the hemorrhage image corresponding red colour system in bleeding part.Because be made as red colour system, can associate the represented bleeding part of hemorrhage image easily by demonstration color with above-mentioned pathological changes labelling.
In addition, show the lightness of the background (i.e. the rectangular area of stipulating) of the labelling display part 320 of this pathological changes labelling by length L and width W, near the value the centre of the background of pathological changes labelling and window W2 preferably, the background colour of above-mentioned labelling display part 320 is a complementary color with respect to the pathological changes labelling preferably.Thus, background that can clear and definite above-mentioned labelling display part 320 and the border between the pathological changes labelling, its result, labelling display part 320 can show users such as doctor or the nurse pathological changes labelling of the pattern of identification easily.
Then, comprise situation among the whole in-vivo image AI of illustration, the action of the control part 225 that carries out control that the pathological changes labelling of representing the hemorrhage image temporal position in whole in-vivo image AI is shown is described as the hemorrhage image of an example of pathological changes image.Figure 31 is that expression is carried out showing the flow chart of an example of processing procedure of the control part 225 of the control that the pathological changes labelling of size shows accordingly with having count results with hemorrhage image.
Control part 225 carries out the roughly same processing procedure of processing procedure (with reference to Figure 26) with above-mentioned steps S1201～S1210, to the picture number that comprises among the whole in-vivo image AI that show on the main viewing area 300 is that each consecutive image group of N counts hemorrhage picture number x, and the count results that will have with above-mentioned hemorrhage picture number x shows that accordingly the pathological changes labelling of size is presented on the labelling display part 320.In this case, control part 225 replaces the processing procedure of above-mentioned steps S1207, S1208, setting with picture number as the consecutive image group of process object is the consecutive image group's of N the demonstration size of the corresponding pathological changes labelling of hemorrhage picture number x, and the pathological changes labelling that will have the demonstration size of this setting is presented on the labelling display part 320.
Specifically, as shown in figure 31, display control unit 225b and above-mentioned steps S1201～S1204 are similarly, calculate the picture number N (step S1301) of each unit picture element of time bar 310, the frame number n (step S1302) of the whole in-vivo image AI of initialization, be that consecutive image group decision in the successive whole in-vivo image AI of image of N be the consecutive image group (step S1303) of process object with this picture number, retrieve as the hemorrhage sign (step S1304) in the consecutive image group of the consecutive image group's of this process object picture number N.
Then, display control unit 225b and above-mentioned steps S1305, S1306 are similarly, judge that this picture number is the having or not of hemorrhage sign (step S1305) among the consecutive image group of N, be judged as (step S1305 under the situation of hemorrhage sign, "Yes"), to this picture number is that the hemorrhage image that comprises among the consecutive image group of N is counted (step S1306), and the picture number that obtains as the group of pictures of this process object is the consecutive image group's of N hemorrhage picture number x.
Then, display control unit 225b is corresponding to the hemorrhage picture number x that obtains in step S1306, sets the demonstration size (step S1307) of the pathological changes labelling of the time location of hemorrhage image more than 1 that comprises among the consecutive image group that this picture number of expression is N.Above-mentioned display control unit 225b uses this picture number to be the hemorrhage picture number x in the consecutive image group of N, calculates the pixel count of the pixel column that forms the pathological changes labelling, the pixel count that obtains is set at the demonstration size of this pathological changes labelling.
Specifically, the following formula (4) that display control unit 225b for example comprises as variable according to the width W with hemorrhage picture number x in the consecutive image group's of this process object picture number N, the consecutive image group that this picture number is N and labelling display part 320 is calculated the demonstration size T of the pathological changes labelling of the time location of hemorrhage image more than 1 that comprises among the consecutive image group of this picture number of expression N x[pixel].This shows big or small T xIt is the pixel count that forms the pixel column of this pathological changes labelling.The demonstration size T that display control unit 225b will obtain xBe set at the demonstration size of this pathological changes labelling.
Show big or small T x=10+ (width W-10) * (hemorrhage picture number x/ picture number N)
...(4)
Here, the demonstration size T that calculates according to this formula (4) x(being the picture number of pathological changes labelling), following this picture number is that the increase of the hemorrhage picture number x in the consecutive image group of N increases, and follows the minimizing of this hemorrhage picture number x and reduces.Display control unit 225b is by setting the demonstration size of pathological changes labelling according to above-mentioned formula (4), is that hemorrhage picture number x in the consecutive image group of N changes according to this picture number thereby make the demonstration size of this pathological changes labelling.
Then, display control unit 225b shows the control (step S1308) of the pathological changes labelling with demonstration size of setting in step S1307 to display part 212.Specifically, display control unit 225b carries out following control: on the time location in the labelling display part 320 corresponding with the unit picture element of the consecutive image group's who represents this picture number N time bar 310, show have with this picture number be that hemorrhage picture number x in the consecutive image group of N shows big or small T accordingly xThe pathological changes labelling.According to the control of above-mentioned display control unit 225b, labelling display part 320 with the unit picture element time corresponding position of the consecutive image group's who represents this picture number N time bar 310 on show and show big or small T by this xThe pathological changes labelling that forms of pixel column.
Afterwards, display control unit 225b and above-mentioned steps S1209 similarly upgrade the frame number n (step S1309) of the whole in-vivo image AI that show on the main viewing area 300.And, display control unit 225b and above-mentioned steps S1210 are similarly, judge whether all images of these whole in-vivo image AI has been finished processing (step S1310), at least one of the image that comprises in being judged as these whole in-vivo image AI is not finish (step S1310 under the situation of processing, "No"), return above-mentioned steps S1303, repeat the later processing procedure of this step S1303.
On the other hand, finished under the situation about handling (step S1310, "Yes") at all images that is judged as whole in-vivo image AI to this, display control unit 225b finishes the pathological changes labelling display process relevant with these whole in-vivo image AI.Under this state, the picture number that comprises among 320 couples of whole in-vivo image AI of labelling display part is each the consecutive image group who comprises the hemorrhage image more than 1 among each consecutive image group of N, shows to have with hemorrhage picture number x to show big or small T accordingly xThe pathological changes labelling.
In addition, be judged as in above-mentioned steps S1305 (step S1305, "No") under the situation that does not have hemorrhage sign, display control unit 225b does not carry out the processing procedure of step S1306～S1308 and enters step S1309.In this case, display control unit 225b does not detect hemorrhage sign from this picture number is the consecutive image group of N in above-mentioned steps S1304.That is, this picture number is not comprise hemorrhage image among the consecutive image group of N.In being the consecutive image group of N, this picture number do not comprise under the situation of hemorrhage image, display control unit 225b is being on the time location in the corresponding labelling display part 320 of consecutive image group's the unit picture element of time bar 310 of N with representing this picture number, not the lesions showed labelling.
Then, illustration is represented the pathological changes labelling M6～M10 (with reference to Figure 29,30) of the time location of the hemorrhage image that comprises among whole in-vivo image AI, specify the action of the display control unit 225b that carries out following control:, show to have the pathological changes labelling that shows size with hemorrhage picture number x accordingly to each the consecutive image group in the whole in-vivo image AI that comprise the hemorrhage image more than 1.Figure 32 is used to specify carry out showing big or small T accordingly to having with hemorrhage picture number x xThe sketch map of action of display control unit 225b of the control that shows of pathological changes labelling.
The whole in-vivo image AI that show on the main viewing area 300 for example are the group of pictures (being that all images is counted the group of pictures that A is 60,000 frames) that comprises 60,000 two field pictures, comprise a plurality of hemorrhage images.Here, length L (being the pixel count of the time-axis direction of formation time bar 310) at time bar 310 is under the situation of 1000 pixels, display control unit 225b counts the length L (=1000 pixel) of A (=6 ten thousand frame) divided by time bar 310 with all images of whole in-vivo image AI, calculates the picture number N (=60 frame) of each unit picture element of this time bar 310.In addition, the width W of this time bar 310 (being the higher limit of the demonstration size of pathological changes labelling) for example is 130 pixels.
Afterwards, display control unit 225b determines that successively the picture number of above-mentioned each unit picture element is the consecutive image group in the successive whole in-vivo image AI of image of N, is that each consecutive image group of N counts hemorrhage picture number x to above-mentioned picture number.And display control unit 225b carries out following control: to the picture number that comprises the hemorrhage image more than 1 is each consecutive image group of N, shows to have with hemorrhage picture number x to show big or small T accordingly xThe pathological changes labelling.
Specifically, shown in figure 32, display control unit 225b determines that from whole in-vivo image AI the picture number of each unit picture element is the consecutive image group Gr1 of successive 60 frames of image of N (=60 frame).In addition, with the situation of above-mentioned embodiment 5 similarly, represent this consecutive image group Gr1 by the unit picture element 312a of time bar 310.
The situation of display control unit 225b and above-mentioned embodiment 5 similarly detects 10 hemorrhage signs from this consecutive image group Gr1, the hemorrhage picture number x as consecutive image group Gr1 counts with the detection number (=10) of this hemorrhage sign.Like this, display control unit 225b obtains the hemorrhage picture number x=10 of this consecutive image group Gr1.
Comprise in this consecutive image group Gr1 under the situation of hemorrhage image of 10 frames, display control unit 225b sets the demonstration size with the corresponding pathological changes labelling of hemorrhage picture number x=10 of this consecutive image group Gr1.Specifically, display control unit 225b is according to above-mentioned formula (4), calculates with hemorrhage picture number x=10 to show big or small T accordingly 10(=30 pixel) as the demonstration size of the pathological changes labelling of the time location of the hemorrhage image in expression this consecutive image group Gr1, sets this demonstration that obtains size T 10
Display control unit 225b carries out following control: the demonstration size T that will have such setting 10The pathological changes labelling M6 of (=30 pixel) is presented on the time location in the labelling display part corresponding with unit picture element 312a 320.According to the control of above-mentioned display control unit 225b, labelling display part 320 with unit picture element 312a time corresponding position on lesions showed labelling M6.
Afterwards, the situation of display control unit 225b and above-mentioned embodiment 5 similarly, the picture number that determines each unit picture element of time bar 310 successively is the consecutive image group Gr2～Gr5 in the successive whole in-vivo image AI of the image of N (=60), and each hemorrhage picture number x of the consecutive image group Gr2～Gr5 of decision is counted respectively.And the situation of display control unit 225b and above-mentioned pathological changes labelling M6 is roughly similarly carried out following control: show that each the hemorrhage picture number x that has respectively with above-mentioned consecutive image group Gr2～Gr5 respectively shows big or small T accordingly xPathological changes labelling M7～M10.
In addition, the situation of consecutive image group Gr2～Gr5 and above-mentioned embodiment 5 is the consecutive image group of 60 frames represented respectively of the unit picture element 312b～312e by time bar 310 similarly, comprises the hemorrhage image more than 1 respectively.
The situation of display control unit 225b and above-mentioned embodiment 5 is similarly obtained the hemorrhage picture number x=15 of hemorrhage picture number x=50, consecutive image group Gr4 of hemorrhage picture number x=25, consecutive image group Gr3 of consecutive image group Gr2 and the hemorrhage picture number x=5 of consecutive image group Gr5 successively.This display control unit 225b sets successively according to above-mentioned formula (4): with the demonstration size T of the corresponding pathological changes labelling of the hemorrhage picture number x=25 M7 of consecutive image group Gr2 25(=60 pixel), with the demonstration size T of the corresponding pathological changes labelling of the hemorrhage picture number x=50 M 8 of consecutive image group Gr3 50(=110 pixel), with the demonstration size T of the corresponding pathological changes labelling of the hemorrhage picture number x=15 M9 of consecutive image group Gr4 15(=40 pixel) and with the demonstration size T of the corresponding pathological changes labelling of the hemorrhage picture number x=5 M10 of consecutive image group Gr5 5(=20 pixel).
Display control unit 225b carries out following control: will have with above-mentioned hemorrhage picture number x and show big or small T accordingly xPathological changes labelling M7～M10 be presented at successively with interior each time location of the corresponding respectively labelling display part of unit picture element 312b～312e 320 on.According to the control of above-mentioned display control unit 225b, labelling display part 320 with each corresponding respectively time location of unit picture element 312b～312e on lesions showed labelling M7～M10 successively.
Here, according to pathological changes labelling M6～M10 that the control of above-mentioned display control unit 225b shows, represent each the hemorrhage group of pictures that comprises in each of consecutive image group Gr1～Gr5 respectively.In addition, on the time location in the labelling display part 320 corresponding, be arranged in the pixel column of 30 pixels on the longitudinal direction of labelling display part 320 by a base and form and have the big or small T of demonstration from labelling display part 320 with unit picture element 312a 10The pathological changes labelling M6 of (=30 pixel).On the time location in the labelling display part 320 corresponding, be arranged in the pixel column of 60 pixels on the longitudinal direction of labelling display part 320 by a base and form and have the big or small T of demonstration from labelling display part 320 with unit picture element 312b 25The pathological changes labelling M7 of (=60 pixel).In the time location in the labelling display part 320 corresponding, be arranged in the pixel column of 110 pixels on the longitudinal direction of labelling display part 320 by a base and form and have the big or small T of demonstration from labelling display part 320 with unit picture element 312c 50The pathological changes labelling M8 of (=110 pixel).On the time location in the labelling display part 320 corresponding, be arranged in the pixel column of 40 pixels on the longitudinal direction of labelling display part 320 by a base and form and have the big or small T of demonstration from labelling display part 320 with unit picture element 312d 15The pathological changes labelling M9 of (=40 pixel).On the time location in the labelling display part 320 corresponding, be arranged in the pixel column of 20 pixels on the longitudinal direction of labelling display part 320 by a base and form and have the big or small T of demonstration from labelling display part 320 with unit picture element 312e 5The pathological changes labelling M10 of (=20 pixel).
Above-mentioned pathological changes labelling M6～M10 respectively shows big or small T xAlong with the increase of each hemorrhage picture number x of above-mentioned consecutive image group Gr1～Gr5 and increase.Specifically, represent the demonstration size T of pathological changes labelling M8 of the hemorrhage image of hemorrhage picture number x=50 50, bigger than pathological changes labelling M6, M7, M9, the M10 of the hemorrhage image of representing less than 50 frames.Represent the demonstration size T of pathological changes labelling M7 of the hemorrhage image of hemorrhage picture number x=25 25, bigger than pathological changes labelling M6, M9, the M10 of the hemorrhage image of representing less than 25 frames.Represent the demonstration size T of pathological changes labelling M9 of the hemorrhage image of hemorrhage picture number x=15 15, bigger than pathological changes labelling M6, the M10 of the hemorrhage image of representing less than 15 frames.Represent the demonstration size T of pathological changes labelling M6 of the hemorrhage image of hemorrhage picture number x=10 10, bigger than the pathological changes labelling M10 of the hemorrhage image of representing less than 10 frames.
Each time location of the hemorrhage image that this pathological changes labelling M6～M10 comprises in each of time bar 310 expression consecutive image group Gr1～Gr5, and show big or small T by each xCan represent the distribution of each hemorrhage picture number of consecutive image group Gr1～Gr5 along time bar 310.In this case, pathological changes labelling M6～M10 is by the size of the demonstration between each pathological changes labelling T xDifference, can be illustrated in what of the hemorrhage picture number that compares between consecutive image group Gr1～Gr5.
User such as doctor or nurse can understand on which time location of hemorrhage image distribution in all time locations of whole in-vivo image AI according to the display position of the pathological changes labelling M6～M10 that shows along time bar 310.Meanwhile, the user is according to the demonstration size of above-mentioned pathological changes labelling M6～M10, can understand the distribution of the hemorrhage picture number on all time locations of whole in-vivo image AI easily, and the hemorrhage picture number that between the time location of above-mentioned hemorrhage image, compares what can understand easily.
More than, as mentioned above, in embodiments of the present invention 6, the demonstration color that replaces above-mentioned pathological changes labelling, carried out the hemorrhage picture number of counting according to successive each consecutive image group of image to the picture number of each unit picture element of time bar, the demonstration size of pathological changes labelling is changed, make its demonstration have the pathological changes labelling that shows size with above-mentioned hemorrhage picture number accordingly, other structure is made as with above-mentioned embodiment 5 same.Therefore, realized following image display device: the action effect of enjoying above-mentioned embodiment 5, and can show the distribution of the pathological changes picture number in all time locations of the internal organs internal image group who takes along time series with the Show Styles of easier identification, can further understand the distribution of above-mentioned pathological changes picture number easily.
In addition, in embodiments of the present invention 1～4, the pathological changes that comprises in the subject as the pathological changes image, illustration the bleeding part or the position of fading, but be not limited thereto, the represented pathological changes of above-mentioned pathological changes image also can be the various pathological changes that the meeting of rubescent position, solidification blood position, rotten to the corn position, ulcer spot etc. takes place in vivo except the bleeding part and the position of fading.
In addition, in embodiments of the present invention 2～4, as multiple pathological changes, illustration the bleeding part and the position of fading, but being not limited thereto, can be the bleeding part also, the various pathological changes that can take place in vivo such as the position of fading, rubescent position, solidification blood position, rotten to the corn position, ulcer spot.In this case; the situation of the 25b of lesion detection portion and the above-mentioned hemorrhage image and the image that fades similarly; the color information (value of the key element of all kinds of average color, RGB etc.) according to image judges whether it is the pathological changes image; under the situation that is the pathological changes image, as long as the corresponding pathological changes sign of pathological changes that will be represented with this pathological changes image (bleeding part, the position of fading, rubescent position, solidification blood position, rotten to the corn position, ulcer spot etc.) appends on this pathological changes image.In addition, the pathological changes color of above-mentioned pathological changes labelling and slide block 111 also can be set at different colors by the kind of above-mentioned multiple pathological changes.
And, in embodiments of the present invention 3,4, selected at least one in the bleeding part and the position of fading, but be not limited thereto, the pathological changes of selecting by pathological changes selection portion 160 more than 1 so long as at least one in the various pathological changes that bleeding part, the position of fading, rubescent position, solidification blood position, rotten to the corn position, ulcer spot etc. can take place in vivo get final product.In this case, in the choice menus of above-mentioned pathological changes selection portion 160, as long as multiple pathological changes such as bleeding part, the position of fading, rubescent position, solidification blood position, rotten to the corn position, ulcer spot are joined in the option.
In addition, in embodiments of the present invention 1～4, the demonstration color information of the pathological changes color (being the pathological changes color of above-mentioned pathological changes labelling and slide block 111) that the pathological changes that setting and pathological changes image is represented is corresponding and the acquiescence color of slide block 111 is saved in storage part 14 in advance, to be made as the pathological changes color of pathological changes labelling and slide block 111 by the pathological changes color of above-mentioned demonstration color information setting, but be not limited thereto, the color of the pathological changes color that the preferably approximate pathological changes image of the pathological changes color of above-mentioned pathological changes labelling and slide block 111 is represented also can be the average color of pathological changes image.
And, in embodiments of the present invention 2～4, a plurality of pathological changes labellings of the time location of each of a plurality of pathological changes images that expression is comprised among whole in-vivo image AI are presented in 1 labelling display part 120, but be not limited thereto, also can possess a plurality of labelling display parts, show a plurality of pathological changes labellings of classifying by above-mentioned a plurality of labelling display parts respectively by the kind of pathological changes by the kind of pathological changes.
In addition, in embodiments of the present invention 1～4, when reading in whole in-vivo image AI from pocket recording medium 5, detect the pathological changes image more than 1 in these whole in-vivo image AI, but be not limited thereto, also the whole in-vivo image AI that are taken into from above-mentioned pocket recording medium 5 can be kept at the storage part 14, detect the pathological changes image more than 1 that comprises among the whole in-vivo image AI in this storage part 14 afterwards.In this case, in above-mentioned embodiment 3,4, also can from whole in-vivo image AI, detect 1 above pathological changes image that will be included in by the pathological changes that pathological changes selection portion 160 is selected among the pathological changes image that in whole in-vivo image AI, comprises in the subject.
And, in embodiments of the present invention 1～4, current under the situation of lesions showed image on the main viewing area 100, demonstration complexion changed pathological changes color more with the slide block 111 of the time location of this pathological changes image of expression, but be not limited thereto, the demonstration color of slide block 111 can not rely on the current display image of above-mentioned main viewing area 100 yet, and utilizes the color (for example giving tacit consent to color) of regulation to show.That is, also can not change the demonstration color of slide block 111.
In addition, in embodiments of the present invention 5, according to the demonstration color of above-mentioned formula (1)～(3) setting with the corresponding pathological changes labelling of hemorrhage picture number x, an example of the calculating formula of the key element of all kinds (R value, G-value, B value) that but above-mentioned formula (1)～(3) are formation and the corresponding pathological changes labelling of hemorrhage picture number x shows color does not limit the present invention.
Specifically, the calculating formula that forms the R value of above-mentioned pathological changes labelling demonstration color is not limited to above-mentioned formula (1), comprises as variable as long as will be illustrated as the pathological changes picture number of hemorrhage picture number x, and the R value that obtains in 0～255 scope according to above-mentioned pathological changes picture number gets final product.In this case, every coefficient of the calculating formula of above-mentioned R value and constant also can be the numerical value of expectation, but the variation that preferably is set at the red-color concentration of following the variation of pathological changes picture number is the visual linear change of people.
In addition, in embodiments of the present invention 5, the demonstration color of pathological changes labelling is set at redness (i.e. 1≤R value≤255 corresponding to the represented bleeding part of hemorrhage image, G-value=0, B value=0), variation along with hemorrhage picture number x, make demonstration color (redness) concentration change of pathological changes labelling, but be not limited thereto; the demonstration color of pathological changes labelling also can be set at 3 color key element R; G; at least 2 colors that make up and form among the B; along with the variation of the pathological changes picture number that is illustrated as hemorrhage picture number x, make the tone of the demonstration color of above-mentioned pathological changes labelling; lightness; perhaps chroma isochrome multimedia message breath changes.In this case, also can be with at least 2 numerical value that are set at more than 1 of the value (R value, G-value, B value) of 3 color key elements, make the value of above-mentioned at least 2 color key elements be changed to numerical value in 1～255 scope respectively along with the variation of pathological changes picture number.
And, in embodiments of the present invention 5, make and form the hemorrhage relatively picture number x linear change of value (R value) that the pathological changes labelling shows the color key element of color, but be not limited thereto, also can make to form value (R value, G-value or B value) the pathological changes picture number of hemorrhage picture number x etc. and the nonlinear change relatively that the pathological changes labelling shows the color key element of color.In this case, form the formula of calculating of value that above-mentioned pathological changes labelling shows the color key element of color, as long as form by the multidimensional function that the pathological changes picture number is comprised as variable.In addition, under the situation that at least 2 colors that make up and form among 3 color key element R, G, the B are set as the demonstration color of pathological changes labelling, as long as in each calculating formula of R value, G-value, B value at least 2 are formed by the multidimensional function that the pathological changes picture number is comprised as variable.And above-mentioned multidimensional function preferably is set at the visually linear change of the variation that the pathological changes labelling of following the pathological changes picture number to change shows color (for example the concentration of tone, lightness, chroma, color etc. variation) the people.
In addition, in embodiments of the present invention 6, set and the big or small T of the demonstration of the corresponding pathological changes labelling of hemorrhage picture number x according to above-mentioned formula (4) x, but above-mentioned formula (4) is to calculate and the big or small T of the demonstration of the corresponding pathological changes labelling of hemorrhage picture number x xAn example of calculating formula, do not limit the present invention.
Specifically, the demonstration of above-mentioned pathological changes labelling size T xCalculating formula be not limited to above-mentioned formula (4), as long as illustrative pathological changes picture number among the hemorrhage picture number x comprised as variable and obtain pixel count in 0 pixel～W pixel (width W that is equivalent to labelling display part 320) scope according to above-mentioned pathological changes picture number.In this case, above-mentioned demonstration size T xEvery coefficient of calculating formula and constant also can be the numerical value of expectation, but preferably be set at the demonstration size T that follows the pathological changes picture number to change xVariation in people's linear change visually.
In addition, in embodiments of the present invention 6, make the demonstration size T of pathological changes labelling xWith respect to hemorrhage picture number x linear change, but be not limited thereto, also can make the demonstration size T of pathological changes labelling xPathological changes picture number nonlinear change with respect to hemorrhage picture number x etc.In this case, the demonstration of above-mentioned pathological changes labelling size T xThe formula of calculating also can form by the multidimensional function that the pathological changes picture number is comprised as variable.And above-mentioned multidimensional function preferably is set at the demonstration size T that follows the pathological changes labelling that the pathological changes picture number changes xVariation in people's linear change visually.
And, in embodiments of the present invention 5,6, as the represented pathological changes of pathological changes image (promptly; the pathological changes that comprises in the subject of pathological changes image); illustration the bleeding part; but be not limited thereto, the represented pathological changes of above-mentioned pathological changes image also can be the various pathological changes that position, rubescent position, solidification blood position, rotten to the corn position, ulcer spot etc. can produce in vivo of fading except the bleeding part.In addition, represent the demonstration color of the pathological changes labelling of above-mentioned pathological changes image temporal position, the corresponding color of preferably represented pathological changes (bleeding part, the position of fading, rubescent position, solidification blood position, rotten to the corn position, ulcer spot etc.) with this pathological changes image.Specifically, be under the situation at bleeding part, rubescent position or solidification blood position in the represented pathological changes of pathological changes image, represent the demonstration color red colour system preferably of the pathological changes labelling of above-mentioned pathological changes image temporal position.In addition, be to fade under the situation of position, rotten to the corn position or ulcer spot in the represented pathological changes of pathological changes image, represent demonstration the color preferably white or the grey colour system of the pathological changes labelling of above-mentioned pathological changes image temporal position.
In addition, in embodiments of the present invention 5,6, when pocket recording medium 205 reads in whole in-vivo image AI, detect the pathological changes image more than 1 in these whole in-vivo image AI, but be not limited thereto, also the whole in-vivo image AI that are taken into from above-mentioned pocket recording medium 205 can be kept at storage part 214, detect the pathological changes image more than 1 that comprises among the whole in-vivo image AI in this storage part 214 afterwards.
And, in embodiments of the present invention 5,6, the front and back of lesions showed image on main viewing area 300, do not make the demonstration complexion changedization of slide block 311, but be not limited thereto, as illustration in the above-mentioned embodiment 1～4, also can be under the situation of lesions showed image on the main viewing area 300 current, with the demonstration complexion changed of the slide block 311 of this pathological changes image temporal position of expression pathological changes color more.That is, also above-mentioned embodiment 1～4 and embodiment 5,6 suitably can be made up.In this case, above-mentioned embodiment 5, the display control unit of 6 related image display devices (is display control unit 215b, 225b) has the display control unit 15a of the related image display device of embodiment 1～4,25a, 35a, the control function that 45a is roughly the same, current under the situation of lesions showed image on the main viewing area 300, for example as shown in figure 33, as long as carry out following control: the demonstration color of slide block 311 that will represent this pathological changes image temporal position is from acquiescence complexion changed pathological changes color (in detail, the corresponding pathological changes color of pathological changes) represented with this pathological changes image more.
＜various distortion 〉
Aforesaid embodiment is only used for illustrating principle of the present invention.Thereby above-mentioned embodiment can carry out various changes.
For example, in above example, whether be the pathological changes image according to current display image, and make the demonstration complexion changedization of slide block.But, show that slide block just can reach purpose of the present invention as long as make it possible to discern the variation ground of slide block Show Styles, so also can at random change the Show Styles of slide block.For example, be not only the color of slide block, also can use the rhythm of shape, size, fill pattern, flicker, flicker, or combination in any in the flicker pattern.
In addition, in the above embodiment, used time bar and labelling display part, but may not need to distinguish them, for example, do not shown the time bar and have the slide block that moves along the labelling display part to get final product.In this case, also can only show the scale of time bar if desired, but also can not show according to the labelling display part.Perhaps, replace showing slide block, for example also can change brightness or color or glimmer, make it possible to distinguish being in the pixel of the vertical direction on the time location of the labelling display part corresponding and the other parts of labelling display part with current display image.
In aforesaid embodiment, the total A that supposes whole in-vivo images is the integral multiple of pixel count L of the length direction of labelling display part, but total A may not be the integral multiple of pixel count L.Be not under the situation of integral multiple of pixel count L at total A, decision has been carried out the consecutive image group of the L that L cuts apart with whole in-vivo images, makes their the consecutive image group of L corresponding with the time location of L.
When in the step S1207 of embodiment 5, setting the color of pathological changes labelling, illustrated in a consecutive image group, whether only to comprise a kind of pathological changes.But, the probability that comprises multiple pathological changes in a consecutive image group is also arranged.In this case, distribute pathological changes to show color by each kind of pathological changes, the pathological changes that comprises in a consecutive image group is under a kind of situation, corresponding pathological changes color is controlled the deep or light of demonstration according to above-mentioned formula (1), in a consecutive image group, comprise under the situation of multiple pathological changes, each pathological changes color obtained colour component with the formula identical with formula (1), and the colour component of obtaining carried out mixing and the color that obtains is made as the color to this consecutive image group's pathological changes labelling.
In addition, in the above-described embodiment, the labelling display part is made as the zone of growing crosswise.But be not limited to this, the labelling display part also can be the zone of lengthwise, need not be straight strip.For example, also can be the L type, also can rectangle if starting point and terminal point are clear and definite.And, the list area that the image that schematically shows shows to oversimplifying the digestive tube that endoscope passed through also can be set in display frame, the digestive tube of the schematic images of this digestive tube partly is made as the labelling display part, perhaps, the labelling display part of in above-mentioned embodiment, narrating, also can be at the digestive tube part lesions showed labelling (if desired, together with slide block) of the schematic images of this digestive tube.Thus, the time location of pathological changes not only can be determined, and the approximate location in the digestive tube can be determined.
In addition, in the above embodiment, the image display device that shows the image that obtains by the capsule type endoscope of automatically exporting in-vivo image with official hour at interval has been described mainly.But principle of the present invention is not limited to capsule type endoscope, also can be applied in the demonstration of the in-vivo image that the user utilization takes with the endoscope of manually photographing.Under these circumstances, though the interval of in-vivo image is not fixed, can use photography to show as labelling viewing area, the time bar at two ends constantly with the photography of image at last constantly with initial image.Under the situation of this embodiment, photography time between adjacent image is not fixed at interval, whole in-vivo images are being mapped to the labelling viewing area, under the situation of time bar or their both (identical time scale), photography time interval (in the demonstration between adjacent image on the time scale at interval) between adjacent image and the unit of time that can distinguish on time scale are (promptly, the interval of the pixel of the time scale direction of labelling viewing area and time bar) compare, long during or group of pictures, during equating or group of pictures, during short or group of pictures mix and be present in time scale or all in the in-vivo image.Whether photography time equate with above-mentioned unit of time at interval, merely is mapped on the time scale about the group of pictures of growing to get final product.But, about photography time at interval (in other words than the short group of pictures of above-mentioned unit of time, surpass such in-vivo image group of the resolution of time-axis direction of labelling viewing area or time bar or the interval on the time scale about the quantity of in-vivo image), utilize the technology of above-mentioned embodiment 5 or 6 to get final product.
According to the image display device relevant with the present invention, discern by demonstration color the slide block of representing the current time location that is presented at the tested intravital image on the viewing area, can judge easily whether this tested in-vivo image is the pathological changes image.Its result plays following effect: do not hinder the current tested intravital image observation that is presented on the viewing area, and easily determine the pathological changes image of bleeding part etc. can the tested intravital group of pictures on being presented at above-mentioned viewing area successively.
In addition, according to the image display device relevant with the present invention, display position according to 1 the above pathological changes labelling that shows along the time shaft of time bar, the pathological changes image temporal position in all time locations of group of pictures in the subject can be represented, and the distribution of the pathological changes picture number in this all time location can be represented according to the Show Styles (for example show color or show size) of above-mentioned pathological changes labelling more than 1.Its result, play following effect: can understand the time location of the pathological changes image that comprises in the group of pictures of the internal organs inside that time series is taken, and can easily understand the distribution of the pathological changes picture number on all time locations of group of pictures of internal organs inside.
Can derive other effects, variation easily by those skilled in the art.Embodiments of the present invention are not limited to aforesaid specific implementations.Thereby, in the scope of the inventive concept of claim that does not exceed interpolation and equipollent thereof, can carry out all changes.
Utilizability on the industry
As mentioned above, the image display device relevant with the present invention is useful in the inspection of the subject inside that each image of the internal organs inside of having taken the subjects such as patient is observed, particularly can determine easily by the pathology image in the group of pictures of the subject inside of picture disply, perhaps can understand easily the distribution of the pathology picture number on all time locations of subject internal image group, its result, being suitable for can be easily and observe efficiently the image display device of the pathology image of subject.

Claims (16)

1. image display device shows according to time series and takes in the subject and the in-vivo image that obtains is characterized in that possessing:
Image detection portion, it detects the pathological changes image that comprises as in all whole in-vivo images of above-mentioned in-vivo image;
The basis display part, its demonstration: the elongated viewing area and the indicator of having distributed the above-mentioned time series time corresponding position during the whole photography with above-mentioned whole in-vivo images in the longitudinal direction, this indicator moves along the length direction of above-mentioned viewing area, represents among whole in-vivo images and the current time location that is presented on the corresponding above-mentioned elongated viewing area of current in-vivo image on the main viewing area;
The pathological changes display part, it detects under the situation of above-mentioned pathological changes image in above-mentioned image detection portion, make in above-mentioned elongated viewing area, be in the locational above-mentioned elongated viewing area of above-mentioned pathological changes image time corresponding on pixel luminous with the pattern of regulation; And
Display control unit, its according to the relevant information of pathological changes of above-mentioned current in-vivo image, the Show Styles of above-mentioned indicator is changed.
2. image display device according to claim 1 is characterized in that,
Above-mentioned basic display part will as one man show with above-mentioned elongated time bar that the viewing area is parallel and length is identical and above-mentioned elongated viewing area, and above-mentioned indicator will be shown as the slide block that moves on above-mentioned time bar.
3. image display device according to claim 1 is characterized in that,
At above-mentioned current in-vivo image is not under the situation of pathological changes image, above-mentioned display control unit is set at the above-mentioned Show Styles of above-mentioned indicator the Show Styles of regulation, at above-mentioned current in-vivo image is under the situation of pathological changes image, and above-mentioned display control unit is set at the above-mentioned Show Styles of above-mentioned indicator the pathological changes Show Styles of the regulation of its meaning of expression.
4. image display device according to claim 1 is characterized in that,
Above-mentioned pathological changes display part make in above-mentioned elongated viewing area, be in the locational pixel of above-mentioned pathological changes image time corresponding with the kind of the pathological changes that comprises in according to above-mentioned pathological changes image and predefined pattern carries out luminous.
5. image display device according to claim 3 is characterized in that,
At above-mentioned current in-vivo image is under the situation of pathological changes image, above-mentioned display control unit with above-mentioned Show Styles be set at above-mentioned pathological changes image in the relevant pathological changes Show Styles of kind of the pathological changes that comprised.
6. image display device according to claim 3 is characterized in that,
Above-mentioned display control unit makes the Show Styles of afore mentioned rules comprise the color of regulation, makes above-mentioned pathological changes Show Styles comprise the pathological changes color of regulation.
7. image display device according to claim 3 is characterized in that,
Above-mentioned display control unit makes the Show Styles of afore mentioned rules comprise the color of regulation, makes above-mentioned pathological changes Show Styles comprise the relevant pathological changes color of kind with the pathological changes of above-mentioned pathological changes image.
8. image display device according to claim 1 is characterized in that,
The luminous pattern harmony mutually of the pixel on the above-mentioned elongated viewing area on the above-mentioned Show Styles that above-mentioned display control unit makes above-mentioned indicator and the above-mentioned time location that is positioned at above-mentioned indicator.
9. image display device according to claim 1 is characterized in that,
Above-mentioned display control unit is set above-mentioned Show Styles, makes the above-mentioned Show Styles of above-mentioned indicator comprise the illuminant color of the pixel on the above-mentioned elongated viewing area on the time location that is positioned at above-mentioned indicator.
10. according to each the described image display device in the claim 1～9, it is characterized in that, comprising:
The pathological changes selection portion, it allows user select more than one kind from a plurality of kinds of apoplexy due to endogenous wind of pathological changes; And
Only will cover the unit that the image in the subject is handled as above-mentioned pathological changes image to the position of the pathological changes of selecting by above-mentioned pathological changes selection portion.
11. each the described image display device according in the claim 1～9 is characterized in that, comprising:
The icon display part, it shows below icon, this icon can allow user about the current above-mentioned current in-vivo image that is presented on the above-mentioned main viewing area, send with picture divide a word with a hyphen at the end of a line, play continuously, contrary picture is divided a word with a hyphen at the end of a line, contrary each display packing of playing continuously is corresponding demonstration indication;
The in-vivo image display part, it is in response to an operation of above-mentioned icon, carries out demonstration to above-mentioned main viewing area with the display packing corresponding with above-mentioned operated icon; And
Mode selection part, it can allow user select above-mentioned whole in-vivo images as the ordinary playing pattern of display object or only with the pathological changes play mode of above-mentioned pathological changes image as display object,
Above-mentioned in-vivo image display part comprises as lower unit: under the situation of having selected above-mentioned ordinary playing pattern, with the object of above-mentioned whole in-vivo images as action, under the situation of having selected above-mentioned pathological changes play mode, extract above-mentioned pathological changes image from above-mentioned whole in-vivo images out, the above-mentioned pathological changes image that only will extract out is as the object of action.
12. each the described image display device according in the claim 1～9 is characterized in that, comprising:
The icon display part, it shows below icon, this icon can allow user about the current above-mentioned current in-vivo image that is presented on the above-mentioned main viewing area, send with picture divide a word with a hyphen at the end of a line, play continuously, contrary picture is divided a word with a hyphen at the end of a line, contrary each display packing of playing continuously is corresponding demonstration indication;
The in-vivo image display part, it is in response to an operation of above-mentioned icon, carries out demonstration to above-mentioned main viewing area with the display packing corresponding with above-mentioned operated icon;
Mode selection part, it can allow user select above-mentioned whole in-vivo images as the ordinary playing pattern of display object or only with the pathological changes play mode of above-mentioned pathological changes image as display object; And
The pathological changes selection portion, it can allow user select more than one kind from a plurality of kinds of apoplexy due to endogenous wind of pathological changes,
Above-mentioned in-vivo image display part comprises as lower unit: under the situation of having selected above-mentioned ordinary playing pattern, with the object of above-mentioned whole in-vivo images as action, under the situation of having selected above-mentioned pathological changes play mode, extract the pathological changes image of the pathological changes that comprises above-mentioned selecteed kind from above-mentioned whole in-vivo images out, the above-mentioned pathological changes image that only will extract out is as the object of action.
13. image display device according to claim 1 is characterized in that,
Above-mentioned basic display part comprises the unit of carrying out following function: in the sum of the above-mentioned whole in-vivo images situation greater than the pixel count L of the length direction of above-mentioned elongated viewing area; Make L consecutive image group cutting apart with above-mentioned pixel count L that above-mentioned whole in-vivo image obtains, is made of continuous in-vivo image corresponding with the time location of the L of the length direction of above-mentioned elongated viewing area; Show above-mentioned indicator at the time location corresponding with the above-mentioned consecutive image group who comprises above-mentioned current in-vivo image
Above-mentioned pathological changes display part possesses pathological changes labelling display part, this pathological changes labelling display part is for each time location of number L, makes pixel column on this time location that is in above-mentioned elongated viewing area according to the quantity of the pathological changes image among the consecutive image group corresponding with this time location and luminous quantitatively.
14. image display device according to claim 13 is characterized in that,
Above-mentioned pathological changes labelling display part makes with the above-mentioned pixel column of the corresponding length of quantity of above-mentioned pathological changes image luminous.
15. image display device according to claim 14 is characterized in that,
Above-mentioned pathological changes labelling display part makes the end alignment of the above-mentioned pixel column that show, the position that makes the other end changes according to the quantity of above-mentioned pathological changes image.
16. each the described image display device according in the claim 13～15 is characterized in that,
The demonstration color of above-mentioned pixel column is the pathological changes corresponding color represented with above-mentioned pathological changes image.
CN2007101431724A 2006-08-03 2007-08-03 Image display device Active CN101116608B (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2006-212510 2006-08-03
JP2006212510 2006-08-03
JP2006212510A JP5005981B2 (en) 2006-08-03 2006-08-03 Image display device
JP2006240384A JP4914680B2 (en) 2006-09-05 2006-09-05 Image display device
JP2006-240384 2006-09-05
JP2006240384 2006-09-05

Publications (2)

Publication Number Publication Date
CN101116608A CN101116608A (en) 2008-02-06
CN101116608B true CN101116608B (en) 2010-06-09

Family

ID=39052988

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2007101431724A Active CN101116608B (en) 2006-08-03 2007-08-03 Image display device

Country Status (2)

Country Link
JP (1) JP5005981B2 (en)
CN (1) CN101116608B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11950760B2 (en) 2018-05-17 2024-04-09 Fujifilm Corporation Endoscope apparatus, endoscope operation method, and program

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5215105B2 (en) * 2008-09-30 2013-06-19 オリンパスメディカルシステムズ株式会社 Image display device, image display method, and image display program
JP5231160B2 (en) * 2008-10-21 2013-07-10 オリンパスメディカルシステムズ株式会社 Image display device, image display method, and image display program
CN102256533B (en) * 2009-07-29 2014-03-05 奥林巴斯医疗株式会社 Image display device, radiographic interpretation support system, and radiographic interpretation support program
JP4727755B2 (en) * 2009-10-06 2011-07-20 シャープ株式会社 Electronic document processing apparatus, electronic document display apparatus, electronic document processing method, electronic document processing program, and recording medium
US9060673B2 (en) * 2010-04-28 2015-06-23 Given Imaging Ltd. System and method for displaying portions of in-vivo images
JP5846841B2 (en) * 2011-10-14 2016-01-20 株式会社東芝 Medical image display device
JP5684300B2 (en) * 2013-02-01 2015-03-11 オリンパスメディカルシステムズ株式会社 Image display device, image display method, and image display program
RU2676432C2 (en) * 2013-04-18 2018-12-28 Конинклейке Филипс Н.В. Acquiring cervical images
JP6351323B2 (en) 2014-03-20 2018-07-04 オリンパス株式会社 Image processing apparatus, image processing method, and image processing program
JP6638230B2 (en) * 2015-07-21 2020-01-29 コニカミノルタ株式会社 Ultrasound image processing device and program
EP3478159B1 (en) * 2016-06-30 2022-04-13 Given Imaging Ltd. Assessment and monitoring of a mucosal disease in a subject's gastrointestinal tract
CN110868907B (en) * 2017-04-28 2022-05-17 奥林巴斯株式会社 Endoscopic diagnosis support system, storage medium, and endoscopic diagnosis support method
WO2018216617A1 (en) * 2017-05-25 2018-11-29 日本電気株式会社 Information processing device, control method, and program
WO2019065111A1 (en) * 2017-09-26 2019-04-04 富士フイルム株式会社 Medical image processing system, endoscope system, diagnosis support device, and medical service support device
JPWO2020066670A1 (en) * 2018-09-27 2021-06-10 Hoya株式会社 Electronic endoscopy system
EP3629340A1 (en) * 2018-09-28 2020-04-01 Siemens Healthcare GmbH Medical imaging device comprising a medical scanner unit and at least one display, and method for controlling at least one display of a medical imaging device
US11950762B2 (en) * 2019-04-26 2024-04-09 Hoya Corporation Electronic endoscope system and data processing device
EP4302679A1 (en) * 2021-03-01 2024-01-10 NEC Corporation Image processing device, image processing method, and storage medium
WO2022209217A1 (en) * 2021-03-31 2022-10-06 ソニーグループ株式会社 Medical imaging system, medical imaging device, and control method
JP2023003458A (en) * 2021-06-24 2023-01-17 株式会社Ａｉメディカルサービス Inspection support device, inspection support method, and inspection support program

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5388197A (en) * 1991-08-02 1995-02-07 The Grass Valley Group, Inc. Video editing system operator inter-face for visualization and interactive control of video material
CN1777390A (en) * 2003-04-25 2006-05-24 奥林巴斯株式会社 Device, method and program for image processing

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222541B1 (en) * 1998-01-20 2001-04-24 International Business Machines Corporation Method and apparatus for fast-path location and selection of links
JP2000172401A (en) * 1998-12-03 2000-06-23 Casio Comput Co Ltd Window display device and storage medium
ES2360701T3 (en) * 2003-10-02 2011-06-08 Given Imaging Ltd. SYSTEM AND PROCEDURE FOR THE PRESENTATION OF DATA FLOWS.
JP4885432B2 (en) * 2004-08-18 2012-02-29 オリンパス株式会社 Image display device, image display method, and image display program
JP4537803B2 (en) * 2004-08-27 2010-09-08 オリンパス株式会社 Image display device
JP4804739B2 (en) * 2004-11-10 2011-11-02 オリンパス株式会社 Image display device, image display method, and image display program
JP4575124B2 (en) * 2004-11-29 2010-11-04 オリンパス株式会社 Image display device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5388197A (en) * 1991-08-02 1995-02-07 The Grass Valley Group, Inc. Video editing system operator inter-face for visualization and interactive control of video material
CN1777390A (en) * 2003-04-25 2006-05-24 奥林巴斯株式会社 Device, method and program for image processing

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11950760B2 (en) 2018-05-17 2024-04-09 Fujifilm Corporation Endoscope apparatus, endoscope operation method, and program

Also Published As

Publication number Publication date
JP2008036028A (en) 2008-02-21
CN101116608A (en) 2008-02-06
JP5005981B2 (en) 2012-08-22

Similar Documents

Publication Publication Date Title
CN101116608B (en) Image display device
US8900124B2 (en) Image display device
CN101005795B (en) Image display device, image display method
JP2008061704A (en) Image display device
JP5087544B2 (en) System and method for displaying a data stream
US8233037B2 (en) Image display apparatus
CN101065050B (en) Image display device
US8228333B2 (en) System and method for presentation of data streams
US8830307B2 (en) Image display apparatus
CN101637379B (en) Image display method and endoscope system
CN101669807B (en) Image display device, image display method and image display program
CN101176654B (en) Image display method and image display apparatus
CN101778591B (en) Image processing device
US20080285826A1 (en) Display processing apparatus of image information and display processing method of image information
CN101721199A (en) Image display device and image display method
CN101784224A (en) Image processing apparatus, image processing program, and image processing method
JP2009509621A (en) System and method for detecting contents in vivo
JP2006280792A (en) Image displaying device
JP2010082241A (en) Image display apparatus, image display method, and image display program
CN104350742A (en) System and method for displaying an image stream
CN101248452B (en) Image display apparatus
JP2013075244A (en) Image display device, image display method, and image display program
JP2010046525A (en) Image display device
JP4594834B2 (en) Image display device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20151126

Address after: Tokyo, Japan, Japan

Patentee after: Olympus Corporation

Address before: Tokyo, Japan, Japan

Patentee before: Olympus Medical Systems Corp.