US7643187B2 - Image processing apparatus and preview image displaying method - Google Patents

Image processing apparatus and preview image displaying method Download PDF

Info

Publication number
US7643187B2
US7643187B2 US11/686,662 US68666207A US7643187B2 US 7643187 B2 US7643187 B2 US 7643187B2 US 68666207 A US68666207 A US 68666207A US 7643187 B2 US7643187 B2 US 7643187B2
Authority
US
United States
Prior art keywords
image
read
preview image
preview
document
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/686,662
Other versions
US20070216973A1 (en
Inventor
Yukio Tagawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ricoh Co Ltd
Original Assignee
Ricoh Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ricoh Co Ltd filed Critical Ricoh Co Ltd
Assigned to RICOH COMPANY, LTD. reassignment RICOH COMPANY, LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TAGAWA, YUKIO
Publication of US20070216973A1 publication Critical patent/US20070216973A1/en
Application granted granted Critical
Publication of US7643187B2 publication Critical patent/US7643187B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/65Apparatus which relate to the handling of copy material
    • G03G15/6538Devices for collating sheet copy material, e.g. sorters, control, copies in staples form
    • G03G15/6541Binding sets of sheets, e.g. by stapling, glueing
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/50Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control
    • G03G15/5016User-machine interface; Display panels; Control console
    • G03G15/502User-machine interface; Display panels; Control console relating to the structure of the control menu, e.g. pop-up menus, help screens
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/65Apparatus which relate to the handling of copy material
    • G03G15/6582Special processing for irreversibly adding or changing the sheet copy material characteristics or its appearance, e.g. stamping, annotation printing, punching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00411Display of information to the user, e.g. menus the display also being used for user input, e.g. touch screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00413Display of information to the user, e.g. menus using menus, i.e. presenting the user with a plurality of selectable options
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00413Display of information to the user, e.g. menus using menus, i.e. presenting the user with a plurality of selectable options
    • H04N1/00416Multi-level menus
    • H04N1/00419Arrangements for navigating between pages or parts of the menu
    • H04N1/00432Arrangements for navigating between pages or parts of the menu using tabs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/0044Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
    • H04N1/00442Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/0044Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
    • H04N1/00442Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
    • H04N1/00445Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a one dimensional array
    • H04N1/00448Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a one dimensional array horizontally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/0044Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
    • H04N1/00442Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
    • H04N1/00445Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a one dimensional array
    • H04N1/0045Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a one dimensional array vertically
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/0044Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
    • H04N1/00442Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
    • H04N1/00453Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a two dimensional array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/0044Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
    • H04N1/00442Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
    • H04N1/00456Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails for layout preview, e.g. page layout
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/0044Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
    • H04N1/00458Sequential viewing of a plurality of images, e.g. browsing or scrolling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00466Display of information to the user, e.g. menus displaying finishing information, e.g. position of punch holes or staple or orientation references
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00408Display of information to the user, e.g. menus
    • H04N1/00472Display of information to the user, e.g. menus using a pop-up window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/0048Indicating an illegal or impossible operation or selection to the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/0035User-machine interface; Control console
    • H04N1/00405Output means
    • H04N1/00482Output means outputting a plurality of job set-up options, e.g. number of copies, paper size or resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00567Handling of original or reproduction media, e.g. cutting, separating, stacking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00567Handling of original or reproduction media, e.g. cutting, separating, stacking
    • H04N1/00639Binding, stapling, folding or perforating, e.g. punching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00567Handling of original or reproduction media, e.g. cutting, separating, stacking
    • H04N1/00663Indicating relating to handling of media
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387Composing, repositioning or otherwise geometrically modifying originals

Definitions

  • the present invention generally relates to an image processing apparatus and a preview image displaying method in the image processing apparatus which allows operability close to human senses.
  • an image processing apparatus In the image processing apparatus, an image is pre-scanned by selecting a reading condition in a scanner and a reading condition having a high recognition rate is automatically selected by applying an OCR (optical character recognition) process to the pre-scanned image. With this, the processing condition is easily determined by the user.
  • OCR optical character recognition
  • Patent Document 2 a scanner and a control method thereof are disclosed.
  • a preview image pre-scanned by a user is rotated corresponding to necessity, and the user scans the image by setting a suitable rotational angle.
  • Patent Document 1 Japanese Laid-Open Patent Application No. 2004-234261
  • Patent Document 2 Japanese Laid-Open Patent Application No. 2001-045239
  • documents are stapled, and a thumbnail image of the staple documents is displayed.
  • the stapled image is displayed in a fixed small image from which the stapled status is hardly recognized.
  • an image processing apparatus and a preview image displaying method in the image processing apparatus which allows operability close to human senses.
  • an image processing apparatus which previews a read image.
  • the image processing apparatus includes a preview image processing unit in which a user is allowed to set a processing condition for the read preview image by operating on the read preview image and a preview image processed by the processing condition is displayed together with the setting of the processing condition on a displaying section.
  • a user can set a processing condition for printing an image by directly operating a preview image.
  • the processing condition can be set by a click and a drag on the preview image. Therefore, the user can visually and intuitively set the processing condition.
  • the user can designate a staple position by touching a desirable position on the preview image.
  • operability of the user can be increased by operation buttons and an operation on the preview image.
  • FIG. 1 is a block diagram showing functions of an image processing apparatus according to an embodiment of the present invention
  • FIG. 2 is a block diagram showing hardware of the image processing apparatus
  • FIG. 3 is a block diagram showing an operating panel in detail in the image processing apparatus
  • FIG. 4 is a diagram showing an upper surface of the operating panel
  • FIG. 5 is a diagram showing an IMH and the operating panel for synthesizing moving images
  • FIG. 6 is a diagram showing a data flow for displaying a preview image at the same time as when image data are stored
  • FIG. 7 is a diagram showing a data flow for displaying a preview image when a processing condition is designated after storing image data
  • FIG. 8 is a diagram showing a data flow for printing a preview image after processing image data
  • FIG. 9 is a diagram showing a data flow for storing a preview image after processing image data
  • FIG. 10 is a diagram showing a data flow for displaying a preview image when a new processing condition is set in the image data stored in an expansion memory
  • FIG. 11 is a diagram showing a data flow for displaying a preview image by using an initial processing condition
  • FIG. 12 is a diagram showing a relationship between a staple position and a page turning direction when the staple positions are two;
  • FIG. 13 is a diagram showing a relationship between a staple position and a page turning direction when the staple position is at the upper side;
  • FIG. 14 is a diagram showing a relationship between a staple position and a page turning direction when the staple position is at a corner end;
  • FIG. 15 is a diagram showing a relationship between a punch position and a page turning direction
  • FIG. 16 is a table in which a binding method of a document and a page turning direction of the document are shown by correlating with each other;
  • FIG. 17 is a flowchart showing processes to execute all the operations which can perform three patterns
  • FIG. 18 is a diagram showing a screen on which a preview image is displayed after reading a document
  • FIG. 19 is a diagram showing a screen on which a rotated preview image is displayed by pushing a rotation button shown in FIG. 18 ;
  • FIG. 20A is a diagram showing a screen on which a preview image is displayed by pushing an automatic page turning button shown in FIG. 18 ;
  • FIG. 20B is a diagram showing a screen on which a preview image on a page is displayed by pushing a start button shown in FIG. 20A ;
  • FIG. 21 is a diagram showing processes for designating a staple position
  • FIG. 22 is a diagram showing processes for designating a document aggregation
  • FIG. 23 is a diagram showing a screen of a preview image in which both-side printing is designated.
  • FIG. 24 is a diagram showing page turning directions
  • FIG. 25 is a diagram showing screens in which documents are turned.
  • FIG. 26 is a diagram showing a screen in which a first sheet image has been completely turned
  • FIG. 27 is a diagram showing a screen in which a process returning to previous pages is shown.
  • FIG. 28 is a diagram showing a screen in which a second sheet image is shown.
  • FIG. 29 is a diagram showing processes for displaying a development view
  • FIG. 30 is a diagram showing a screen in which the head and tail of the rear surface of the first sheet image is changed
  • FIG. 31 is a diagram showing screens of a preview image in which a staple position is determined by designating the page turning direction;
  • FIG. 32 is a diagram showing processes for designating the page turning direction
  • FIG. 33 is a diagram showing screens in which the first sheet image is turned
  • FIG. 34 is a diagram showing a screen in which the rear surface of the first sheet image (second page) is displayed;
  • FIG. 35 is a diagram showing a screen in which a process returning to previous pages is shown.
  • FIG. 36 is a diagram showing a screen in which the second sheet image is shown.
  • FIG. 37 is a diagram showing processes to display a development view
  • FIG. 38 is a diagram showing screens in which the head and tail of the rear surface of the first sheet image are reversed
  • FIG. 39 is a diagram showing processes (screen flow) in which a processing condition is determined before reading a document
  • FIG. 40 is a diagram showing processes (screen flow) for adjusting a staple position
  • FIG. 41 is a diagram showing a screen in which the staple position is adjusted
  • FIG. 42 is a diagram showing a screen in which a document image position is adjusted.
  • FIG. 43 is a diagram showing a screen in which a document image is reduced.
  • FIG. 44 is a flowchart showing processes to adjust an overlap position where a binding position of documents overlaps an image
  • FIG. 45 is a timing chart of a normal operation for displaying a preview image
  • FIG. 46 is a diagram showing a flow for displaying a preview image in the normal operation
  • FIG. 47 is a timing chart for displaying a preview image when a rotation method is designated in a processing condition
  • FIG. 48 is a diagram showing first document images when the image is read and displayed by being applied a rotation method
  • FIG. 49 is a timing chart for displaying a preview image when page turning is designated by a drag of a user
  • FIG. 50 is a timing chart for displaying a preview image when automatic page turning is designated by a user
  • FIG. 51 is a first timing chart in which a preview image is displayed by aggregating four document images into one page;
  • FIG. 52 is a diagram showing a first screen flow in which a preview image having four reduced document images is displayed
  • FIG. 53 is a diagram showing a second screen flow in which a preview image having the four reduced document images is displayed
  • FIG. 54 is a diagram showing a third screen flow in which a preview image having the four reduced document images is displayed
  • FIG. 55 is a diagram showing a fourth screen flow in which a preview image having the four reduced document images is displayed
  • FIG. 56 is a second timing chart in which a preview image is displayed by aggregating four document images into one page
  • FIG. 57 is a diagram showing a screen flow in which a preview image having the four reduced document images is displayed based on the second timing chart;
  • FIG. 58 is a third timing chart in which a preview image is displayed by aggregating two document images into one page
  • FIG. 59 is a timing chart showing processes to attach a staple mark on a preview image of a document image
  • FIG. 60 is a screen flow when a staple mark is attached to a preview image.
  • FIG. 61 is a diagram showing screens of preview images in which the staple position is determined.
  • FIG. 1 is a block diagram showing functions of an image processing apparatus according to an embodiment of the present invention.
  • an image processing apparatus 1 includes a software group 2 , a hardware resource 4 , and an operating panel 80 .
  • a software group 2 As shown in FIG. 1 , an image processing apparatus 1 includes a software group 2 , a hardware resource 4 , and an operating panel 80 .
  • an operating panel 80 In the image processing apparatus 1 shown in FIG. 1 , in order to make the description concise, only elements necessary for the present invention are shown.
  • the software group 2 includes various functions to be realized by programs which are executed by a CPU (central processing unit) 61 (described below) in a controller 60 (described below).
  • the hardware resource 4 includes a plotter 11 , a scanner 12 , and so on.
  • the operating panel 80 receives an instruction from a user and displays information for the user.
  • the software group 2 includes an application layer 5 and a platform layer 6 .
  • An OS operating system
  • the software group 2 includes an application layer 5 and a platform layer 6 .
  • An OS operating system
  • the application layer 5 includes, for example, copy application software 22 for supplying a copy function to a user.
  • the application layer 5 can include other application software.
  • the platform layer 6 manages the use of the hardware resource 4 by interpreting a process request from the application layer 5 .
  • the platform layer 6 includes an MCS (memory control service) 36 and an IMH (image memory handler) 41 .
  • the MCS 36 obtains a memory region and releases the obtained memory region, utilizes an HDD (described below), controls compressing image data and expanding the compressed image data, and controls other functions.
  • the IMH 41 manages a memory.
  • the MCS 36 requests the IMH 41 to obtain an image read by the scanner 12 .
  • the scanner 12 obtains an image requested by the IMH 41
  • the scanner 12 informs the IMH 41 of obtaining the image.
  • the IMH 41 informs the MCS 36 of obtaining the image.
  • the MCS 36 informs the copy application software 22 of obtaining the image.
  • the copy application software 22 communicates with the operating panel 80 so that the obtained image is previewed.
  • the preview image is displayed on the operating panel 80 , and a user performs a desirable operation on the preview image on the operating panel 80 .
  • the copy application software 22 receives the processing conditions from the operating panel 80 and makes the IMH 41 execute a process on the image read by the scanner 12 via the MCS 36 .
  • the IMH 41 makes the plotter 11 form an image on a predetermined recording medium on which image the process is to be applied.
  • FIG. 2 is a block diagram showing hardware of the image processing apparatus 1 .
  • the image processing apparatus 1 includes the controller 60 , the operating panel 80 , the plotter 11 and the scanner 12 .
  • the controller 60 includes the CPU 61 , a system memory 62 , an NB (north bridge) 63 , an ASIC (application specific integrated circuit) 66 , a local memory 67 , a HDD (hard disk drive) 68 , and an external interface 70 .
  • NB noth bridge
  • ASIC application specific integrated circuit
  • the operating panel 80 is connected to the ASIC 66 .
  • the plotter 11 and the scanner 12 are connected to the ASIC 66 via a PCI (peripheral component interconnect) bus 79 .
  • PCI peripheral component interconnect
  • the local memory 67 and the HDD 68 are connected to the ASIC 66 , and the CPU 61 is connected to the ASIC 66 via the NB 63 which is a CPU chip set.
  • the ASIC 66 is connected to the NB 63 via an AGP (accelerated graphic port) 65 .
  • the CPU 61 controls all the elements in the image processing apparatus 1 .
  • the CPU 61 operates the MCS 36 and the IMH 41 on the OS, and operates the copy application software 22 in the application layer 5 .
  • the NB 63 connects the CPU 61 to the system memory 62 , the ASIC 66 , and the external interface 70 .
  • the NB 63 is connected to the external interface 70 via a PCI bus 73 .
  • the system memory 62 stores image data for writing.
  • the local memory 67 is a buffer for storing image data for copying and for storing code data.
  • the ASIC 66 is an image processing IC having hardware elements.
  • the HDD 68 is storage for storing image data, document data, programs, font data, form data, and so on.
  • the external interface 70 connects the image processing apparatus 1 to a network such as the Internet and a LAN.
  • FIG. 3 is a block diagram showing the operating panel 80 in detail in the image processing apparatus 1 .
  • the operating panel 80 includes an operating screen CPU 81 , a program memory 82 , a touch panel controller 83 , a display data memory 84 , a LCD (liquid crystal display) panel controller 85 , and an LCD panel 90 .
  • the operating screen CPU 81 controls all the elements in the operating panel 80 by communicating with the controller 60 .
  • the operating screen CPU 81 controls a display on the LCD panel 90 by reading a program stored in the program memory 82 and executing the program.
  • the program memory 82 stores all the programs for controlling all the elements in the operating panel 80 .
  • the touch panel controller 83 controls the LCD panel 90 corresponding to a user operation on a screen displayed on the LCD panel 90 via the LCD panel controller 85 .
  • the display data memory 84 stores image data which are used for displaying a preview image.
  • the LCD panel controller 85 controls a display on the LCD panel 90 corresponding to the user operation.
  • the LCD panel 90 provides a touch panel function.
  • FIG. 4 is a diagram showing an outline of the operating panel 80 .
  • the operating panel 80 includes a liquid crystal panel 8 , a function selecting button 8 a , an operating button 8 b , ten-key buttons 8 c , buttons 8 d , a start button 8 e , and a power switch 8 f.
  • the function selecting button 8 a includes a copy button, a document button, a facsimile button, a printer button, and a scanner button; and one of the buttons is selected by a user.
  • the operating button 8 b includes a program button, a reset button, and a preheat button.
  • the button 8 d includes a trial copy button and clear/stop buttons for canceling the operation.
  • the user starts operations by pushing the start button 8 e .
  • the power of the image processing apparatus 1 is turned on by pushing the power switch 8 f.
  • FIG. 5 is a diagram showing the IMH 41 and the operating panel 80 for synthesizing moving images.
  • the IMH 41 includes a compression/expansion processing section 41 a , an image synthesis processing section 41 b , an expansion memory 67 a , and a PCI controller 79 a.
  • the compression/expansion processing section 41 a compresses image data stored in the expansion memory 67 a and image data read by the scanner 12 when the image data are stored in the HDD 68 .
  • the compression/expansion processing section 41 a expands the image data stored in the HDD 68 when the image data are processed by the plotter 11 or are stored in the expansion memory 67 a.
  • the image synthesis processing section 41 b synthesizes image data read by the scanner 12 by storing the image data in the expansion memory 67 a based on an initial processing condition, and synthesizes image data stored in the expansion memory 67 a based on a set processing condition.
  • the synthesized image data are output by the plotter 11 as print data.
  • the expansion memory 67 a is a part of the local memory 67 which can be used by the IMH 41 and stores processed image data.
  • the PCI controller 79 a includes a PCI memory 79 b and an interrupt processing section 79 c and controls access to the scanner 12 and the plotter 11 vi the PCI bus 79 (refer to FIG. 2 ).
  • the PCI memory 79 b temporarily stores image data read by the scanner 12 and image data for an image to be formed by the plotter 11 .
  • the interrupt processing section 79 c generates an interrupt signal corresponding to timing when the image synthesis processing section 41 b forms an image. Since the scanner 12 reads image data line by line, when the interruption signal is generated every one line reading, a preview image is formed by synthesizing line images and one line image is sequentially displayed. In addition, when the preview image is displayed by rotating the image, the number of image transfer clocks generated by the scanner 12 at each one line reading is counted and the interrupt signal is generated when the counted number equals clocks for the lines of one page.
  • the operating panel 80 includes a display synthesis processing section 82 a , a symbol mark region 84 a , and an LCD controller 85 .
  • the display synthesis processing section 82 a is realized when the operating screen CPU 81 executes a program stored in the program memory 82 , and synthesizes a symbol mark stored in the symbol mark region 84 a with image data from expansion memory 67 a to form a preview image.
  • the symbol mark region 84 a is a part of the display data memory 84 and stores picture images such as a staple mark and a punch mark beforehand.
  • the LCD controller 85 displays a synthesized preview image and also displays a screen based on an instruction by the user on the LCD panel 90 .
  • FIG. 6 is a diagram showing a data flow for displaying a preview image at the same time as when image data are being stored.
  • image data read by the scanner 12 are sent to the compression/expansion processing section 41 a and the image synthesis processing section 41 b via the PCI controller 79 a.
  • the compression/expansion processing section 41 a compresses the received image data and stores the compressed image data in the HDD 68 .
  • the image synthesis processing section 41 b synthesizes the received image data and stores the synthesized image data in the expansion memory 67 a.
  • the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with the picture image stored in the symbol mark region 84 a .
  • the LCD controller 85 displays the preview image (display data) on the LCD panel 90 .
  • FIG. 7 is a diagram showing a data flow for displaying a preview image when a processing condition is designated after storing image data.
  • the compression/expansion processing section 41 a expands image data read from the HDD 68
  • the image synthesis processing section 41 b synthesizes the expanded image data by the designated processing condition and stores the synthesized image data in the expansion memory 67 a.
  • the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with the picture image stored in the symbol mark region 84 a .
  • the LCD controller 85 displays the preview image (display data) on the LCD panel 90 .
  • FIG. 8 is a diagram showing a data flow for printing a preview image after processing image data.
  • processed image data stored in the expansion memory 67 a are sent to the plotter 11 via the PCI controller 79 a , and the plotter 11 forms (prints) a preview image on a predetermined recording medium.
  • FIG. 9 is a diagram showing a data flow for storing a preview image after processing image data.
  • processed image data stored in the expansion memory 67 a are compressed by the compression/expansion processing section 41 a and the compressed image data are stored in the HDD 68 .
  • FIG. 10 is a diagram showing a data flow for displaying a preview image when a new processing condition is set in the image data stored in the expansion memory 67 a .
  • the image synthesis processing section 41 b reads image data from the expansion memory 67 a without reading image data from the HDD 68 , synthesizes the read image data, and stores the image data in the expansion memory 67 a.
  • the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with the picture image stored in the symbol mark region 84 a .
  • the LCD controller 85 displays the preview image (display data) on the LCD panel 90 .
  • FIG. 11 is a diagram showing a data flow for displaying a preview image by using an initial processing condition.
  • the compression/expansion processing section 41 a expands image data read from the HDD 68
  • the image synthesis processing section 41 b synthesizes the expanded image data by the initial processing condition and stores the synthesized image data in the expansion memory 67 a.
  • the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with a picture image stored in the symbol mark region 84 a .
  • the LCD controller 85 displays the preview image (display data) on the LCD panel 90 .
  • the following method in order to easily determine a processing condition for printing an image by directly operating a preview image displayed on the operating panel 80 , the following method is established which method designates a processing condition based on user psychology.
  • a staple button is pushed, a binding position of documents is clicked, and a staple position is designated.
  • a page is turned, a finishing state of a document is confirmed, and a staple position of the document is designated.
  • a staple button is pushed and the page turning direction is designated.
  • a staple position and the head and tail of a document are set in an image processing apparatus corresponding to the page turning direction.
  • Horizontal wiring may be largely used in a business document.
  • the staple position is suitable at the upper side or the left side of the business document.
  • the staple position may be at the side of the sheet having a small page number.
  • the page turning direction is determined by the staple position.
  • a short stroke is suitable when a page is turned, and a page turning direction is suitable which easily turns a page.
  • a punch position is similar to the above staple position.
  • candidates for providing the user with easy operations are determined, and the user can select one of the candidates.
  • FIGS. 12 through 16 a relationship between a staple position and a page turning direction is described.
  • the number written in each sheet 1 , 2 , 3 , and 4 is the image order scanned by the scanner 12 , for example, the number corresponds to the page number.
  • the image order is referred to as the read image 1 , 2 , 3 , . . . n.
  • a staple position “sp” is shown by a bold line and a punch position “ph” is shown by “o”, and a page turning direction “d” is shown by an arrow.
  • FIG. 12 is a diagram showing a relationship between a staple position “sp” and a page turning direction “d” when the staple positions “sp” are two.
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3 ).
  • the staple positions “sp” are predicted at the right sides of the read images 2 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple positions “sp” are at the right sides of the read images 6 and 8 in the sheet 2 and at the left sides of the read images 9 and 11 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2 ).
  • the staple positions “sp” are predicted at the left sides of the read images 3 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple positions “sp” are at the left sides of the read images 7 and 8 in the sheet 2 and at the right sides of the read images 9 and 10 in the sheet 3 .
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2 ).
  • the staple positions “sp” are predicted at the lower sides of the read images 3 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple positions “sp” are at the lower sides of the read images 7 and 8 in the sheet 2 and at the upper sides of the read images 9 and 10 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3 ).
  • the staple positions “sp” are predicted at the lower sides of the read images 2 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple positions “sp” are at the lower sides of the read images 6 and 8 in the sheet 2 and at the upper sides of the read images 9 and 11 in the sheet 3 .
  • FIG. 13 is a diagram showing a relationship between a staple position “sp” and a page turning direction “d” when the staple position “sp” is at the upper side.
  • the staple is positioned along one side at the upper end of the sheet.
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower right side of the read image 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the upper right side of the read image 6 in the sheet 2 and at the upper left side of the read image 9 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the staple position “sp” is designated at the upper right side of the read image 1 along the side
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower left side of the read image 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the upper left side of the read image 7 in the sheet 2 and at the upper right side of the read image 9 in the sheet 3 .
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower right side of the read image 4 along the lower side.
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the lower left side of the read image 7 in the sheet 2 and at the upper left side of the read image 9 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower left side of the read image 4 along the lower side.
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the lower right side of the read image 6 in the sheet 2 and at the upper right side of the read image 9 in the sheet 3 .
  • FIG. 14 is a diagram showing a relationship between a staple position “sp” and a page turning direction “d” when the staple position “sp” is at a corner end.
  • the long-length direction of the staple is positioned along one corner of the sheet.
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the staple position “sp” is designated at the upper left corner of the read image 1
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower right corner of the read image 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the upper right corner of the read image 6 in the sheet 2 and at the upper left corner of the read image 9 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the staple position “sp” is designated at the upper right corner of the read image 1
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower left corner of the read image 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the upper left corner of the read image 7 in the sheet 2 and at the upper right corner of the read image 9 in the sheet 3 .
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the staple position “sp” is designated at the upper left corner of the read image 1
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower right corner of the read image 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the upper right corner of the read image 6 in the sheet 2 and at the upper left corner of the read image 9 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the staple position “sp” is designated at the upper right corner of the read image 1
  • the page turning direction “d” is predicted from the read image 4 to the read image 1 .
  • the staple position “sp” is predicted at the lower left corner of the read image 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the staple position “sp” is at the upper left corner of the read image 6 in the sheet 2 and at the upper right corner of the read image 9 in the sheet 3 .
  • FIG. 15 is a diagram showing the relationship between the punch position “ph” and the page turning direction “d”.
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the punch position “ph” is designated at the left sides of the read images 1 and 3
  • the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3 ).
  • the punch position “ph” is predicted at the right sides of the read images 2 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the punch position “ph” is at the right sides of the read images 6 and 8 in the sheet 2 and at the left sides of the read images 9 and 11 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the punch position “ph” is designated at the upper sides of the read images 1 and 3
  • the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3 ).
  • the punch position “sp” is predicted at the lower sides of the read images 2 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the punch position “ph” is at the lower sides of the read images 6 and 8 in the sheet 2 and at the upper sides of the read images 9 and 11 in the sheet 3 .
  • the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions.
  • the punch position “ph” is designated at the upper sides of the read images 1 and 2
  • the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2 ).
  • the punch position “ph” is predicted at the lower sides of the read images 3 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the punch position “ph” is at the lower sides of the read images 7 and 8 in the sheet 2 and at the upper sides of the read images 9 and 10 in the sheet 3 .
  • the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions.
  • the punch position “ph” is designated at the right sides of the read images 1 and 2
  • the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2 ).
  • the punch position “ph” is predicted at the left sides of the read images 3 and 4 .
  • the sheets 2 and 3 are a two-page spread.
  • the sheet 2 is a rear surface of the sheet 1 .
  • the punch position “ph” is at the left sides of the read images 7 and 8 in the sheet 2 and at the right sides of the read images 9 and 10 in the sheet 3 .
  • FIG. 16 is a table 92 in which a binding method of a document and a page turning direction of the document are shown by correlating with each other.
  • the image processing apparatus 1 forms the table 92 shown in FIG. 16 based on methods similar to those shown in FIGS. 12 through 15 and stores the table 92 in the HDD 68 .
  • each item has a position and a rear surface direction for a front surface.
  • items of left direction turning, right direction turning, and upper direction turning are shown, and each item has horizontal writing and vertical writing.
  • a left side, a right side, and an upper side are shown.
  • the same direction and the head and tail reversed direction are shown.
  • patters are estimated about user operations.
  • pattern 1 a user scans an image, stores the scanned image, and processes the image.
  • a user scans an image by setting a processing condition, displays a preview image, and prints the image and simultaneously stores the image.
  • a user scans an image by setting a processing condition, displays a preview image, processes the image, and prints the image and simultaneously stores the image.
  • FIG. 17 is a flowchart showing the processes to execute all the operations which can perform the above three patterns.
  • the image processing apparatus 1 determines whether a processing condition is designated by a user instruction (S 11 ).
  • the image processing apparatus 1 determines that the processing condition is designated by the user (YES in S 11 )
  • the user designates the processing condition (S 12 ).
  • the process goes to S 13 .
  • the image processing apparatus 1 reads a document by the scanner 12 (S 13 ), and forms an image by synthesizing line images (S 14 ).
  • images in each line or in one page are sequentially synthesized to form a preview image by the designated processing condition.
  • the synthesis of one line image and the one page image are automatically switched based on the designated processing condition (described below).
  • a preview image is displayed on the operating panel 80 (S 15 ). Then it is determined whether the user instructs to print the preview image (S 16 ). When it is determined that the user instructs to print the preview image (YES in S 16 ), the image processing apparatus 1 prints the preview image by the plotter 11 (S 16 - 2 ).
  • the image processing apparatus 1 makes the user designate a processing condition and applies the process to the preview image based on the processing condition (S 18 ) and the process returns to S 14 .
  • FIGS. 18 through 30 screens for designating a staple position on a document are described.
  • FIG. 18 is a diagram showing a screen on which a preview image is displayed after reading a document.
  • a screen G 100 displayed on the LCD panel 90 includes a message region 100 a , a staple button 100 b , a both-side printing button 100 c , a document aggregation button 100 d , a rotation button 170 , an automatic page turning button 180 , and a preview image displaying region 100 e .
  • a staple position is designated by the staple button 100 b
  • both-side printing is designated by the both-side printing button 100 c
  • aggregation of pages is designated by the document aggregation button 100 d
  • a preview image is rotated by the rotation button 170
  • the status of all the pages of the document is shown by the automatic page turning button 180 .
  • a first document image IMG 1 is displayed on a sheet image SHT 1 in the preview image displaying region 100 e , and a message, for example, “SELECT MODE” for instructing a user to operate is displayed on the message region 100 a .
  • the user pushes, for example, the staple button 100 b and designates the staple position.
  • a scroll bar can be disposed at the right side of the preview image displaying region 100 e . With this, the user can view pages by using the scroll bar.
  • buttons for executing the embodiment of the present invention are shown, and other buttons may be omitted.
  • FIG. 19 is a diagram showing the screen G 100 on which a rotated preview image is displayed by pushing the rotation button 170 shown in FIG. 18 .
  • the rotation method selecting button 172 includes a head and tail reversing button 172 a , a right direction rotation button 172 b , a left direction rotation button 172 c , an angle designation region 172 d , and an OK button for determining the rotation angle.
  • the user can change the head and tail of the sheet image SHT 1 by operating the head and tail reversing button 172 a .
  • the user can rotate the sheet image SHT 1 clockwise on a 90° basis by operating the right direction rotation button 172 b , and can rotate the sheet image SHT 1 counterclockwise on a 90° basis by operating the left direction rotation button 172 c .
  • the user can designate the rotation angle by selecting one of 90°, 180°, 270°, 360° (0°) by operating an up and down button in the angle designation region 172 d .
  • the rotation angle is determined, the user pushes the “OK” button 172 f . Then the user executes a next process.
  • FIG. 20A is a diagram showing the screen G 100 on which a preview image is displayed by pushing the automatic page turning button 180 shown in FIG. 18 .
  • the page turning speed selecting button 182 includes a fast button 182 a , a normal button 182 b , a slow button 182 c , a page turning speed designating region 182 d , and a start button for starting the page turning with the designated speed.
  • the user can select fast speed by operating the fast button 182 a , can select normal speed by operating the normal button 182 b , and can select slow speed by operating the slow button 182 c.
  • the user can change the speed by operating an up and down button in the page turning speed designating region 182 d .
  • the user pushes the start button 182 f .
  • preview images are sequentially displayed at the selected speed on the preview image displaying region 100 e in the order of the pages of the document read by the scanner 12 .
  • FIG. 20B is a diagram showing the screen G 100 on which a preview image on a page is displayed by pushing the start button 182 f shown in FIG. 20A .
  • a message for example, “STOP PAGE TURNING BY TOUCHING SCREEN, PUSH START TO RESTART” is displayed.
  • the user can stop the automatic page turning at an arbitrarily page by touching the preview image display region 100 e and can restart the automatic page turning by pushing the start button 182 f.
  • FIG. 21 is a diagram showing processes for designating a staple position.
  • a screen G 101 shown in FIG. 21 when the staple button 100 b is selected, plural staple marks STPL 1 , STPL 2 , STPL 3 , STPL 4 , STPL 5 , and STPL 6 are shown on the sheet image SHT 1 .
  • a message “SELECT STAPLE MARK AT DESIRABLE POSITION” is displayed, and the user selects, for example, the staple mark STPL 3 on the sheet image SHT 1 .
  • the selected staple mark STPL 3 is changed to a staple mark STPL 31 by being exaggerated and the staple mark STPL 31 is displayed on a screen G 102 .
  • a message “PUSH ENTER” is displayed, and the user push an enter button 100 f on the screen G 102 .
  • a screen G 103 is displayed.
  • FIG. 22 is a diagram showing processes for designating a document aggregation.
  • a screen G 111 shown in FIG. 22 in the message region 100 a , “SELECT NUMBER OF DOCUMENTS TO BE AGGREGATED IN ONE SHEET” is displayed, and an aggregation candidate 110 is displayed.
  • the aggregation candidate 110 includes a button 110 a which aggregates two documents into one sheet, a button 110 b which aggregates four documents into one sheet, and a button 110 c which aggregates nine documents into one sheet.
  • a screen G 112 is displayed.
  • a message “PUSH ENTER BUTTON WHEN ORDER IS SUITABLE, PUSH PREFERABLE ARRANGEMENT BUTTON WHEN ORDER IS TO BE CHANGED” is displayed and a document arrangement candidate 114 is displayed instead of displaying the aggregation candidate 110 .
  • the document arrangement candidate 114 includes buttons 114 a , 114 b , 114 c , and 114 d .
  • the button 114 a four documents are arranged in the order of upper left, upper right, lower left, and lower right positions.
  • the button 114 b four documents are arranged in the order of upper left, lower left, upper right, and lower right positions.
  • the button 114 c four documents are arranged in the order of upper right, upper left, lower right, and lower left positions.
  • four documents are arranged in the order of upper right, lower right, upper left, and lower left positions.
  • the four documents are displayed in the arrangement order of the button 114 a .
  • the staple mark STPL 31 selected by the user the first document image IMG 1 , a second document image IMG 2 , a third document image IMG 3 , and a fourth document image IMG 4 are displayed on the sheet image SHT 1 .
  • the user When the user satisfies the arrangement order shown by the button 114 a , the user pushes the enter button 110 f . However, when the user does not satisfy the arrangement order shown by the button 114 a , the user can change the arrangement order by selecting one of the buttons 114 b through 114 d.
  • a screen G 113 is displayed.
  • the message “SELECT MODE” is displayed.
  • a screen shown in FIG. 23 is displayed.
  • FIG. 23 is a diagram showing a screen G 120 of a preview image in which both-side printing is designated.
  • a message “DRAG ON SCREEN IN PAGE TURNING DIRECTION AND CONFIRM TURNED PAGE, AND PUSH ENTER” is displayed, and a both-side preview selection 121 is displayed.
  • the both-side preview selection 121 includes a development view button 121 a for previewing a development view, a reverse button 121 b for previewing a reversed preview image, and a head and tail changing button 121 c for changing the head and tail.
  • the preview image is determined for printing.
  • FIG. 24 is a diagram showing page turning directions.
  • the page turning direction faces the STPL 31 .
  • the page turning status is shown in a screen G 121 in FIG. 25( a ).
  • FIG. 25 is a diagram showing screens in which documents are turned.
  • FIG. 24( b ) when the user drags on the screen in a direction “a 2 ” from the lower left position to the upper right position on the sheet image SHT 1 , as shown in FIG. 24( c ), a warning screen 123 a is shown in the screen G 120 .
  • a message for example, “WARNING! DOCUMENT CANNOT BE TURNED IN DESIGNATED DIRECTION” is displayed.
  • the user pushes an enter button 123 f and designates again a page turning direction.
  • FIG. 25 screens in which the sheet image SHT 1 is turned are described.
  • a screen G 121 shown in FIG. 25( a ) the sheet image SHT 1 is started to be turned.
  • a screen G 122 shown in FIG. 25( b ) the sheet image SHT 1 (first page) is turned and the rear surface of the sheet image SHT 1 (second page) and a sheet image SHT 2 (third page) are shown.
  • a screen G 123 shown in FIG. 25( c ) the sheet image SHT 1 has been almost turned and the rear surface of the sheet image SHT 1 (second page) is shown.
  • FIG. 26 is a diagram showing a screen in which the sheet image SHT 1 has been completely turned. As shown in FIG. 26 , a screen G 124 (preview screen) in which the sheet image SHT 1 has been completely turned and the rear surface of the sheet image SHT 1 (second page) is shown.
  • FIG. 27 is a diagram showing a screen G 124 in which a process returning to previous pages is shown.
  • the screen is sequentially returned from G 124 to G 123 , G 122 , G 122 ( FIG. 25 ), and G 120 ( FIG. 24 ). That is, the screen is turned in reverse.
  • FIG. 28 is a diagram showing a screen G 125 in which the sheet image SHT 2 is shown.
  • the screen G 125 shown in FIG. 28 is shown.
  • the front surface of the sheet image SHT 2 (third page) is shown as a preview image. That is, in the sheet image SHT 2 , ninth through twelfth document images are shown.
  • FIG. 29 is a diagram showing processes for displaying a development view.
  • a message for example, “CLICK DESIRABLE PAGE, CLICKED PAGE IS DISPLAYED, PUSH ENTER”.
  • FIG. 30 is a diagram showing a screen G 128 in which the head and tail of the rear surface of the sheet image SHT 1 is changed.
  • FIG. 30 a preview image in which the head and tail of the rear surface of the sheet image SHT 1 is changed is shown.
  • FIG. 31 is a diagram showing screens of a preview image in which the staple position is determined by designating the page turning direction.
  • a screen G 201 is displayed.
  • a message for example, “DESIGNATE PAGE TURNING DIRECTION BY DRAG ON SCREEN” is displayed.
  • a screen G 202 is displayed.
  • the staple marks STPL 21 and STPL 22 are displayed along the upper side of the sheet image SHT 1 .
  • a message for example, “PUSH ENTER BUTTON” is displayed.
  • the sheet image SHT 1 is determined as the preview image for printing.
  • FIG. 32 is a diagram showing processes for designating the page turning direction.
  • the page turning direction is designated to be a direction facing the staple marks STPL 21 and STPL 22 (from lower to upper positions). That is, when the user drags on the screen G 220 in a direction “a 7 ”, as shown in FIG. 32( a ), the sheet image SHT 1 is started to be turned.
  • FIG. 33 is a diagram showing screens in which the sheet image SHT 1 is turned.
  • a warning screen 223 a is shown in the screen G 220 of FIG. 32( c ).
  • a message for example, “WARNING! DOCUMENT CANNOT BE TURNED IN DESIGNATED DIRECTION” is displayed.
  • the user pushes an enter button 223 f and designates again a page turning direction.
  • FIG. 33 turning the sheet image SHT 1 is described.
  • the turning progress is displayed as frames of moving images.
  • FIG. 33( a ) in the screen G 221 , the sheet image SHT 1 is started to be turned.
  • FIG. 33( b ) in a screen G 222 , the rear surface of the sheet image SHT 1 (second page) and the front surface of the sheet image SHT 2 (third page) are started to be displayed.
  • FIG. 33( c ) in a screen G 223 , the rear surface of the sheet image SHT 1 (second page) has been almost displayed.
  • FIG. 34 is a diagram showing a screen G 224 in which the rear surface of the sheet image SHT 1 (second page) is displayed.
  • FIG. 35 is a diagram showing the screen G 224 in which a process returning to previous pages is shown.
  • the screen is sequentially returned from G 224 to G 223 , G 222 , G 221 ( FIG. 33 ), and G 220 ( FIG. 32 ). That is, the screen is reversely turned.
  • FIG. 36 is a diagram showing a screen G 225 in which the sheet image SHT 2 is shown.
  • the screen G 225 shown in FIG. 36 is displayed.
  • the front surface of the sheet image SHT 2 (third page) is shown as a preview image. That is, in the sheet image SHT 2 , ninth through twelfth document images are shown.
  • FIG. 37 is a diagram showing processes to display a development view.
  • the sheet images SHT 1 and SHT 2 are bound by the staple marks STPL 21 and STPL 22 .
  • a message for example, “CLICK DESIRABLE PAGE, THEN IMAGE OF CLICKED PAGE IS DISPLAYED, PUSH ENTER BUTTON”.
  • FIG. 38( a ) or 38 ( b ) in which the head and tail of the rear surface of the sheet image SHT 1 are reversed is shown in a screen G 228 a or G 228 b.
  • FIG. 38 is a diagram showing screens in which the head and tail of the rear surface of the sheet image SHT 1 are reversed.
  • FIG. 38( a ) on the screen G 228 a , the head and tail of each image in the SHT 1 are reversed. That is, the head and tail of the images in the rear surface of the sheet image SHT 1 are reversed.
  • FIG. 38( b ) on the screen G 228 b , the positions of the staple marks STPL 21 and STPL 22 are only reversed.
  • FIG. 39 is a diagram showing processes (screen flow) in which a processing condition is determined before reading a document.
  • a processing condition is determined before reading a document.
  • a message for example, “PUSH ENTER WHEN ORDER IS SUITABLE, PUSH PREFERABLE ARRANGEMENT BUTTON WHEN ORDER IS TO BE CHANGED” is displayed.
  • the user When the user desires to change the arrangement order of documents, the user pushes one of the buttons in the document arrangement candidate 114 .
  • the order On the screen G 300 , the order is shown by numbers 1, 2, 3, and 4 on the sheet image SFT 1 .
  • the image processing apparatus 1 reads a first document. As shown in a screen G 301 , a first document image IMG 1 is displayed at the position of “1” on the sheet image SHT 1 .
  • a second document image IMG 2 is displayed at the position of “2” on the sheet image SHT 1 .
  • a third document image IMG 3 is displayed at the position of “3” on the sheet image SHT 1 .
  • a fourth document image IMG 4 is displayed at the position of “4” on the sheet image SHT 1 .
  • FIG. 40 is a diagram showing processes (screen flow) for adjusting a staple position.
  • a warning screen 420 having a message, for example, “WARNING! IMAGE EXISTS AT DESIGNATED STAPLE POSITION” is displayed.
  • the warning screen 420 includes a staple position adjusting button 420 e , a document image position adjusting button 420 f , a document image reducing button 420 g , and a non-adjustment button 420 h in which the current staple positions are used.
  • the user finely adjusts the positions of the staple mark STPL 21 and/or the staple mark STPL 22 .
  • the user selects one of the buttons 420 e , 420 f , and 420 g .
  • the user pushes the button 420 h.
  • FIG. 41 is a diagram showing a screen G 402 in which the staple position is adjusted.
  • the screen G 402 shown in FIG. 41 is displayed.
  • a message for example, “STAPLE POSITION IS ADJUSTED” is displayed, and staple position adjustment 410 is displayed.
  • the staple position adjustment 410 includes a vertical adjustment button 410 a for vertically adjusting the staple position and a horizontal adjustment button 410 b for horizontally adjusting the staple position.
  • the user adjusts the positions of the staple marks STPL 21 and STPL 22 by using the buttons 410 a and 410 b .
  • the user pushes an enter button 220 f.
  • the image processing apparatus 1 again determines whether the staple position overlaps the document image IMG 1 and/or IMG 2 . When the staple position overlaps the document image IMG 1 and/or IMG 2 , the image processing apparatus 1 again displays the warning screen 420 .
  • the staple positions before adjustment are shown by broken line marks C 21 and C 22 on the sheet image SHT 1 . Therefore, the user can use the buttons 410 a and 410 b by viewing the screen G 402 .
  • FIG. 42 is a diagram showing a screen G 403 in which the document image position is adjusted.
  • the screen G 403 shown in FIG. 42 is displayed.
  • a message for example, “DOCUMENT IMAGE POSITION IS ADJUSTED, INPUT FIGURE” is displayed, and document image position adjustment 420 is displayed.
  • the document image position adjustment 420 includes a vertical adjustment button 420 a for vertically adjusting the document image position and a horizontal adjustment button 420 b for horizontally adjusting the document image position.
  • the user adjusts the positions of the document images IMG 1 through IMG 4 by using the buttons 420 a and 420 b .
  • the user pushes the enter button 220 f.
  • the image processing apparatus 1 again determines whether the staple position overlaps the document image IMG 1 and/or IMG 2 . When the staple position overlaps the document image IMG 1 and/or IMG 2 , the image processing apparatus 1 again displays the warning screen 420 .
  • the document image positions before adjustment are shown by broken line marks D 1 through D 4 . Therefore, the user can use the buttons 420 a and 420 b by viewing the screen G 403 .
  • FIG. 43 is a diagram showing a screen G 404 in which the document image is reduced.
  • the screen G 404 shown in FIG. 43 is displayed.
  • a message for example, “DOCUMENT IMAGE IS REDUCED” is displayed, and reduction adjustment 430 is displayed.
  • the reduction adjustment 430 includes a scale factor button 430 a.
  • the user reduces the sizes of the document images IMG 1 through IMG 4 by using the buttons 430 a .
  • the user pushes the enter button 220 f.
  • the image processing apparatus 1 again determines whether the staple position overlaps the document image IMG 1 and/or IMG 2 . When the staple position overlaps the document image IMG 1 and/or IMG 2 , the image processing apparatus 1 again displays the warning screen 420 .
  • the sizes of the document images IMG 1 through IMG 4 before reduction are shown by broken line marks M 1 through M 4 . Therefore, the user can use the button 430 a by viewing the screen G 404 .
  • the user can adjust the staple position, the document image position, or can reduce the size of the document image by viewing the preview image displaying screen 100 e .
  • the user can combine the above adjustments (reduction). That is, a finishing process can be applied to the preview image.
  • the finishing process includes a stapling process and a punching process.
  • the adjustment (reduction) can be applied to total pages of a document, only a page designated by a user, or a two-page spread. That is, the user may select the adjustment (reduction).
  • the above staple position adjustment can be applied to punch position adjustment.
  • FIG. 44 is a flowchart showing processes to adjust an overlap position where a binding position of documents overlaps an image. That is, an overlap position is found where the staple position and/or the punch position overlaps an image.
  • a user designates a binding position of documents (S 31 ).
  • the image processing apparatus 1 searches for a position where the binding position overlaps an image (S 32 ). In this case, a binding margin can be considered.
  • the image processing apparatus 1 determines whether the binding position overlaps the image based on the searched result (S 33 ). When the binding position does not overlap the image (NO in S 33 ), the process ends.
  • the image processing apparatus 1 displays a warning (S 34 ).
  • the image processing apparatus 1 determines whether a user adjusts the binding position (S 35 ).
  • a button for adjusting the binding position is displayed (S 36 ). Then the process returns to S 31 , and the processes on and after S 31 are repeated.
  • the above processes for adjusting the overlap position where the binding position of the document overlaps the image can be executed in S 12 shown in FIG. 17 or in S 18 shown in FIG. 17 before a preview image is displayed when the staple position and/or the punch position is designated. That is, in S 12 , the processing condition is designated before the scanner 12 reads the document, and in S 18 , the processing condition is designated after the scanner 12 reads the document.
  • FIG. 45 is a timing chart of a normal operation for displaying a preview image.
  • FIG. 46 is a diagram showing a flow for displaying a preview image in the normal operation. Referring to FIGS. 45 and 46 , the normal operation for displaying a preview image based on an initial processing condition is described.
  • the interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines.
  • the HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
  • the display synthesis processing section 82 a synthesizes the one band images to form the document images IMG 1 and IMG 2 .
  • the LCD controller 85 displays the document image IMG 1 in the order of band images L 1 , L 2 , L 3 , L 4 , and L 5 .
  • the band images L 1 through L 5 are almost simultaneously displayed. Since the display synthesis processing section 82 a stores the document image IMG 2 , the document image IMG 2 can be simultaneously displayed when the page is turned. As shown in FIG. 46 , the document image is displayed in the order of band images L 1 , L 2 , L 3 , L 4 , and L 5 .
  • FIG. 47 is a timing chart for displaying a preview image when a rotation method is designated in a processing condition.
  • FIG. 48 is a diagram showing the document images IMG 1 when the image is read and displayed by being applied a rotation method. Referring to FIGS. 47 and 48 , an operation is described in which the rotation method is designated in the processing condition for displaying a preview image.
  • signals of the document images IMG 1 , IMG 2 , and IMG 3 read by the scanner 12 are instantly stored in the PCI memory 79 b .
  • the HDD 68 sequentially stores the document images IMG 1 , IMG 2 , and IMG 3 based on an image transfer clock generated by the scanner 12 .
  • the interrupt processing section 79 c When the rotation method is designated, the interrupt processing section 79 c generates an interrupt signal each time when one of the document images IMG 1 , IMG 2 , and IMG 3 is stored in the HDD 68 .
  • the image synthesis processing section 41 b instantly stores the document images IMG 1 , IMG 2 , and IMG 3 by rotating the images in the expansion memory 67 a based on the interrupt signal.
  • the display synthesis processing section 82 a synthesizes the one band images to form the document images IMG 1 , IMG 2 , and IMG 3 .
  • the LCD controller 85 displays the document images IMG 1 , IMG 2 , and IMG 3 in this order on the LCD panel 90 .
  • the document images IMG 1 , IMG 2 , and IMG 3 are almost simultaneously displayed. As shown in FIG. 48 , the document image IMG 1 is vertically read and horizontally displayed.
  • FIG. 49 is a timing chart for displaying a preview image when page turning is designated by a drag of a user. Referring to FIG. 49 , an operation is described in which the page turning is designated by a drag of a user on the preview image displaying region 10 e .
  • signals of the document images IMG 1 , IMG 2 , and IMG 3 read by the scanner 12 are instantly stored in the PCI memory 79 b.
  • the interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines.
  • the HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
  • the display synthesis processing section 82 a synthesizes the one band images to form the document images IMG 1 and IMG 2 .
  • the LCD controller 85 displays the document image IMG 1 in the order of band images L 1 , L 2 , L 3 , L 4 , and L 5 .
  • the band images L 1 through L 5 are almost simultaneously displayed. The processes described above are almost the same as those shown in the normal operation in FIG. 45 .
  • the LCD controller 85 displays the document image IMG 2 in the order of band images L 1 , L 2 , L 3 , L 4 , and L 5 .
  • the display synthesis processing section 82 a synthesizes the band images to form a next document image (the document image IMG 3 ).
  • the document image IMG 3 is displayed.
  • the document image IMG 2 is displayed. With this, the document image of a previous page or a next page can be easily displayed.
  • FIG. 50 is a timing chart for displaying a preview image when automatic page turning is designated by a user. Referring to FIG. 50 , an operation is described in which the automatic page turning is designated by pushing the automatic page turning button 180 shown in FIG. 18 or an instruction on the image processing apparatus 1 .
  • signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 read by the scanner 12 are instantly stored in the PCI memory 79 b.
  • the interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines.
  • the HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
  • the display synthesis processing section 82 a synthesizes the one band images to form the document image IMG 1 ; after synthesizing the one band images of the document image IMG 1 , the one band images of the document image IMG 2 are synthesized. The above processes are continued to synthesize the one band images to form the document image IMG 4 .
  • the LCD controller 85 displays the document image IMG 1 in the order of band images L 1 , L 2 , L 3 , L 4 , and L 5 , after displaying the document image IMG 1 , the document image IMG 2 is displayed. The above processes are continued to display the document image IMG 4 .
  • the band images L 1 through L 5 are almost simultaneously displayed.
  • the document images IMG 2 through IMG 4 are displayed after displaying the document image IMG 1 and after synthesizing the one band images thereof, the document image IMG 1 is displayed longer than the document images IMG 2 through IMG 4 . Therefore, the user can watch the document image IMG 1 for a long time.
  • a preview image is displayed by aggregating two or more document images into one page. For example, when four document images are aggregated into one page, the sizes of the four document images are reduced. When an enlarged document image is reduced, the image quality is degraded; therefore, it is preferable that the original document image be reduced. Therefore, as shown in the data flow of FIG. 11 , the original document image stored in the HDD 68 is used.
  • FIG. 51 is a first timing chart in which a preview image is displayed by aggregating four document images into one page.
  • signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 read by the scanner 12 are instantly stored in the PCI memory 79 b .
  • the signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 are sequentially stored in the HDD 68 based on an image transfer clock generated at each time when an image of one band having the predetermined number of lines is read.
  • the interrupt processing section 79 c calculates interrupt timing from a reducing factor designated by a processing condition.
  • the interrupt timing is determined by a predetermined algorithm with the consideration of the writing speed. For example, in a four document image aggregation, each document image, IMG 1 , IMG 2 , IMG 3 , or IMG 4 is reduced to 1 ⁇ 4 size, and the reading speed is four times higher than the writing speed due to the thinning. Therefore, the interrupt timing is the time when 75% of the document image IMG 1 is written in the HDD 68 .
  • the interrupt processing section 79 c generates an interrupt signal at the calculated interrupt timing.
  • the image synthesis processing section 41 b sequentially reads the document images IMG 1 through IMG 4 based on the reading speed of the reducing factor while instantly storing the document images IMG 1 through IMG 4 in the expansion memory 67 a.
  • the display synthesis processing section 82 a synthesizes the reduced document images IMG 1 through IMG 4 to form display images.
  • the LCD controller 85 sequentially displays the reduced document images IMG 1 through IMG 4 on the LCD panel 90 in one sheet region.
  • the reduced document images IMG 1 through IMG 4 are instantly displayed.
  • the displaying timings of the reduced document images IMG 1 through IMG 4 on one sheet in the order of upper left, upper right, lower left, and lower right positions are shown.
  • FIG. 52 is a diagram showing a first screen flow in which a preview image having the four reduced document images is displayed.
  • FIG. 53 is a diagram showing a second screen flow in which a preview image having the four reduced document images is displayed.
  • FIG. 54 is a diagram showing a third screen flow in which a preview image having the four reduced document images is displayed.
  • FIG. 55 is a diagram showing a fourth screen flow in which a preview image having the four reduced document images is displayed. The screen flow for displaying a preview image of four document image aggregation is completed by connecting the screen flows shown in FIGS. 52 through 55 .
  • the reduced document image IMG 1 is displayed in the order of the one band images in the upper left position 1 .
  • the reduced document image IMG 2 is displayed in the order of the one band images in the upper right position 2 , and the reduced document image IMG 3 is started to display in the order of the one band images in the lower left position 3 .
  • the reduced document image IMG 3 is displayed in the order of the one band images in the lower left position 3
  • the reduced document image IMG 4 is started to display in the order of the one band images in the lower right 4 .
  • the reduced document image IMG 4 is displayed in the lower right position 4 . With this, a preview image of the four document image aggregation is completed.
  • FIGS. 56 and 57 a second displaying method is described in which four document images are aggregated into one page.
  • the band images of two reduced document images are simultaneously displayed.
  • FIG. 56 is a second timing chart in which a preview image is displayed by aggregating four document images into one page.
  • signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 read by the scanner 12 are instantly stored in the PCI memory 79 b .
  • the signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 are sequentially stored in the HDD 68 based on an image transfer clock generated at each time when an image of one band having the predetermined number of lines is read.
  • the interrupt processing section 79 c calculates interrupt timing from a reducing factor designated by a processing condition.
  • the calculation method of the interrupt timing is the same as that in the first displaying method described above.
  • the interrupt processing section 79 c generates an interrupt signal based on the calculated interrupt timing.
  • the image synthesis processing section 41 b sequentially reads the document images IMG 1 through IMG 4 based on the reading speed of the reducing factor of the four document image aggregation while instantly storing the document images IMG 1 through IMG 4 in the expansion memory 67 a.
  • the display synthesis processing section 82 a sequentially synthesizes the reduced document images IMG 1 through IMG 4 to form display images.
  • the LCD controller 85 simultaneously displays the reduced document images IMG 1 and IMG 2 on a predetermined region, and when the reduced document image IMG 4 is formed, the LCD controller 85 simultaneously displays the reduced document images IMG 3 and IMG 4 on another predetermined region.
  • the displaying timing to simultaneously display the reduced document images IMG 1 and IMG 2 on upper half position of one sheet and the displaying timing to simultaneously display the reduced document images IMG 3 and IMG 4 on lower half position of the one sheet are shown.
  • FIG. 57 is a diagram showing a screen flow in which a preview image having the four reduced document images is displayed based on the second timing chart.
  • the reduced document images IMG 1 and IMG 2 are simultaneously displayed in the order of the one band images in the upper half positions on one sheet.
  • the reduced document images IMG 3 and IMG 4 are simultaneously displayed in the order of the one band images in the lower half positions on the one sheet.
  • FIG. 58 a third displaying method is described in which two document images are aggregated into one page.
  • the band images of two reduced document images are simultaneously displayed.
  • FIG. 58 is a third timing chart in which a preview image is displayed by aggregating two document images into one page.
  • signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 read by the scanner 12 are instantly stored in the PCI memory 79 b .
  • the signals of the document images IMG 1 , IMG 2 , IMG 3 , and IMG 4 are sequentially stored in the HDD 68 based on an image transfer clock generated at each time when an image of one band having the predetermined number of lines is read.
  • the interrupt processing section 79 c calculates interrupt timing from a reducing factor designated by a processing condition.
  • the calculation method of the interrupt timing is the same as that in the first displaying method described above. However, in this case, since the reducing factor is 50%, the reading speed is twice that of the writing speed. Therefore, the interrupt timing is the time when 50% of the document image IMG 1 is written in the HDD 68 .
  • the display synthesis processing section 82 a sequentially synthesizes the reduced document images IMG 1 through IMG 4 to form display images.
  • the LCD controller 85 simultaneously displays the reduced document images IMG 1 and IMG 2 on one sheet.
  • a case is described.
  • a preview image of a document image is displayed by attaching a staple mark to the preview image.
  • the image processing apparatus 1 synthesizes a staple mark on a band image where the staple mark is to be displayed and displays a preview image having the staple mark.
  • FIGS. 59 through 61 one staple mark is attached to the document image IMG 1 .
  • plural staple marks are attached to the document image IMG 1 .
  • FIG. 59 is a timing chart showing processes to attach a staple mark on a preview image of a document image.
  • signals of the document image IMG 1 read by the scanner 12 are instantly stored in the PCI memory 79 b.
  • the interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines.
  • the HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
  • the display synthesis processing section 82 a synthesizes the one band images to form the document image IMG 1 .
  • the LCD controller 85 displays the document image IMG 1 in the order of band images L 1 , L 2 , L 3 , L 4 , and L 5 .
  • the band images L 1 through L 5 are almost simultaneously displayed.
  • the display synthesis processing section 82 a synthesizes a part of the band image L 1 where the staple is to be attached with a staple mark read from the symbol mark region 84 a (partial synthesis 51 ) and rewrites the position of the staple mark on a part of the band image where the staple mark is already positioned. Then the new staple mark position is displayed.
  • the LCD controller 85 displays the staple mark position at a position L 1 ′.
  • FIG. 60 is a screen flow when a staple mark is attached to a preview image.
  • the band image L 1 is replaced by a synthesis image part 52 .
  • FIG. 61 is a diagram showing screens of preview images in which the staple position is determined.
  • a screen G 501 shown of FIG. 61( a ) on a sheet image SHT 1 of a normal preview display, a staple position is determined and the staple mark L 31 is displayed.
  • a screen G 502 of FIG. 61( b ) the staple position is enlarged.
  • a user can determine a processing condition for printing a document image by directly operating a preview image.
  • the user can determine the processing condition by operations such as a click and a drag. Further, the user can visually and intuitively determine the processing condition.
  • the user when the user touches a desirable position on a preview image, the user can designate a binding position by a staple.
  • the user since the user can operate on the preview image by touching a screen and pushing a button, the operability for the user can be increased.
  • the present invention is based on Japanese Priority Patent Application No. 2006-073406, filed on Mar. 16, 2006, and Japanese Priority Patent Application No. 2007-060381, filed on Mar. 9, 2007, with the Japanese Patent Office, the entire contents of which are hereby incorporated herein by reference.

Abstract

An image processing apparatus which previews a read image is disclosed. The image processing apparatus includes a preview image processing unit in which a user is allowed to set a processing condition for the read preview image by operating on the read preview image and a preview image processed by the processing condition is displayed together with the setting of the processing condition on a displaying section.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention generally relates to an image processing apparatus and a preview image displaying method in the image processing apparatus which allows operability close to human senses.
2. Description of the Related Art
Recently, in an image processing apparatus having a copying function, a scanning function, and so on, a method is proposed in which a processing condition by a user is easily determined when an image is formed by using the above function.
For example, in Patent document 1, an image processing apparatus is disclosed. In the image processing apparatus, an image is pre-scanned by selecting a reading condition in a scanner and a reading condition having a high recognition rate is automatically selected by applying an OCR (optical character recognition) process to the pre-scanned image. With this, the processing condition is easily determined by the user.
In addition, in Patent Document 2, a scanner and a control method thereof are disclosed. In the scanner, a preview image pre-scanned by a user is rotated corresponding to necessity, and the user scans the image by setting a suitable rotational angle.
[Patent Document 1] Japanese Laid-Open Patent Application No. 2004-234261
[Patent Document 2] Japanese Laid-Open Patent Application No. 2001-045239
However, when a user copies images (documents) by setting processing conditions such as both-side printing, aggregation of pages, and stapling sheets; an output document may be different from that the user desires to obtain. Consequently, the user tries a copy of the images by setting processing conditions, and confirms the copied document. Then, the user changes the processing conditions, if necessary.
In some cases, corresponding to the settings of the processing conditions, documents are stapled, and a thumbnail image of the staple documents is displayed. However, the stapled image is displayed in a fixed small image from which the stapled status is hardly recognized.
Consequently, the user cannot recognize whether the documents are stapled by the set processing conditions before the document is actually printed.
That is, in the conventional method, a visually recognition method of the status to be output and a changing method of settings are not provided. Therefore, the user cannot easily determine the settings of the processing conditions visually and intuitively before an image is output.
SUMMARY OF THE INVENTION
In a preferred embodiment of the present invention, there is provided an image processing apparatus and a preview image displaying method in the image processing apparatus which allows operability close to human senses.
Features and advantages of the present invention are set forth in the description that follows, and in part will become apparent from the description and the accompanying drawings, or may be learned by practice of the invention according to the teachings provided in the description. Features and advantages of the present invention will be realized and attained by an image processing apparatus and a preview image displaying method in the image processing apparatus particularly pointed out in the specification in such full, clear, concise, and exact terms as to enable a person having ordinary skill in the art to practice the invention.
To achieve one or more of these and other advantages, according to one aspect of the present invention, there is provided an image processing apparatus which previews a read image. The image processing apparatus includes a preview image processing unit in which a user is allowed to set a processing condition for the read preview image by operating on the read preview image and a preview image processed by the processing condition is displayed together with the setting of the processing condition on a displaying section.
EFFECT OF THE INVENTION
According to an embodiment of the present invention, a user can set a processing condition for printing an image by directly operating a preview image. In addition, the processing condition can be set by a click and a drag on the preview image. Therefore, the user can visually and intuitively set the processing condition.
Moreover, the user can designate a staple position by touching a desirable position on the preview image. In addition, operability of the user can be increased by operation buttons and an operation on the preview image.
BRIEF DESCRIPTION OF THE DRAWINGS
Features and advantages of the present invention will become more apparent from the following detailed description when read in conjunction with the accompanying drawings, in which:
FIG. 1 is a block diagram showing functions of an image processing apparatus according to an embodiment of the present invention;
FIG. 2 is a block diagram showing hardware of the image processing apparatus;
FIG. 3 is a block diagram showing an operating panel in detail in the image processing apparatus;
FIG. 4 is a diagram showing an upper surface of the operating panel;
FIG. 5 is a diagram showing an IMH and the operating panel for synthesizing moving images;
FIG. 6 is a diagram showing a data flow for displaying a preview image at the same time as when image data are stored;
FIG. 7 is a diagram showing a data flow for displaying a preview image when a processing condition is designated after storing image data;
FIG. 8 is a diagram showing a data flow for printing a preview image after processing image data;
FIG. 9 is a diagram showing a data flow for storing a preview image after processing image data;
FIG. 10 is a diagram showing a data flow for displaying a preview image when a new processing condition is set in the image data stored in an expansion memory;
FIG. 11 is a diagram showing a data flow for displaying a preview image by using an initial processing condition;
FIG. 12 is a diagram showing a relationship between a staple position and a page turning direction when the staple positions are two;
FIG. 13 is a diagram showing a relationship between a staple position and a page turning direction when the staple position is at the upper side;
FIG. 14 is a diagram showing a relationship between a staple position and a page turning direction when the staple position is at a corner end;
FIG. 15 is a diagram showing a relationship between a punch position and a page turning direction;
FIG. 16 is a table in which a binding method of a document and a page turning direction of the document are shown by correlating with each other;
FIG. 17 is a flowchart showing processes to execute all the operations which can perform three patterns;
FIG. 18 is a diagram showing a screen on which a preview image is displayed after reading a document;
FIG. 19 is a diagram showing a screen on which a rotated preview image is displayed by pushing a rotation button shown in FIG. 18;
FIG. 20A is a diagram showing a screen on which a preview image is displayed by pushing an automatic page turning button shown in FIG. 18;
FIG. 20B is a diagram showing a screen on which a preview image on a page is displayed by pushing a start button shown in FIG. 20A;
FIG. 21 is a diagram showing processes for designating a staple position;
FIG. 22 is a diagram showing processes for designating a document aggregation;
FIG. 23 is a diagram showing a screen of a preview image in which both-side printing is designated;
FIG. 24 is a diagram showing page turning directions;
FIG. 25 is a diagram showing screens in which documents are turned;
FIG. 26 is a diagram showing a screen in which a first sheet image has been completely turned;
FIG. 27 is a diagram showing a screen in which a process returning to previous pages is shown;
FIG. 28 is a diagram showing a screen in which a second sheet image is shown;
FIG. 29 is a diagram showing processes for displaying a development view;
FIG. 30 is a diagram showing a screen in which the head and tail of the rear surface of the first sheet image is changed;
FIG. 31 is a diagram showing screens of a preview image in which a staple position is determined by designating the page turning direction;
FIG. 32 is a diagram showing processes for designating the page turning direction;
FIG. 33 is a diagram showing screens in which the first sheet image is turned;
FIG. 34 is a diagram showing a screen in which the rear surface of the first sheet image (second page) is displayed;
FIG. 35 is a diagram showing a screen in which a process returning to previous pages is shown;
FIG. 36 is a diagram showing a screen in which the second sheet image is shown;
FIG. 37 is a diagram showing processes to display a development view;
FIG. 38 is a diagram showing screens in which the head and tail of the rear surface of the first sheet image are reversed;
FIG. 39 is a diagram showing processes (screen flow) in which a processing condition is determined before reading a document;
FIG. 40 is a diagram showing processes (screen flow) for adjusting a staple position;
FIG. 41 is a diagram showing a screen in which the staple position is adjusted;
FIG. 42 is a diagram showing a screen in which a document image position is adjusted;
FIG. 43 is a diagram showing a screen in which a document image is reduced;
FIG. 44 is a flowchart showing processes to adjust an overlap position where a binding position of documents overlaps an image;
FIG. 45 is a timing chart of a normal operation for displaying a preview image;
FIG. 46 is a diagram showing a flow for displaying a preview image in the normal operation;
FIG. 47 is a timing chart for displaying a preview image when a rotation method is designated in a processing condition;
FIG. 48 is a diagram showing first document images when the image is read and displayed by being applied a rotation method;
FIG. 49 is a timing chart for displaying a preview image when page turning is designated by a drag of a user;
FIG. 50 is a timing chart for displaying a preview image when automatic page turning is designated by a user;
FIG. 51 is a first timing chart in which a preview image is displayed by aggregating four document images into one page;
FIG. 52 is a diagram showing a first screen flow in which a preview image having four reduced document images is displayed;
FIG. 53 is a diagram showing a second screen flow in which a preview image having the four reduced document images is displayed;
FIG. 54 is a diagram showing a third screen flow in which a preview image having the four reduced document images is displayed;
FIG. 55 is a diagram showing a fourth screen flow in which a preview image having the four reduced document images is displayed;
FIG. 56 is a second timing chart in which a preview image is displayed by aggregating four document images into one page;
FIG. 57 is a diagram showing a screen flow in which a preview image having the four reduced document images is displayed based on the second timing chart;
FIG. 58 is a third timing chart in which a preview image is displayed by aggregating two document images into one page;
FIG. 59 is a timing chart showing processes to attach a staple mark on a preview image of a document image;
FIG. 60 is a screen flow when a staple mark is attached to a preview image; and
FIG. 61 is a diagram showing screens of preview images in which the staple position is determined.
DESCRIPTION OF THE PREFERRED EMBODIMENTS Best Mode of Carrying Out the Invention
The best mode of carrying out the present invention is described with reference to the accompanying drawings.
FIG. 1 is a block diagram showing functions of an image processing apparatus according to an embodiment of the present invention. As shown in FIG. 1, an image processing apparatus 1 includes a software group 2, a hardware resource 4, and an operating panel 80. In the image processing apparatus 1 shown in FIG. 1, in order to make the description concise, only elements necessary for the present invention are shown.
The software group 2 includes various functions to be realized by programs which are executed by a CPU (central processing unit) 61 (described below) in a controller 60 (described below). The hardware resource 4 includes a plotter 11, a scanner 12, and so on. The operating panel 80 receives an instruction from a user and displays information for the user.
The software group 2 includes an application layer 5 and a platform layer 6. An OS (operating system) on the application layer 5 and the platform layer 6 executes software in the application layer 5 and the platform layer 6 in parallel.
The application layer 5 includes, for example, copy application software 22 for supplying a copy function to a user. The application layer 5 can include other application software.
The platform layer 6 manages the use of the hardware resource 4 by interpreting a process request from the application layer 5. The platform layer 6 includes an MCS (memory control service) 36 and an IMH (image memory handler) 41. The MCS 36 obtains a memory region and releases the obtained memory region, utilizes an HDD (described below), controls compressing image data and expanding the compressed image data, and controls other functions. The IMH 41 manages a memory.
When the copy application software 22 requests the MCS 36 to obtain an image for previewing the image, the MCS 36 requests the IMH 41 to obtain an image read by the scanner 12. When the scanner 12 obtains an image requested by the IMH 41, the scanner 12 informs the IMH 41 of obtaining the image. The IMH 41 informs the MCS 36 of obtaining the image. The MCS 36 informs the copy application software 22 of obtaining the image. The copy application software 22 communicates with the operating panel 80 so that the obtained image is previewed.
The preview image is displayed on the operating panel 80, and a user performs a desirable operation on the preview image on the operating panel 80. When processing conditions are determined by a user operation, the copy application software 22 receives the processing conditions from the operating panel 80 and makes the IMH 41 execute a process on the image read by the scanner 12 via the MCS 36. The IMH 41 makes the plotter 11 form an image on a predetermined recording medium on which image the process is to be applied.
FIG. 2 is a block diagram showing hardware of the image processing apparatus 1. As shown in FIG. 2, the image processing apparatus 1 includes the controller 60, the operating panel 80, the plotter 11 and the scanner 12.
As shown in FIG. 2, the controller 60 includes the CPU 61, a system memory 62, an NB (north bridge) 63, an ASIC (application specific integrated circuit) 66, a local memory 67, a HDD (hard disk drive) 68, and an external interface 70.
The operating panel 80 is connected to the ASIC 66. The plotter 11 and the scanner 12 are connected to the ASIC 66 via a PCI (peripheral component interconnect) bus 79.
The local memory 67 and the HDD 68 are connected to the ASIC 66, and the CPU 61 is connected to the ASIC 66 via the NB 63 which is a CPU chip set. The ASIC 66 is connected to the NB 63 via an AGP (accelerated graphic port) 65.
The CPU 61 controls all the elements in the image processing apparatus 1. The CPU 61 operates the MCS 36 and the IMH 41 on the OS, and operates the copy application software 22 in the application layer 5.
The NB 63 connects the CPU 61 to the system memory 62, the ASIC 66, and the external interface 70. The NB 63 is connected to the external interface 70 via a PCI bus 73.
The system memory 62 stores image data for writing. The local memory 67 is a buffer for storing image data for copying and for storing code data. The ASIC 66 is an image processing IC having hardware elements. The HDD 68 is storage for storing image data, document data, programs, font data, form data, and so on.
The external interface 70 connects the image processing apparatus 1 to a network such as the Internet and a LAN.
FIG. 3 is a block diagram showing the operating panel 80 in detail in the image processing apparatus 1. As shown in FIG. 3, the operating panel 80 includes an operating screen CPU 81, a program memory 82, a touch panel controller 83, a display data memory 84, a LCD (liquid crystal display) panel controller 85, and an LCD panel 90.
The operating screen CPU 81 controls all the elements in the operating panel 80 by communicating with the controller 60. In addition, the operating screen CPU 81 controls a display on the LCD panel 90 by reading a program stored in the program memory 82 and executing the program.
The program memory 82 stores all the programs for controlling all the elements in the operating panel 80. The touch panel controller 83 controls the LCD panel 90 corresponding to a user operation on a screen displayed on the LCD panel 90 via the LCD panel controller 85. The display data memory 84 stores image data which are used for displaying a preview image. The LCD panel controller 85 controls a display on the LCD panel 90 corresponding to the user operation. The LCD panel 90 provides a touch panel function.
FIG. 4 is a diagram showing an outline of the operating panel 80. As shown in FIG. 4, the operating panel 80 includes a liquid crystal panel 8, a function selecting button 8 a, an operating button 8 b, ten-key buttons 8 c, buttons 8 d, a start button 8 e, and a power switch 8 f.
A preview image (described below) is displayed on the liquid crystal panel 8. The function selecting button 8 a includes a copy button, a document button, a facsimile button, a printer button, and a scanner button; and one of the buttons is selected by a user. The operating button 8 b includes a program button, a reset button, and a preheat button.
From the ten-key button 8 c, the user inputs a figure. The button 8 d includes a trial copy button and clear/stop buttons for canceling the operation. The user starts operations by pushing the start button 8 e. The power of the image processing apparatus 1 is turned on by pushing the power switch 8 f.
Next, referring to FIGS. 1 through 9, the IMH 41 and the operating panel 80 for displaying a preview image are described in detail.
FIG. 5 is a diagram showing the IMH 41 and the operating panel 80 for synthesizing moving images. As shown in FIG. 5, the IMH 41 includes a compression/expansion processing section 41 a, an image synthesis processing section 41 b, an expansion memory 67 a, and a PCI controller 79 a.
The compression/expansion processing section 41 a compresses image data stored in the expansion memory 67 a and image data read by the scanner 12 when the image data are stored in the HDD 68. In addition, the compression/expansion processing section 41 a expands the image data stored in the HDD 68 when the image data are processed by the plotter 11 or are stored in the expansion memory 67 a.
The image synthesis processing section 41 b synthesizes image data read by the scanner 12 by storing the image data in the expansion memory 67 a based on an initial processing condition, and synthesizes image data stored in the expansion memory 67 a based on a set processing condition. The synthesized image data are output by the plotter 11 as print data.
The expansion memory 67 a is a part of the local memory 67 which can be used by the IMH 41 and stores processed image data.
The PCI controller 79 a includes a PCI memory 79 b and an interrupt processing section 79 c and controls access to the scanner 12 and the plotter 11 vi the PCI bus 79 (refer to FIG. 2). The PCI memory 79 b temporarily stores image data read by the scanner 12 and image data for an image to be formed by the plotter 11.
The interrupt processing section 79 c generates an interrupt signal corresponding to timing when the image synthesis processing section 41 b forms an image. Since the scanner 12 reads image data line by line, when the interruption signal is generated every one line reading, a preview image is formed by synthesizing line images and one line image is sequentially displayed. In addition, when the preview image is displayed by rotating the image, the number of image transfer clocks generated by the scanner 12 at each one line reading is counted and the interrupt signal is generated when the counted number equals clocks for the lines of one page.
As shown in FIG. 5, the operating panel 80 includes a display synthesis processing section 82 a, a symbol mark region 84 a, and an LCD controller 85.
The display synthesis processing section 82 a is realized when the operating screen CPU 81 executes a program stored in the program memory 82, and synthesizes a symbol mark stored in the symbol mark region 84 a with image data from expansion memory 67 a to form a preview image.
The symbol mark region 84 a is a part of the display data memory 84 and stores picture images such as a staple mark and a punch mark beforehand. The LCD controller 85 displays a synthesized preview image and also displays a screen based on an instruction by the user on the LCD panel 90.
FIG. 6 is a diagram showing a data flow for displaying a preview image at the same time as when image data are being stored. In FIG. 6, in the IMH 41, image data read by the scanner 12 are sent to the compression/expansion processing section 41 a and the image synthesis processing section 41 b via the PCI controller 79 a.
The compression/expansion processing section 41 a compresses the received image data and stores the compressed image data in the HDD 68. The image synthesis processing section 41 b synthesizes the received image data and stores the synthesized image data in the expansion memory 67 a.
In the operating panel 80, the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with the picture image stored in the symbol mark region 84 a. The LCD controller 85 displays the preview image (display data) on the LCD panel 90.
FIG. 7 is a diagram showing a data flow for displaying a preview image when a processing condition is designated after storing image data. In FIG. 7, when a user designates a processing condition for image data stored in the HDD 68, in the IMH 41, the compression/expansion processing section 41 a expands image data read from the HDD 68, and the image synthesis processing section 41 b synthesizes the expanded image data by the designated processing condition and stores the synthesized image data in the expansion memory 67 a.
In the operating panel 80, the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with the picture image stored in the symbol mark region 84 a. The LCD controller 85 displays the preview image (display data) on the LCD panel 90.
FIG. 8 is a diagram showing a data flow for printing a preview image after processing image data. In FIG. 8, in the IMH 41, processed image data stored in the expansion memory 67 a are sent to the plotter 11 via the PCI controller 79 a, and the plotter 11 forms (prints) a preview image on a predetermined recording medium.
FIG. 9 is a diagram showing a data flow for storing a preview image after processing image data. In FIG. 9, in the IMH 41, processed image data stored in the expansion memory 67 a are compressed by the compression/expansion processing section 41 a and the compressed image data are stored in the HDD 68.
FIG. 10 is a diagram showing a data flow for displaying a preview image when a new processing condition is set in the image data stored in the expansion memory 67 a. In FIG. 10, when a user designates a new processing condition for the image data stored in the expansion memory 67 a, the image synthesis processing section 41 b reads image data from the expansion memory 67 a without reading image data from the HDD 68, synthesizes the read image data, and stores the image data in the expansion memory 67 a.
In the operating panel 80, the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with the picture image stored in the symbol mark region 84 a. The LCD controller 85 displays the preview image (display data) on the LCD panel 90.
In this case, a process is not needed in which the compression/expansion processing section 41 a expands image data by reading the image data from the HDD 68. Therefore, the memory resources can be effectively used and the power consumption can be reduced.
FIG. 11 is a diagram showing a data flow for displaying a preview image by using an initial processing condition. In FIG. 11, when a determined processing condition is cancelled and a processing condition is made to be an initial processing condition, in the IMH 41, the compression/expansion processing section 41 a expands image data read from the HDD 68, and the image synthesis processing section 41 b synthesizes the expanded image data by the initial processing condition and stores the synthesized image data in the expansion memory 67 a.
In the operating panel 80, the display synthesis processing section 82 a forms a preview image (display data) by synthesizing the image data received from the expansion memory 67 a in the IMH 41 with a picture image stored in the symbol mark region 84 a. The LCD controller 85 displays the preview image (display data) on the LCD panel 90.
In the embodiment of the present invention, in order to easily determine a processing condition for printing an image by directly operating a preview image displayed on the operating panel 80, the following method is established which method designates a processing condition based on user psychology.
[Designation of Staple Position]
(1). A staple button is pushed, a binding position of documents is clicked, and a staple position is designated.
(2). A page is turned, a finishing state of a document is confirmed, and a staple position of the document is designated.
(3). When the head and tail of a stapled document are wrong, a staple position of the document is designated by changing the head and tail.
[Designation of Page Turning Direction]
(1). A staple button is pushed and the page turning direction is designated.
(2). A staple position and the head and tail of a document are set in an image processing apparatus corresponding to the page turning direction.
(3). When the head and tail of a stapled document are wrong, the head and tail of the rear surface is changed by changing the head and tail of the front surface.
[Relationship Between Staple Position and Page Turning Direction]
(1). Horizontal wiring may be largely used in a business document.
(2). The staple position is suitable at the upper side or the left side of the business document.
(3). When some documents are aggregated in one sheet, the staple position may be at the side of the sheet having a small page number.
(4). The page turning direction is determined by the staple position.
(5). A short stroke is suitable when a page is turned, and a page turning direction is suitable which easily turns a page.
A punch position is similar to the above staple position.
There is an exception to the user psychology; therefore, in the embodiment of the present invention, candidates for providing the user with easy operations are determined, and the user can select one of the candidates.
Referring to FIGS. 12 through 16, a relationship between a staple position and a page turning direction is described. In FIGS. 12 through 16, an example in which four pages are aggregated in one sheet is described. The number written in each sheet 1, 2, 3, and 4 is the image order scanned by the scanner 12, for example, the number corresponds to the page number. The image order is referred to as the read image 1, 2, 3, . . . n. In addition, a staple position “sp” is shown by a bold line and a punch position “ph” is shown by “o”, and a page turning direction “d” is shown by an arrow.
FIG. 12 is a diagram showing a relationship between a staple position “sp” and a page turning direction “d” when the staple positions “sp” are two.
In FIG. 12( a), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 12( a), when the staple positions “sp” are designated at the left sides of the read images 1 and 3, the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 2 (the read image 3 to the read image 4), the staple positions “sp” are predicted at the right sides of the read images 2 and 4.
In FIG. 12( a), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple positions “sp” are at the right sides of the read images 6 and 8 in the sheet 2 and at the left sides of the read images 9 and 11 in the sheet 3.
In FIG. 12( b), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 12( b), when the staple positions “sp” are designated at the right sides of the read images 1 and 2, the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 3 (the read image 2 to the read image 4), the staple positions “sp” are predicted at the left sides of the read images 3 and 4.
In FIG. 12( b), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple positions “sp” are at the left sides of the read images 7 and 8 in the sheet 2 and at the right sides of the read images 9 and 10 in the sheet 3.
In FIG. 12( c), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 12( c), when the staple positions “sp” are designated at the upper sides of the read images 1 and 2, the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 3 (the read image 2 to the read image 4), the staple positions “sp” are predicted at the lower sides of the read images 3 and 4.
In FIG. 12( c), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple positions “sp” are at the lower sides of the read images 7 and 8 in the sheet 2 and at the upper sides of the read images 9 and 10 in the sheet 3.
In FIG. 12( d), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 12( d), when the staple positions “sp” are designated at the upper sides of the read images 1 and 3, the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 2 (the read image 3 to the read image 4), the staple positions “sp” are predicted at the lower sides of the read images 2 and 4.
In FIG. 12( d), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple positions “sp” are at the lower sides of the read images 6 and 8 in the sheet 2 and at the upper sides of the read images 9 and 11 in the sheet 3.
FIG. 13 is a diagram showing a relationship between a staple position “sp” and a page turning direction “d” when the staple position “sp” is at the upper side. In FIG. 13, the staple is positioned along one side at the upper end of the sheet.
In FIG. 13( a), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 13( a), when the staple position “sp” is designated at the upper left side of the read image 1 along the side, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower right side of the read image 4.
In FIG. 13( a), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the upper right side of the read image 6 in the sheet 2 and at the upper left side of the read image 9 in the sheet 3.
In FIG. 13( b), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 13( b), when the staple position “sp” is designated at the upper right side of the read image 1 along the side, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower left side of the read image 4.
In FIG. 13( b), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the upper left side of the read image 7 in the sheet 2 and at the upper right side of the read image 9 in the sheet 3.
In FIG. 13( c), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 13( c), when the staple position “sp” is designated at the upper left side of the read image 1 along the upper side, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower right side of the read image 4 along the lower side.
In FIG. 13( c), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the lower left side of the read image 7 in the sheet 2 and at the upper left side of the read image 9 in the sheet 3.
In FIG. 13( d), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 13( d), when the staple position “sp” is designated at the upper right side of the read image 1 along the upper side, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower left side of the read image 4 along the lower side.
In FIG. 13( d), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the lower right side of the read image 6 in the sheet 2 and at the upper right side of the read image 9 in the sheet 3.
FIG. 14 is a diagram showing a relationship between a staple position “sp” and a page turning direction “d” when the staple position “sp” is at a corner end. In FIG. 14, the long-length direction of the staple is positioned along one corner of the sheet.
In FIG. 14( a), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 14( a), when the staple position “sp” is designated at the upper left corner of the read image 1, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower right corner of the read image 4.
In FIG. 14( a), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the upper right corner of the read image 6 in the sheet 2 and at the upper left corner of the read image 9 in the sheet 3.
In FIG. 14( b), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 14( b), when the staple position “sp” is designated at the upper right corner of the read image 1, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower left corner of the read image 4.
In FIG. 14( b), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the upper left corner of the read image 7 in the sheet 2 and at the upper right corner of the read image 9 in the sheet 3.
In FIG. 14( c), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 14( c), when the staple position “sp” is designated at the upper left corner of the read image 1, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower right corner of the read image 4.
In FIG. 14( c), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the upper right corner of the read image 6 in the sheet 2 and at the upper left corner of the read image 9 in the sheet 3.
In FIG. 14( d), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 14( d), when the staple position “sp” is designated at the upper right corner of the read image 1, the page turning direction “d” is predicted from the read image 4 to the read image 1. On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 4, the staple position “sp” is predicted at the lower left corner of the read image 4.
In FIG. 14( d), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The staple position “sp” is at the upper left corner of the read image 6 in the sheet 2 and at the upper right corner of the read image 9 in the sheet 3.
Next, a relationship between a punch position “ph” and a page turning direction “d” is described.
FIG. 15 is a diagram showing the relationship between the punch position “ph” and the page turning direction “d”.
In FIG. 15( a), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 15( a), when the punch position “ph” is designated at the left sides of the read images 1 and 3, the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 2 (the read image 3 to the read image 4), the punch position “ph” is predicted at the right sides of the read images 2 and 4.
In FIG. 15( a), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The punch position “ph” is at the right sides of the read images 6 and 8 in the sheet 2 and at the left sides of the read images 9 and 11 in the sheet 3.
In FIG. 15( b), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 15( b), when the punch position “ph” is designated at the upper sides of the read images 1 and 3, the page turning direction “d” is predicted from the read image 2 to the read image 1 (the read image 4 to the read image 3). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 2 (the read image 3 to the read image 4), the punch position “sp” is predicted at the lower sides of the read images 2 and 4.
In FIG. 15( b), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The punch position “ph” is at the lower sides of the read images 6 and 8 in the sheet 2 and at the upper sides of the read images 9 and 11 in the sheet 3.
In FIG. 15( c), in horizontal direction sheets 1, 2, and 3, the read images are aggregated in the order of upper left, upper right, lower left, and lower right positions. In FIG. 15( c), when the punch position “ph” is designated at the upper sides of the read images 1 and 2, the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 3 (the read image 2 to the read image 4), the punch position “ph” is predicted at the lower sides of the read images 3 and 4.
In FIG. 15( c), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The punch position “ph” is at the lower sides of the read images 7 and 8 in the sheet 2 and at the upper sides of the read images 9 and 10 in the sheet 3.
In FIG. 15( d), in vertical direction sheets 1, 2, and 3, the read images are aggregated in the order of upper right, lower right, upper left, and lower left positions. In FIG. 15( d), when the punch position “ph” is designated at the right sides of the read images 1 and 2, the page turning direction “d” is predicted from the read image 3 to the read image 1 (the read image 4 to the read image 2). On the other hand, when the page turning direction “d” is designated from the read image 1 to the read image 3 (the read image 2 to the read image 4), the punch position “ph” is predicted at the left sides of the read images 3 and 4.
In FIG. 15( d), when the sheet 1 is turned, the sheets 2 and 3 are a two-page spread. The sheet 2 is a rear surface of the sheet 1. The punch position “ph” is at the left sides of the read images 7 and 8 in the sheet 2 and at the right sides of the read images 9 and 10 in the sheet 3.
FIG. 16 is a table 92 in which a binding method of a document and a page turning direction of the document are shown by correlating with each other.
The image processing apparatus 1 forms the table 92 shown in FIG. 16 based on methods similar to those shown in FIGS. 12 through 15 and stores the table 92 in the HDD 68.
In the binding method of the document, items of 2-position stapling, 1-position stapling, and punching are shown, and each item has a position and a rear surface direction for a front surface. In the page turning direction, items of left direction turning, right direction turning, and upper direction turning are shown, and each item has horizontal writing and vertical writing.
Further, in the position, a left side, a right side, and an upper side are shown. In the rear surface direction for front surface, the same direction and the head and tail reversed direction are shown.
Next, user patterns are described.
The following patters are estimated about user operations.
In pattern 1, a user scans an image, stores the scanned image, and processes the image.
In pattern 2, a user scans an image by setting a processing condition, displays a preview image, and prints the image and simultaneously stores the image.
In pattern 3, a user scans an image by setting a processing condition, displays a preview image, processes the image, and prints the image and simultaneously stores the image.
Next, processes to execute all the operations which can perform the above three patterns are described.
FIG. 17 is a flowchart showing the processes to execute all the operations which can perform the above three patterns.
Referring to FIG. 17, the processes are described. First, the image processing apparatus 1 determines whether a processing condition is designated by a user instruction (S11). When the image processing apparatus 1 determines that the processing condition is designated by the user (YES in S11), the user designates the processing condition (S12). When the image processing apparatus 1 does not determine that the processing condition is designated by the user (NO in S11), the process goes to S13.
Then, the image processing apparatus 1 reads a document by the scanner 12 (S13), and forms an image by synthesizing line images (S14). In the image synthesis, images in each line or in one page are sequentially synthesized to form a preview image by the designated processing condition. The synthesis of one line image and the one page image are automatically switched based on the designated processing condition (described below).
Next, a preview image is displayed on the operating panel 80 (S15). Then it is determined whether the user instructs to print the preview image (S16). When it is determined that the user instructs to print the preview image (YES in S16), the image processing apparatus 1 prints the preview image by the plotter 11 (S16-2).
When the user does not instruct to print the preview image (NO in S16), it is determined whether the user instructs to apply a process to the preview image (S17). When it is determined that the user instructs to apply a process to the preview image (YES in S17), the image processing apparatus 1 makes the user designate a processing condition and applies the process to the preview image based on the processing condition (S18) and the process returns to S14.
Next, referring to FIGS. 18 through 30, screens for designating a staple position on a document are described.
FIG. 18 is a diagram showing a screen on which a preview image is displayed after reading a document. As shown in FIG. 18, a screen G100 displayed on the LCD panel 90 includes a message region 100 a, a staple button 100 b, a both-side printing button 100 c, a document aggregation button 100 d, a rotation button 170, an automatic page turning button 180, and a preview image displaying region 100 e. A staple position is designated by the staple button 100 b, both-side printing is designated by the both-side printing button 100 c, aggregation of pages is designated by the document aggregation button 100 d, a preview image is rotated by the rotation button 170, and the status of all the pages of the document is shown by the automatic page turning button 180.
When a preview image is displayed after reading a document, a first document image IMG1 is displayed on a sheet image SHT1 in the preview image displaying region 100 e, and a message, for example, “SELECT MODE” for instructing a user to operate is displayed on the message region 100 a. In order to select a mode, the user pushes, for example, the staple button 100 b and designates the staple position.
In addition to the automatic page turning button 180, a scroll bar can be disposed at the right side of the preview image displaying region 100 e. With this, the user can view pages by using the scroll bar.
In the following, main buttons for executing the embodiment of the present invention are shown, and other buttons may be omitted.
FIG. 19 is a diagram showing the screen G100 on which a rotated preview image is displayed by pushing the rotation button 170 shown in FIG. 18.
When the user pushes the rotation button 170 shown in FIG. 18 on the screen G100, as shown in FIG. 19, a rotation method selecting button 172 is displayed. The rotation method selecting button 172 includes a head and tail reversing button 172 a, a right direction rotation button 172 b, a left direction rotation button 172 c, an angle designation region 172 d, and an OK button for determining the rotation angle.
The user can change the head and tail of the sheet image SHT1 by operating the head and tail reversing button 172 a. In addition, the user can rotate the sheet image SHT1 clockwise on a 90° basis by operating the right direction rotation button 172 b, and can rotate the sheet image SHT1 counterclockwise on a 90° basis by operating the left direction rotation button 172 c. Further, the user can designate the rotation angle by selecting one of 90°, 180°, 270°, 360° (0°) by operating an up and down button in the angle designation region 172 d. When the rotation angle is determined, the user pushes the “OK” button 172 f. Then the user executes a next process.
FIG. 20A is a diagram showing the screen G100 on which a preview image is displayed by pushing the automatic page turning button 180 shown in FIG. 18.
When the user pushes the automatic page turning button 180 shown in FIG. 18 on the screen G100, as shown in FIG. 20A, a page turning speed selecting button 182 is displayed. The page turning speed selecting button 182 includes a fast button 182 a, a normal button 182 b, a slow button 182 c, a page turning speed designating region 182 d, and a start button for starting the page turning with the designated speed.
The user can select fast speed by operating the fast button 182 a, can select normal speed by operating the normal button 182 b, and can select slow speed by operating the slow button 182 c.
In addition, the user can change the speed by operating an up and down button in the page turning speed designating region 182 d. When the page turning speed is determined, the user pushes the start button 182 f. With this, preview images are sequentially displayed at the selected speed on the preview image displaying region 100 e in the order of the pages of the document read by the scanner 12.
FIG. 20B is a diagram showing the screen G100 on which a preview image on a page is displayed by pushing the start button 182 f shown in FIG. 20A. In FIG. 20B, in the message region 100 a, a message, for example, “STOP PAGE TURNING BY TOUCHING SCREEN, PUSH START TO RESTART” is displayed. The user can stop the automatic page turning at an arbitrarily page by touching the preview image display region 100 e and can restart the automatic page turning by pushing the start button 182 f.
FIG. 21 is a diagram showing processes for designating a staple position. In a screen G101 shown in FIG. 21, when the staple button 100 b is selected, plural staple marks STPL1, STPL2, STPL3, STPL4, STPL5, and STPL6 are shown on the sheet image SHT1.
In the message region 100 a of the screen G101, for example, a message “SELECT STAPLE MARK AT DESIRABLE POSITION” is displayed, and the user selects, for example, the staple mark STPL3 on the sheet image SHT1. The selected staple mark STPL3 is changed to a staple mark STPL31 by being exaggerated and the staple mark STPL31 is displayed on a screen G102.
In the message region 100 a of the screen G102, for example, a message “PUSH ENTER” is displayed, and the user push an enter button 100 f on the screen G102. When the user pushes the enter button 100 f on the screen G102, a screen G103 is displayed.
On the screen G103, only the staple mark STPL31 is displayed on the sheet image SHT1, and “SELECT MODE” is displayed on the message region 100 a. The user can continuously select another mode, for example, the both-side printing or the document aggregation. For example, when the user selects the document aggregation button 100 d, processes of the document aggregation shown in FIG. 22 are started.
FIG. 22 is a diagram showing processes for designating a document aggregation. In a screen G111 shown in FIG. 22, in the message region 100 a, “SELECT NUMBER OF DOCUMENTS TO BE AGGREGATED IN ONE SHEET” is displayed, and an aggregation candidate 110 is displayed.
The aggregation candidate 110 includes a button 110 a which aggregates two documents into one sheet, a button 110 b which aggregates four documents into one sheet, and a button 110 c which aggregates nine documents into one sheet.
For example, when a user selects the button 110 b, a screen G112 is displayed. In the message region 100 a of the screen G112, for example, a message “PUSH ENTER BUTTON WHEN ORDER IS SUITABLE, PUSH PREFERABLE ARRANGEMENT BUTTON WHEN ORDER IS TO BE CHANGED” is displayed and a document arrangement candidate 114 is displayed instead of displaying the aggregation candidate 110.
The document arrangement candidate 114 includes buttons 114 a, 114 b, 114 c, and 114 d. In the button 114 a, four documents are arranged in the order of upper left, upper right, lower left, and lower right positions. In the button 114 b, four documents are arranged in the order of upper left, lower left, upper right, and lower right positions. In the button 114 c, four documents are arranged in the order of upper right, upper left, lower right, and lower left positions. In the button 114 d, four documents are arranged in the order of upper right, lower right, upper left, and lower left positions.
When the screen G112 is displayed, the four documents are displayed in the arrangement order of the button 114 a. In the screen G112, the staple mark STPL31 selected by the user, the first document image IMG1, a second document image IMG2, a third document image IMG3, and a fourth document image IMG4 are displayed on the sheet image SHT1.
When the user satisfies the arrangement order shown by the button 114 a, the user pushes the enter button 110 f. However, when the user does not satisfy the arrangement order shown by the button 114 a, the user can change the arrangement order by selecting one of the buttons 114 b through 114 d.
When the user pushes the enter button 110 f, a screen G113 is displayed. In the message region 110 a of the screen G113, the message “SELECT MODE” is displayed. When the user pushes the both-side printing button 100 c, a screen shown in FIG. 23 is displayed.
FIG. 23 is a diagram showing a screen G120 of a preview image in which both-side printing is designated. In the screen G120, in the message region 100 a, for example, a message “DRAG ON SCREEN IN PAGE TURNING DIRECTION AND CONFIRM TURNED PAGE, AND PUSH ENTER” is displayed, and a both-side preview selection 121 is displayed.
The both-side preview selection 121 includes a development view button 121 a for previewing a development view, a reverse button 121 b for previewing a reversed preview image, and a head and tail changing button 121 c for changing the head and tail.
When the user pushes the enter button 120 f, the preview image is determined for printing.
FIG. 24 is a diagram showing page turning directions. In FIG. 24( a), the page turning direction faces the STPL31. When the user drags on the screen in a direction “a1” from the lower right position to the upper left position on the sheet image SHT1, the page turning status is shown in a screen G121 in FIG. 25( a). FIG. 25 is a diagram showing screens in which documents are turned.
On the other hand, as shown in FIG. 24( b), when the user drags on the screen in a direction “a2” from the lower left position to the upper right position on the sheet image SHT1, as shown in FIG. 24( c), a warning screen 123 a is shown in the screen G120.
In FIG. 24( c), in the warning screen 123 a, a message, for example, “WARNING! DOCUMENT CANNOT BE TURNED IN DESIGNATED DIRECTION” is displayed. The user pushes an enter button 123 f and designates again a page turning direction.
Referring to FIG. 25, screens in which the sheet image SHT1 is turned are described. In a screen G121 shown in FIG. 25( a), the sheet image SHT1 is started to be turned. In a screen G122 shown in FIG. 25( b), the sheet image SHT1 (first page) is turned and the rear surface of the sheet image SHT1 (second page) and a sheet image SHT2 (third page) are shown. In a screen G123 shown in FIG. 25( c), the sheet image SHT1 has been almost turned and the rear surface of the sheet image SHT1 (second page) is shown.
FIG. 26 is a diagram showing a screen in which the sheet image SHT1 has been completely turned. As shown in FIG. 26, a screen G124 (preview screen) in which the sheet image SHT1 has been completely turned and the rear surface of the sheet image SHT1 (second page) is shown.
FIG. 27 is a diagram showing a screen G124 in which a process returning to previous pages is shown. When the user drags on the screen G124 in a direction “a3” from the upper right position to the lower left position which direction is reverse to the page turning direction, the screen is sequentially returned from G124 to G123, G122, G122 (FIG. 25), and G120 (FIG. 24). That is, the screen is turned in reverse.
FIG. 28 is a diagram showing a screen G125 in which the sheet image SHT2 is shown. When the user pushes the reverse button 121 b on the screen G124 shown in FIG. 27, the screen G125 shown in FIG. 28 is shown. In the screen G125, the front surface of the sheet image SHT2 (third page) is shown as a preview image. That is, in the sheet image SHT2, ninth through twelfth document images are shown.
FIG. 29 is a diagram showing processes for displaying a development view.
In FIG. 29( a), in a screen G126, the sheet images SHT1 and SHT2 are bound by the staple mark STPL31. In the message region 100 a in the screen G126, a message, for example, “CLICK DESIRABLE PAGE, CLICKED PAGE IS DISPLAYED, PUSH ENTER”.
For example, when the user clicks the screen G126 at a point “9 p” in FIG. 29( b), as shown in FIG. 29( c), in a screen G127, only the rear surface of sheet image SHT1 (second page) is enlarged and displayed.
FIG. 30 is a diagram showing a screen G128 in which the head and tail of the rear surface of the sheet image SHT1 is changed.
When the user pushes the head and tail changing button 121 c in the screen G127 shown in FIG. 29( c), as shown in FIG. 30, a preview image in which the head and tail of the rear surface of the sheet image SHT1 is changed is shown.
Next, referring to FIGS. 31 through 38, processes for designating the page turning direction are described. A case is described. In this case, first, the user selects the both-side printing and the document aggregation, and after this, the staple position is selected.
FIG. 31 is a diagram showing screens of a preview image in which the staple position is determined by designating the page turning direction. In FIG. 31, after the user selects the both-side printing and the document aggregation, when the user pushes the staple button 100 b, a screen G201 is displayed. In the message region 100 a of the screen G201, a message, for example, “DESIGNATE PAGE TURNING DIRECTION BY DRAG ON SCREEN” is displayed.
When the user drags in a direction “a5” (from lower to upper direction), a screen G202 is displayed. In the screen G202, the staple marks STPL21 and STPL22 are displayed along the upper side of the sheet image SHT1. In addition, in the message region 100 a of the screen G202, a message, for example, “PUSH ENTER BUTTON” is displayed.
When the user pushes an enter button 220 f, the sheet image SHT1 is determined as the preview image for printing.
Next, processes for designating the page turning direction on the sheet image SHT1 are described. FIG. 32 is a diagram showing processes for designating the page turning direction.
In FIG. 32( a), the page turning direction is designated to be a direction facing the staple marks STPL21 and STPL22 (from lower to upper positions). That is, when the user drags on the screen G220 in a direction “a7”, as shown in FIG. 32( a), the sheet image SHT1 is started to be turned. FIG. 33 is a diagram showing screens in which the sheet image SHT1 is turned.
As shown in FIG. 32( b), when the user drags on the screen G220 in a direction “a8” (from left to right direction), a warning screen 223 a is shown in the screen G220 of FIG. 32( c). In FIG. 32(c), in the warning screen 223 a, a message, for example, “WARNING! DOCUMENT CANNOT BE TURNED IN DESIGNATED DIRECTION” is displayed. The user pushes an enter button 223 f and designates again a page turning direction.
Referring to FIG. 33, turning the sheet image SHT1 is described. In FIG. 33, the turning progress is displayed as frames of moving images. In FIG. 33( a), in the screen G221, the sheet image SHT1 is started to be turned. In FIG. 33( b), in a screen G222, the rear surface of the sheet image SHT1 (second page) and the front surface of the sheet image SHT2 (third page) are started to be displayed. In FIG. 33( c), in a screen G223, the rear surface of the sheet image SHT1 (second page) has been almost displayed.
Then, as shown in FIG. 34, when the sheet image SHT1 has been completely turned, the rear surface of the sheet image SHT1 (second page) is displayed. FIG. 34 is a diagram showing a screen G224 in which the rear surface of the sheet image SHT1 (second page) is displayed.
FIG. 35 is a diagram showing the screen G224 in which a process returning to previous pages is shown. When the user drags on the screen G224 in a direction “a9” from the lower position to the upper position which direction is reverse to the page turning direction, the screen is sequentially returned from G224 to G223, G222, G221 (FIG. 33), and G220 (FIG. 32). That is, the screen is reversely turned.
FIG. 36 is a diagram showing a screen G225 in which the sheet image SHT2 is shown. When the user pushes the reverse button 121 b on the screen G224 shown in FIG. 35, the screen G225 shown in FIG. 36 is displayed. In the screen G225, the front surface of the sheet image SHT2 (third page) is shown as a preview image. That is, in the sheet image SHT2, ninth through twelfth document images are shown.
When the user pushes the development view button 121 a on the screen G225, a screen flow (processes) shown in FIG. 37 is executed. FIG. 37 is a diagram showing processes to display a development view.
In FIG. 37( a), in a screen G226, the sheet images SHT1 and SHT2 are bound by the staple marks STPL21 and STPL22. In the message region 100 a in the screen G226, a message, for example, “CLICK DESIRABLE PAGE, THEN IMAGE OF CLICKED PAGE IS DISPLAYED, PUSH ENTER BUTTON”.
For example, when the user clicks the screen G226 at a point “29 p” in FIG. 37( b), as shown in FIG. 37( c), in a screen G227, only the rear surface of sheet image SHT1 (second page) is enlarged and displayed.
When the user pushes the head and tail changing button 121 c on the screen G227, a preview image shown in FIG. 38( a) or 38(b) in which the head and tail of the rear surface of the sheet image SHT1 are reversed is shown in a screen G228 a or G228 b.
FIG. 38 is a diagram showing screens in which the head and tail of the rear surface of the sheet image SHT1 are reversed.
In FIG. 38( a), on the screen G228 a, the head and tail of each image in the SHT1 are reversed. That is, the head and tail of the images in the rear surface of the sheet image SHT1 are reversed. In FIG. 38( b), on the screen G228 b, the positions of the staple marks STPL21 and STPL22 are only reversed.
Next, processes in which a processing condition is determined before reading a document are described. FIG. 39 is a diagram showing processes (screen flow) in which a processing condition is determined before reading a document. In FIG. 39, on a screen G300, a processing condition is determined before reading a document.
In the message region 100 a on the screen G300, a message, for example, “PUSH ENTER WHEN ORDER IS SUITABLE, PUSH PREFERABLE ARRANGEMENT BUTTON WHEN ORDER IS TO BE CHANGED” is displayed.
When the user desires to change the arrangement order of documents, the user pushes one of the buttons in the document arrangement candidate 114. On the screen G300, the order is shown by numbers 1, 2, 3, and 4 on the sheet image SFT1. When the user pushes an enter button 300 f, the image processing apparatus 1 reads a first document. As shown in a screen G301, a first document image IMG1 is displayed at the position of “1” on the sheet image SHT1.
When the image processing apparatus 1 reads a second document, as shown in a screen G302, a second document image IMG2 is displayed at the position of “2” on the sheet image SHT1. When the image processing apparatus 1 reads a third document, as shown in a screen G303, a third document image IMG3 is displayed at the position of “3” on the sheet image SHT1. In addition, when the image processing apparatus 1 reads a fourth document, as shown in a screen G304, a fourth document image IMG4 is displayed at the position of “4” on the sheet image SHT1.
Next, a staple position adjusting method is described. When a document image exists at a staple position, the staple position must be adjusted. FIG. 40 is a diagram showing processes (screen flow) for adjusting a staple position.
On a screen G401 of FIG. 40, when the staple marks STPL21 and STPL22 are designated to overlap the document image IMG1 and/or the document image IMG2, a warning screen 420 having a message, for example, “WARNING! IMAGE EXISTS AT DESIGNATED STAPLE POSITION” is displayed. The warning screen 420 includes a staple position adjusting button 420 e, a document image position adjusting button 420 f, a document image reducing button 420 g, and a non-adjustment button 420 h in which the current staple positions are used.
When the user finely adjusts the positions of the staple mark STPL21 and/or the staple mark STPL22, the user selects one of the buttons 420 e, 420 f, and 420 g. When the user does not adjust the positions of the staple mark STPL21 and/or the staple mark STPL22, the user pushes the button 420 h.
FIG. 41 is a diagram showing a screen G402 in which the staple position is adjusted. When the user pushes the button 402 e, the screen G402 shown in FIG. 41 is displayed. In the message region 100 a on the screen G402, a message, for example, “STAPLE POSITION IS ADJUSTED” is displayed, and staple position adjustment 410 is displayed.
The staple position adjustment 410 includes a vertical adjustment button 410 a for vertically adjusting the staple position and a horizontal adjustment button 410 b for horizontally adjusting the staple position.
The user adjusts the positions of the staple marks STPL21 and STPL22 by using the buttons 410 a and 410 b. When the user determines the positions of the staple marks STPL21 and STPL22, the user pushes an enter button 220 f.
The image processing apparatus 1 again determines whether the staple position overlaps the document image IMG1 and/or IMG2. When the staple position overlaps the document image IMG1 and/or IMG2, the image processing apparatus 1 again displays the warning screen 420.
In the preview image displaying region 100 e, the staple positions before adjustment are shown by broken line marks C21 and C22 on the sheet image SHT1. Therefore, the user can use the buttons 410 a and 410 b by viewing the screen G402.
FIG. 42 is a diagram showing a screen G403 in which the document image position is adjusted. When the user pushes the button 402 f shown in FIG. 40, the screen G403 shown in FIG. 42 is displayed. In the message region 100 a on the screen G403, a message, for example, “DOCUMENT IMAGE POSITION IS ADJUSTED, INPUT FIGURE” is displayed, and document image position adjustment 420 is displayed.
The document image position adjustment 420 includes a vertical adjustment button 420 a for vertically adjusting the document image position and a horizontal adjustment button 420 b for horizontally adjusting the document image position.
The user adjusts the positions of the document images IMG1 through IMG4 by using the buttons 420 a and 420 b. When the user determines the positions of the document images IMG1 through IMG4, the user pushes the enter button 220 f.
The image processing apparatus 1 again determines whether the staple position overlaps the document image IMG1 and/or IMG2. When the staple position overlaps the document image IMG1 and/or IMG2, the image processing apparatus 1 again displays the warning screen 420.
In the preview image displaying region 100 e, the document image positions before adjustment are shown by broken line marks D1 through D4. Therefore, the user can use the buttons 420 a and 420 b by viewing the screen G403.
FIG. 43 is a diagram showing a screen G404 in which the document image is reduced. When the user pushes the button 402 g, the screen G404 shown in FIG. 43 is displayed. In the message region 100 a on the screen G404, a message, for example, “DOCUMENT IMAGE IS REDUCED” is displayed, and reduction adjustment 430 is displayed.
The reduction adjustment 430 includes a scale factor button 430 a.
The user reduces the sizes of the document images IMG1 through IMG4 by using the buttons 430 a. When the user determines the scale factor of the document images IMG1 through IMG4, the user pushes the enter button 220 f.
The image processing apparatus 1 again determines whether the staple position overlaps the document image IMG1 and/or IMG2. When the staple position overlaps the document image IMG1 and/or IMG2, the image processing apparatus 1 again displays the warning screen 420.
In the preview image displaying region 100 e, the sizes of the document images IMG1 through IMG4 before reduction are shown by broken line marks M1 through M4. Therefore, the user can use the button 430 a by viewing the screen G404.
As described above, in order that a staple position does not overlap a document image, the user can adjust the staple position, the document image position, or can reduce the size of the document image by viewing the preview image displaying screen 100 e. In addition, the user can combine the above adjustments (reduction). That is, a finishing process can be applied to the preview image. The finishing process includes a stapling process and a punching process.
In the staple position adjusting processes shown in FIGS. 41 through 43, the adjustment (reduction) can be applied to total pages of a document, only a page designated by a user, or a two-page spread. That is, the user may select the adjustment (reduction).
The above staple position adjustment can be applied to punch position adjustment.
FIG. 44 is a flowchart showing processes to adjust an overlap position where a binding position of documents overlaps an image. That is, an overlap position is found where the staple position and/or the punch position overlaps an image.
First, a user designates a binding position of documents (S31). The image processing apparatus 1 searches for a position where the binding position overlaps an image (S32). In this case, a binding margin can be considered.
The image processing apparatus 1 determines whether the binding position overlaps the image based on the searched result (S33). When the binding position does not overlap the image (NO in S33), the process ends.
When the binding position overlaps the image (YES in S33), the image processing apparatus 1 displays a warning (S34). The image processing apparatus 1 determines whether a user adjusts the binding position (S35). When the user adjusts the binding position (YES in S35), a button for adjusting the binding position is displayed (S36). Then the process returns to S31, and the processes on and after S31 are repeated.
When the user does not adjust the binding position (NO in S35), the process ends.
The above processes for adjusting the overlap position where the binding position of the document overlaps the image can be executed in S12 shown in FIG. 17 or in S18 shown in FIG. 17 before a preview image is displayed when the staple position and/or the punch position is designated. That is, in S12, the processing condition is designated before the scanner 12 reads the document, and in S18, the processing condition is designated after the scanner 12 reads the document.
Next, timings of processes based on a processing condition in the image processing apparatus 1 are described. Referring to FIGS. 45 through 61, the timings of the processes are described. The processes in S13, S14, and S15 shown in FIG. 17 are realized in parallel based on a processing condition designated by the user. Each line of a document image read by the scanner 12 is stored in the PCI memory 79 b, and after this, one band of the document image having predetermined number of lines is processed. The document images read by the scanner 12 are shown by the IMG1, the IMG2, the IMG3, the IMG4 . . . .
FIG. 45 is a timing chart of a normal operation for displaying a preview image. FIG. 46 is a diagram showing a flow for displaying a preview image in the normal operation. Referring to FIGS. 45 and 46, the normal operation for displaying a preview image based on an initial processing condition is described.
In FIG. 45, the interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines. The HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
Each time when the one band image is stored in the expansion memory 67 a, the display synthesis processing section 82 a synthesizes the one band images to form the document images IMG1 and IMG2. The LCD controller 85 displays the document image IMG1 in the order of band images L1, L2, L3, L4, and L5. The band images L1 through L5 are almost simultaneously displayed. Since the display synthesis processing section 82 a stores the document image IMG2, the document image IMG2 can be simultaneously displayed when the page is turned. As shown in FIG. 46, the document image is displayed in the order of band images L1, L2, L3, L4, and L5.
FIG. 47 is a timing chart for displaying a preview image when a rotation method is designated in a processing condition. FIG. 48 is a diagram showing the document images IMG1 when the image is read and displayed by being applied a rotation method. Referring to FIGS. 47 and 48, an operation is described in which the rotation method is designated in the processing condition for displaying a preview image.
When a user selects one of the buttons in the rotation method selecting button 172 on the screen G100 and pushes the OK button 172 f in FIG. 19, a preview image is rotated.
In FIG. 47, signals of the document images IMG1, IMG2, and IMG3 read by the scanner 12 are instantly stored in the PCI memory 79 b. In addition, the HDD 68 sequentially stores the document images IMG1, IMG2, and IMG3 based on an image transfer clock generated by the scanner 12.
When the rotation method is designated, the interrupt processing section 79 c generates an interrupt signal each time when one of the document images IMG1, IMG2, and IMG3 is stored in the HDD 68. The image synthesis processing section 41 b instantly stores the document images IMG1, IMG2, and IMG3 by rotating the images in the expansion memory 67 a based on the interrupt signal.
Each time when the one band image is stored in the expansion memory 67 a, the display synthesis processing section 82 a synthesizes the one band images to form the document images IMG1, IMG2, and IMG3. The LCD controller 85 displays the document images IMG1, IMG2, and IMG3 in this order on the LCD panel 90. The document images IMG1, IMG2, and IMG3 are almost simultaneously displayed. As shown in FIG. 48, the document image IMG1 is vertically read and horizontally displayed.
FIG. 49 is a timing chart for displaying a preview image when page turning is designated by a drag of a user. Referring to FIG. 49, an operation is described in which the page turning is designated by a drag of a user on the preview image displaying region 10 e. In FIG. 49, signals of the document images IMG1, IMG2, and IMG3 read by the scanner 12 are instantly stored in the PCI memory 79 b.
The interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines. The HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
Each time when the one band image is stored in the expansion memory 67 a, the display synthesis processing section 82 a synthesizes the one band images to form the document images IMG1 and IMG2. The LCD controller 85 displays the document image IMG1 in the order of band images L1, L2, L3, L4, and L5. The band images L1 through L5 are almost simultaneously displayed. The processes described above are almost the same as those shown in the normal operation in FIG. 45.
When the user designates to turn the document image IGM1 to a next document image (IMG2) by a drag on a screen, the LCD controller 85 displays the document image IMG2 in the order of band images L1, L2, L3, L4, and L5. When the document image IMG2 is displayed, the display synthesis processing section 82 a synthesizes the band images to form a next document image (the document image IMG3).
When the user designates to turn the document image IGM2, the document image IMG3 is displayed. When the user designates to turn the document image IGM3 to a previous document image, the document image IMG2 is displayed. With this, the document image of a previous page or a next page can be easily displayed.
FIG. 50 is a timing chart for displaying a preview image when automatic page turning is designated by a user. Referring to FIG. 50, an operation is described in which the automatic page turning is designated by pushing the automatic page turning button 180 shown in FIG. 18 or an instruction on the image processing apparatus 1. In FIG. 50, signals of the document images IMG1, IMG2, IMG3, and IMG4 read by the scanner 12 are instantly stored in the PCI memory 79 b.
The interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines. The HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
Each time when the one band images of a document image are stored in the expansion memory 67 a, the display synthesis processing section 82 a synthesizes the one band images to form the document image IMG1; after synthesizing the one band images of the document image IMG1, the one band images of the document image IMG2 are synthesized. The above processes are continued to synthesize the one band images to form the document image IMG4. The LCD controller 85 displays the document image IMG1 in the order of band images L1, L2, L3, L4, and L5, after displaying the document image IMG1, the document image IMG2 is displayed. The above processes are continued to display the document image IMG4. The band images L1 through L5 are almost simultaneously displayed.
Since the document images IMG2 through IMG4 are displayed after displaying the document image IMG1 and after synthesizing the one band images thereof, the document image IMG1 is displayed longer than the document images IMG2 through IMG4. Therefore, the user can watch the document image IMG1 for a long time.
Next, referring to FIGS. 51 through 58, cases are described. In the cases, a preview image is displayed by aggregating two or more document images into one page. For example, when four document images are aggregated into one page, the sizes of the four document images are reduced. When an enlarged document image is reduced, the image quality is degraded; therefore, it is preferable that the original document image be reduced. Therefore, as shown in the data flow of FIG. 11, the original document image stored in the HDD 68 is used.
First, referring to FIGS. 51 through 55, a first displaying method is described in which four document images are aggregated into one page. FIG. 51 is a first timing chart in which a preview image is displayed by aggregating four document images into one page. In FIG. 51, signals of the document images IMG1, IMG2, IMG3, and IMG4 read by the scanner 12 are instantly stored in the PCI memory 79 b. In addition, the signals of the document images IMG1, IMG2, IMG3, and IMG4 are sequentially stored in the HDD 68 based on an image transfer clock generated at each time when an image of one band having the predetermined number of lines is read.
The interrupt processing section 79 c calculates interrupt timing from a reducing factor designated by a processing condition. When the size of a document image is to be reduced, since the original document image is read from the HDD 68 by thinning (not reading all) data thereof, the reading speed is higher than the writing speed to the HDD 68. Therefore, the interrupt timing is determined by a predetermined algorithm with the consideration of the writing speed. For example, in a four document image aggregation, each document image, IMG1, IMG2, IMG3, or IMG4 is reduced to ¼ size, and the reading speed is four times higher than the writing speed due to the thinning. Therefore, the interrupt timing is the time when 75% of the document image IMG1 is written in the HDD 68.
The interrupt processing section 79 c generates an interrupt signal at the calculated interrupt timing. The image synthesis processing section 41 b sequentially reads the document images IMG1 through IMG4 based on the reading speed of the reducing factor while instantly storing the document images IMG1 through IMG4 in the expansion memory 67 a.
Each time when the one band image of the reduced document image is stored in the expansion memory 67 a, the display synthesis processing section 82 a synthesizes the reduced document images IMG1 through IMG4 to form display images. The LCD controller 85 sequentially displays the reduced document images IMG1 through IMG4 on the LCD panel 90 in one sheet region. The reduced document images IMG1 through IMG4 are instantly displayed. In the LCD controller 85 of FIG. 51, the displaying timings of the reduced document images IMG1 through IMG4 on one sheet in the order of upper left, upper right, lower left, and lower right positions are shown.
Referring to FIGS. 52 through 55, screen flows by the displaying timings are described. FIG. 52 is a diagram showing a first screen flow in which a preview image having the four reduced document images is displayed. FIG. 53 is a diagram showing a second screen flow in which a preview image having the four reduced document images is displayed. FIG. 54 is a diagram showing a third screen flow in which a preview image having the four reduced document images is displayed. FIG. 55 is a diagram showing a fourth screen flow in which a preview image having the four reduced document images is displayed. The screen flow for displaying a preview image of four document image aggregation is completed by connecting the screen flows shown in FIGS. 52 through 55.
In FIG. 52, first, the reduced document image IMG1 is displayed in the order of the one band images in the upper left position 1. Next, in FIG. 53, the reduced document image IMG2 is displayed in the order of the one band images in the upper right position 2, and the reduced document image IMG3 is started to display in the order of the one band images in the lower left position 3. Then, in FIG. 54, the reduced document image IMG3 is displayed in the order of the one band images in the lower left position 3, and the reduced document image IMG4 is started to display in the order of the one band images in the lower right 4. Finally, in FIG. 55, the reduced document image IMG4 is displayed in the lower right position 4. With this, a preview image of the four document image aggregation is completed.
Next, referring to FIGS. 56 and 57, a second displaying method is described in which four document images are aggregated into one page. In the second displaying method, the band images of two reduced document images are simultaneously displayed. FIG. 56 is a second timing chart in which a preview image is displayed by aggregating four document images into one page. In FIG. 56, signals of the document images IMG1, IMG2, IMG3, and IMG4 read by the scanner 12 are instantly stored in the PCI memory 79 b. In addition, the signals of the document images IMG1, IMG2, IMG3, and IMG4 are sequentially stored in the HDD 68 based on an image transfer clock generated at each time when an image of one band having the predetermined number of lines is read.
The interrupt processing section 79 c calculates interrupt timing from a reducing factor designated by a processing condition. The calculation method of the interrupt timing is the same as that in the first displaying method described above.
The interrupt processing section 79 c generates an interrupt signal based on the calculated interrupt timing. The image synthesis processing section 41 b sequentially reads the document images IMG1 through IMG4 based on the reading speed of the reducing factor of the four document image aggregation while instantly storing the document images IMG1 through IMG4 in the expansion memory 67 a.
Each time when the one band images of the reduced document image are stored in the expansion memory 67 a, the display synthesis processing section 82 a sequentially synthesizes the reduced document images IMG1 through IMG4 to form display images. When the reduced document image IMG2 is formed, the LCD controller 85 simultaneously displays the reduced document images IMG1 and IMG2 on a predetermined region, and when the reduced document image IMG4 is formed, the LCD controller 85 simultaneously displays the reduced document images IMG3 and IMG4 on another predetermined region.
In the LCD controller 85 of FIG. 56, the displaying timing to simultaneously display the reduced document images IMG1 and IMG2 on upper half position of one sheet and the displaying timing to simultaneously display the reduced document images IMG3 and IMG4 on lower half position of the one sheet are shown.
Referring to FIG. 57, a screen flow by the displaying timings is described. FIG. 57 is a diagram showing a screen flow in which a preview image having the four reduced document images is displayed based on the second timing chart. In FIG. 57, the reduced document images IMG1 and IMG2 are simultaneously displayed in the order of the one band images in the upper half positions on one sheet. Then, the reduced document images IMG3 and IMG4 are simultaneously displayed in the order of the one band images in the lower half positions on the one sheet.
Next, referring to FIG. 58, a third displaying method is described in which two document images are aggregated into one page. In the third displaying method, the band images of two reduced document images are simultaneously displayed. FIG. 58 is a third timing chart in which a preview image is displayed by aggregating two document images into one page. In FIG. 58, signals of the document images IMG1, IMG2, IMG3, and IMG4 read by the scanner 12 are instantly stored in the PCI memory 79 b. In addition, the signals of the document images IMG1, IMG2, IMG3, and IMG4 are sequentially stored in the HDD 68 based on an image transfer clock generated at each time when an image of one band having the predetermined number of lines is read.
The interrupt processing section 79 c calculates interrupt timing from a reducing factor designated by a processing condition. The calculation method of the interrupt timing is the same as that in the first displaying method described above. However, in this case, since the reducing factor is 50%, the reading speed is twice that of the writing speed. Therefore, the interrupt timing is the time when 50% of the document image IMG1 is written in the HDD 68.
Each time when the one band images of the reduced document image are stored in the expansion memory 67 a, the display synthesis processing section 82 a sequentially synthesizes the reduced document images IMG1 through IMG4 to form display images. When the reduced document image IMG2 is formed, the LCD controller 85 simultaneously displays the reduced document images IMG1 and IMG2 on one sheet.
In FIG. 58, since the display synthesis processing section 82 a stores the synthesized reduced document images IMG3 and IMG4, when the page is turned, a next preview image formed of the reduced document images IMG3 and IMG4 can be quickly displayed.
Referring to FIGS. 59 through 61, a case is described. In this case, a preview image of a document image is displayed by attaching a staple mark to the preview image. When the user pushes the staple button 100 b on the screen G100 displaying a preview image shown in FIG. 18, the image processing apparatus 1 synthesizes a staple mark on a band image where the staple mark is to be displayed and displays a preview image having the staple mark.
In FIGS. 59 through 61, one staple mark is attached to the document image IMG1. However, when plural staple marks are attached to the document image IMG1, the same processes as those shown in FIG. 59 can be used. FIG. 59 is a timing chart showing processes to attach a staple mark on a preview image of a document image. In FIG. 59, signals of the document image IMG1 read by the scanner 12 are instantly stored in the PCI memory 79 b.
The interrupt processing section 79 c generates an interrupt signal each time when the scanner 12 reads an image of one band having the predetermined number of lines. The HDD 68 stores the one band image based on an image transfer clock, and the image synthesis processing section 41 b and the expansion memory 67 a obtain the one band image based on the interrupt signal.
Each time when the one band images are stored in the expansion memory 67 a, the display synthesis processing section 82 a synthesizes the one band images to form the document image IMG1. The LCD controller 85 displays the document image IMG1 in the order of band images L1, L2, L3, L4, and L5. The band images L1 through L5 are almost simultaneously displayed.
When the user pushes the staple button 100 b and designates the position of a staple mark in the document image IMG1 which is previewed, the display synthesis processing section 82 a synthesizes a part of the band image L1 where the staple is to be attached with a staple mark read from the symbol mark region 84 a (partial synthesis 51) and rewrites the position of the staple mark on a part of the band image where the staple mark is already positioned. Then the new staple mark position is displayed. In FIG. 59, the LCD controller 85 displays the staple mark position at a position L1′.
When the document images IMG2, IMG3, IMG4, . . . are read after reading the document image IMG1, the normal operation shown in FIG. 45 is used.
FIG. 60 is a screen flow when a staple mark is attached to a preview image. In FIG. 60, when a document image is displayed by the band images L1 through L5 and the user designates a staple position of a staple mark M31, the band image L1 is replaced by a synthesis image part 52.
When a preview image is displayed by being enlarged, as shown in FIG. 61, a part of the document image is replaced by a new image.
FIG. 61 is a diagram showing screens of preview images in which the staple position is determined. In a screen G501 shown of FIG. 61( a), on a sheet image SHT1 of a normal preview display, a staple position is determined and the staple mark L31 is displayed. In a screen G502 of FIG. 61( b), the staple position is enlarged.
As described above, according to the embodiment of the present invention, a user can determine a processing condition for printing a document image by directly operating a preview image. In addition, the user can determine the processing condition by operations such as a click and a drag. Further, the user can visually and intuitively determine the processing condition.
Moreover, according to the embodiment of the present invention, when the user touches a desirable position on a preview image, the user can designate a binding position by a staple. In addition, since the user can operate on the preview image by touching a screen and pushing a button, the operability for the user can be increased.
Further, the present invention is not limited to the specifically disclosed embodiment, and variations and modifications may be made without departing from the scope of the present invention.
The present invention is based on Japanese Priority Patent Application No. 2006-073406, filed on Mar. 16, 2006, and Japanese Priority Patent Application No. 2007-060381, filed on Mar. 9, 2007, with the Japanese Patent Office, the entire contents of which are hereby incorporated herein by reference.

Claims (19)

1. An image processing apparatus which previews a read image, comprising:
a preview image processing unit in which a user sets a processing condition for the read image by operating on the read image to generate a first preview image of a first side of a page to be printed, the processing condition including a binding condition and a double-sided printing condition; and
a displaying section configured to display the first preview image processed by the processing condition together with the setting of the processing condition, wherein
the preview image processing unit is configured to orient the first preview image according to the double-sided printing condition, the binding condition, and an orientation of a second preview image of a second side of the page to be printed.
2. The image processing apparatus as claimed in claim 1, wherein:
the preview image processing unit allows the user to apply a process to the read image to which the processing condition is to be applied and displays a processed preview image on a displaying section.
3. The image processing apparatus as claimed in claim 2, wherein:
the preview image processing unit makes the user designate a finishing process for the read image as the processing condition.
4. The image processing apparatus as claimed in claim 2, wherein:
the preview image processing unit allows the user to designate a binding position of documents of pages to be printed by dragging on the read image in a page turning direction, and displays the page turning status in a moving image.
5. The image processing apparatus as claimed in claim 4, wherein:
the preview image processing unit displays a message when the page turning direction dragged by the user on the read image does not correspond to the binding position of the documents.
6. The image processing apparatus as claimed in claim 4, wherein:
the preview image processing unit includes
a determining unit for determining whether the binding position of the documents overlaps the read image; and
a warning message displaying unit for displaying a warning message when the binding position of the documents overlaps the read image.
7. The image processing apparatus as claimed in claim 6, wherein:
the preview image processing unit displays a function button for adjusting the binding position of the documents when the binding position of the documents overlaps the read image.
8. The image processing apparatus as claimed in claim 1, wherein:
image processing timing is changed corresponding to the set processing condition.
9. The image processing apparatus as claimed in claim 8, wherein:
at least one of image synthesizing timing to form a print image and image synthesizing timing to form a preview image is changed for the read image by a scanner corresponding to the setting of the processing condition.
10. The image processing apparatus as claimed in claim 1, wherein:
the preview image processing unit is effective before and after reading an image.
11. The image processing apparatus of claim 1, wherein
the preview image processing unit is configured to orient a head and tail of the first preview image according to a head and tail orientation of the second preview image.
12. The image processing apparatus of claim 1, wherein
the displaying section is configured to display the first preview image and a third preview image of a first side of a second page to be printed according to the double-sided printing condition and the binding condition.
13. The image processing apparatus of claim 1, wherein:
the binding condition is set in the preview image processing unit to include one or more staple positions.
14. The image processing apparatus of claim 1, wherein:
the binding condition is set in the preview image processing unit to include one or more punched hole positions.
15. A preview image displaying method which previews a read image on a displaying panel in an image processing apparatus, comprising:
setting a processing condition for the read image by operating on the read image to generate a first preview image of a first side of a page to be printed, the processing condition including a binding condition and a double-sided printing condition; and
displaying the first a preview image processed by the processing condition together with the setting of the processing condition on the displaying panel; and
orienting the first preview image according to the double-sided printing condition, the binding condition, and an orientation of a second preview image of a second side of the page to be printed.
16. The preview image displaying method as claimed in claim 15, wherein:
the preview image processing step allows the user to designate a binding position of documents on the read image.
17. The preview image displaying method as claimed in claim 15, wherein:
the preview image processing step makes the user designate a finishing process for the read image as the processing condition.
18. The preview image displaying method as claimed in claim 15, wherein:
image processing timing is changed corresponding to the set processing condition.
19. The preview image displaying method as claimed in claim 15, wherein:
the preview image processing step is effective before and after reading an image.
US11/686,662 2006-03-16 2007-03-15 Image processing apparatus and preview image displaying method Active 2027-12-26 US7643187B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2006073406 2006-03-16
JP2006-073406 2006-03-16
JP2007060381A JP5030622B2 (en) 2006-03-16 2007-03-09 Image processing apparatus and preview display method
JP2007-060381 2007-03-09

Publications (2)

Publication Number Publication Date
US20070216973A1 US20070216973A1 (en) 2007-09-20
US7643187B2 true US7643187B2 (en) 2010-01-05

Family

ID=38291309

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/686,662 Active 2027-12-26 US7643187B2 (en) 2006-03-16 2007-03-15 Image processing apparatus and preview image displaying method

Country Status (3)

Country Link
US (1) US7643187B2 (en)
EP (1) EP1835715B1 (en)
JP (1) JP5030622B2 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090009788A1 (en) * 2007-07-04 2009-01-08 Yuki Mizobuchi Image processing apparatus
US20090316235A1 (en) * 2008-06-23 2009-12-24 Atsuhisa Morimoto Image processing apparatus, image forming apparatus, image processing method, and storage medium
US20100020363A1 (en) * 2008-07-25 2010-01-28 Sharp Kabushiki Kaisha Image forming apparatus
US20100023856A1 (en) * 2006-03-09 2010-01-28 Kabushiki Kaisha Toshiba Image Forming Apparatus
US20120131452A1 (en) * 2010-07-22 2012-05-24 Sharp Kabushiki Kaisha Image forming apparatus
US20130063775A1 (en) * 2011-09-08 2013-03-14 Canon Kabushiki Kaisha Image forming apparatus capable of providing actual-size preview, method of controlling the same, and storage medium
US20170282617A1 (en) * 2016-04-05 2017-10-05 Seiko Epson Corporation Printing apparatus
US20230008933A1 (en) * 2021-07-07 2023-01-12 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium
US11943408B2 (en) * 2022-01-31 2024-03-26 Brother Kogyo Kabushiki Kaisha Printing apparatus

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8098395B2 (en) * 2007-03-30 2012-01-17 Ricoh Company, Ltd System and method for image thumbnail/preview on an image processing device
JP2008209985A (en) * 2007-02-23 2008-09-11 Canon Inc Data processor, electronic document registration method and computer program
JP4849001B2 (en) * 2007-04-19 2011-12-28 コニカミノルタビジネステクノロジーズ株式会社 Image processing apparatus, image forming apparatus, and program
JP2009017019A (en) * 2007-07-02 2009-01-22 Sharp Corp Device, method and program for forming image and recording medium
US20090103114A1 (en) * 2007-10-22 2009-04-23 Ricoh Company, Ltd. Multifunction printer and method for confirming preview image
JP5542320B2 (en) 2007-12-03 2014-07-09 オセ−テクノロジーズ・ベー・ヴエー Document scanning system
JP5314887B2 (en) 2007-12-20 2013-10-16 インターナショナル・ビジネス・マシーンズ・コーポレーション Setting method of output image including image processing information and setting control program thereof
JP5438916B2 (en) * 2008-05-16 2014-03-12 京セラドキュメントソリューションズ株式会社 Image forming apparatus
CN101762998B (en) * 2008-12-24 2012-10-31 京瓷办公信息系统株式会社 Image forming apparatus and preview display method
JP4766136B2 (en) * 2009-03-19 2011-09-07 コニカミノルタビジネステクノロジーズ株式会社 Image processing apparatus, image processing method, and program
JP4943527B2 (en) * 2010-03-25 2012-05-30 シャープ株式会社 Image display operation device and image forming apparatus having the same
JP5112471B2 (en) * 2010-05-11 2013-01-09 シャープ株式会社 Image display operation device and image forming apparatus having the same
JP5031069B2 (en) * 2010-06-07 2012-09-19 シャープ株式会社 Image processing apparatus, image forming system, computer program, and image display method
JP2012015846A (en) * 2010-07-01 2012-01-19 Canon Inc Image processing apparatus, display control method, and program
JP5200065B2 (en) * 2010-07-02 2013-05-15 富士フイルム株式会社 Content distribution system, method and program
JP5601070B2 (en) * 2010-07-27 2014-10-08 コニカミノルタ株式会社 GUI mounting program, GUI mounting apparatus, and GUI mounting method
JP5192019B2 (en) * 2010-09-22 2013-05-08 シャープ株式会社 Image forming apparatus
JP5161280B2 (en) * 2010-09-27 2013-03-13 シャープ株式会社 Image display operation device and image forming apparatus having the same
JP5533790B2 (en) * 2011-06-15 2014-06-25 コニカミノルタ株式会社 Client server system provided with web application, and client device in the client server system
JP5541240B2 (en) 2011-07-12 2014-07-09 コニカミノルタ株式会社 Image forming apparatus and image processing method
CN102520855A (en) * 2011-12-03 2012-06-27 鸿富锦精密工业(深圳)有限公司 Electronic equipment with touch screen and page turning method for electronic equipment
JP6107225B2 (en) * 2012-03-12 2017-04-05 コニカミノルタ株式会社 Image processing apparatus, control method for image processing apparatus, and control program
JP5668725B2 (en) 2012-06-18 2015-02-12 コニカミノルタ株式会社 Image processing apparatus, display apparatus, and program
JP5598500B2 (en) 2012-06-18 2014-10-01 コニカミノルタ株式会社 Image processing apparatus, display apparatus, and program
JP5772751B2 (en) 2012-07-30 2015-09-02 コニカミノルタ株式会社 Image processing apparatus, display apparatus, and program
JP2014071568A (en) * 2012-09-28 2014-04-21 Brother Ind Ltd Image processing program and image processing device
JP2014086836A (en) * 2012-10-23 2014-05-12 Canon Inc Image processing apparatus, control method, and program
CN102970343B (en) * 2012-10-31 2015-04-08 小米科技有限责任公司 Method and device for displaying push information
JP6071487B2 (en) * 2012-11-30 2017-02-01 キヤノン株式会社 Print control apparatus, print control method, and program
JP2015111819A (en) * 2013-10-30 2015-06-18 ブラザー工業株式会社 Reading device and image processing system
JP2015100951A (en) * 2013-11-22 2015-06-04 キヤノン株式会社 Image formation apparatus, method of controlling image formation apparatus, and program
US10136025B2 (en) * 2015-09-16 2018-11-20 Canon Kabushiki Kaisha Image processing apparatus capable of generating image, method of controlling the same, and storage medium
USD835117S1 (en) * 2016-02-18 2018-12-04 Branch Banking And Trust Company Display screen or portion thereof with graphical user interface
USD825580S1 (en) * 2016-05-27 2018-08-14 Adp, Llc Display screen or portion thereof with graphical user interface
JP6708501B2 (en) * 2016-07-08 2020-06-10 キヤノン株式会社 Printing device, printing device control method, and program
JP7129249B2 (en) * 2018-07-06 2022-09-01 キヤノン株式会社 Program, information processing device, and control method thereof
NL2021943B1 (en) * 2018-11-06 2020-05-15 Canon Production Printing Holding Bv A Method of Creating a Print Job for a Multi-Page Print Product
JP2022074347A (en) * 2020-11-04 2022-05-18 セイコーエプソン株式会社 Program, display method, and print control unit

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4871158A (en) * 1989-02-27 1989-10-03 Xerox Corporation Very high speed duplicator with finishing function
US6115510A (en) 1995-07-20 2000-09-05 Canon Kabushiki Kaisha Image processing apparatus capable of displaying image to be formed on sheet
JP2001045239A (en) 1999-08-02 2001-02-16 Canon Inc Scanner, its control method and memory medium
US20010024195A1 (en) 2000-03-21 2001-09-27 Keisuke Hayakawa Page information display method and device and storage medium storing program for displaying page information
US6473539B1 (en) * 1996-12-02 2002-10-29 Canon Kabushiki Kaisha Image processing apparatus with an image and binding positions display feature, related method, and medium
US20020186983A1 (en) 2001-06-06 2002-12-12 Hidehiko Asai Image forming apparatus, image forming method, medium for providing control program, and control program
JP2004234261A (en) 2003-01-29 2004-08-19 Ricoh Co Ltd Image reader
US20040165207A1 (en) 2002-12-27 2004-08-26 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and image processing program
US6927865B1 (en) 1999-06-23 2005-08-09 Canon Kabushiki Kaisha Information processing apparatus and method utilizing print previews, and computer-readable storage medium
US20050243371A1 (en) 2004-04-16 2005-11-03 Canon Kabushiki Kaisha Document processing apparatus and method
US20060114490A1 (en) * 2004-12-01 2006-06-01 Xerox Corporation System and method for document production visualization
US20070143671A1 (en) * 2005-12-21 2007-06-21 Xerox Corporation WYSIWYG multifunction device finishing options

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3974948B2 (en) * 1994-10-07 2007-09-12 株式会社日立製作所 Page turning display method and apparatus
GB0009129D0 (en) * 2000-04-14 2000-05-31 Picsel Technologies Limited Digital document processing
JP2004282439A (en) * 2003-03-17 2004-10-07 Kyocera Mita Corp Image forming apparatus
JP2005115683A (en) * 2003-10-08 2005-04-28 Canon Inc Print setting method and information processor
JP3894203B2 (en) * 2004-05-27 2007-03-14 コニカミノルタビジネステクノロジーズ株式会社 Display device, display system, display method, and display program
JP2006041947A (en) * 2004-07-27 2006-02-09 Ricoh Co Ltd Image-forming apparatus, image forming method, and program for executing the method by computer
JP4716695B2 (en) 2004-09-03 2011-07-06 三洋電機株式会社 Charging method
JP2007060381A (en) 2005-08-25 2007-03-08 Oki Electric Ind Co Ltd Ip telephone system for providing voice guidance

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4871158A (en) * 1989-02-27 1989-10-03 Xerox Corporation Very high speed duplicator with finishing function
US6115510A (en) 1995-07-20 2000-09-05 Canon Kabushiki Kaisha Image processing apparatus capable of displaying image to be formed on sheet
US6473539B1 (en) * 1996-12-02 2002-10-29 Canon Kabushiki Kaisha Image processing apparatus with an image and binding positions display feature, related method, and medium
US6927865B1 (en) 1999-06-23 2005-08-09 Canon Kabushiki Kaisha Information processing apparatus and method utilizing print previews, and computer-readable storage medium
JP2001045239A (en) 1999-08-02 2001-02-16 Canon Inc Scanner, its control method and memory medium
US20010024195A1 (en) 2000-03-21 2001-09-27 Keisuke Hayakawa Page information display method and device and storage medium storing program for displaying page information
US20020186983A1 (en) 2001-06-06 2002-12-12 Hidehiko Asai Image forming apparatus, image forming method, medium for providing control program, and control program
US20040165207A1 (en) 2002-12-27 2004-08-26 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and image processing program
JP2004234261A (en) 2003-01-29 2004-08-19 Ricoh Co Ltd Image reader
US20050243371A1 (en) 2004-04-16 2005-11-03 Canon Kabushiki Kaisha Document processing apparatus and method
US20060114490A1 (en) * 2004-12-01 2006-06-01 Xerox Corporation System and method for document production visualization
US20070143671A1 (en) * 2005-12-21 2007-06-21 Xerox Corporation WYSIWYG multifunction device finishing options

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8849144B2 (en) * 2006-03-09 2014-09-30 Kabushiki Kaisha Toshiba Image forming apparatus and display unit of an image forming apparatus
US20100023856A1 (en) * 2006-03-09 2010-01-28 Kabushiki Kaisha Toshiba Image Forming Apparatus
US8054480B2 (en) * 2007-07-04 2011-11-08 Sharp Kabushiki Kaisha Image processing apparatus
US20090009788A1 (en) * 2007-07-04 2009-01-08 Yuki Mizobuchi Image processing apparatus
US8537443B2 (en) 2008-06-23 2013-09-17 Sharp Kabushiki Kaisha Image processing apparatus, image forming apparatus, image processing method, and storage medium
US20090316235A1 (en) * 2008-06-23 2009-12-24 Atsuhisa Morimoto Image processing apparatus, image forming apparatus, image processing method, and storage medium
US8310744B2 (en) * 2008-06-23 2012-11-13 Sharp Kabushiki Kaisha Image processing apparatus, image forming apparatus, image processing method, and storage medium
US20100020363A1 (en) * 2008-07-25 2010-01-28 Sharp Kabushiki Kaisha Image forming apparatus
US20120131452A1 (en) * 2010-07-22 2012-05-24 Sharp Kabushiki Kaisha Image forming apparatus
US20130063775A1 (en) * 2011-09-08 2013-03-14 Canon Kabushiki Kaisha Image forming apparatus capable of providing actual-size preview, method of controlling the same, and storage medium
US20170282617A1 (en) * 2016-04-05 2017-10-05 Seiko Epson Corporation Printing apparatus
US9862217B2 (en) * 2016-04-05 2018-01-09 Seiko Epson Corporation Printing apparatus
US20230008933A1 (en) * 2021-07-07 2023-01-12 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium
US11947787B2 (en) * 2021-07-07 2024-04-02 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium
US11943408B2 (en) * 2022-01-31 2024-03-26 Brother Kogyo Kabushiki Kaisha Printing apparatus

Also Published As

Publication number Publication date
US20070216973A1 (en) 2007-09-20
JP5030622B2 (en) 2012-09-19
EP1835715B1 (en) 2015-05-06
EP1835715A2 (en) 2007-09-19
JP2007280369A (en) 2007-10-25
EP1835715A3 (en) 2008-12-24

Similar Documents

Publication Publication Date Title
US7643187B2 (en) Image processing apparatus and preview image displaying method
JP4787779B2 (en) Image processing apparatus, program, and preview image display method
US8174709B2 (en) Image processing apparatus, computer program product, and preview image displaying method
JP4828338B2 (en) Image processing apparatus and program
US9118788B2 (en) Display device and method of controlling the same
JP4704288B2 (en) Image processing apparatus and program
JP4375578B2 (en) Image forming apparatus and setting method in image forming apparatus
JP4922021B2 (en) Image processing apparatus, program, and preview image display method
US8879114B2 (en) Image forming apparatus performing combine printing
US20110267634A1 (en) Image forming apparatus, image forming method, and computer-readable recording medium
JP2011229181A (en) Image processing apparatus and preview image displaying method
US8730499B2 (en) Image forming apparatus, control method therefor, and storage medium
CN111246043B (en) Image forming apparatus, method of controlling the same, and computer-readable storage medium
JP2008046366A (en) Image processing apparatus, image processing system and control program
JP2008229851A (en) Image processing apparatus, program, and preview image displaying method
JP6988571B2 (en) Printing equipment, printing control equipment and programs
US20200213458A1 (en) Image processing apparatus
US8958101B2 (en) Image processing apparatus, method of controlling the same, and storage medium
JP2003274147A (en) Image forming device
JP2015100951A (en) Image formation apparatus, method of controlling image formation apparatus, and program
JP2013252622A (en) Image forming device, method, and program
JP3987066B2 (en) Image forming apparatus, image forming method, and program
JP2008181272A (en) Information processor and program
JP2015005836A (en) Image editing device and image forming apparatus
KR100571918B1 (en) Method for automatical duplex printing on the smaller area of the printed paper and apparatus thereof

Legal Events

Date Code Title Description
AS Assignment

Owner name: RICOH COMPANY, LTD., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TAGAWA, YUKIO;REEL/FRAME:019282/0966

Effective date: 20070330

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12