US20030122791A1

US20030122791A1 - Kit for recording or transmitting information of a form and of a note in freehand

Info

Publication number: US20030122791A1
Application number: US10/059,901
Authority: US
Inventors: Sheldon Breiner
Original assignee: Individual
Current assignee: Individual
Priority date: 1999-05-27
Filing date: 2002-01-28
Publication date: 2003-07-03
Also published as: US20010038375A1; US6351259B2; WO2000074029A1; AU4693500A; US20020063699A1

Abstract

The invention provides for the display and storage of information of a form and a note in freehand. A computer receives a signal from a receiver including a suite of gestures and information of the note in freehand. The computer determines which of a plurality of computer-level templates corresponds to the information of the form based on the suite of gestures in the signal. The selected template is used to provide a two-dimensional layout substantially similar to the ink printed on the form. Upon selecting the template, the template is used to display an image of the freehand note on a computer display. The two-dimensional image of the freehand note and the template may also be stored in a datastore.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This is a continuation-in-part of application Ser. No. (not yet assigned), filed on Nov. 2, 2001, that is still pending, which is a continuation of Ser. No. 09/321,466 filed on May 27, 1999.[0001]

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to a kit for recording or transmitting information of a form and of a note in freehand.

2. Discussion of Related Art

Entering data in personal computers is accomplished in many ways including a keyboard, downloading from a network, insertion of a floppy disk or CD-ROM or a pointing device, or mouse.

Another way of entering data, usually by artists, is a graphics tablet, a flat board with a working surface on which a user draws with a special purpose pen-like stylus to create special effects on the computer screen.

When a keyboard is used to enter data into a computer, a program or application software must be present and active to receive the data, act on the data or merely accept the data. If one wants to enter simple data of the kind one normally writes on a desk pad, keyboard entry is not practical. Moreover, most persons prefer to write short notes rather than entering them into a computer via a keyboard or a special purpose stylus on the plastic surface of a graphics tablet. That is why one finds a pen and paper on practically every desk.

A popular mans of writing notes is the use of a pen and sticky notes, called Post-it™ notes, which can be found on most desks at home and the office. Information on these notes is of interest to the user for a variety of home and office purposes such as telephone numbers, appointments or specific instructions to others or to oneself to take some sort of action. Most persons feel very comfortable writing something down on a piece of paper, particularly when recording a quick thought, while speaking on the telephone or to another person nearby or recording small bits of information.

In today's computer-dependent society, however, that same person will very probably wish to enter the information into his/her computer for a variety of critical purposes. Among these is to save the information for later recall; sending the information to another person in the office or in another city; verifying, or attaching, a signature; or sending a sketch or doodle.

Combining the ubiquitous sticky notes with modern electronics and the Internet would be a very useful way of solving the problems of saving and sending information, in a very friendly, practical and inexpensive manner.

SUMMARY OF THE INVENTION

The invention provides a kit for recording or transmitting information of a form and a note in freehand. The kit includes a plurality of forms and a unit for relaying information of one of the forms and a note in freehand created on that form. The unit includes a pad having a surface on which a form of the plurality of forms can be positioned. The pad includes a housing, and secured to the housing, a positioned sensor, a signal converter, and a transmitter. The positioned sensor takes the position of a writing instrument when the form is located on the surface and the writing instrument is used to create a suite of gestures on the form indicating the desire to provide display or store an image of the form and information of the note in freehand. The signal converter receives the suite of gestures and the information of note in freehand from the position sensor and converts the information to a signal. The transmitter receives the signal from the signal converter and transmits the signal to a remote location.

The invention also provides for a computer receiving the signal from a receiver. The computer determines which of a plurality of computer-level templates corresponds to the form based on the suite of gestures. The template is used to provide a two-dimensional layout substantially similar to the ink printed on the form. Upon selecting the template, the template is used to display an image of the freehand note on a computer display. The two-dimensional image of the freehand note and the template may also be stored in a datastore.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention is further described by way of example with reference to the accompanying drawings wherein: [0013]
FIG. 1 is a plan view of a kit, for recording a note in freehand, according to an embodiment of the invention; [0014]
FIG. 2 is a plan view of a notesheet forming part of the kit; [0015]
FIG. 3 is a bottom view of the notesheet; [0016]
FIG. 4 is a side view of a stack of the notesheets of FIG. 2 and FIG. 3; [0017]
FIG. 5 is a perspective view of a desk unit forming part of the kit; [0018]
FIG. 6 is a sectioned side view of the desk unit; [0019]
FIG. 7 is a block diagram of components forming part of the desk unit; [0020]
FIG. 8 is a block diagram of a receiver/connector assembly for receiving information from the desk unit, and a computer to which the receiver/connector assembly is connected; [0021]
FIG. 9 is a visual representation of a program which is stored on a CD-ROM or other computer readable medium forming part of the kit; [0022]
FIG. 10 is a block diagram of the computer of FIG. 8; [0023]
FIG. 11 is a flow chart illustrating the respective steps which a user goes through while creating a note in freehand on one of the notesheets; [0024]
FIG. 12[0025] a is a plan view of one of the notesheets when a tip of a writing instrument is just used to contact the notesheet;
FIG. 12[0026] b is a plan view of a graphics tablet of the desk unit on which the notesheet is located, illustrating where the graphics tablet detects the location and pressure of the writing tip of the writing instrument;
FIG. 12[0027] c is a table illustrating information received by the computer when the writing tip is as shown in FIG. 12a;
FIG. 12[0028] d illustrates a graphic display on a video display of the computer when the writing tip of the writing instrument is positioned as in FIG. 12a;
FIG. 13[0029] a is a plan view of the notesheet after the user has just started a note in freehand;
FIG. 13[0030] b is a plan view of the graphics tablet, illustrating how the graphics tablet sequentially detects distinct locations of the writing tip of the writing instrument;
FIG. 13[0031] c is a table like the table in FIG. 12c which is updated with information when the writing tip is as shown in FIG. 13a;
FIG. 13[0032] d is a view similar to FIG. 13c when the user starts creating a note in freehand like the note in freehand created on the notesheet as shown in FIG. 13a;
FIG. 14[0033] a is a plan view of the notesheet after the user has created one element of the note in freehand thereon;
FIG. 14[0034] b is a plan view of the graphics tablet illustrating how the graphics tablet has sequentially detected respective positions of the writing tip of the writing instrument;
FIG. 14[0035] c is a table like the table of FIG. 13c which is updated with information of a freehand element created as shown in FIG. 14a;
FIG. 14[0036] d illustrates how the note in freehand is represented on the new note on the video display unit;
FIG. 15[0037] a is a plan view of the notesheet after the user has added another element of the note in freehand and a command element within a printed command area;
FIG. 15[0038] b is a plan view of the graphics tablet illustrating respective areas of the graphics tablet, each located directly below each one of a number of command areas of the notesheet;
FIG. 15[0039] c illustrates the display on the video display unit when the note in freehand is finally created as shown in FIG. 15a;
FIG. 16 illustrates an address book database which is updated so as to include an additional entry which is a copy of the new note created as shown in FIG. 15[0040] c after the user has created a command element within one of the command areas on the notesheet as illustrated in FIG. 15a;
FIG. 17 illustrates a command element address book located in the computer; [0041]
FIG. 18 illustrates the computer which is connected to a number of recipient computers over a network; [0042]
FIG. 19 illustrates a packet of code and information which is sent over the network to one of the recipient computers, the recipient computer depending on the network address in the command element address book of FIG. 17, and on the command element entered by the user in a selected one of the [0043] command areas 50 of the notesheet;
FIG. 20 illustrates a graphic display created by code of the packet and an engine on a recipient computer, the graphic display having elements which look like the elements of the note in freehand created on the notesheet; [0044]
FIG. 21 is a diagram of an embodiment illustrating a subsystem form selection according to an embodiment of the invention; [0045]
FIG. 22 is a flow diagram illustrating how the subsystem of FIG. 21 is implemented. [0046]

DETAILED DESCRIPTION

FIG. 1 of the accompanying drawings illustrates a [0047] kit 20 for recording a note in freehand. The kit 20 includes a container 22 and a desk unit 24, stacks of notesheets 26, a computer readable medium in the form of a CD-ROM 28, a receiver/connector assembly 30, and a writing instrument 31 such as a pen or a pencil located within the container 22.
FIG. 2 and FIG. 3 illustrate one [0048] notesheet 32 of one of the stacks 26. The notesheet 32 includes a paper writing sheet 34, ink 36 printed on a front of the writing sheet 36, and a sticky material 38 on a back of a writing sheet 34. The writing sheet has a width W and a length L. The ink 36 is located on an edge of the writing sheet 34, thus leaving enough open space 40 for creating a note in freehand of the writing sheet 34.
The [0049] ink 36 is laid out in the form of a first, second, third and fourth block 42, 44, 46 and 48 respectively. A respective command area 50 is thus defined within each block 42, 44, 46, and 48. The word “Address” is printed next to the first block 42, the word “Calendar” is printed next to the second block 44, the words “To-Do” are printed next to the third block 46, and the word “Internet” is printed next to the fourth block 48. The words printed next to the blocks 42 to 48 are command functions, each indicting a different function to be performed by a user's computer at a remote location as will be described in more detail hereinbelow.
The [0050] sticky material 38 is located in a strip on an edge on one side only of the back of the writing sheet 34. As shown in FIG. 4 the writing sheet 34 can be attached to a following writing sheet 34A by the sticky material 38. The writing sheet 34A has a sticky material 38A only on a side thereof opposing a side to which the writing sheet 34 is attached thereto. The sticky material 38A is used to attach the writing sheet 34A to a next writing sheet 34B which is similar to writing sheet 34. By attaching the writing sheets 34, 34A, 34B etc. in such a manner the stack 26 is thus in the form of a fan or a concertina.
FIG. 5 and FIG. 6 illustrate the [0051] desk unit 24 in more detail. The desk unit 24 is in the form of a desk pad 70 having a lower surface 72 which can be positioned on a desk 74. The desk pad 70 includes a housing 76 and a graphics tablet 78.
The [0052] housing 76 includes a front portion 80 and a rear portion 82.
The [0053] front portion 80 has a recess 84 having a periphery 86. The graphics tablet 78 is mounted within the recess 84 so that the periphery 86 forms an aperture through which the graphics tablet 78 is visible from above. Lines are printed or otherwise defined on the graphics table to indicate a selected area that has a width W1 and a length L1.
The [0054] rear portion 82 includes a partial enclosure 90 and a lid 92 which is pivotally secured to the partial enclosure 90 by a hinge 94. An opening 98 is formed through the lid 92.
In use, the [0055] lid 92 is opened so that one of the stacks 26 can be inserted into the partial enclosure 90. An upper one of the notesheets 32 is then partially inserted through the opening 98. The lid 92 is then closed to that the partial enclosure 90 and the lid 92 jointly define a receptacle 100 for the stack 26. The receptacle 100 has internal dimensions which are slightly larger than the stack 26 to allow for housing of the stack 26. The opening 98 is relatively narrow in one dimension when compared to the length one of the notesheets 32, and is at least as wide as one of the notesheets 32 in a cross dimension.
The [0056] notesheet 32 may be pulled out of the receptacle 100. The following notesheet 32A then follows the notesheet 32 out of the receptacle 100. The notesheet 32 is then detached from the notesheet 32A which, in turn, has a portion located externally of the receptacle 100. A weight (not shown) may be attached to the receptacle to prevent lifting of the housing 76 when the notesheets 32 and 32A are pulled out. The sticky material of the notesheet 32 remains thereon and can be used again for attaching the notesheet 32 to another surface.
The [0057] graphics tablet 78 has an upper surface 110 on which the notesheet 32 can be positioned and attached thereto. The width W1 of the selected are defined by the lines is only slightly wider than the width W of the notesheet 32, and the length L1 of the selected area is only slightly longer than the length L of the notesheet 32. The selected area also defines an orientation of how the notesheet 32 is to be located, i.e. within relatively tight tolerances. Provided that the command areas 50 are always printed at substantially the same locations on the writing sheet 34 of the notesheet 32, 32A etc. and because the notesheet 32 is located within relatively tight tolerances on the graphics tablet 78, the command areas 50 are always located over the same areas of the graphics tablet 78.
The [0058] graphics tablet 78 has an array or a matrix which senses where and when pressure is applied thereto. The graphics tablet 78 also detects how much pressure is applied thereto. When a writing instrument is thus used to create a note in freehand on the notesheet 32, pressure is applied to an area of the graphics tablet 78 directly below a writing tip of the writing instrument. Graphics tablets are known in the art. The graphics tablet may, for example, be a thread of overlying wires. When pressure is applied to the wires, the capacitancies of the wires will change. An output can be provided by the graphics tablet which, at each moment in time, provides information of where, and the magnitude of pressure which is applied thereto. Alternatively, the graphics tablet 78 may be a stack of resistive sheets separated by a perforated insulator such that, when the stack is compressed by the writing instrument, the sheets act as an orthogonal resistor bridge. Other graphics tablets may also be used.
FIG. 7 is a block diagram of the [0059] desk unit 24 including the graphics tablet 78. In addition to the graphics tablet 78, a signal converter 112 and a transmitter 114 are also mounted to the housing 76. The graphics tablet 78 provides an analog output 116 of where pressure and how much is applied thereto at each moment in time. The signal converter 112 receives the analog output 116 (and therefore also information of the note in freehand) from the graphics tablet 78. The signal converter converts the analog signal 116 to a digital signal 118. The digital signal 118 includes information of where pressure is applied to the graphics tablet 78 at that moment, and, over time, therefore also what the note in freehand created on the notesheet 32 looks like as well as the pressure applied at each point of the note in freehand.
A [0060] transmitter 114 receives the digital signal 118 from the signal converter 112 and transmits a wireless signal 120 to a remote location. The transmitter 114 is typically an infrared or radio frequency transmitter and the wireless signal 120 is typically an infrared or radio frequency signal. An advantage of a radio frequency signal is that no line of sight is required between the transmitter 114 and a receiver. Infrared transmitters are however less expensive than radio frequency transmitters and usually allow for more bandwidth. The wireless signal 120 includes information of where pressure is applied to the graphics tablet 78 at that moment and, over time, information of what the note in freehand created on the notesheet 32 looks like, and how much pressure and the moment in time of each point of the note in freehand.
FIG. 8 illustrates the receiver/[0061] connector assembly 30 which is used in combination with a computer 150. The receiver/connector assembly 30 includes a receiver 152, an extension 154, and a connector 156. One end of the extension 154 is connected to the receiver, and an opposing end of the extension 154 is connected to the connector 156. The connector 156 may be a serial port connector, a parallel port connector, a universal serial bus (USB) connector, a firewire or any other connector which can be used for interfacing with the computer 150. A receiver may, alternatively, be built into a computer. The receiver 152 is typically an infrared receiver which can receive the infrared signal 120 transmitted by the transmitter 114. The receiver 152 then provides the signal to the computer 150 via the extension 154 and to a connector 156. The computer 150 thus receives information of where and how much pressure is applied to the graphics tablet 78 at that moment, and, over time, information of what the note in freehand created on the notesheet 32 looks like and how it is created in terms of time and pressure applied.
FIG. 9 illustrates a [0062] program 170 which is stored on the CD-ROM 28. The program 170 includes display logic 172, communication logic 174, new note activation logic 176, smoothing logic 178, command function logic 180, and timing logic 182. The program 170 is loaded into the computer 150.
FIG. 10 illustrates the [0063] computer 150 in more detail. The computer 150 includes a processor 202, a main memory 204 and a static memory 205 which communicate with each other by a bus 206. The computer 150 is further shown to include a video display unit 208 e.g. a liquid crystal display (LCD). The computer 150 also includes an alpha-numeric input device 210 (e.g. a keyboard), a cursor control device 212 (e.g. a mouse), a disk drive unit 214, a signal generation device 216 (e.g. a speaker), and a network interface device 218. The CD-ROM 28 including the program 170 is inserted into the disk drive unit 214 and installed on a hard drive of the computer 150. Some instructions of the program are loaded into the computer. Once the program 170 is loaded into the computer, software 220 resides, completely or at least partially, within the main memory and/or within the processor 202. Some of the software also remains on the hard drive.
The [0064] desk unit 24 is usually located on a desk of a user. The computer 150 may be located in the general vicinity, but remotely from the desk unit. The desk unit is then used for relaying information of what a note in freehand created on one of the notesheets 32 looks like. The computer 150 receives the information, provides a display of the information, and also stores the information at different locations.
FIG. 11 illustrates how a user records a note in freehand utilizing the [0065] kit 20 hereinbefore described. In step 250 the user contacts the notesheet located on the graphics tablet with a writing tip of a writing instrument such as a pen or a pencil. In step 252 the user starts writing on the notesheet. In step 254 the user completes one element of a note in freehand on the notesheet. In step 256 the user optionally writes another element on the notesheet. In step 258 the user optionally writes a command element on one of the command areas of the notesheet. Steps 250-258 are now illustrated with reference to FIG. 12, FIG. 13, FIG. 14, and FIG. 15.
FIG. 12[0066] a illustrates the notesheet 32 which is located on the graphics tablet 78. A user contacts the notesheet 32 with a writing tip 302 of a writing instrument 304 such as a pen or a pencil. (Step 250). The writing instrument 304 may be the writing instrument 31 included in the kit 20, or may be any other writing instrument that is readily available. FIG. 12b illustrates that the graphics tablet 78 has a location 306 directly below the writing tip 302 where the graphics tablet 78 senses that pressure is applied thereto at the location 306. The graphics tablet 78 sends a signal to the computer 150 of coordinates of the location 306 and how much pressure is applied thereto at the location 306. FIG. 12c illustrates information received by the computer 156 due to the writing tip contacting the notesheet 32 as shown in FIG. 12a. The computer 150 receives the information of the location 306 at a moment in time (t1) which is when the writing tip 302 contacts the notesheet 32. The information received by the computer of the location 306 includes the coordinates (x1; y1) of the location and the amount of pressure (p1) applied at the location 306. FIG. 12d illustrates a visual display on the video display 208. The display logic 172 displays a number of notes 312 in a stack 314. The notes 312 are located visually behind one another and are organized chronologically by time of creation. Month and year separators 316 are located between the notes 312. Each month separator 316 has a respective tab 318 which indicates the month of the notes that follow. Utilizing the cursor control device 212, a user may click on the one of the tabs 318 to access the notes 316 of that month, and then click through the notes to find the note that the user is looking for. Alternatively, a user may also use other means, such as categories, to organize the notes. The category of each note may be entered utilizing block letters written on the notesheet, a keyboard or other device. The user may access a required note by searching utilizing time, block letters, or keystrokes.
The computer receives the information about the coordinates of the [0067] location 306, and adds an additional note 326 to the last note 312 of the stack 314 by first drawing a rectangular border 327 and then filling the border 327 with color such as yellow. A dot is added to the note 326 at the coordinates corresponding to the location 306. The computer 150 may provide an audible notification via the signal generation device 216, such as “beep” sound, when receiving the information relating to the location 306.
FIG. 13[0068] a illustrates the user starting to create a note in freehand on the notesheet rat 32. (Step 252). The writing tip 302 moves over the notesheet 32 to create a line 320. FIG. 13b illustrates the graphics tablet 78 again being depressed at a location 322 which is displaced from the location 306. For purposes of illustration only the locations 322 and 306 are shown, but it should be understood that the graphics tablet 78 may have detected locations between the locations 306 and 322 while the user created the line 320. Coordinates of the location 322 are again provided to the computer 150. FIG. 13c illustrates that the computer 150 now receives information of the location 322. The information of the location 322 include the moment in time (t2) when the writing tip 302 m moves over the location, the coordinates (x2, y2) of the location 322, and the pressure (p2) applied at the location 322. A line 328 is also added to the note 326 from the coordinates of the location 306 to the coordinates of the location 322, as shown in FIG. 13d.
FIG. 14[0069] a illustrates the user completing one freehand element 330 of a note in freehand on the notesheet 32. (Step 254). As shown in FIG. 14b, the graphics tablet 78 detects the position of the writing tip 302 sequentially at a number of additional locations 334. The coordinates of each location 334 are also forwarded to the computer 150 when detected. FIG. 14c illustrates the information received by the computer. For each one of the locations 334 the computer receives information regarding the moment in time (t3 . . . tn) when pressure is applied to the respective location 334, the coordinates (x3; y3 . . . xn;yn) of the respective location 334, and the pressure (p3 . . . pn) applied at the respective location 334. The smoothing logic 178 fits a smoothing curve 336 through the coordinates of the locations as shown in FIG. 14d. Smoothing curves are known in the art. The smoothing curve 336 looks the same or at least substantially the same as the element 330 on the notesheet 32. It can thus be seen that electronic versions of notes can be created with an ordinary pen or pencil.
A person may then create another [0070] freehand element 340 on the notesheet 32 as illustrated in FIG. 15a. (Step 256). The user may then utilize a user predesignated penstroke, recognized by the computer, which indicates that the note 326 is complete. A new note will then be created when the user again depresses on the graphics tablet 78. Alternatively, the timing logic 182 determines the amount of time from when the element 330 is finally completed until when the creation of the element 340 is started. Depending on the amount of time between the elements 330 and 340, the timing logic determines whether a new note should be created or not. If the amount of time is less than, for example, five minutes the timing logic determines that element 340 is part of the same note as the element 330 and adds a curve 342 on the note 326. A new note will only be created if the amount of time is more than five minutes. Alternatively a user may create a penstroke to indicate that a new note should be created. The note 326 may then have a curved border, blink, or otherwise indicate that some action should be taken such as saving the note 326 in another database or viewing the note 326 for correctness. The user may then access the note 326, change it, or save it in any desired location. It may also be possible for the user to carry out any operations on the note 326 as on the notesheet 32, which correspondingly similar reaction by the computer.
As also illustrated in FIG. 15[0071] a, the user may, additionally, write a command element 400 in one of the command areas 50. (Step 258). Because the notesheet 32 is accurately located in a selected area over the graphics tablet 78, the command element 400 will always be detected in one of four areas 402 of the graphics tablet 78. A ridge (not shown) may be located on the graphics tablet 78 to prevent or hinder a user from writing on the command areas while creating the element 340 or 330. The graphics tablet 78 provides information of the coordinates of the command element 400 to the computer 150. The computer 150 may display the command element as an element 404 on the notesheet 326. In addition, the note 326 may include fields which correspond in appearance to the areas 50 and other ink printed on the notesheet 32. More importantly is that the command function logic 180 recognizes that the command element 400 is detected within one of the areas 402, which area 402 detects the command element 400, and sometimes also what the command element 400 looks like. The use of a command element such as the command element 400 is now described in more detail. It should be noted, that, although the command elements are created on the notesheet as hereinafter described, the logic in the computer may also allow for manipulating of the computer by creating command elements on the note itself with reaction of the computer in an identical manner as hereinafter described.
FIG. 16 of the accompanying drawings illustrates an [0072] address book database 500 within the computer 150. The address book database 500 includes a number of address book entries 510. Address book databases are known in the art and can be created and accessed with known computer applications.
As shown in FIG. 15[0073] a, the user creates the command element 400 in the command area 50 with “Address” next to it. The graphics tablet 78 detects where the command element 400 is created, namely directly above one of the areas 402, and transmits the coordinates of the command element 400 to the computer 150. The command function 180 determines that the coordinates of the command element 400 respond to the command area 50 with “Address” next to it. Then, upon determination of the coordinates of the command element 400, the command function logic 180 creates a copy of the newly created note 326 and stores the copy as a new address book entry 512 in the address book database 500. The computer 150 may automatically convert the entry 512 to text, or a user may subsequently manually convert the entry 512 to text utilizing the alpha-numeric input device 210. It can thus be seen that entry of records into a database such as the address book database 500 can be done without the complications of calling special commands on a computer or following complex protocol or wait for an application to be activated. An electronic version of a hard copy is thus be created and stored and can be easily and automatically processed. The entry 512 may be stored in a buffer database for later access. Alternatively a user may type on the note 326 to designate a filing location, or separately type block letters to designate a filing location.
The [0074] address book database 500 may be viewed, utilizing a suitable application, on the video display unit 208 of the computer 150. A user will then see that there is a new address book entry 512. The user may then access the new address book entry 512 in the address book database 500. When the new address book entry 512 is opened, a note appears which is the same as the note 326 in FIG. 15c.
Similarly, a calendar database and a “To-Do” database may also be located in the [0075] computer 150. When a user creates an element on one of the areas 50 with “Calendar” or “To-Do” next to it, a copy of the note 326 will be stored in either the calendar database or the “To-Do” database. Other databases may also be designated.
The use of the [0076] command area 50 with “Internet” next to it is now described in more detail.
FIG. 17 illustrates a command [0077] element address book 520 which is stored on the computer 150. The command element address book 520 includes a number of different network command elements 522 and a number of different network addresses 524. Each network address 524 corresponds to a respective one of the network command elements 522. The network command elements 522 are freehand elements which may be preinstalled on the computer 150 or may be entered by a user when installing the program 170, perhaps by using the desk unit 24 or perhaps using block letters entered by the alpha-numeric input device 210.
A user may create a command element within the [0078] command area 50 with “Internet” next to it. The graphics tablet 78 provides the coordinates of the command element to the computer 150. In addition, the graphics tablet 78 provides information to the computer 150 of what the command element looks like. The command function logic 180 then compares the information of what the command element looks like with each one of the network command elements 522. The network command element 522 which corresponds most closely to the command element created within the area 50 with “Internet” next to it is then used to access a corresponding network address 524. For example, if a command element is created which looks more or less like an encircled “X” the third network address (Network address 3) is read from the command element address book 520.
FIG. 18 illustrates a number of computers connected in a network configuration over a [0079] network 532 such as the Internet. The computers include the computer 150 of the user, and a number of recipient computers 530. Each recipient computer 530 has a different respective network address. The computer 150 of the user sends a packet of code and information to one of the recipient computers 530. The recipient computer 530 to which the packet sent is the one with the network address which is read from the command element address book 530. For example, should the third recipient computer 530A (Recipient 3) have the third network address (Network address 3), then the packet will be sent to the third recipient computer 530A.
FIG. 19 illustrates a [0080] packet 600 which is sent to the recipient computer 530. The packet 600 includes information 610 of the note created on the notesheet. More specifically, the information includes all the information of the element 330 as represented by the table in FIG. 14c.
An [0081] engine 614 is located on the recipient computer 530. The code 612, when received on the recipient computer 530A, automatically interacts with the engine 614 to control the recipient computer 530A. FIG. 20 illustrates a video display unit 620 of the recipient computer 530A. The code 612 and the engine 614 creates a note 622 displayed on the video display unit 620 by again drawing borders and filling the borders with color. The information 610 is used to create a number of elements 624 in the note 622. The elements look the same as the note in freehand created on the notesheet 33. (See FIG. 15a).
In addition, software on the [0082] recipient computer 530A may analyze the information, including the information in the table in FIG. 14c. The note created in freehand on the notesheet 32 may, for example, be a signature. The information may be used to authenticate the signature against proof data on the recipient computer 530A. The coordinates may, for example, be authenticated against the data on the proof of the data. In addition, since each point of the note corresponds with a certain movement in time, the speed and acceleration of the writing tip 302 can be determined at each moment in time and be compared with the proof data. An amount of pressure applied at each point is also included in the information and can be prepared with the proof data.
A [0083] button 626 is also created on the notesheet 622. When the recipient clicks on the button 626, the recipient computer opens a web browser. The web browser may then automatically open an Internet website with information of a kit such as the kit 20 hereinbefore described, sales information thereof, and more code that can be used to enhance the note 622. A sending user may also select a “signature” while creating the note in free hand on the notesheet 32. Such “signature” may determine other features of the note 622, such as a border, color or inclusions such as sounds of the note 622. The user may, for example, select such a “signature” by creating a character in another command area such as one of the command areas 50.
It can thus be seen that the hardware including the [0084] desk unit 24 and the stack of notesheets 26 need not necessarily be complicated or expensive. In particular, there may be no need for providing a processor within the desk unit 24.
The use of the hardware is also relatively uncomplicated. The only functions performed by a user is to locate one of the [0085] notesheets 26 on the graphics tablet 78, creating a note in freehand on the notesheet, and, maybe, creating a command element within one of the command areas 50. Simple handwriting data can be entered into a computer without a user having to look at a screen while concentrating on another task such as speaking with someone, or without having to wait for a specific computer program to be activated.
Regardless thereof that the hardware and the use thereof are relatively uncomplicated, relatively complex functions can be performed by the software on the [0086] computer 150. These functions include sending a note over the Internet and controlling a recipient computer.
One use of a kit as herein before described is for electronically recording handwritten notes. Such a kit may also find application in other fields such as commerce. A kit may for example include standard forms by bank tellers, receptionists, medical doctors for prescriptions, or credit card verifiers. A desk unit may be included with areas indicated for positioning of the forms. The software may include a list of templates from which a user may select a template corresponding to the forms used. The templates provides for a two-dimensional layout that corresponds in appearance to the ink printed on the form. The template may also be modified or customized or the user may be able to create templates that correspond to forms that are designed and printed to requirement. A computer form can also be created which can be printed to provide a plurality of notesheets and which can form the basis of mapping command areas, recognized by the computer, to an actual notesheet that is used. [0087]
In one embodiment, information of each template created on a computer is stored in a template table to be used to display the template with the freehand notes of the handwriting on the form. The template information includes a suite of gestures that the user associates with the template and with which the template may be retrieved, as will be described. [0088]
FIG. 21 illustrates how forms can be selected in a [0089] system 900, according to an embodiment. The system 900 includes a plurality of forms 905 a-905 i, a transmitted signal 908, a template table 910, a plurality of computer level templates 920 a-920 i, and the computer display 208. FIG. 22 illustrates how the form selection is implemented. The following description illustrates the manner in which freehand notes on a form is displayed on a computer level template to be recorded, with reference to FIGS. 21 and 22.
At [0090] block 810, the user selects form 905 b from the pluralities of forms 905 a-905 i to be placed on the graphics table 78 to have a freehand note handwritten thereupon. Each of the plurality of forms 905 a-905 i has characteristics that differentiate each form. The selected form 905 b may be, for example, an Order Requisition form to be used to request supplies by handwriting the items to be ordered. As shown, the freehand note 943 of ‘Nails’ is handwritten on the selected form 905 b.
At [0091] block 820, the user selects to have a template displayed by marking a suite of gestures in the command area 941 and 942 on the selected form 905 b. Because the selected form 905 b is accurately located in selected control areas (not shown) over the graphics tablet 78, a suite of gestures could be used to indicate the computer-level template to be used to display a freehand note 943 on the computer display 208. Here, each form of the plurality of forms 905 a-905 i is associated with a specific integer designation one thru ninety-nine. Each form 905 a-905 i has a “tens” command area 941, and a “units” command area 942, with which the user selects to have any freehand note displayed on a specific template associated with the form. Form 905 b, as illustrated, shows how the user identifies the form by marking the gesture 946 in the “tens” command element 941, and the gesture 947 in the “units” command area 942. The suite of gestures becomes a unique template identifier, corresponding to the form selected, to identify a computer-level template to be displayed, as will be described.
The graphics tablet [0092] 87 then transmits and the computer 150 receives the signal 908 of information that includes the suite of gestures and the information of the freehand notes (830).
At [0093] block 840, a template to be displayed is selected from the template table 910 based on a comparison of the suite of gestures in the signal with the plurality of different computer level templates in the template table 910. The template table 910 includes a “tens” and “units” column containing the suite of gestures and a pointer to a template. Upon accessing the row in the table that corresponds or closely corresponds with the suite of gestures in the signal, the associated template is selected. Here, the suite of gestures in the signal is a unique template identifier associated to the computer level template. As shown in the template table 910, the suite of gestures ‘02’ stored in the table 910, are associated with the template 920 a; the suite of gestures ‘25’, stored in the template table 910, are associated with the template 920 b; and the suite of gestures ‘26’, stored in the template table 910, are associated with the template 920 c. It should be understood that the pointer to a template may be a pointer to template data describing the characteristics of the template.
At [0094] block 850, upon identifying the appropriate template, the computer 150 displays a two-dimensional image of the template and the note in the signal 908 on the computer display 208. The two-dimensional image is the same as a layout of the form 905 b. The freehand note 943 is displayed in the location and in the style on the template substantially similar to the coordinates and style of the freehand note on the form 905 b. The freehand note may also be in a cursive style of handwriting (e.g., a signature). The computer 150 recognizes the cursive note and displays a curve corresponding to the cursive note on the selected template in the location similar to the coordinates of the freehand note on the form.
In an alternative embodiment, the [0095] computer 150 also displays a two-dimensional image of the suite of gestures in the location on the template substantially similar to the coordinates on the form 905 b.
At [0096] block 860, an electronic representation of the selected template and freehand note are stored in a datastore. In an alternative embodiment, the electronic representation of the suite of gestures is also stored with the selected image.
It should be appreciated that handwriting on a form positioned on top of a kit, as herein before described, provides for the display and recording of an electronic copy, as well as a physical hardcopy, of the handwritten note. Standard forms used in various industries may be displayed and recorded on a template, corresponding to the form, on a remote computer display of another person nearby. The electronic recording of the form eliminates the need of personnel to manually perform data entry of the handwritten information from the form into a computer system. [0097]
It will be appreciated that that more or fewer processes may be incorporated into the method(s) illustrated in FIG. 22 without departing from the scope of the invention and that no particular order is implied by the arrangement of blocks shown and described herein. It further will be appreciated that the method(s) described in conjunction with FIG. 22 may be embodied in machine-executable instructions, e.g. software. The instructions can be used to cause a general-purpose or special-purpose processor that is programmed with the instructions to perform the operations described. Alternatively, the operations might be performed by specific hardware components that contain hardwired logic for performing the operations, or by any combination of programmed computer components and custom hardware components. The methods may be provided as a computer program product that may include a machine-readable medium having stored thereon instructions which may be used to program a computer (or other electronic devices) to perform the methods. For the purposes of this specification, the terms “machine-readable medium” shall be taken to include any medium that is capable of storing or encoding a sequence of instructions for execution by the machine and that cause the machine to perform any one of the methodologies of the present invention. The term “machine-readable medium” shall accordingly be taken to included, but not be limited to, solid-state memories, optical and magnetic disks, and carrier wave signals. Furthermore, it is common in the art to speak of software, in one form or another (e.g., program, procedure, process, application, module, logic . . . ), as taking an action or causing a result. Such expressions are merely a shorthand way of saying that execution of the software by a computer causes the processor of the computer to perform an action or a produce a result. [0098]
It should be understood that although the invention is described as providing a suite of gestures to identify a corresponding computer-level template, in alternative embodiments, other characteristics or information about the form might be used to select a template that most closely corresponds to the form. In addition, upon identifying the appropriate template, the [0099] computer 150 may display the recorded template and the notes via alternative remote output devices, such as, a printer device, a facsimile device, among other examples.
While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative and note restrictive of the current invention, and that this invention is not restricted to the specific constructions and arrangements shown and described, since modifications may occur to those ordinarily skilled in the art. [0100]

Claims

What is claimed:

1. A method comprising:

receiving a signal from a receiver, the signal including a suite of gestures and information of a freehand note, the information to describe the freehand note;

selecting a template based on a comparison of the suite of gestures with a plurality of different computer-level templates, each of the plurality of computer-level templates being differentiated from each other; and

displaying a two-dimensional image of the selected template and a curve on the image which corresponds to the freehand note.

2. The method of claim 1 further comprising displaying a two-dimensional image of the suite of gestures on the template.

3. The method of claim 1 further comprising storing the two-dimensional image of the template and a curve on the image in a datastore.

4. The method of claim 1 further comprising storing the two-dimensional image of the template and the suite of gestures on the template in a datastore.

5. The method of claim 1 wherein the freehand note is a cursive note.

6. The method of claim 5 wherein the freehand note is a signature.

7. The method of claim 1 wherein the information of the freehand note in the signal is different from the suite of gestures in the signal.

8. The method of claim 1 wherein the displaying is performed on a computer display.

9. The method of claim 1 wherein the selecting the template comprises comparing the suite of gestures from the signal with information of the plurality of different computer-level templates in a table of templates with each template having a different suite of gestures associated therewith.

10. The method of claim 9 wherein the selecting comprises accessing the template in the table that corresponds most closely with the suite of gestures.

11. The method of claim 1 wherein the signal is a wireless communications signal.

12. The method of claim 1 wherein the signal is an infrared signal.

13. The method of claim 1 wherein the signal is a radio frequency signal.

14. The method of claim 9 further comprising:

creating a new one of the plurality of templates;

providing information of the new one of the plurality of templates in the table; and

associating a new suite of gestures with the information of the new one of the plurality of templates in the table.

15. The method of claim 14 wherein the creating the new one of the plurality of templates includes a user creating the template utilizing an input device of a computer while the new one of the plurality of templates is displayed to the user.

16. The method of claim 14 wherein the associating the new suite of gestures includes a user associating the new suite of gestures utilizing an input device of a computer.

17. The method of claim 1 wherein the suite of gestures from the signal includes a number associated to one of the plurality of templates, and the selecting being based on the number.

18. The method of claim 1 wherein the suite of gestures from the signal includes a plurality of numbers associated to one of the plurality of templates, and the selecting being based on the plurality of numbers.

19. The method of claim 1 wherein the suite of gestures from the signal includes the coordinates of marks made on a form, and the selecting being based on the coordinates.

20. The method of claim 1 wherein the information of a freehand note includes the location of the freehand note on a form, and the displaying the two-dimensional image of the curve on the image includes displaying the curve substantially in the location of the f reehand note on the form.

21. The method of claim 1 wherein the suite of gestures from the signal includes information of a location of a mark made on a form, and the selecting being based on the location.

22. The method of claim 1 wherein the suite of gestures from the signal includes information of locations of a plurality of different marks made on a form, and the selecting being based on the location of each of the plurality of marks.

23. A method comprising:

receiving from a form a suite of gestures associated with the form and information of a freehand note;

converting the suite of gestures and the information of the freehand note to a signal; and

transmitting the suite of gestures in the signal to a computer to display a two-dimensional layout of a template and the freehand note.

24. The method of claim 23 further comprising storing the wherein the receiving the suite of gestures comprises converting a command element from a control area into the suite of gestures.

25. The method of claim 23 wherein the note is a cursive note.

26. The method of claim 23 wherein the information of the freehand note in the signal is different from the suite of gestures in the signal.

27. The method of claim 23 wherein the signal is a wireless communications signal.

28. The method of claim 23 wherein the signal is an infrared signal.

29. The method of claim 23 wherein the signal is a radio frequency signal.

30. The method of claim 23 wherein the suite of gestures is a number associated with the form.

31. The method of claim 23 wherein the suite of gestures is a location of a mark on the form.

32. The method of claim 23 wherein the suite of gestures being coordinates of a mark on the form, the coordinates providing information of the form.

33. The method of claim 23 wherein the suite of gestures is a signature.

34. The method of claim 23 wherein the form being from a plurality of forms.

35. A computer-implemented method comprising:

communicating with a receiver which receives a signal which is transmitted;

recognizing a transmitted suite of gestures in the signal;

comparing the transmitted suite of gestures from the signal with a number of different computer-level suite of gestures, each computer-level suite of gestures having a different computer-level template associated therewith, and selecting a selected one of the computer-level suite of gestures based on a comparison with the suite of gestures in the signal;

accessing a selected one of the different computer-level templates associated with the selected computer-level suite of gestures;

displaying a two-dimensional image of the selected template differing from form layouts corresponding the other computer-level templates;

recognizing information of a cursive note in freehand in the signal; and

displaying a two-dimensional image a curve on the image, the curve being similar to the cursive note in freehand.

36. The computer implemented method of claim 35 wherein the displaying the two-dimensional images is to display on a computer display.

37. The computer implemented method of claim 35 further comprising storing the two-dimensional images of the template and the curve in a datastore.

38. The computer implemented method of claim 35 wherein the note is a signature.

39. The computer implemented method of claim 35 wherein the signal is a wireless communications signal.

40. The computer implemented method of claim 35 wherein the signal is an infrared signal.

41. The computer implemented method of claim 35 wherein the signal is a radio frequency signal.

42. A machine-readable medium having executable instructions to cause a machine to perform a method comprising:

selecting a template based on a comparison of the suite of gestures with a plurality of different computer-level templates, each of the plurality of templates being differentiated from each other; and

displaying a two-dimensional image of the template and a curve on the image which corresponds to the freehand note.

43. The machine-readable medium of claim 42 further comprising displaying a two-dimensional image of the suite of gestures on the template.

44. The machine-readable medium of claim 42 further comprising storing the two-dimensional image of the template and a curve on the image in a datastore.

45. The machine-readable medium of claim 42 further comprising storing the two-dimensional image of the template and the suite of gestures on the template in a datastore.

46. The machine-readable medium of claim 42 where in the freehand note is a cursive note.

47. The machine-readable medium of claim 46 wherein the freehand note is a signature.

48. The machine-readable medium of claim 42 wherein the information of the freehand note in the signal is different from the suite of gestures in the signal.

49. The machine-readable medium of claim 42 wherein the displaying is performed on a computer display.

50. The machine-readable medium of claim 42 wherein the selecting the template comprises comparing the suite of gestures from the signal with information of the plurality of different computer-level templates in a table of templates with each template having a different suite of gestures associated therewith.

51. The machine-readable medium of claim 42 wherein the selecting comprises accessing a template in the table that corresponds most closely with the suite of gestures.

52. The machine-readable medium of claim 42 wherein the signal is a wireless communications signal.

53. The machine-readable medium of claim 42 wherein the signal is an infrared signal.

54. The machine-readable medium of claim 42 wherein the signal is a radio frequency signal.

55. The machine-readable medium of claim 42 further comprising:

creating a new one of the plurality of templates;

56. The machine-readable medium of claim 55 wherein the creating the new one of the plurality of templates includes a user creating the template utilizing an input device of a computer while the new one of the plurality of templates is displayed to the user.

57. The machine-readable medium of claim 55 wherein the associating the new suite of gestures includes a user associating the new suite of gestures utilizing an input device of a computer.

58. The machine-readable medium of claim 55 wherein the suite of gestures from the signal includes a number associated to one of the plurality of templates, and the selecting being based on the number.

59. The machine-readable medium of claim 42 wherein the suite of gestures from the signal includes a plurality of numbers associated to one of the plurality of templates, and the selecting being based on the plurality of numbers.

60. The machine-readable medium of claim 42 wherein the suite of gestures from the signal includes the coordinates of marks made on a form, and the selecting being based on the coordinates.

61. The machine-readable medium of claim 42 wherein the information of a freehand note includes the location of the freehand note on a form, and the displaying the two-dimensional image of the curve on the image includes displaying the curve substantially in the location of the freehand note on the form.

62. The machine-readable medium of claim 42 wherein the suite of gestures from the signal includes information of a location of a mark made on a form, and the selecting being based on the location.

63. The machine-readable medium of claim 42 wherein the suite of gestures from the signal includes information of locations a plurality of different marks made on a form, and the selecting being based on the location of each of the plurality of marks.

64. A machine-readable medium having executable instructions to cause a machine to perform a method comprising:

receiving a suite of gestures associated with a form and information of a freehand note;

65. The machine-readable medium of claim 64 further comprising storing the wherein the receiving the suite of gestures comprises converting a command element from a control area into the suite of gestures.

66. The machine-readable medium of claim 64 wherein the note is a cursive note.

67. The machine-readable medium of claim 64 wherein the information of the freehand note in the signal is different from the suite of gestures in the signal.

68. The machine-readable medium of claim 64 wherein the signal is a wireless communications signal.

69. The machine-readable medium of claim 64 wherein the signal is an infrared signal.

70. The machine-readable medium of claim 64 wherein the signal is a radio frequency signal.

71. The machine-readable medium of claim 64 wherein the suite of gestures is a number associated with the form.

72. The machine-readable medium of claim 64 wherein the suite of gestures is a location of a mark on the form.

73. The machine-readable medium of claim 64 wherein the suite of gestures being coordinates of a mark on the form, the coordinates providing information of the form.

74. The machine-readable medium of claim 64 wherein the suite of gestures is a signature.

75. The machine-readable medium of claim 64 wherein the form being from a plurality of forms.

76. A system, comprising:

a form;

a network;

a first device having a surface on which the form can be positioned, upon a user writing on the form a signal is transmitted containing a suite of gestures and information of a freehand note; and

a second device having a receiver to receive the signal via the network, the second device to select a template having an identifying characteristic corresponding to the suite of gestures, the template having a layout similar to the form, the second device displaying a two-dimensional image of the template and a curve corresponding to the freehand note.

77. The system of claim 76 wherein the form being from a plurality of forms.

78. The system of claim 77 wherein the plurality of form each include a writing sheet and ink printed on the writing sheet, the ink leaving space for writing the note in freehand.

79. The system of claim 76 wherein the template is customizable to change a location of the command area to allow for a different from having a command area at a different location to be used.

80. The system of claim 76 wherein the network is a wireless network coupling the first device to the second device.

81. The system of claim 76 wherein the signal is an infrared signal radio frequency signal.

82. The system of claim 76 wherein the signal is a radio frequency signal.

83. The system of claim 76 wherein the network is a wireless network coupling the first device to the second device.

84. A kit for recording a note in freehand, comprising:

a unit for relaying a suite of gestures and information of a note in freehand created on a form, including a pad having a surface on which the form can be positioned, the pad including a housing, and, secured to the housing, a positioned sensor detecting the position of a writing tip of a writing instrument is used to create the note in freehand and the suite of gestures on the form, and providing information of the note in freehand and the suite of gestures, a signal converter which receives the suite of gestures and the information of the note in freehand from the position sensor and converts the information and suite of gestures to a signal, and, a transmitter which receives the signal from the signal converter and transmits the signal to a remote location; and

a computer readable medium having stored thereon a program which, when executed by a processor of a user computer at the remote location is capable of:

(i) communicating with a receiver which receives the signal which is transmitted;

(ii) recognizing the suite of gestures in the signal;

(iii) comparing the transmitted suite of gestures from the signal with a number of different computer-level suite of gestures, each computer-level suite of gestures having a different computer-level template associated therewith, and selecting a selected one of the computer-level suite of gestures based on a comparison with the suite of gestures in the signal;

(iv) accessing a selected one of the different computer-level form templates associated with the selected computer-level suite of gestures;

(V) displaying a two-dimensional image of the selected template differing from form layouts corresponding the other computer-level templates;

(vi) recognizing information of a cursive note in freehand in the signal; and

(vii) displaying a two-dimensional image a curve on the image, the curve being similar to the cursive note in freehand.

85. The kit of claim 84 further comprising the program storing an electronic representation of the selected template with the cursive note in a datastore.

86. The kit of claim 84 further comprising the program displaying a two-dimensional image of the suite of gesture from the signal.

87. The kit of claim 84 wherein the displaying is performed on a computer display.

88. The kit of claim 84 further comprising a plurality of forms.

89. The kit of claim 88 wherein the plurality of forms include a writing sheet and ink printed on the writing sheet, the ink leaving space for writing the note in freehand, defining a command area to write the suite of gestures, the program recognizing that the suite of gestures is written in the command area to display the selected template.

90. The kit of claim 89 wherein at least some of the forms each include a writing sheet and ink printed on the writing sheet, the ink being laid out so that a plurality of command areas are defined thereby.

91. The kit of claim 84 wherein the transmitting of the signal includes transmitting via a wireless network signal.

92. The kit of claim 84 wherein the transmitting of the signal includes transmitting via an infrared signal.

93. The kit of claim 84 wherein the transmitting of the signal includes transmitting via a radio frequency signal.