WO2005031272A1

WO2005031272A1 - Method and computer program for reconstructing at least one activity

Info

Publication number: WO2005031272A1
Application number: PCT/FI2004/000574
Authority: WO
Inventors: Hannu Moilanen; Ville Kampman; Arttu Salovaara
Original assignee: Frwd Technologies Ltd
Priority date: 2003-10-01
Filing date: 2004-10-01
Publication date: 2005-04-07
Also published as: FI20031423A; FI118275B; FI20031423A0

Abstract

The present invention discloses a method and a computer program for reconstructing at least one activity recorded using a measurement device. Measurement data relating to at least one continuous activity is loaded into a memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement. Furthermore, the activity is reconstructed based on the loaded measurement data and displayed continuously at a desired playback speed using a plurality of graphs illustrating various values. The values may include one or more of the following: a two or three-dimensional position, a pitch angle value, a speed value, a heart rate value, an altitude value, and a pitch angle value, speed value, heart rate value and/or alitude value as a function of time or distance.

Description

METHOD AND COMPUTER PROGRAM FOR RECONSTRUCTING AT LEAST ONE ACTIVITY

FIELD OF THE INVENTION The present invention relates partly to posi- tion determining. In particular, the present invention relates to a novel and improved method and computer program product for reconstructing at least one activity, e.g. a sport activity, measured using a measuring device .

BACKGROUND OF THE INVENTION People have always been interested in how they perform in various tasks, e.g. in various sport events. Different manufacturers have provided various kinds of devices that can be used to analyze e.g. a sport event. These devices include e.g. a heart rate monitor, a wrist computer etc. Global Positioning System (GPS) provides a service in which by using a special GPS receiver posi- tion information can be acquired. The GPS uses a plurality of satellites to determine the position. There exists a plurality of known solutions that use the GPS to log a path e.g. of a sport event. Such a data logger can be afterwards connected to a computer and the performed path, e.g. a run path, can be displayed on a screen of the computer by connecting the logged position points (coordinates) . Furthermore, there exist known solutions that are able to log e.g. heart rate during an exercise. One known solution uses a combination of a wristwatch and a heart rate belt display and/or record the heart rate data. The watch can be connected to a computer after the exercise, and based on the recorded heart rate data, a heart rate curve can be displayed to the user as a function of time. What the prior art solutions do not provide is how to reconstruct and display the recorded activity, event or exercise based on the recorded data in the most: conventient and illustrative way.

SUMMARY OF THE INVENTION According to one aspect of the invention, there is provided a method for reconstructing at least one activity recorded using a measurement device, the method comprising the steps of loading measurement data relating to at least one continuous activity into a memorry, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing the activity based on the loaded measurement data; and providing a continuous activity playback on a computer screen at a desired playback speed using a plurality of graphs illustrat- ing various values relating to said activity. In one embodiment the method further comprises "the steps of loading measurement data relating to at least two different continuous activities recorded essentially in the same path into the memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least; one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing the activities based on the loaded measurement data; and providing at least two continuous activity playbacks on the computer screen simultaneously at a desired playback speed using a plurality of graphs illustrating various values relating to said activities . In one embodiment the method further comprises providing at least one continuous activity playback on the computer screen at a virtual three- dimensional landscape created based on the loaded measurement data. In one embodiment abovementioned various values comprise at least one of a two and/or three- dimensional position, a pitch angle value, a speed value, a heart rate value, an altitude value, and a pitch angle value, speed value, heart rate value and/or alitude value as a function of time or distance. In one embodiment the method further comprises determining differences between each reconstructed activity as a function of time at a desired moment of time; and displaying the differences. In one embodiment the method further com- prises changing the desired playback speed for each playback and/or during a playback. According to another aspect of the invention, there is prrovided a computer program for reconstructing at least one activity recorded using a measurement device, the computer program product comprising program code adapted to perform the steps of loading measurement data relating to at least one continuous activity into a memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing the activity based on the loaded measurement data; and providing a continuous activity playback on a computer screen at a desired playback speed using a plurality of graphs illustrating various values relating to said activity. In one embodiment the computer program further comprises program code adapted to perform the steps of loading measurement data relating to at least two different continuous activities in the same path into the memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing the activities based on the loaded measurement data; and providing at least two continuous activity playbacks on the computer screen simultaneously at a desired playback speed using a plurality of graphs illustrating various values . In one embodiment the computer program fur- ther comprises program code adapted to perform the step of providing at least one continuous activity playback on the computer screen at a virtual three- dimensional landscape created based on the loaded measurement data. In one embodiment the graphs comprise at least one of a two and/or three-dimensional position, a pitch, angle value, a speed value, a heart rate value, altitude value, and a pitch angle value, speed value, heart rate value and/or alitude value as a function of time or distance. In one embodiment the computer program further comprises program code adapted to perform the steps of determining differences between each reconstructed activity as a function of time at a desired moment of time; and displaying the differences. In one embodiment the computer program further comprises program code adapted to perform the step of changing the desired playback speed for each playback and/or during a playback. In one embodiment the computer program has bee arranged on a storage medium. The present invention has several advantages over the prior-art solutions. With the present invention a user is able to accurately and in an illustra- tive way to replay an activity or exercise. Furthermore, a user is able to arrange a comparision or com- petition between several different measurements (activities) .

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and constitute a part of this specification, illustrate embodiments of the invention and together with the description help to explain the principles of the invention. In the drawings: Figure 1 illustrates one embodiment of a possible snapshot of a window in accordance with the present invention; Figure 2 illustrates another embodiment of a possible snapshot of a window in accordance with the present invention; and Figure 3 illustrates a virtual three- dimensional animation mode in accordance with the present invention.

DETAILED DESCRIPTION OF THE INVENTION Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Figure 1 illustrates one embodiment of a possible snapshot of a window in accordance with the present invention. The illustrated window is a graphical user interface of a software program that can be used to reconstruct a measured event, e.g. a sport event. The measurement data needed to reconstruct an exercise can be obtained e.g. directly from a measurement device (downloading) or from a measurement file downloaded earlier to the computer. In this embodiment the measurement file includes a plurality of consecutive measurement point sets. Each set includes at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement. Figure 1 comprises two main graphs 10 and 12. The first graph 10 is a scaled map into which an exer- cise is plotted. The curve is plotted based on the GPS position measurements recorded with the measurement device . The second graph 12 illustrates altitude as a function of distance. In another embodiment altitude may be illustrated as a function of time. Figure 1 displays the program in a replay mode. In the replay mode, an exercise can be replayed at a desired playback speed. The playback speed is chosen using button 120, and the speed can be adjusted during a replay of a measurement. When a measurement is to be replayed, the replaying sequence starts from a starting point 122. When a play button 126 is pressed the playback is started, and indicator 116 moves along a measured path 128 according to the chosen playback speed. At the same time an indicator 118 moves along the altitude profile in graph 12 according to the chosen playback speed. There are further indicators that illustrate the exercise in a continuous manner. A meter 14 shows the current speed, a meter 16 the current heart rate, a meter 18 the current altitude, a meter 100 the current pitch angle and a meter 102 the current temperature. It must be noted that each meter is directly linked to the played back exercise. When indicators 116 and 118 move from one measured point to the next point, meters 14, 16, 18, 100 and 102 show the corresponding value on the next point . Thus a continuous and illustrative playback of the exercise is achieved. A slide control 104 can be used to find a desired point in the exercise when the playback is in a halted state. Buttons 106 can be used to choose between a two-dimensional and a three-dimensional display mode in graph 10. Also highlights of the activity may be presented on a computer screen on the special way. For example, when activity top speed is achieved, the replay may be automatically paused and a custom anima- tion may be displayed to indicate the event. Figure 2 illustrates another embodiment of a possible snapshot of a window in accordance with the present invention. The illustrated window is a graphical user interface of a software program that can be used to reconstruct a measured event, e.g. a sport event. The measurement data needed to reconstruct an exercise can be obtained e.g. directly from a measurement device (downloading) or from a measurement file downloaded earlier to the computer. In this embodiment the measurement file includes a plurality of consecutive measurement point sets. Each set includes at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement. Figure 2 comprises two main graphs 20 and 22.

The first graph 20 is a scaled map into which several exercises are plotted. The curves are plotted based on GPS position measurements logged with a measurement device. The second graph 22 illustrates altitude as a function of distance. In another embodiment altitude may be illustrated as a function of time. Figure 2 displays the program in a race mode. In the race mode, several exercises recorded at the same exercise path can be replayed at the same time at a desired playback speed. The playback speed is chosen using a button 218, and the speed can be adjusted during a replay of a measurement. The participants (different measurements) can be chosen using open buttons in a menu 28. When the measurements are to be replayed, the replaying sequence starts from a starting point 212. When a play button 216 is pressed the playback is started and indicators 220 move along measured paths 222 according to the chosen playback speed. At the same time indicators 224 move along the altitude profile in graph 22 again according to the chosen playback speed. There are further indicators that illustrate the measurements in a continuous manner. A meter 24 shows the current speeds of the competitors using separate speed indicators, and a meter 26 shows the current heart rates of the competitors (measurements) using separate speed indicators. It must be noted that each meter is directly linked to the played back exercises. When indicators 220 and 224 move from one measured point to the next point, meters 24 and 26 show the corresponding values of the next point. Thus a continuous and. illustrative playback of the exercises is achieved. A slide control 202 can be used to find a desired position of the competitors at a desired time in the exercise when the playback is in a halted state. A button 204 can be used to zoom either of the graphs 20, 22. Figure 2 further comprises a checkpoint window

26. When the update button is pressed, the software determines differences between each competitor (measurement) relative to the leader and displays the time difference between the competitors (measurements) . Figure 3 illustrates a virtual three- dimensional animation mode in accordance with the present invention. Due to the fact that the environmental and physiological data is gathered and combined, the activity replay may be presented also in virtual three-dimensional animation mode as well as in mathematical graphs. In the three-dimensional virtual animation mode, the activity is visualized for the operator like the typical animated three-dimensional computer game. By using accurate barometrical altitude measurement data combined with the GPS xy-location data, the three-dimensional virtual mode altitude graphs of the landscape may be created by using a spe- cial interpolation mathematical algorithm. Actual replay of the activity is then presented on the created virtual landscape. During the replay, the virtual athlete performs the activity according to the collected physiological, environmental and GPS data. The collected data may also be presented as numerical values on the screen during the replay. In addition, when for example the virtual runner' s heart rate increases on the uphill, the replay presents these changes by modi- fying also the virtual runner's breath inhale speed and appearance of the virtual face. Furthermore, when for example the speed increases, the virtual runner accelerates his/her speed according to the data changes. The three-dimensional virtual replay may also be played at various speeds and even backwards. In one embodiment, the computer operator may change the camera view during replay. Different camera views comprise, for example, a helicopter view, a stable or a moving tv-camera view or an athlete's view. Also, if there are more athletes on the replay at the same time, camera views may be changed from one athlete to another. The aforementioned steps and embodiments in one embodiment are implemented using a computer pro- gram that may be loaded into the memory of a computer or used directly from a storage medium, e.g. a compact disc. It is obvious to a person skilled in the art that with the advancement of technology, the basic idea of the invention may be implemented in various ways. The invention and its embodiments are thus not limited to the examples described above, instead they may vary within the scope of the claims.

Claims

CLAIMS 1. A method for reconstructing at least one activity recorded using a measurement device, c h a r a c t e r i s e d in that the method comprises : loading measurement data relating to at least one continuous activity into a memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing said activity based on said loaded measurement data; and providing a continuous activity playback on a com- puter screen at a desired playback speed using a plurality of graphs illustrating various values relating to said activity.

2. The method according to claim 1, characteri sed in that the method further comprises: loading measurement data relating to at least two different continuous activities recorded essentially in the same path into said memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing said activities based on said loaded measurement data; and providing at least two continuous activity play- backs on the computer screen simultaneously at a desired playback speed using a plurality of graphs illustrating various values relating to said activities.

3. The method according to claim 1 or 2, characterised in that providing at least one continuous activity playback on the computer screen at a virtual three-dimensional landscape created based on the loaded measurement data.

4. The method according to claim 1 or 2, characteri sed in that said various values comprise at least one of the following: a two and/or three-dimensional position; a pitch angle value; a speed value; a heart rate value; an altitude value; and a pitch angle value, speed value, heart rate value and/or alitude value as a function of time or distance .

5. The method according to claim 2, characteri s ed in that the method further comprises: determining differences between each reconstructed activity as a function of time at a desired moment of time; and displaying said differences.

6. The method according to claim 1, 2, 3, 4 or 5, characteri sed in that the method fur- ther comprises: changing the desired playback speed for each playback and/or during a playback.

7. A computer program for reconstructing at least one activity recorded using a measurement de- vice, characteri sed in that the computer program comprises program code adapted to perform the steps of: loading measurement data relating to at least one continuous activity into a memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS position measurement and an altitude measurement; reconstructing said activity based on said loaded measurement data; and providing a continuous activity playback on a computer screen at a desired playback speed using a plurality of graphs illustrating various values relating to said activity.

8. The computer program according to claim 7, characterised in the computer program further comprises program code adapted to perform the steps of: loading measurement data relating to at least two different continuous activities recorded essentially in the same path into said memory, the measurement data including at least a plurality of consecutive measurement point sets, each set including at least one heart rate measurement, a time stamp, a GPS posi- tion measurement and an altitude measurement; reconstructing said activities based on said loaded measurement data; and providing at least two continuous activity playbacks on the computer screen simultaneously at a de- sired playback speed using a plurality of graphs illustrating various values relating to said activities.

9. The computer program according to claim 7 or 8, characterised in the computer program further comprises program code adapted to perform the step of: providing at least one continuous activity playback on the computer screen at a virtual three- dimensional landscape created based on the loaded measurement data.

10. The computer program according to claim

7, 8 or 9, characterised in that said graphs comprise at least one of the following: a two and/or three-dimensional position; a pitch angle value; a speed value; a heart rate value; an altitude value; and a pitch angle value, speed value, heart rate value and/or alitude value as a function of time or distance.

11. The computer program according to claim 8, characteri sed in that the computer program further comprises program code adapted to perform the steps of: determining differences between each reconstructed as a function of time activity at a desired moment of time; and displaying said differences.

12. The computer program according to claim 7, 8, 9, 10 or 11, characterised in that in the computer program further comprises program code adapted to perform the step of: changing the desired playback speed for each playback and/or during a playback.

13. The computer program according to claim 7, 8, 9, 10, 11 or 12, characterised in that the computer program has been arranged on a storage medium.