WO2012167393A1 - Method for motion-dependent navigation in continuous data streams along visual structures - Google Patents

Method for motion-dependent navigation in continuous data streams along visual structures Download PDF

Info

Publication number
WO2012167393A1
WO2012167393A1 PCT/CH2012/000124 CH2012000124W WO2012167393A1 WO 2012167393 A1 WO2012167393 A1 WO 2012167393A1 CH 2012000124 W CH2012000124 W CH 2012000124W WO 2012167393 A1 WO2012167393 A1 WO 2012167393A1
Authority
WO
WIPO (PCT)
Prior art keywords
visual representation
sound
relative
data stream
played
Prior art date
Application number
PCT/CH2012/000124
Other languages
German (de)
French (fr)
Inventor
Markus Cslovjecsek
Original Assignee
Markus Cslovjecsek
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Markus Cslovjecsek filed Critical Markus Cslovjecsek
Publication of WO2012167393A1 publication Critical patent/WO2012167393A1/en

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/40—Rhythm
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0091—Means for obtaining special acoustic effects
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34—Indicating arrangements 
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/155—Musical effects
    • G10H2210/195—Modulation effects, i.e. smooth non-discontinuous variations over a time interval, e.g. within a note, melody or musical transition, of any sound parameter, e.g. amplitude, pitch, spectral response, playback speed
    • G10H2210/241—Scratch effects, i.e. emulating playback velocity or pitch manipulation effects normally obtained by a disc-jockey manually rotating a LP record forward and backward
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/375—Tempo or beat alterations; Music timing control
    • G10H2210/385—Speed change, i.e. variations from preestablished tempo, tempo change, e.g. faster or slower, accelerando or ritardando, without change in pitch
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
    • G10H2220/096—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith using a touch screen

Definitions

  • Body movements in particular finger gestures for controlling functions and data via touch-sensitive surfaces but also for non-contact control of devices are known.
  • the gesture-based navigation of reading systems for the visually impaired is also known: "Voice-output reading System with
  • the visual representation is a data stream, e.g. deposited a continuous soundtrack, which is flexibly connected to one or more anchors with the visual representation.
  • the method is characterized in that the stored data stream is played back relative to the movement of the finger, which means e.g. the soundtrack can be played forwards, backwards, faster and slower, but also in sections or in modified pitch.
  • the control can also be done with a pen, a mouse or another pointing device.
  • both the pointing means can move relative to the visual representation as well as the visual representation can be moved relative to the point marked by the pointing means point on the screen.
  • multiple streams can be played independently.
  • FIG. 1 Graphic
  • FIG 2 text and picture
  • FIG. 3 sequence of pictures and musical notation
  • a method on a touch screen or other environment such as an iPhone or iPad, an imaged mousepad, e-paper or laser-scanned area, for navigating in a data stream, in particular sound recording by relative movement of a pointing means, in particular a finger along one visual representation of a data stream.
  • both the pointing means relative to the visual representation and the visual representation can be moved relative to the point marked by the pointing means on the screen.
  • the visual representation is a continuous soundtrack deposited, which is flexibly connected to one or more anchors with the visual representation. This allows the visual representation to be linked to the associated data stream, e.g. Moving, enlarging, reducing and rotating a soundtrack on the screen, but also cutting, editing and recombining.
  • the audio track can be any audio recording, from the spoken word, any musical instruments and the sung song to the symphony, from the animal sound to the machine noise and thunder rumble.
  • the recording is possible via microphone, line input or directly from the internet or computer.
  • the visual representation can be any visual structure, in particular a graphic [1], an image [2] or a text [3], a series of images [4] or a musical notation [5], a certain distance on a map [8] , a score ( Figure 5), a surface texture of a material (Figure 6), a photograph ( Figure 7), or combinations thereof.
  • the visual representation can be any visual structure, in particular a graphic [1], an image [2] or a text [3], a series of images [4] or a musical notation [5], a certain distance on a map [8] , a score ( Figure 5), a surface texture of a material ( Figure 6), a photograph ( Figure 7), or combinations thereof.
  • Presentation can be both static and dynamic.
  • the relative movement of the play position to the visual structure is decisive.
  • the method is characterized in that in a sound sequence, this is played relative to the speed of the movement, which means that the tempo of the soundtrack being played is controlled by the speed of the relative finger movement.
  • the soundtrack can thus be played both forwards and backwards, as well as in whole or in sections, which means that the beginning or the end of the sound sequence at an arbitrary position, eg. in a voice recording in the middle of a word, can lie.
  • the playback speed can change the pitch proportionally, inversely proportional or disproportionately, which opens up many possibilities for creative design with the existing sound material.
  • the pitch of the played soundtrack can also remain unchanged, which is especially important when playing a piece of music.
  • the forward and Reverse playback of the soundtrack is also possible automatically.
  • the finger pressure or with Accessibility [6] any parameter, such as pitch, volume and effects can be influenced or set.
  • a cursor [7] can display the exact playback position.
  • Multiple soundtracks can be played simultaneously or synchronously.
  • the user can intuitively realize a polyphonic design, from simple polyphony, a canon to the symphony or a free sound collage.
  • the described method can also be used in combination with known methods for the reproduction of discrete data.
  • Capture, save and edit functions [9] can be used to save, import, cut, edit and recombine sequences. Individual recordings or entire compositions can be exchanged with other users via e-mail or e-platforms.

Abstract

The invention relates to a computer-based method for navigating in continuous data streams, in particular in sound recordings. In said method, data streams are played back relative to the motion of a finger, of a defined point on a screen, or of another input medium along a visual structure, specifically in accordance with direction, speed, and pressure. Thus, the sound recording is played back forward or backward and with frequency modulation relative to the speed of the motion, as with an old open reel tape or a vinyl record. By means of a method for pitch control, the change in the frequency can also be compensated.

Description

TITEL:  TITLE:
VERFAHREN ZUM BEWEGUNGS ABHÄNGIGEN NAVIGIEREN IN KONTINUIERLICHEN DATENSTRÖMEN ENTLANG VISUELLER STRUKTUREN  METHOD FOR MOVING DEPENDENT NAVIGATION IN CONTINUOUS DATA STREAMS ALONG VISUAL STRUCTURES
STAND DER TECHNIK: STATE OF THE ART:
Körperbewegungen, insbesondere Fingergesten zur Steuerung von Funktionen und Daten über berührungssensitive Oberflächen aber auch für berührungsloses Steuern von Geräten sind bekannt: Beschrieben wird z.B. "Devices, Methods, and Graphical User Interfaces for Accessibility using a Touch-Sensitive Surface" (US2010/0309147) oder eine "Method and Device for a Touchless Interface" (US2008/0048878). Bekannt ist auch die gestenbasierte Navigation von Lesesystemen für Sehbehinderte: "Voice-output reading System with Body movements, in particular finger gestures for controlling functions and data via touch-sensitive surfaces but also for non-contact control of devices are known. "Devices, Methods, and Graphical User Interfaces for Accessibility Using a Touch Sensitive Surface" (US2010 / 0309147) or a "Method and Device for a Touchless Interface" (US2008 / 0048878). The gesture-based navigation of reading systems for the visually impaired is also known: "Voice-output reading System with
Gesturebased Navigation" (US006115482 A). Gesture based navigation "(US006115482 A).
Diese Anwendungen steuern diskrete Daten an, also ein ganzes gesprochenes Wort wie in "Systeme d'aide a l'apprentissage de la lecture" (FR2840092), ein Bild, ein Dokument, eine Uhrzeit, eine Funktion oder eine diskrete Stelle in einem grösseren Datenkontinuum. In dieser Art funktioniert auch das Suchen sowie das schnelle Vor- und Rückspulen in einem  These applications control discrete data, a whole spoken word as in Systems d'aide a l'apprentissage de la lecture (FR2840092), an image, a document, a time, a function, or a discrete location in a larger data continuum , In this way, searching and fast-forwarding and rewinding work in one
Musikstück oder einer Videosequenz auf einem iPod gemäss der "Method and Apparatus for Accelerated Scrolling" (WO03/036457 A2). Piece of music or a video sequence on an iPod according to the "Method and Apparatus for Accelerated Scrolling" (WO03 / 036457 A2).
Das Navigieren in einem Datenkontinuum ist bekannt als "virtueller Phonograph"  Navigating in a data continuum is known as a "virtual phonograph"
(US2010/0318204) und wird für das bei DJ's beliebte "scratchen" beschrieben. Hier erfolgt der Output jedoch aufgrund einer Bewegung der virtuellen Schallplatte. Das Playback wird hier zwar auch relativ zur Bewegung des Fingers, allerdings aber durch den, durch den Finger bewegten Plattenteller an der Position des Tonabnehmers wiedergegeben. Die Vinylplatte oder ein anderes "sound recording medium" weist dabei keine Struktur auf, welche (US2010 / 0318204) and is described for DJ's popular "scratching". Here, however, the output is due to a movement of the virtual record. Although the playback is also reproduced here relative to the movement of the finger, but by the, moved by the finger turntable at the position of the pickup. The vinyl record or other "sound recording medium" has no structure, which
Rückschlüsse erlaubt auf den Verlauf des damit synchronisierten Playbacks. Inferences allowed on the course of the synchronized playback.
Im Patent "Musical Instrument having a Ribbed Surface" (US 7317157 B2) wird ein mechanisches Verfahren zur Erzeugung von Tönen mittels gerippter Oberflächen The patent "Musical Instrument having a Ribbed Surface" (US 7317157 B2) discloses a mechanical method for producing tones by means of ribbed surfaces
beschrieben. In der Beschreibung wird erwähnt, wie dieses Verfahren auf einem Computer- Bildschirm simuliert werden kann. Die vorliegende Erfindung unterscheidet sich dadurch, dass dieses Verfahren auf einer berührungssensitiven Oberfläche realisiert wird und dass sich sowohl der Datenstrom relativ zu einem Zeigemittel als auch das Zeigemittel relativ zum Datenstrom bewegen kann. Zudem ermöglicht das neue Verfahren die Verwendung unterschiedlicher Datenströme (z.B. Geräusche bis Sinfonien) und verschiedenster visueller Darstellungen (siehe Figuren 1-7). BESCHREIBUNG DER ERFINDUNG: described. The description mentions how this method can be simulated on a computer screen. The present invention differs in that this method is implemented on a touch-sensitive surface and that both the data stream relative to a pointing means and the pointing means can move relative to the data stream. In addition, the new method allows the use of different data streams (eg, noises to symphonies) and various visual representations (see Figures 1-7). DESCRIPTION OF THE INVENTION:
Ein Verfahren auf einem Touch-Screen zum Navigieren in einem Datenstrom, insbesondere einer Tonaufnahme durch relative Bewegung eines Zeigemittels, insbesondere eines Fingers entlang einer visuellen Darstellung des Datenstroms. Dabei ist der visuellen Darstellung ein Datenstrom, z.B. eine kontinuierliche Tonspur hinterlegt, welche mit einem oder mehreren Ankern flexibel mit der visuellen Darstellung verbunden ist. Das Verfahren ist dadurch gekennzeichnet, dass der hinterlegte Datenstrom relativ zur Bewegung des Fingers abgespielt wird, was bedeutet das z.B. die Tonspur vorwärts, rückwärts, schneller und langsamer, aber auch ausschnittweise oder in veränderter Tonhöhe abgespielt werden kann. Anstelle der Steuerung mit Fingern kann die Steuerung auch mit einem Stift, einer Maus oder einem anderen Pointing Device erfolgen. Dabei kann sich sowohl das Zeigemittel relativ zur visuellen Darstellung bewegen wie auch die visuelle Darstellung relativ zu dem durch das Zeigemittel markierten Punkt auf dem Screen bewegt werden. Bei der Verwendung von mehreren Fingern können mehrere Datenströme unabhängig voneinander abgespielt werden. A method on a touch screen for navigating in a data stream, in particular a sound recording by relative movement of a pointing means, in particular a finger along a visual representation of the data stream. Here, the visual representation is a data stream, e.g. deposited a continuous soundtrack, which is flexibly connected to one or more anchors with the visual representation. The method is characterized in that the stored data stream is played back relative to the movement of the finger, which means e.g. the soundtrack can be played forwards, backwards, faster and slower, but also in sections or in modified pitch. Instead of controlling with fingers, the control can also be done with a pen, a mouse or another pointing device. In this case, both the pointing means can move relative to the visual representation as well as the visual representation can be moved relative to the point marked by the pointing means point on the screen. When using multiple fingers, multiple streams can be played independently.
FIGURENLISTE: LIST OF FIGURES:
FIG l: Grafik FIG. 1: Graphic
FIG 2: Text und Bild  FIG 2: text and picture
FIG 3: Bilderfolge und Notenschrift  FIG. 3: sequence of pictures and musical notation
FIG 4: ein Plan  4 shows a plan
FIG 5: eine Partitur  5: a score
FIG 6: eine Oberflächenstruktur eines Materials  6 shows a surface structure of a material
FIG 7: eine Fotographie 7 shows a photograph
AUSFÜHRUNG DER ERFINDUNG: EMBODIMENT OF THE INVENTION:
Ein Verfahren auf einem Touch-Screen oder einer anderen Umgebung, wie z.B. einem iPhone oder iPad, einem bebilderten Mousepad, einem e-Papier oder einer mit Laserstrahlen abgetasteten Fläche, zum Navigieren in einem Datenstrom, insbesondere einer Tonaufnahme durch relative Bewegung eines Zeigemittels, insbesondere eines Fingers entlang einer visuellen Darstellung eines Datenstromes. Dabei kann sowohl das Zeigemittel relativ zur visuellen Darstellung wie auch die visuelle Darstellung relativ zu dem durch das Zeigemittel markierten Punkt auf dem Screen bewegt werden. A method on a touch screen or other environment, such as an iPhone or iPad, an imaged mousepad, e-paper or laser-scanned area, for navigating in a data stream, in particular sound recording by relative movement of a pointing means, in particular a finger along one visual representation of a data stream. In this case, both the pointing means relative to the visual representation and the visual representation can be moved relative to the point marked by the pointing means on the screen.
Der visuellen Darstellung ist eine kontinuierliche Tonspur hinterlegt, welche mit einem oder mehreren Ankern flexibel mit der visuellen Darstellung verbunden ist. Damit lässt sich die visuelle Darstellung mit dem verbundenen Datenstrom, z.B. einer Tonspur auf dem Screen verschieben, vergrössern, verkleinern und drehen, aber auch schneiden, editieren und neu kombinieren. The visual representation is a continuous soundtrack deposited, which is flexibly connected to one or more anchors with the visual representation. This allows the visual representation to be linked to the associated data stream, e.g. Moving, enlarging, reducing and rotating a soundtrack on the screen, but also cutting, editing and recombining.
Als Tonspur kann jede beliebige Audioaufnahme dienen, also vom gesprochenen Wort, über beliebige Musikinstrumente und das gesungene Lied bis zur Symphonie, vom Tierlaut bis zum Maschinengeräusch und Donnergrollen. Die Aufnahme ist via Mikrophon, Line-Eingang oder direkt aus dem Internet oder Computer möglich. The audio track can be any audio recording, from the spoken word, any musical instruments and the sung song to the symphony, from the animal sound to the machine noise and thunder rumble. The recording is possible via microphone, line input or directly from the internet or computer.
Die visuelle Darstellung kann jede beliebige visuelle Struktur sein, insbesondere eine Grafik [1], ein Bild [2] oder ein Text [3], eine Bilderfolge [4] oder eine Notenschrift [5], eine bestimmte Strecke auf einem Plan [8], eine Partitur (Fig.5), eine Oberflächenstruktur eines Materials (Fig.6), eine Fotographie (Fig.7) oder Kombinationen davon. Die visuelle The visual representation can be any visual structure, in particular a graphic [1], an image [2] or a text [3], a series of images [4] or a musical notation [5], a certain distance on a map [8] , a score (Figure 5), a surface texture of a material (Figure 6), a photograph (Figure 7), or combinations thereof. The visual
Darstellung kann sowohl statisch als auch dynamisch sein. Für das Abspielen der Tonspur ist die relative Bewegung der Abspielposition zur visuellen Struktur bestimmend. Presentation can be both static and dynamic. For the playback of the sound track, the relative movement of the play position to the visual structure is decisive.
Das Verfahren ist dadurch gekennzeichnet, dass bei einer Klangfolge diese relativ zum Tempo der Bewegung abgespielt wird, was bedeutet, dass das Tempo der abgespielten Tonspur durch das Tempo der relativen Fingerbewegung gesteuert wird. Abhängig von der relativen Bewegung kann die Tonspur damit sowohl vorwärts als auch rückwärts, sowie ganz oder abschnittweise abgespielt werden, das bedeutet, dass der Beginn oder das Ende der Klangfolge an einer beliebigen Stelle, also z.B. bei einer Sprachaufnahme auch mitten in einem Wort, liegen kann. The method is characterized in that in a sound sequence, this is played relative to the speed of the movement, which means that the tempo of the soundtrack being played is controlled by the speed of the relative finger movement. Depending on the relative movement, the soundtrack can thus be played both forwards and backwards, as well as in whole or in sections, which means that the beginning or the end of the sound sequence at an arbitrary position, eg. in a voice recording in the middle of a word, can lie.
Die Abspielgeschwindigkeit kann die Tonhöhe proportional, umgekehrt proportional oder überproportional verändern, was kreativem Gestalten mit dem bestehenden Tonmaterial viele Möglichkeiten eröffnet. Die Tonhöhe der abgespielten Tonspur kann aber auch unverändert bleiben, was insbesondere beim Abspielen eines Musikstückes wichtig ist. Das Vorwärts- und Rückwärtsabspielen der Tonspur ist auch automatisiert möglich. Durch die" Position des Zeigemittels, den Fingerdruck oder mit Eingabehilfen [6] können beliebige Parameter, z.B. Tonhöhe, Lautstärke und Effekte beeinflusst oder festgelegt werden. Ein Cursor [7] kann die exakte Abspielposition anzeigen. The playback speed can change the pitch proportionally, inversely proportional or disproportionately, which opens up many possibilities for creative design with the existing sound material. The pitch of the played soundtrack can also remain unchanged, which is especially important when playing a piece of music. The forward and Reverse playback of the soundtrack is also possible automatically. By the "position of the pointing means, the finger pressure or with Accessibility [6] any parameter, such as pitch, volume and effects can be influenced or set. A cursor [7] can display the exact playback position.
Mehrere Tonspuren können gleichzeitig unabhängig voneinander oder synchronisiert abgespielt werden. Damit kann intuitiv vom Anwender eine polyphone Gestaltung realisiert werden, von einfacher Mehrstimmigkeit, einem Kanon bis zur Symphonie oder einer freien Klangcollage. Das beschriebene Verfahren kann auch in Kombination mit bekannten Verfahren für die Wiedergabe von diskreten Daten eingesetzt werden. Multiple soundtracks can be played simultaneously or synchronously. Thus, the user can intuitively realize a polyphonic design, from simple polyphony, a canon to the symphony or a free sound collage. The described method can also be used in combination with known methods for the reproduction of discrete data.
Dadurch, dass bei der Verwendung einer Tonspur beliebige akustische Quellen verwendet werden können, ergeben sich Möglichkeiten aller denkbaren Klang- und The fact that when using a soundtrack any acoustic sources can be used, there are possibilities of all conceivable sound and
Geräuschkombinationen. Verbunden mit der visuellen Darstellung ergeben sich für den Anwender visuelle Erinnerungshilfen, die das kreative Spiel unterstützen. Sound combinations. Connected to the visual presentation, the user has visual reminders that support creative play.
Mit Aufnahme-, Speicher- und Editierfunktionen [9] können Sequenzen gespeichert, importiert, geschnitten, editiert und neu kombiniert werden. Einzelne Aufnahmen oder ganze Kompositionen können über Email oder via E-Plattformen mit anderen Usern ausgetauscht werden. Capture, save and edit functions [9] can be used to save, import, cut, edit and recombine sequences. Individual recordings or entire compositions can be exchanged with other users via e-mail or e-platforms.

Claims

PATENTANSPRÜCHE: CLAIMS:
Anspruch 1 : Ein Verfahren auf einem, Touch-Screen zum Navigieren in einem Datenstrom, insbesondere einer Tonaufnahme durch Bewegung eines Zeigemittels, insbesondere eines Fingers entlang einer visuellen Darstellung welcher der kontinuierliche Datenstrom, insbesondere eine Tonspur, hinterlegt ist, Claim 1: A method on a, touch screen for navigating in a data stream, in particular a sound recording by moving a pointing means, in particular a finger along a visual representation of which the continuous data stream, in particular a soundtrack, deposited
dadurch gekennzeichnet dass der Datenstrom relativ zur Zeigemittelbewegung abgespielt wird und dabei sowohl das Zeigemittel relativ zur visuellen Darstellung wie auch die visuelle Darstellung relativ zu dem durch das Zeigemittel markierten Punkt auf dem Screen bewegt werden kann. characterized in that the data stream is played relative to the Zeigentittelbewegung and both the pointing means relative to the visual representation as well as the visual representation relative to the point marked by the pointing means point on the screen can be moved.
Anspruch 2: Ein Verfahren gemäss Anspruch 1 Claim 2: A method according to claim 1
dadurch gekennzeichnet dass der Datenstrom, insbesondere eine Klangfolge, sowohl vorwärts als auch rückwärts sowie ganz oder abschnittweise abgespielt werden kann. characterized in that the data stream, in particular a sound sequence, can be played both forwards and backwards as well as completely or in sections.
Anspruch 3: Ein Verfahren gemäss den Ansprüchen 1 oder 2, Claim 3: A process according to claims 1 or 2,
dadurch gekennzeichnet dass beim Abspielen einer Klangfolge die Tonhöhe unabhängig vom Tempo der relativen Fingerbewegung oder der Abspielgeschwindigkeit erhalten bleibt. characterized in that when playing a sound sequence, the pitch is maintained regardless of the speed of the relative finger movement or the playback speed.
Anspruch 4: Ein Verfahren gemäss den Ansprüchen 1 oder 2, Claim 4: A method according to claims 1 or 2,
dadurch gekennzeichnet dass beim Abspielen einer Klangfolge das Tempo der relativen Fingerbewegung bzw. die Abspielgeschwindigkeit die Tonhöhe verändert. characterized in that when playing a sound sequence, the speed of the relative finger movement or the playback speed changes the pitch.
Anspruch 5: Ein Verfahren nach einem der Ansprüche 1-4, Claim 5: A method according to any one of claims 1-4,
dadurch gekennzeichnet dass die visuelle Darstellung jede beliebige visuelle Darstellung sein kann, insbesondere ein Bild, eine Grafik, ein Text, eine Notenschrift, ein Plan, eine Struktur, eine Fotographie oder Kombinationen davon. characterized in that the visual representation may be any visual representation, in particular an image, a graphic, a text, a notation, a plan, a structure, a photograph or combinations thereof.
Anspruch 6: Ein Verfahren nach einem der Ansprüche 1-5, Claim 6: A method according to any one of claims 1-5,
dadurch gekennzeichnet dass die Tonspur mit einem oder mehreren Ankern flexibel mit der visuellen Darstellung verbunden ist und damit die visuelle Darstellung mit der verbundenen Tonspur auf dem Screen verschiebbar, vergrösserbar, verkleinerbar und drehbar, sowie in Abschnitte zerlegbar, editierbar und neu kombinierbar ist. characterized in that the soundtrack with one or more anchors is flexibly connected to the visual representation and thus the visual representation with the associated sound track on the screen displaceable, zoomable, reducible and rotatable, as well as separable into sections, editable and can be recombined.
Anspruch 7: Ein Verfahren nach einem der Ansprüche 1-6, dadurch gekennzeichnet dass gleichzeitig mehrere Spuren unabhängig voneinander oder synchronisiert abgespielt werden können. Claim 7: A method according to any one of claims 1-6, characterized in that at the same time multiple tracks can be played independently or synchronized.
Anspruch 8: Ein Verfahren nach einem der Ansprüche 1-7, Claim 8: A method according to any one of claims 1-7,
dadurch gekennzeichnet dass als akustisches Phänomen für die Tonspur ein gesprochener Text, ein gesungener Text, eine instrumentale Melodie, ein Rhythmus, mehrere von gleichen oder unterschiedlichen Instrumenten gespielte Melodien, eine Tierstimme, ein Naturklang oder -geräusch, eine technische Klangfolge, eine Geräuschfolge oder Kombinationen davon verwendet werden kann. characterized in that as the acoustic phenomenon for the soundtrack a spoken text, a sung text, an instrumental melody, a rhythm, several melodies played by the same or different instruments, an animal voice, a nature sound or sound, a technical sound sequence, a sound sequence or combinations of which it can be used.
Anspruch 9: Computerprogrammprodukt enthaltend die Software zur Durchführung des Verfahrens nach einem der Ansprüche 1-8. Claim 9: Computer program product containing the software for performing the method according to any one of claims 1-8.
Anspruch 10: Elektronisches Gerät mit installierter Software zur Durchführung des Claim 10: Electronic device with installed software for carrying out the
Verfahrens nach einem der Ansprüche 1-8. Method according to one of claims 1-8.
PCT/CH2012/000124 2011-06-06 2012-06-05 Method for motion-dependent navigation in continuous data streams along visual structures WO2012167393A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CH00952/11A CH705069A1 (en) 2011-06-06 2011-06-06 A method of motion-dependent link in continuous data streams along visual structures.
CH952/11 2011-06-06

Publications (1)

Publication Number Publication Date
WO2012167393A1 true WO2012167393A1 (en) 2012-12-13

Family

ID=46551334

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CH2012/000124 WO2012167393A1 (en) 2011-06-06 2012-06-05 Method for motion-dependent navigation in continuous data streams along visual structures

Country Status (2)

Country Link
CH (1) CH705069A1 (en)
WO (1) WO2012167393A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2765573A1 (en) * 2013-02-08 2014-08-13 Native Instruments GmbH Controlling a multimedia storage playback by a finger position, speed & direction on a touchscreen displaying zoomed dual timelines for scratch effect.

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6115482A (en) 1996-02-13 2000-09-05 Ascent Technology, Inc. Voice-output reading system with gesture-based navigation
US6275222B1 (en) * 1996-09-06 2001-08-14 International Business Machines Corporation System and method for synchronizing a graphic image and a media event
WO2003036457A2 (en) 2001-10-22 2003-05-01 Apple Computer, Inc. Method and apparatus for accelerated scrolling
FR2840092A1 (en) 2002-05-22 2003-11-28 Florent Henri Jean Staes Reading instruction system has touch screen and plays sound to match word touched by finger
US7317157B2 (en) 2002-01-21 2008-01-08 Cstools Gmbh Musical instrument having a ribbed surface
US20080048878A1 (en) 2006-08-24 2008-02-28 Marc Boillot Method and Device for a Touchless Interface
EP1942401A1 (en) * 2007-01-05 2008-07-09 Apple Inc. Multimedia communication device with touch screen responsive to gestures for controlling, manipulating and editing of media files
WO2010034063A1 (en) * 2008-09-25 2010-04-01 Igruuv Pty Ltd Video and audio content system
US20100309147A1 (en) 2009-06-07 2010-12-09 Christopher Brian Fleizach Devices, Methods, and Graphical User Interfaces for Accessibility Using a Touch-Sensitive Surface
US20100318204A1 (en) 2009-06-16 2010-12-16 Kyran Daisy Virtual phonograph
US20110058056A1 (en) * 2009-09-09 2011-03-10 Apple Inc. Audio alteration techniques

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8572513B2 (en) * 2009-03-16 2013-10-29 Apple Inc. Device, method, and graphical user interface for moving a current position in content at a variable scrubbing rate
GB2473066A (en) * 2009-09-01 2011-03-02 Release Consulting Ltd Electronic apparatus for displaying and controlling a scrolling musical notation sequence

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6115482A (en) 1996-02-13 2000-09-05 Ascent Technology, Inc. Voice-output reading system with gesture-based navigation
US6275222B1 (en) * 1996-09-06 2001-08-14 International Business Machines Corporation System and method for synchronizing a graphic image and a media event
WO2003036457A2 (en) 2001-10-22 2003-05-01 Apple Computer, Inc. Method and apparatus for accelerated scrolling
US7317157B2 (en) 2002-01-21 2008-01-08 Cstools Gmbh Musical instrument having a ribbed surface
FR2840092A1 (en) 2002-05-22 2003-11-28 Florent Henri Jean Staes Reading instruction system has touch screen and plays sound to match word touched by finger
US20080048878A1 (en) 2006-08-24 2008-02-28 Marc Boillot Method and Device for a Touchless Interface
EP1942401A1 (en) * 2007-01-05 2008-07-09 Apple Inc. Multimedia communication device with touch screen responsive to gestures for controlling, manipulating and editing of media files
WO2010034063A1 (en) * 2008-09-25 2010-04-01 Igruuv Pty Ltd Video and audio content system
US20100309147A1 (en) 2009-06-07 2010-12-09 Christopher Brian Fleizach Devices, Methods, and Graphical User Interfaces for Accessibility Using a Touch-Sensitive Surface
US20100318204A1 (en) 2009-06-16 2010-12-16 Kyran Daisy Virtual phonograph
US20110058056A1 (en) * 2009-09-09 2011-03-10 Apple Inc. Audio alteration techniques

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2765573A1 (en) * 2013-02-08 2014-08-13 Native Instruments GmbH Controlling a multimedia storage playback by a finger position, speed & direction on a touchscreen displaying zoomed dual timelines for scratch effect.
US10496199B2 (en) 2013-02-08 2019-12-03 Native Instruments Gmbh Device and method for controlling playback of digital multimedia data as well as a corresponding computer-readable storage medium and a corresponding computer program

Also Published As

Publication number Publication date
CH705069A1 (en) 2012-12-14

Similar Documents

Publication Publication Date Title
Schneider et al. Studying design process and example use with Macaron, a web-based vibrotactile effect editor
AU2011341876B2 (en) Method and apparatus for controlling touch screen using timeline bar, recording medium with program for the same recorded therein, and user terminal having the same
US8332757B1 (en) Visualizing and adjusting parameters of clips in a timeline
US8452432B2 (en) Realtime editing and performance of digital audio tracks
Kato et al. TextAlive: Integrated design environment for kinetic typography
US7820901B2 (en) Information management method, information management program, and information management device
TW200921447A (en) Synchronizing slide show events with audio
US9087508B1 (en) Presenting representative content portions during content navigation
US20130332859A1 (en) Method and user interface for creating an animated communication
Nash et al. Liveness and Flow in Notation Use.
US20170206055A1 (en) Realtime audio effects control
Nash et al. Tracking virtuosity and flow in computer music
Andersen Mixxx: Towards novel DJ interfaces
JP5760742B2 (en) Controller and parameter control method
Green NIME, Musicality and Practice-led Methods.
Hürst et al. Interfaces for timeline-based mobile video browsing
WO2012167393A1 (en) Method for motion-dependent navigation in continuous data streams along visual structures
Roma et al. A Tabletop Waveform Editor for Live Performance.
Schnell et al. Playing the" MO"-Gestural Control and Re-Embodiment of Recorded Sound and Music.
Koszolko The tactile evolution: electronic music production and affordances of iOS apps
Magnusson ixi software: The Interface as Instrument
JP6242638B2 (en) Teacher-supported presentation system and program
Hürst et al. Interactive manipulation of replay speed while listening to speech recordings
Gelineck et al. Music mixing surface
Lee et al. DiMaß: A technique for audio scrubbing and skimming using direct manipulation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12738014

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12738014

Country of ref document: EP

Kind code of ref document: A1