WO2017028506A1

WO2017028506A1 - System and method for playing music puzzle

Info

Publication number: WO2017028506A1
Application number: PCT/CN2016/073007
Authority: WO
Inventors: Zheng Shi; Huihui Wang
Original assignee: Zheng Shi
Priority date: 2015-08-14
Filing date: 2016-01-31
Publication date: 2017-02-23
Also published as: CN105056531B; CN105056531A

Abstract

A system for playing music puzzle is disclosed. The system includes multiple physical objects (101), an interactive surface (102), a database (104) and a processor (103). Each of the physical objects (101) is provided with a visual marker and an identification code. The interactive surface (102) is configured to recognize the position and the identification code of the physical object (101) placed on the interactive surface (102). The database (104) is configured to store music pieces. The processor (103) is configured to retrieve a first music piece, dissect the first music piece into a plurality of music fragments, and assign each of music fragments to one corresponding physical object (101). Once a plurality of physical objects (101) are placed on the interactive surface (102) and arranged into a structural pattern, the processor (103) is configured to derive a second music piece from the structural pattern. The physical objects (101) are used in the music puzzle game, so that the limit of a computer screen is overcome. Users interact with the physical objects (101) through touching and physical perception, and the pleasure of the music puzzle game is increased. A method for playing music puzzle is also disclosed.

Description

SYSTEM AND METHOD FOR PLAYING MUSIC PUZZLE

TECHNICAL FIELD

The present invention relates to a music puzzle game, particularly to the system and method for a physical object based music puzzle game.

BACKGROUND

Music is one of the most outstanding creations by human beings. Listening to music and enjoying music are very common amusement in modern lives. And music is an indispensable part in the everyday life that plays an immeasurably important role in the growth of children.

To date, a lot of software in music cutting and merging has been widely used in a variety of computers and handheld device. Music puzzle games using physical objects go beyond the computer screens. It is easier for children to be fully engaged in music puzzle games when they interact with computers by manipulating physical objects, compared to by using computers directly. People interact with physical objects by touching and physical perception, which increases the fun of music puzzle games. Thus, in order that the user’s experience of interacting with computers by manipulating physical objects is enhanced, it is necessary to provide a system and method for music puzzle games based on physical objects.

SUMMARY OF INVENTION

Aiming to solve the problems above, the present invention provides a system and the accompanying method for playing music puzzle.

The system includes multiple physical objects, each having a visual marker and an identification code, an interactive surface configured to recognize the position and identification code of the physical object placed on it, a database configured to store music pieces, and a processor configured to retrieve music pieces, dissect a first music piece into a plurality of music fragments, and assign each music fragment to a physical object. Once a plurality of physical objects are placed on the interactive surface and arranged into a structural pattern, the processor is configured to derive a second music piece from the structural pattern.

Further, the processor is configured to compare the second music piece with the first music piece and provides feedback to the user.

Further, the interactive surface has an electrode array that comprises at least one electrode and an RF array that comprises at least one RF antenna.

Further, the identification code is embedded in a radio frequency identification tag.

Further, the processor dissects the first music piece into music fragments based on one or more algorithms. The algorithms can be a time-interval based algorithm, a melody based algorithm, a track based algorithm, an instrument based algorithm, or a lyrics based algorithm.

Further, the processor assigns each music fragment to an object based on one or more algorithms. The algorithms can be a random algorithm, an algorithm based on the visual marker of an object, an algorithm based on the physical attributes of an object, or an algorithm based on the history of interactions with an object by the user.

Further, the music puzzle game system comprises an audio device that is configured to play the music fragment assigned to the object.

Further, the music puzzle game system comprises an audio device that is configured to play the second music piece derived from the structural pattern.

Further, the music puzzle game system comprises a monitor that is configured to display the music note of the music fragment.

Further, the music puzzle game system comprises a monitor that is configured to display the second music piece derived from the structural pattern.

The present invention provides a method for playing music puzzle, including the following steps: retrieving a first music piece from a database by a processor； dissecting the first music piece into a plurality of music fragments by the processor； assigning, by the processor, each music fragment to a physical object that has a visual marker and identification code； arranging a plurality of physical objects on an interactive surface into a structural pattern by a user, and the interactive surface is configured to recognize the position and identification code of the physical object on the interactive surface； deriving a second music piece from the structural pattern by the processor.

The present invention provides a physical object based system and method for playing music puzzle, which goes beyond the limits of computer screens. The interaction with physical objects through touching and physical perception increases the fun of the music puzzle game.

BRIEF DESCRIPTION OF THE DRAWINGS

To better illustrate the technical features of the embodiments of the present invention, various embodiments of the present invention will be briefly described in conjunction with the accompanying drawings. It should be obvious that the drawings are only for exemplary embodiments of the present invention, and that a person of ordinary skill in the art may derive additional drawings without deviating from the principles of the present invention.

FIG. 1 is an exemplary schematic diagram illustrating the music puzzle game system in accordance with one embodiment of the present invention.

FIG. 2 is an exemplary schematic diagram illustrating the process flow of the music puzzle game in accordance with one embodiment of the present invention.

FIG. 3 is an exemplary schematic diagram illustrating the playing of the music puzzle game in accordance with one embodiment of the present invention.

FIG. 4 is an exemplary schematic diagram illustrating the playing of the music puzzle game in accordance with another embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

To better illustrate the purpose, technical feature, and advantages of the embodiments of the present invention, various embodiments of the present invention will be further described in conjunction with the accompanying drawings.

While the present invention will be described in connection with various specific embodiments, the invention is not limited to these embodiments. People skilled in the art will recognize that the system and method of the present invention may be used in many other applications. The present invention is intended to cover all alternatives, modifications and equivalents within the spirit and scope of invention, which is defined by the apprehended claims.

The technical scheme in the embodiment of the present invention will be described clearly and completely by reference to the accompanying drawings.

FIG. 1 is an exemplary schematic diagram illustrating the music puzzle game system in accordance with one embodiment of the present invention. The physical object based programming system includes multiple physical objects 101, an interactive surface 102, a processor 103, a database 104, an audio device 105, and a monitor 106.

Each physical object 101 has a visual marker that carries different patterns. Each physical object 101 further has an identification code that is embedded in a radio frequency identification (RFID) tag. The physical object 101 can be a card, a button, an icon, a foil, or a figurine.

The interactive surface 102 shown in FIG. 1 has an electrode array that comprises at least one electrode and a RF antenna array that comprises at least one RF antenna. In the present embodiment, the electrode refers to metal electrode, such as iron and copper. The physical object 101 is made up of materials that can be capacitively coupled with the electrode. The interactive board 102 derives the location of the physical object 101 by detecting the magnitude of capacitive coupling between the physical object 101 on the interactive board 102 and the electrodes of the interactive board 102. The interactive board 102 can further determines the ID of the physical object 101 via the wireless communication between the RFID tag of the physical object 101 on the interactive board and the RF antennas of the interactive board 102.

The database 104 stores music pieces and is operatively linked to the processor 103. The processor 103 is configured to retrieve a music piece from the database 104, and dissects the music piece into music fragments based on one or more algorithms. The algorithms can be a time-interval based algorithm, a melody based algorithm, a track based algorithm, an instrument based algorithm, or a lyrics based algorithm. The processor 103 is also configured to assign each music fragment to an object based on one or more algorithms. The algorithms include a random algorithm, an algorithm based on the visual marker of an object, an algorithm based on the physical attributes of an object, and an algorithm based on the history of interactions with an object by the user. The processor 103 operatively linked to the interactive surface is further configured to derive another music piece from the structural pattern that is formed by a user using multiple physical objects on the interactive surface.

The physical object based programming system shown in FIG. 1 further comprises the audio device 105 that is configured to play the music fragment assigned to the object 101. The audio device 105 is further configured to play the music piece derived from the structural pattern.

The physical object based programming system shown in FIG. 1 further comprises the monitor 106 that is configured to display the music note of the music fragment assigned to the physical object 101. The monitor 106 is further configured to display the music note of the music piece derived from the structural pattern.

FIG. 2 is an exemplary schematic diagram illustrating the process flow of the music puzzle game in accordance with one embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:

Step 201: retrieving a first music piece from a database by a processor. The music piece may be vocal music or instrumental music.

Step 202: dissecting the first music piece into a plurality of music fragments, by the processor, based on one or more algorithms. The algorithms can be a time-interval based algorithm, a melody based algorithm, a track based algorithm, an instrument based algorithm, or a lyrics based algorithm.

Step 203: assigning, by the processor, each music fragment to a physical object that has a visual marker and identification code, based on one or more algorithms. The algorithms include a random algorithm, an algorithm based on the visual marker of an object, an algorithm based on the physical attributes of an object, and an algorithm based on the history of interactions with an object by the user.

Step 204: arranging multiple physical objects on an interactive surface into a structural pattern by a user, and the interactive surface is configured to recognize the position and identification code of the physical object on the interactive surface. Once the user touches the physical object, an audio device plays the music fragment corresponding to the physical object, and the monitor displays the corresponding music note of the music fragment, so that the user can figure out the corresponding relationship between the physical object and the music fragment.

Step 205: deriving a second music piece from the structural pattern by the processor. The user enters commands and the audio device plays the second music piece derived from the structural pattern and the monitor displays the music note of the second music piece.

Step 206: comparing the second music piece derived from the structural pattern with the first music piece retrieved from the database, and providing feedback to the user, by the processor.

The processor 303 retrieves a popular English lullaby “Twinkle, Twinkle, Little Star” from the database 304. The processor 303 dissects this music piece into 12 music fragments using a melody-based algorithm.

The processor 303 then assigns each of the 12 music fragments to a physical block 301 using the algorithm based on the visual marker. Specifically, these 12 music fragments are assigned to 12 blocks 301, with the visual markers of the blocks in the sequence of A, B, C, D, E, F, G, H, I, J, K, L.

Once a user touches one or more blocks 301, the audio device 305 plays the music fragments corresponding to the blocks 301 that have been touched, and the monitor 306 displays the corresponding music notes of the music fragments, which enables the user to realize the corresponding relationship between the blocks and the music fragments.

The user then arranges the 12 physical blocks into a structural pattern on the interactive surface 302 that is configured to recognize the position and identification code of each physical block 301 placed on the interactive surface 302.

The processor 303 retrieves a second music piece from the structural pattern. The user enters commands and the audio device 305 plays the second music piece derived from the structural pattern and the monitor 306 displays the second music piece.

The processor 303 compares the second music piece derived from the structural pattern with the original music piece, determines whether the second music piece and the original music piece are the same, and provides feedback to the user.

The processor 403 retrieves from the database 404 a pop song “She Says” that is composed of three tracks. Processor 403 dissects this music piece into 24 music fragments using a time-interval based algorithm and a track based algorithm. Each of the three tracks is dissected into 8 music fragments.

The processor 403 assigns each music fragment to a physical block 401 using algorithms based on the visual marker and the physical attributes of the object. The 24 physical blocks belong to 3 groups, with each group having 8 physical blocks 401. The first group of physical blocks 401 is in red, with the visual markers 1, 2, 3, 4, 5, 6, 7, and 8. The second group of physical blocks 401 is in yellow, also with the visual markers 1 through 8. The third group of physical blocks 401 is in blue, also with the visual markers 1 through 8. A total of 24 music fragments are assigned to the 24 physical blocks 401. The 8 music fragments of the first, second and third tracks are assigned to the physical block 401 in red, in yellow, and in blue respectively.

Once a user touches a physical block 401, the audio device 405 plays the music fragment that corresponds to the physical block 401, and the monitor 406 displays the corresponding music note of the physical block 401, which enables the user to understand the corresponding relationship between the physical block 401 and the music fragment.

The user then arranges the 24 physical blocks 401 into a structural pattern on the interactive surface 402 that is configured to recognize the position and identification code of each physical block 401 placed on the interactive surface 402. The three lines displayed on the interactive surface 402 represent the three tracks. The red blocks are placed along the first line, i. e. , for the first track, the yellow blocks for the second track, and the blue blocks for the third track.

The processor 403 retrieves a second music piece from the structural pattern. The user enters commands, and the audio device 405 plays the second music piece derived from the structural pattern, and the monitor 406 displays the music note of the second music piece.

The processor 403 compares the second music piece with the original music piece, determining whether the second music piece and the original music piece are the same or not, and provides feedback to the user.

Claims

A system for playing music puzzle, comprising:

-a plurality of physical objects, wherein each physical object has a visual marker and an identification code,

-an interactive surface configured to recognize the position and the identification code of the physical object placed on the interactive surface,

-a database configured to store music pieces,

-a processor configured to retrieve a first music piece from the database, dissect the first music piece into a plurality of music fragments, and assign each music fragment to a physical object,

wherein, upon a user having placed a plurality of physical objects on the interactive surface and arranging the physical objects into a structural pattern, the processor is configured to derive a second music piece from the structural pattern.
The system of claim 1, wherein, the processor is configured to compare the second music piece derived from the structural pattern with the first music piece retrieved from the database, and provides feedback to the user.
The system of claim 1, wherein the interactive surface comprises an electrode array and an RF antenna array, and wherein the electrode array comprises at least one electrode and the RF antenna array comprises at least one RF antenna.
The system of claim 1, wherein the identification code is embedded in an RFID tag.
The system of claim 1, wherein the processor is configured to dissect the first music piece retrieved from the database into music fragments based on one or more algorithms that are selected from a group consisting of a time-interval based algorithm, a melody based algorithm, a track based algorithm, an instrument based algorithm, and a lyrics based algorithm.
The system of claim 1, wherein the processor is configured to assign each music fragment to an object based on one or more algorithms that are selected from a group consisting of a random algorithm, an algorithm based on the visual marker of an object, an algorithm based on the physical attributes of an object, and an algorithm based on the history of interactions with an object by the user.
The system of claim 1, further comprising an audio device configured to play the music fragment assigned to an object.
The system of claim 1, further comprising an audio device configured to play the second music piece derived from the structural pattern.
The system of claim 1, further comprising a monitor configured to display the music note of a music fragment.
The system of claim 1, further comprising a monitor configured to display the second music piece derived from the structural pattern.
A method for playing music puzzle, comprising:

-retrieving a first music piece from a database by a processor,

-dissecting the first music piece into a plurality of music fragments by the processor,

-assigning each music fragment to a physical object by the processor, wherein the physical object has a visual marker and identification code,

-arranging a plurality of physical objects placed on an interactive surface into a structural pattern by a user, wherein the interactive surface is configured to recognize the position and identification code of the physical object placed on the interactive surface,

-deriving a second music piece from the structural pattern by the processor.
The method of claim 11, further comprising, comparing the second music piece derived from the structural pattern with the first music piece retrieved from the database and providing feedback to the user, by the processor.
The method of claim 11, wherein the interactive surface comprises an electrode array and an RF antenna array, and wherein the electrode array comprises at least one electrode and the RF antenna array comprises at least one RF antenna.
The method of claim 11, wherein the identification code is embedded in an RFID tag.
The method of claim 11, further comprising, dissecting, by the processor, the first music piece retrieved from the database into music fragments based on one or more algorithms that are selected from a group consisting of a time-interval based algorithm, a melody based algorithm, a track based algorithm, an instrument based algorithm, and a lyrics based algorithm.
The method of claim 11, further comprising, assigning, by the processor, each music fragment to an object based on one or more algorithms that are selected from a group consisting of a random algorithm, an algorithm based on the visual marker of an object, an algorithm based on the physical attributes of an object, and an algorithm based on the history of interactions with an object by the user.
The method of claim 11, further comprising playing the music fragment assigned to an object by an audio device.
The method of claim 11, further comprising playing the second music piece derived from the structural pattern by an audio device.
The method of claim 11, further comprising displaying the music note of the music fragment by a monitor.
The method of claim 11, further comprising displaying the second music piece derived from the structural pattern by a monitor.