WO2011075446A1 - Continuous pitch-corrected vocal capture device cooperative with content server - Google Patents
Continuous pitch-corrected vocal capture device cooperative with content server Download PDFInfo
- Publication number
- WO2011075446A1 WO2011075446A1 PCT/US2010/060135 US2010060135W WO2011075446A1 WO 2011075446 A1 WO2011075446 A1 WO 2011075446A1 US 2010060135 W US2010060135 W US 2010060135W WO 2011075446 A1 WO2011075446 A1 WO 2011075446A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pitch
- performance
- backing track
- portable computing
- encoding
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
- G10H1/366—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
- G10H1/368—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
- G10L21/007—Changing voice quality, e.g. pitch or formants characterised by the process used
- G10L21/013—Adapting to target pitch
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
- G10L21/0356—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude for synchronising with other signals, e.g. video signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
- G10H2210/066—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
- G10H2210/091—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/155—Musical effects
- G10H2210/245—Ensemble, i.e. adding one or more voices, also instrumental voices
- G10H2210/251—Chorus, i.e. automatic generation of two or more extra voices added to the melody, e.g. by a chorus effect processor or multiple voice harmonizer, to produce a chorus or unison effect, wherein individual sounds from multiple sources with roughly the same timbre converge and are perceived as one
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
- G10H2210/325—Musical pitch modification
- G10H2210/331—Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/005—Non-interactive screen display of musical or status data
- G10H2220/011—Lyrics displays, e.g. for karaoke applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2230/00—General physical, ergonomic or hardware implementation of electrophonic musical tools or instruments, e.g. shape or architecture
- G10H2230/005—Device type or category
- G10H2230/015—PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/121—Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
- G10H2240/125—Library distribution, i.e. distributing musical pieces from a central or master library
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
- G10H2240/175—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
- G10H2240/201—Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
- G10H2240/211—Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
- G10H2240/201—Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
- G10H2240/241—Telephone transmission, i.e. using twisted pair telephone lines or any type of telephone network
- G10H2240/251—Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analog or digital, e.g. DECT GSM, UMTS
Definitions
- the invention relates generally to capture and/or processing of vocal performances and, in particular, to techniques suitable for use in portable device implementations of pitch correcting vocal capture.
- vocal musical performances may be captured and continuously pitch-corrected for mixing and rendering with backing tracks in ways that create compelling user experiences.
- the vocal performances of individual users are captured on mobile devices in the context of a karaoke-style presentation of lyrics in correspondence with audible renderings of a backing track.
- Such performances can be pitch-corrected in real-time at the mobile device (or more generally, at a portable computing device such as a mobile phone, personal digital assistant, laptop computer, notebook computer, pad-type computer or netbook) in accord with pitch correction settings.
- pitch correction settings code a particular key or scale for the vocal performance or for portions thereof.
- a method includes using a portable computing device for vocal performance capture, the portable computing device having a display, a microphone interface and a data communications interface. Both (i) lyrics and (ii) pitch correction settings are retrieved via the data communications interface. The retrieved lyrics and pitch correction settings respectively code temporal
- method includes supplying a first portable computing device (from a content server and responsive to a user selection) with (i) a first encoding of a backing track, (ii) associated lyrics and (iii) pitch correction settings, the associated lyrics and pitch correction settings respectively coding temporal correspondence of particular lyrics and of particular variations in pitch correction settings with particular points in the backing track.
- the method further includes receiving, at the content server, an encoding of a captured and pitch-corrected vocal performance of the user, wherein the pitch-corrected vocal performance corresponds to the supplied backing track, lyrics and pitch correction settings.
- the method further includes mixing the received pitch-corrected vocal performance with a second encoding of the backing track and thereafter supplying the resulting mixed performance for audible rendering at a second portable computing device.
- FIG. 1 depicts information flows amongst illustrative mobile phone-type portable computing devices and a content server in accordance with some embodiments of the present invention.
- first and second encodings are respective versions (often of differing quality or fidelity) of the same underlying audio source material, although in some cases or situations, different source material with equivalent timing may be employed.
- first and second encodings of such a backing track allow the respective encodings to be adapted to data transfer bandwidth constraints or to needs at the particular device/platform at which they are employed.
- a first encoding of the backing track audibly rendered at a handheld or other portable computing device as an audio backdrop to vocal capture may be of lesser quality or fidelity than a second encoding of that same backing track used at the content server to prepare the mixed performance for audible rendering. In this way, high quality mixed audio content may be provided while limiting data bandwidth
- encodings of dry vocal and/or pitch-corrected vocals may be uploaded to the content server.
- vocals encoded, e.g., as wav, m4a, ogg/vorbis content or otherwise
- pitch-corrected vocals can then be mixed (e.g., with backing audio) to produce files or streams of quality or coding characteristics selected accord with capabilities or limitations a particular target or network.
- pitch-corrected vocals can be mixed with both the stereo and mono wav files to produce streams of differing quality.
- a high quality stereo version can be produced for web playback and a lower quality mono version for streaming to devices such as the handheld device itself.
- pitch-detection and pitch- correction have a rich technological history in the music and voice coding arts. Indeed, a wide variety of feature picking, time-domain and even frequency domain techniques have been employed in the art and may be employed in some embodiments in accord with the present invention. The present description does not seek to exhaustively inventory the wide variety of signal processing techniques that may be suitable in various design or implementations in accord with the present description; rather, we summarize certain techniques that have proved workable in implementations (such as mobile device applications) that contend with CPU-limited computational platforms.
- Scale/mode settings may be updated in the course of a particular vocal performance, but usually not too often based on score-coded information, or in an a capella or Freestyle mode based on user selections.
- the captured vocal performance audio (typically pitch-corrected) is compressed using an audio codec (e.g., a vorbis codec) and included as an audio layer in an appropriate container object (e.g., in a file object in accord with the ogg container format) and uploaded to the content server 110, 210.
- the content server then mixes (111 , 211 ) the captured, pitch- corrected vocal performance encoding with the full instrumental (and/or background vocal) backing track (HQ version) to create high fidelity master audio.
- This master (not separately shown) may, in turn, be encoded using any techniques suitable for the target device(s) and/or the expected network transports.
- a first encoding (LQ MONO) of the backing track is of lesser quality/fidelity than a second encoding (HQ STEREO) thereof, but both are encodings, or derivative encodings, of the same performance by T-Pain of the song "I'm in Luv (wit a In some cases or situations, different source material with equivalent timing could be employed.
- first and second encodings of such a backing track allow the respective encodings to be adapted to data transfer bandwidth constraints or to needs at the particular device/platform at which they are employed.
- a first encoding of the backing track audibly rendered at a handheld or other portable computing device as an audio backdrop to vocal capture may be of lesser quality or fidelity than a second encoding of that same backing track used at the content server to prepare the mixed performance for audible rendering.
- Lyrics, timing information and applicable pitch correction settings may be retrieved for association with the existing backing track using any of a variety of identifiers ascertainable, e.g., from audio metadata, track title, an associated thumbnail or even fingerprinting techniques applied to the audio, if desired.
- vocal and/or backing track audio exchange between the handheld device and content server may be adapted to the quality and capabilities of an available data connection.
- FIG. 1 includes, for at least some targets at which the pitch- corrected vocal performance will be audibly rendered, mixing (at content server 110) with a high quality backing track (HQ), in some cases or for some targets, mixing of pitch- corrected vocals with a suitable backing track may be performed elsewhere, e.g., at the mixed performance rendering target itself.
- HQ high quality backing track
- content server is intended to have broad scope, encompassing not only a single physical server that hosts audio content and functionality described and illustrated herein, but also collections of server or service platforms that together host the audio content and functionality described.
- content server 110, 210 is implemented (at least in part) using hosted storage services such as popularized by platforms such as the Amazon Simple Storage Service (S3) platform.
- Functionality such as mixing of backing audio with captured, pitch-corrected vocals, selection of appropriate source or target audio coding forms or containers and introduction of appropriately coded or transcoded audio into networks, etc. may itself by hosted on servers or service/compute platforms.
- vocal performance capture occurs at another device and after a corresponding encoding of the captured (and typically pitch-corrected) vocal performance is received at a present device, it is audibly rendered in association with a visual display animation suggestive of the vocal performance emanating from a particular location on a globe.
- FIG. 1 illustrates a snapshot of such a visual display animation at handheld 120, which for purposes of the present illustration, will be understood as another instance of a programmed mobile phone (or other portable computing device) such as described and illustrated with reference to handheld device instances 101 and 201 , except that (as depicted with the snapshot) handheld 120 is operating in a play (or listener) mode, rather than the capture and pitch-correction mode described at length hereinabove.
- FIG. 4 illustrates features of a mobile device that may serve as a platform for execution of software implementations in accordance with some embodiments of the present invention. More specifically, FIG. 4 is a block diagram of a mobile device 400 that is generally consistent with commercially-available versions of an iPhoneTM mobile digital device.
- mobile device 400 includes a display 402 that can be sensitive to haptic and/or tactile contact with a user.
- Touch-sensitive display 402 can support multi- touch features, processing multiple simultaneous touch points, including processing data related to the pressure, degree and/or position of each touch point. Such processing facilitates gestures and interactions with multiple fingers, chording, and other interactions.
- other touch-sensitive display technologies can also be used, e.g., a display in which contact is made using a stylus or other pointing device.
- mobile device 400 presents a graphical user interface on the touch-sensitive display 402, providing the user access to various system objects and for conveying information.
- the graphical user interface can include one or more display objects 404, 406.
- the display objects 404, 406, are graphic representations of system objects. Examples of system objects include device functions, applications, windows, files, alerts, events, or other identifiable system objects.
- applications when executed, provide at least some of the digital acoustic functionality described herein.
- the mobile device 400 supports network connectivity including, for example, both mobile radio and wireless internetworking functionality to enable the user to travel with the mobile device 400 and its associated network-enabled functions.
- the mobile device 400 can interact with other devices in the vicinity (e.g., via Wi-Fi, Bluetooth, etc.).
- mobile device 400 can be configured to interact with peers or a base station for one or more devices. As such, mobile device 400 may grant or deny network access to other wireless devices.
- Mobile device 400 includes a variety of input/output (I/O) devices, sensors and transducers.
- a speaker 460 and a microphone 462 are typically included to facilitate audio, such as the capture of vocal performances and audible rendering of backing tracks and mixed pitch-corrected vocal performances as described elsewhere herein.
- speaker 460 and microphone 662 may provide appropriate transducers for techniques described herein.
- An external speaker port 464 can be included to facilitate hands-free voice functionalities, such as speaker phone functions.
- An audio jack 466 can also be included for use of headphones and/or a microphone.
- an external speaker and/or microphone may be used as a transducer for the techniques described herein.
- a proximity sensor 468 can be included to facilitate the detection of user positioning of mobile device 400.
- an ambient light sensor 470 can be utilized to facilitate adjusting brightness of the touch- sensitive display 402.
- An accelerometer 472 can be utilized to detect movement of mobile device 400, as indicated by the directional arrow 474. Accordingly, display objects and/or media can be presented according to a detected orientation, e.g., portrait or landscape.
- mobile device 400 may include circuitry and sensors for supporting a location determining capability, such as that provided by the global positioning system (GPS) or other positioning systems (e.g., systems using Wi-Fi access points, television signals, cellular grids, Uniform Resource Locators (URLs)) to facilitate geocodings described herein.
- Mobile device 400 can also include a camera lens and sensor 480.
- the camera lens and sensor 480 can be located on the back surface of the mobile device 400. The camera can capture still images and/or video for association with captured pitch-corrected vocals.
- Mobile device 400 can also include one or more wireless communication subsystems, such as an 802.1 1 b/g communication device, and/or a BluetoothTM communication device 488. Other communication protocols can also be supported, including other 802.x
- a port device 490 e.g., a Universal Serial Bus (USB) port, or a docking port, or some other wired port connection, can be included and used to establish a wired connection to other computing devices, such as other communication devices 400, network access devices, a personal computer, a printer, or other processing devices capable of receiving and/or transmitting data.
- Port device 490 may also allow mobile device 400 to synchronize with a host device using one or more protocols, such as, for example, the TCP/IP, HTTP, UDP and any other known protocol.
- Device instance 501 operates in a vocal capture and continuous pitch correction mode, while device instance 520 operates in a listener mode. Both communicate via wireless data transport and intervening networks 504 with a server 512 or service platform that hosts storage and/or functionality explained herein with regard to content server 110, 210. Captured, pitch-corrected vocal performances may (optionally) be streamed from and audibly rendered at laptop computer 511.
- Embodiments in accordance with the present invention may take the form of, and/or be provided as, a computer program product encoded in a machine-readable medium as instruction sequences and other functional constructs of software, which may in turn be executed in a computational system (such as a iPhone handheld, mobile device or portable computing device) to perform methods described herein.
- a machine readable medium can include tangible articles that encode information in a form (e.g., as applications, source or object code, functionally descriptive information, etc.) readable by a machine (e.g., a computer, computational facilities of a mobile device or portable computing device, etc.) as well as tangible storage incident to transmission of the information.
- a machine-readable medium may include, but is not limited to, magnetic storage medium (e.g., disks and/or tape storage); optical storage medium (e.g., CD-ROM, DVD, etc.); magneto-optical storage medium; read only memory (ROM); random access memory (RAM); erasable programmable memory (e.g., EPROM and EEPROM); flash memory; or other types of medium suitable for storing electronic instructions, operation sequences, functionally descriptive information encodings, etc.
- magnetic storage medium e.g., disks and/or tape storage
- optical storage medium e.g., CD-ROM, DVD, etc.
- magneto-optical storage medium e.g., magneto-optical storage medium
- ROM read only memory
- RAM random access memory
- EPROM and EEPROM erasable programmable memory
- flash memory or other types of medium suitable for storing electronic instructions, operation sequences, functionally descriptive information encodings, etc.
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2010332041A AU2010332041B2 (en) | 2009-12-15 | 2010-12-13 | Continuous pitch-corrected vocal capture device cooperative with content server |
GB1211876.6A GB2488957B (en) | 2009-12-15 | 2010-12-13 | Continuous pitch-corrected vocal capture device cooperative with content server |
CA2786241A CA2786241C (en) | 2009-12-15 | 2010-12-13 | Continuous pitch-corrected vocal capture device cooperative with content server |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US28674909P | 2009-12-15 | 2009-12-15 | |
US61/286,749 | 2009-12-15 | ||
US32334810P | 2010-04-12 | 2010-04-12 | |
US61/323,348 | 2010-04-12 | ||
US12/876,132 US9147385B2 (en) | 2009-12-15 | 2010-09-04 | Continuous score-coded pitch correction |
US12/876,131 US9058797B2 (en) | 2009-12-15 | 2010-09-04 | Continuous pitch-corrected vocal capture device cooperative with content server for backing track mix |
US12/876,131 | 2010-09-04 | ||
US12/876,132 | 2010-09-04 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011075446A1 true WO2011075446A1 (en) | 2011-06-23 |
Family
ID=44143895
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2010/060135 WO2011075446A1 (en) | 2009-12-15 | 2010-12-13 | Continuous pitch-corrected vocal capture device cooperative with content server |
Country Status (5)
Country | Link |
---|---|
US (8) | US9058797B2 (en) |
AU (1) | AU2010332041B2 (en) |
CA (1) | CA2786241C (en) |
GB (1) | GB2488957B (en) |
WO (1) | WO2011075446A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11032602B2 (en) | 2017-04-03 | 2021-06-08 | Smule, Inc. | Audiovisual collaboration method with latency management for wide-area broadcast |
US11310538B2 (en) | 2017-04-03 | 2022-04-19 | Smule, Inc. | Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics |
US11488569B2 (en) | 2015-06-03 | 2022-11-01 | Smule, Inc. | Audio-visual effects system for augmentation of captured performance based on content thereof |
Families Citing this family (59)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9058797B2 (en) * | 2009-12-15 | 2015-06-16 | Smule, Inc. | Continuous pitch-corrected vocal capture device cooperative with content server for backing track mix |
US8682653B2 (en) * | 2009-12-15 | 2014-03-25 | Smule, Inc. | World stage for pitch-corrected vocal performances |
US10930256B2 (en) | 2010-04-12 | 2021-02-23 | Smule, Inc. | Social music system and method with continuous, real-time pitch correction of vocal performance and dry vocal capture for subsequent re-rendering based on selectively applicable vocal effect(s) schedule(s) |
US8868411B2 (en) | 2010-04-12 | 2014-10-21 | Smule, Inc. | Pitch-correction of vocal performance in accord with score-coded harmonies |
US9601127B2 (en) | 2010-04-12 | 2017-03-21 | Smule, Inc. | Social music system and method with continuous, real-time pitch correction of vocal performance and dry vocal capture for subsequent re-rendering based on selectively applicable vocal effect(s) schedule(s) |
JP5625482B2 (en) * | 2010-05-21 | 2014-11-19 | ヤマハ株式会社 | Sound processing apparatus, sound processing system, and sound processing method |
US20120089390A1 (en) * | 2010-08-27 | 2012-04-12 | Smule, Inc. | Pitch corrected vocal capture for telephony targets |
US9866731B2 (en) | 2011-04-12 | 2018-01-09 | Smule, Inc. | Coordinating and mixing audiovisual content captured from geographically distributed performers |
WO2013149188A1 (en) | 2012-03-29 | 2013-10-03 | Smule, Inc. | Automatic conversion of speech into song, rap or other audible expression having target meter or rhythm |
KR102246623B1 (en) * | 2012-08-07 | 2021-04-29 | 스뮬, 인코포레이티드 | Social music system and method with continuous, real-time pitch correction of vocal performance and dry vocal capture for subsequent re-rendering based on selectively applicable vocal effect(s) schedule(s) |
US8847056B2 (en) | 2012-10-19 | 2014-09-30 | Sing Trix Llc | Vocal processing with accompaniment music input |
US9595256B2 (en) * | 2012-12-04 | 2017-03-14 | National Institute Of Advanced Industrial Science And Technology | System and method for singing synthesis |
CN103295568B (en) * | 2013-05-30 | 2015-10-14 | 小米科技有限责任公司 | A kind of asynchronous chorus method and apparatus |
CN103646656B (en) * | 2013-11-29 | 2016-05-04 | 腾讯科技(成都)有限公司 | Sound effect treatment method, device, plugin manager and audio plug-in unit |
US20160078853A1 (en) * | 2014-09-12 | 2016-03-17 | Creighton Strategies Ltd. | Facilitating Online Access To and Participation In Televised Events |
WO2016070080A1 (en) * | 2014-10-30 | 2016-05-06 | Godfrey Mark T | Coordinating and mixing audiovisual content captured from geographically distributed performers |
US9554207B2 (en) | 2015-04-30 | 2017-01-24 | Shure Acquisition Holdings, Inc. | Offset cartridge microphones |
US9565493B2 (en) | 2015-04-30 | 2017-02-07 | Shure Acquisition Holdings, Inc. | Array microphone system and method of assembling the same |
AU2016270352B2 (en) | 2015-06-03 | 2020-10-29 | Smule, Inc. | Automated generation of coordinated audiovisual work based on content captured from geographically distributed performers |
US11093210B2 (en) * | 2015-10-28 | 2021-08-17 | Smule, Inc. | Wireless handheld audio capture device and multi-vocalist method for audiovisual media application |
US10565972B2 (en) * | 2015-10-28 | 2020-02-18 | Smule, Inc. | Audiovisual media application platform with wireless handheld audiovisual input |
US10771521B2 (en) * | 2015-12-22 | 2020-09-08 | Spotify Ab | Methods and systems for overlaying and playback of audio data received from distinct sources |
CN109923609A (en) * | 2016-07-13 | 2019-06-21 | 思妙公司 | The crowdsourcing technology generated for tone track |
CN106486128B (en) * | 2016-09-27 | 2021-10-22 | 腾讯科技(深圳)有限公司 | Method and device for processing double-sound-source audio data |
US10728695B2 (en) | 2016-12-30 | 2020-07-28 | Spotify Ab | System and method for use of crowdsourced microphone or other information with a digital media content environment |
US10367948B2 (en) | 2017-01-13 | 2019-07-30 | Shure Acquisition Holdings, Inc. | Post-mixing acoustic echo cancellation systems and methods |
JP6497404B2 (en) * | 2017-03-23 | 2019-04-10 | カシオ計算機株式会社 | Electronic musical instrument, method for controlling the electronic musical instrument, and program for the electronic musical instrument |
US10249209B2 (en) | 2017-06-12 | 2019-04-02 | Harmony Helper, LLC | Real-time pitch detection for creating, practicing and sharing of musical harmonies |
US11282407B2 (en) | 2017-06-12 | 2022-03-22 | Harmony Helper, LLC | Teaching vocal harmonies |
KR101925217B1 (en) * | 2017-06-20 | 2018-12-04 | 한국과학기술원 | Singing voice expression transfer system |
US10957297B2 (en) * | 2017-07-25 | 2021-03-23 | Louis Yoelin | Self-produced music apparatus and method |
US10311848B2 (en) | 2017-07-25 | 2019-06-04 | Louis Yoelin | Self-produced music server and system |
US9934772B1 (en) * | 2017-07-25 | 2018-04-03 | Louis Yoelin | Self-produced music |
DE112018004717T5 (en) * | 2017-08-21 | 2020-06-10 | Smule, Inc. | Audiovisual effects system for expanding a recorded performance based on its content |
JP6569712B2 (en) * | 2017-09-27 | 2019-09-04 | カシオ計算機株式会社 | Electronic musical instrument, musical sound generation method and program for electronic musical instrument |
US10671278B2 (en) * | 2017-11-02 | 2020-06-02 | Apple Inc. | Enhanced virtual instrument techniques |
CN112805675A (en) * | 2018-05-21 | 2021-05-14 | 思妙公司 | Non-linear media segment capture and editing platform |
US11250825B2 (en) * | 2018-05-21 | 2022-02-15 | Smule, Inc. | Audiovisual collaboration system and method with seed/join mechanic |
JP7422685B2 (en) | 2018-05-31 | 2024-01-26 | シュアー アクイジッション ホールディングス インコーポレイテッド | System and method for intelligent voice activation for automatic mixing |
EP3804356A1 (en) | 2018-06-01 | 2021-04-14 | Shure Acquisition Holdings, Inc. | Pattern-forming microphone array |
US11297423B2 (en) | 2018-06-15 | 2022-04-05 | Shure Acquisition Holdings, Inc. | Endfire linear array microphone |
WO2020061353A1 (en) | 2018-09-20 | 2020-03-26 | Shure Acquisition Holdings, Inc. | Adjustable lobe shape for array microphones |
CN109981893B (en) * | 2019-02-28 | 2021-05-14 | 广州酷狗计算机科技有限公司 | Lyric display method and device |
CN113841421A (en) | 2019-03-21 | 2021-12-24 | 舒尔获得控股公司 | Auto-focus, in-region auto-focus, and auto-configuration of beamforming microphone lobes with suppression |
US11558693B2 (en) | 2019-03-21 | 2023-01-17 | Shure Acquisition Holdings, Inc. | Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality |
EP3942842A1 (en) | 2019-03-21 | 2022-01-26 | Shure Acquisition Holdings, Inc. | Housings and associated design features for ceiling array microphones |
CN110267081B (en) * | 2019-04-02 | 2021-01-22 | 北京达佳互联信息技术有限公司 | Live stream processing method, device and system, electronic equipment and storage medium |
US11315585B2 (en) | 2019-05-22 | 2022-04-26 | Spotify Ab | Determining musical style using a variational autoencoder |
WO2020237206A1 (en) | 2019-05-23 | 2020-11-26 | Shure Acquisition Holdings, Inc. | Steerable speaker array, system, and method for the same |
US11302347B2 (en) | 2019-05-31 | 2022-04-12 | Shure Acquisition Holdings, Inc. | Low latency automixer integrated with voice and noise activity detection |
US10726874B1 (en) * | 2019-07-12 | 2020-07-28 | Smule, Inc. | Template-based excerpting and rendering of multimedia performance |
EP4018680A1 (en) | 2019-08-23 | 2022-06-29 | Shure Acquisition Holdings, Inc. | Two-dimensional microphone array with improved directivity |
US11355137B2 (en) | 2019-10-08 | 2022-06-07 | Spotify Ab | Systems and methods for jointly estimating sound sources and frequencies from audio |
US11366851B2 (en) * | 2019-12-18 | 2022-06-21 | Spotify Ab | Karaoke query processing system |
US11552611B2 (en) | 2020-02-07 | 2023-01-10 | Shure Acquisition Holdings, Inc. | System and method for automatic adjustment of reference gain |
US11205418B2 (en) * | 2020-05-13 | 2021-12-21 | Microsoft Technology Licensing, Llc | Monotone speech detection |
US11706562B2 (en) | 2020-05-29 | 2023-07-18 | Shure Acquisition Holdings, Inc. | Transducer steering and configuration systems and methods using a local positioning system |
US20220036868A1 (en) * | 2020-07-31 | 2022-02-03 | Virtual Music Ensemble Technologies, LLC | Automated creation of virtual ensembles |
EP4285605A1 (en) | 2021-01-28 | 2023-12-06 | Shure Acquisition Holdings, Inc. | Hybrid audio beamforming system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070150082A1 (en) * | 2005-12-27 | 2007-06-28 | Avera Technology Ltd. | Method, mechanism, implementation, and system of real time listen-sing-record STAR karaoke entertainment (STAR "Sing Through And Record") |
US20080033585A1 (en) * | 2006-08-03 | 2008-02-07 | Broadcom Corporation | Decimated Bisectional Pitch Refinement |
US20080156178A1 (en) * | 2002-11-12 | 2008-07-03 | Madwares Ltd. | Systems and Methods for Portable Audio Synthesis |
US20080312914A1 (en) * | 2007-06-13 | 2008-12-18 | Qualcomm Incorporated | Systems, methods, and apparatus for signal encoding using pitch-regularizing and non-pitch-regularizing coding |
Family Cites Families (88)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4688464A (en) | 1986-01-16 | 1987-08-25 | Ivl Technologies Ltd. | Pitch detection apparatus |
US5231671A (en) | 1991-06-21 | 1993-07-27 | Ivl Technologies, Ltd. | Method and apparatus for generating vocal harmonies |
US5428708A (en) * | 1991-06-21 | 1995-06-27 | Ivl Technologies Ltd. | Musical entertainment system |
GB2279172B (en) * | 1993-06-17 | 1996-12-18 | Matsushita Electric Ind Co Ltd | A karaoke sound processor |
JP2842228B2 (en) | 1994-07-14 | 1998-12-24 | ヤマハ株式会社 | Effect giving device |
JP2820052B2 (en) | 1995-02-02 | 1998-11-05 | ヤマハ株式会社 | Chorus effect imparting device |
US5641927A (en) | 1995-04-18 | 1997-06-24 | Texas Instruments Incorporated | Autokeying for musical accompaniment playing apparatus |
JP3386639B2 (en) | 1995-09-28 | 2003-03-17 | ヤマハ株式会社 | Karaoke equipment |
US7989689B2 (en) | 1996-07-10 | 2011-08-02 | Bassilic Technologies Llc | Electronic music stand performer subsystems and music communication methodologies |
JP3952523B2 (en) | 1996-08-09 | 2007-08-01 | ヤマハ株式会社 | Karaoke equipment |
JP3246347B2 (en) | 1996-08-26 | 2002-01-15 | ヤマハ株式会社 | Karaoke system |
JP3718919B2 (en) | 1996-09-26 | 2005-11-24 | ヤマハ株式会社 | Karaoke equipment |
JP3709631B2 (en) * | 1996-11-20 | 2005-10-26 | ヤマハ株式会社 | Karaoke equipment |
JP4010019B2 (en) * | 1996-11-29 | 2007-11-21 | ヤマハ株式会社 | Singing voice signal switching device |
US5966687A (en) * | 1996-12-30 | 1999-10-12 | C-Cube Microsystems, Inc. | Vocal pitch corrector |
JP3900580B2 (en) * | 1997-03-24 | 2007-04-04 | ヤマハ株式会社 | Karaoke equipment |
US6336092B1 (en) * | 1997-04-28 | 2002-01-01 | Ivl Technologies Ltd | Targeted vocal transformation |
EP1343139B1 (en) * | 1997-10-31 | 2005-03-16 | Yamaha Corporation | audio signal processor with pitch and effect control |
US6971882B1 (en) * | 1998-01-07 | 2005-12-06 | Electric Planet, Inc. | Method and apparatus for providing interactive karaoke entertainment |
US6477506B1 (en) * | 1998-02-23 | 2002-11-05 | Sony Corporation | Terminal apparatus, information service center, transmitting system, and transmitting method |
TW430778B (en) | 1998-06-15 | 2001-04-21 | Yamaha Corp | Voice converter with extraction and modification of attribute data |
US6369311B1 (en) | 1999-06-25 | 2002-04-09 | Yamaha Corporation | Apparatus and method for generating harmony tones based on given voice signal and performance data |
JP3365354B2 (en) | 1999-06-30 | 2003-01-08 | ヤマハ株式会社 | Audio signal or tone signal processing device |
US6353174B1 (en) | 1999-12-10 | 2002-03-05 | Harmonix Music Systems, Inc. | Method and apparatus for facilitating group musical interaction over a network |
JP2004538496A (en) * | 1999-12-20 | 2004-12-24 | ハンセウルソフト カンパニー リミテッド | Network-based music performance / song accompaniment service system and method |
JP4416244B2 (en) | 1999-12-28 | 2010-02-17 | パナソニック株式会社 | Pitch converter |
JP3879357B2 (en) | 2000-03-02 | 2007-02-14 | ヤマハ株式会社 | Audio signal or musical tone signal processing apparatus and recording medium on which the processing program is recorded |
US6643372B2 (en) | 2000-03-08 | 2003-11-04 | Dennis L. Ford | Apparatus and method for music production by at least two remotely located music sources |
US6751439B2 (en) * | 2000-05-23 | 2004-06-15 | Great West Music (1987) Ltd. | Method and system for teaching music |
US6535269B2 (en) * | 2000-06-30 | 2003-03-18 | Gary Sherman | Video karaoke system and method of use |
US7068596B1 (en) * | 2000-07-07 | 2006-06-27 | Nevco Technology, Inc. | Interactive data transmission system having staged servers |
JP4356226B2 (en) * | 2000-09-12 | 2009-11-04 | ソニー株式会社 | Server apparatus, distribution system, distribution method, and terminal apparatus |
JP2002149166A (en) * | 2000-11-09 | 2002-05-24 | Yamaha Corp | Musical composition information distributing device, its method and recording medium |
US6898637B2 (en) | 2001-01-10 | 2005-05-24 | Agere Systems, Inc. | Distributed audio collaboration method and apparatus |
JP4423790B2 (en) | 2001-01-11 | 2010-03-03 | ソニー株式会社 | Demonstration system, demonstration method via network |
RU2178922C1 (en) * | 2001-03-28 | 2002-01-27 | Ровнер Яков Шоел-Берович | Mobile karaoke system |
US6917912B2 (en) | 2001-04-24 | 2005-07-12 | Microsoft Corporation | Method and apparatus for tracking pitch in audio analysis |
US6653545B2 (en) | 2002-03-01 | 2003-11-25 | Ejamming, Inc. | Method and apparatus for remote real time collaborative music performance |
US8387321B2 (en) * | 2002-03-12 | 2013-03-05 | The Steel Network, Inc. | Connector for connecting building components |
JP4042571B2 (en) * | 2003-01-15 | 2008-02-06 | ヤマハ株式会社 | Content providing method and apparatus |
US7102072B2 (en) | 2003-04-22 | 2006-09-05 | Yamaha Corporation | Apparatus and computer program for detecting and correcting tone pitches |
JP2005012674A (en) * | 2003-06-20 | 2005-01-13 | Canon Inc | Image display method, program of executing it, and image display apparatus |
JP4001091B2 (en) | 2003-09-11 | 2007-10-31 | ヤマハ株式会社 | Performance system and music video playback device |
US20060206582A1 (en) * | 2003-11-17 | 2006-09-14 | David Finn | Portable music device with song tag capture |
JP4305153B2 (en) | 2003-12-04 | 2009-07-29 | ヤマハ株式会社 | Music session support method, musical session instrument |
KR100570633B1 (en) * | 2003-12-05 | 2006-04-12 | 한국전자통신연구원 | Karaoke service system and method using set-top box |
US20050182504A1 (en) | 2004-02-18 | 2005-08-18 | Bailey James L. | Apparatus to produce karaoke accompaniment |
US7806759B2 (en) | 2004-05-14 | 2010-10-05 | Konami Digital Entertainment, Inc. | In-game interface with performance feedback |
US7164076B2 (en) * | 2004-05-14 | 2007-01-16 | Konami Digital Entertainment | System and method for synchronizing a live musical performance with a reference performance |
JP2008517305A (en) * | 2004-09-27 | 2008-05-22 | コールマン、デーヴィッド | Method and apparatus for remote voice over or music production and management |
US7297858B2 (en) | 2004-11-30 | 2007-11-20 | Andreas Paepcke | MIDIWan: a system to enable geographically remote musicians to collaborate |
US7825321B2 (en) | 2005-01-27 | 2010-11-02 | Synchro Arts Limited | Methods and apparatus for use in sound modification comparing time alignment data from sampled audio signals |
US20070028750A1 (en) | 2005-08-05 | 2007-02-08 | Darcie Thomas E | Apparatus, system, and method for real-time collaboration over a data network |
US7899389B2 (en) * | 2005-09-15 | 2011-03-01 | Sony Ericsson Mobile Communications Ab | Methods, devices, and computer program products for providing a karaoke service using a mobile terminal |
TWI295433B (en) * | 2005-09-22 | 2008-04-01 | Asustek Comp Inc | Karaoke apparatus and the method thereof |
US7853342B2 (en) | 2005-10-11 | 2010-12-14 | Ejamming, Inc. | Method and apparatus for remote real time collaborative acoustic performance and recording thereof |
US20070098368A1 (en) | 2005-11-02 | 2007-05-03 | Thomas Carley | Mobile recording studio system |
US20070245881A1 (en) | 2006-04-04 | 2007-10-25 | Eran Egozy | Method and apparatus for providing a simulated band experience including online interaction |
US20070245882A1 (en) * | 2006-04-04 | 2007-10-25 | Odenwald Michael J | Interactive computerized digital media management system and method |
WO2007121776A1 (en) * | 2006-04-21 | 2007-11-01 | Nero Ag | Apparatus and method for encoding and decoding plurality of digital data sets |
US20070287141A1 (en) | 2006-05-11 | 2007-12-13 | Duane Milner | Internet based client server to provide multi-user interactive online Karaoke singing |
JP2008004134A (en) * | 2006-06-20 | 2008-01-10 | Sony Corp | Music reproducing method and music reproducing device |
JP4124247B2 (en) | 2006-07-05 | 2008-07-23 | ヤマハ株式会社 | Music practice support device, control method and program |
US20080184870A1 (en) | 2006-10-24 | 2008-08-07 | Nokia Corporation | System, method, device, and computer program product providing for a multiple-lyric karaoke system |
CN102867526A (en) | 2007-02-14 | 2013-01-09 | 缪斯亚米有限公司 | Collaborative music creation |
US7974838B1 (en) * | 2007-03-01 | 2011-07-05 | iZotope, Inc. | System and method for pitch adjusting vocals |
US8108144B2 (en) | 2007-06-28 | 2012-01-31 | Apple Inc. | Location based tracking |
WO2009003347A1 (en) | 2007-06-29 | 2009-01-08 | Multak Technology Development Co., Ltd | A karaoke apparatus |
US8138409B2 (en) | 2007-08-10 | 2012-03-20 | Sonicjam, Inc. | Interactive music training and entertainment system |
KR20070099501A (en) * | 2007-09-18 | 2007-10-09 | 테크온팜 주식회사 | System and methode of learning the song |
US20090106429A1 (en) | 2007-10-22 | 2009-04-23 | Matthew L Siegal | Collaborative music network |
US8173883B2 (en) * | 2007-10-24 | 2012-05-08 | Funk Machine Inc. | Personalized music remixing |
US20090164902A1 (en) | 2007-12-19 | 2009-06-25 | Dopetracks, Llc | Multimedia player widget and one-click media recording and sharing |
US7973230B2 (en) * | 2007-12-31 | 2011-07-05 | Apple Inc. | Methods and systems for providing real-time feedback for karaoke |
US8487173B2 (en) | 2009-06-30 | 2013-07-16 | Parker M. D. Emmerson | Methods for online collaborative music composition |
US8315396B2 (en) | 2008-07-17 | 2012-11-20 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Apparatus and method for generating audio output signals using object based metadata |
KR20100057307A (en) * | 2008-11-21 | 2010-05-31 | 삼성전자주식회사 | Singing score evaluation method and karaoke apparatus using the same |
US20100255827A1 (en) | 2009-04-03 | 2010-10-07 | Ubiquity Holdings | On the Go Karaoke |
WO2011002933A2 (en) | 2009-06-30 | 2011-01-06 | Museami, Inc. | Vocal and instrumental audio effects |
US8681124B2 (en) * | 2009-09-22 | 2014-03-25 | Microsoft Corporation | Method and system for recognition of user gesture interaction with passive surface video displays |
US20110126103A1 (en) | 2009-11-24 | 2011-05-26 | Tunewiki Ltd. | Method and system for a "karaoke collage" |
US9058797B2 (en) | 2009-12-15 | 2015-06-16 | Smule, Inc. | Continuous pitch-corrected vocal capture device cooperative with content server for backing track mix |
US8682653B2 (en) | 2009-12-15 | 2014-03-25 | Smule, Inc. | World stage for pitch-corrected vocal performances |
EP2362378B1 (en) | 2010-02-25 | 2016-06-08 | YAMAHA Corporation | Generation of harmony tone |
US8868411B2 (en) | 2010-04-12 | 2014-10-21 | Smule, Inc. | Pitch-correction of vocal performance in accord with score-coded harmonies |
US8762893B2 (en) * | 2010-05-14 | 2014-06-24 | Google Inc. | Automatic derivation of analogous touch gestures from a user-defined gesture |
WO2012064847A1 (en) | 2010-11-09 | 2012-05-18 | Smule, Inc. | System and method for capture and rendering of performance on synthetic string instrument |
US9082380B1 (en) | 2011-10-31 | 2015-07-14 | Smule, Inc. | Synthetic musical instrument with performance-and/or skill-adaptive score tempo |
-
2010
- 2010-09-04 US US12/876,131 patent/US9058797B2/en active Active
- 2010-09-04 US US12/876,132 patent/US9147385B2/en active Active
- 2010-12-13 AU AU2010332041A patent/AU2010332041B2/en active Active
- 2010-12-13 WO PCT/US2010/060135 patent/WO2011075446A1/en active Application Filing
- 2010-12-13 GB GB1211876.6A patent/GB2488957B/en active Active
- 2010-12-13 CA CA2786241A patent/CA2786241C/en active Active
-
2015
- 2015-05-22 US US14/720,320 patent/US9754571B2/en active Active
- 2015-09-16 US US14/856,152 patent/US9754572B2/en active Active
-
2017
- 2017-09-01 US US15/694,461 patent/US10672375B2/en active Active
- 2017-09-01 US US15/693,946 patent/US10685634B2/en active Active
-
2020
- 2020-06-11 US US16/898,891 patent/US11545123B2/en active Active
-
2023
- 2023-01-03 US US18/149,656 patent/US20230410780A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080156178A1 (en) * | 2002-11-12 | 2008-07-03 | Madwares Ltd. | Systems and Methods for Portable Audio Synthesis |
US20070150082A1 (en) * | 2005-12-27 | 2007-06-28 | Avera Technology Ltd. | Method, mechanism, implementation, and system of real time listen-sing-record STAR karaoke entertainment (STAR "Sing Through And Record") |
US20080033585A1 (en) * | 2006-08-03 | 2008-02-07 | Broadcom Corporation | Decimated Bisectional Pitch Refinement |
US20080312914A1 (en) * | 2007-06-13 | 2008-12-18 | Qualcomm Incorporated | Systems, methods, and apparatus for signal encoding using pitch-regularizing and non-pitch-regularizing coding |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11488569B2 (en) | 2015-06-03 | 2022-11-01 | Smule, Inc. | Audio-visual effects system for augmentation of captured performance based on content thereof |
US11032602B2 (en) | 2017-04-03 | 2021-06-08 | Smule, Inc. | Audiovisual collaboration method with latency management for wide-area broadcast |
US11310538B2 (en) | 2017-04-03 | 2022-04-19 | Smule, Inc. | Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics |
US11553235B2 (en) | 2017-04-03 | 2023-01-10 | Smule, Inc. | Audiovisual collaboration method with latency management for wide-area broadcast |
US11683536B2 (en) | 2017-04-03 | 2023-06-20 | Smule, Inc. | Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics |
Also Published As
Publication number | Publication date |
---|---|
US20110144982A1 (en) | 2011-06-16 |
US9058797B2 (en) | 2015-06-16 |
US20180182366A1 (en) | 2018-06-28 |
US20210125595A1 (en) | 2021-04-29 |
AU2010332041A1 (en) | 2012-07-19 |
CA2786241C (en) | 2018-06-12 |
US10672375B2 (en) | 2020-06-02 |
AU2010332041B2 (en) | 2014-07-03 |
US20230410780A1 (en) | 2023-12-21 |
US20110144981A1 (en) | 2011-06-16 |
US9147385B2 (en) | 2015-09-29 |
GB201211876D0 (en) | 2012-08-15 |
GB2488957B (en) | 2017-05-31 |
US10685634B2 (en) | 2020-06-16 |
US9754572B2 (en) | 2017-09-05 |
US20160005416A1 (en) | 2016-01-07 |
CA2786241A1 (en) | 2011-06-23 |
US9754571B2 (en) | 2017-09-05 |
US20180151164A1 (en) | 2018-05-31 |
US11545123B2 (en) | 2023-01-03 |
US20160071503A1 (en) | 2016-03-10 |
GB2488957A (en) | 2012-09-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11545123B2 (en) | Audiovisual content rendering with display animation suggestive of geolocation at which content was previously rendered | |
US8682653B2 (en) | World stage for pitch-corrected vocal performances | |
US11074923B2 (en) | Coordinating and mixing vocals captured from geographically distributed performers | |
US10229662B2 (en) | Social music system and method with continuous, real-time pitch correction of vocal performance and dry vocal capture for subsequent re-rendering based on selectively applicable vocal effect(s) schedule(s) | |
US11670270B2 (en) | Social music system and method with continuous, real-time pitch correction of vocal performance and dry vocal capture for subsequent re-rendering based on selectively applicable vocal effect(s) schedule(s) | |
KR102246623B1 (en) | Social music system and method with continuous, real-time pitch correction of vocal performance and dry vocal capture for subsequent re-rendering based on selectively applicable vocal effect(s) schedule(s) |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10838184 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010332041 Country of ref document: AU |
|
ENP | Entry into the national phase |
Ref document number: 2786241 Country of ref document: CA |
|
ENP | Entry into the national phase |
Ref document number: 1211876 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20101213 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1211876.6 Country of ref document: GB |
|
ENP | Entry into the national phase |
Ref document number: 2010332041 Country of ref document: AU Date of ref document: 20101213 Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10838184 Country of ref document: EP Kind code of ref document: A1 |