- Expressive MeansFrithjof Vollmer and Chris Cannam, method partly by Tilo HaehnelPlugins for analysis of articulation, vibrato, and portamento in audio recordings of musical performances, with a primary focus on bowed stringed instruments.
Expressive Means: Pitch VibratoNotes → ExpressionIdentifies types and intensities of pitch vibrato instances in monophonic recordings.- Expressive Means: ArticulationNotes → ExpressionIdentifies types and intensity of articulation in monophonic recordings.
- Expressive Means (advanced): ArticulationNotes → ExpressionIdentifies types and intensities of articulation in monophonic recordings.
- Expressive Means (advanced): Pitch VibratoNotes → ExpressionIdentifies types and intensities of pitch vibrato instances in monophonic recordings.
- Expressive Means: PortamentoNotes → ExpressionIdentifies types and intensities of portamento instances in monophonic recordings.
- Expressive Means (advanced): PortamentoNotes → ExpressionIdentifies types and intensities of portamento instances in monophonic recordings.
- Expressive Means (advanced)Time → OnsetsFinds note onsets and durations in monophonic recordings based on changes in spectral content, power, and pitch.
- Expressive MeansTime → OnsetsFinds note onsets and durations in monophonic recordings based on changes in spectral content, power, and pitch.
- MARSYAS Vamp pluginsMarsyas PluginsLow-level feature extraction plugins containing functionality from the MARSYAS batch feature extractor.
- Marsyas - Batch Feature Extract - Spectral Flatness MeasureLow Level FeaturesMarsyas - Batch Feature Extract - Spectral Flatness Measure.
- Marsyas - Batch Feature Extract - Mel-Frequency Cepstral CoefficientsLow Level FeaturesMarsyas - Batch Feature Extract - Mel-Frequency Cepstral Coefficients.
- Marsyas - Batch Feature Extract - CentroidLow Level FeaturesMarsyas - Batch Feature Extract - Centroid.
- Marsyas - Batch Feature Extract - Linear Prediction Cepstral CoefficientsLow Level FeaturesMarsyas - Batch Feature Extract - Linear Prediction Cepstral Coefficients.
- Marsyas - Batch Feature Extract - Line Spectral PairsLow Level FeaturesMarsyas - Batch Feature Extract - Line Spectral Pairs.
- Marsyas - Batch Feature Extract - Spectral RolloffLow Level FeaturesMarsyas - Batch Feature Extract - Spectral Rolloff.
- Marsyas - Batch Feature Extract - Zero CrossingsLow Level FeaturesMarsyas - Batch Feature Extract - Zero Crossings.
- Marsyas - Batch Feature Extract - Spectral Crest FactorLow Level FeaturesMarsyas - Batch Feature Extract - Spectral Crest Factor.
MELODIA - Melody ExtractionMusic Technology Group, Universitat Pompeu FabraMelody pitch estimator for polyphonic music.- MELODIA - Melody ExtractionPitchEstimates the melody pitch in polyphonic music (also good for homophonic and monophonic music). Segments without melody are indicated by zero or negative values. For further details please read:
J. Salamon and E. Gomez, "Melody Extraction from Polyphonic Music Signals using Pitch Contour Characteristics", IEEE Transactions on Audio, Speech and Language Processing, 20(6):1759-1770, 2012.
We would highly appreciate the above reference being cited in publications of work in which this plug-in was used. - MELODIA - Melody Extraction (intermediate steps)VisualisationProvides visualisations of the intermediate steps calculated by the melody extraction algorithm implemented in the MELODIA - Melody Extraction plug-in. For further details please read:
J. Salamon and E. Gomez, "Melody Extraction from Polyphonic Music Signals using Pitch Contour Characteristics", IEEE Transactions on Audio, Speech and Language Processing, 20(6):1759-1770, 2012.
We would highly appreciate the above reference being cited in publications of work in which this plug-in was used.
- Vamp example pluginsVamp SDK Example PluginsA set of simple plugins as included with the Vamp developers kit. Amplitude tracker, simple percussion onset detector, tempo estimator, spectral centroid, power spectrum, and zero-crossing counter.
- Amplitude FollowerLow Level FeaturesTrack the amplitude of the audio signal.
- Simple Power SpectrumVisualisationReturn the power spectrum of a signal.
- Zero CrossingsLow Level FeaturesDetect and count zero crossing points.
- Simple Percussion Onset DetectorTime → OnsetsDetect percussive note onsets by identifying broadband energy rises.
- Spectral CentroidLow Level FeaturesCalculate the centroid frequency of the spectrum of the input signal.
- Simple Fixed Tempo EstimatorTime → TempoStudy a short section of audio and estimate its tempo, assuming the tempo is constant.
Vamp Aubio pluginsPaul BrossierThe Vamp Aubio Plugins provide methods from Paul Brossier's aubio annotation library, including beat and tempo tracking, onset detection, pitch detection, note tracking, silence detector, and Mel-frequency cepstral coefficients.- Aubio Mfcc ExtractorLow Level FeaturesExtract Mel-Frequency Cepstrum Coefficients.
- Aubio Mel-Frequency Bands ExtractorLow Level FeaturesCompute energy in each 40 mel-frequency bands.
- libxtract Vamp pluginsChris Cannam and Jamie BullockLow-level feature extraction plugins using Jamie Bullock's libxtract library to provide around 50 spectral and other features.
- LoudnessLow Level FeaturesExtract the loudness of an audio signal from its spectrum.
- Spectral SpreadLow Level FeaturesExtract the spectral spread of an audio spectrum.
- Spectral Average DeviationExtract the average deviation of an audio spectrum.
- Spectral SlopeLow Level FeaturesExtract the spectral slope of an audio spectrum.
- VarianceLow Level FeaturesExtract the variance of a range of values.
- Lowest ValueLow Level FeaturesExtract the lowest value from a given range.
- Discrete Cosine TransformVisualisationExtract the DCT of an audio signal.
- MeanLow Level FeaturesExtract the mean of a range of values.
- Fundamental Frequency (failsafe)Low Level FeaturesExtract the fundamental frequency of an audio signal (failsafe).
- NoisinessLow Level FeaturesExtract the noisiness of an audio spectrum.
- Average Magnitude Difference FunctionLow Level FeaturesExtract the AMDF of an audio signal.
- Spectral VarianceLow Level FeaturesExtract the variance of an audio spectrum.
- Bark CoefficientsLow Level FeaturesExtract bark coefficients from an audio spectrum.
- Fundamental FrequencyLow Level FeaturesExtract the fundamental frequency of an audio signal.
- TonalityLow Level FeaturesExtract the tonality an audio spectrum.
- InharmonicityLow Level FeaturesExtract the inharmonicity of an audio spectrum.
- Average Squared Difference FunctionLow Level FeaturesExtract the ASDF of an audio signal.
- Spectral RolloffLow Level FeaturesExtract the rolloff point of an audio spectrum.
- Spectral SharpnessLow Level FeaturesExtract the spectral sharpness of an audio spectrum.
- Tristimulus IIILow Level FeaturesExtract the tristimulus (type III) of an audio spectrum.
- Spectral SkewnessLow Level FeaturesExtract the skewness of an audio spectrum.
- Tristimulus IILow Level FeaturesExtract the tristimulus (type II) of an audio spectrum.
- Irregularity ILow Level FeaturesExtract the irregularity (type I) of an audio spectrum.
- Tristimulus ILow Level FeaturesExtract the tristimulus (type I) of an audio spectrum.
- Spectral SmoothnessLow Level FeaturesExtract the spectral smoothness of an audio spectrum.
- Irregularity IILow Level FeaturesExtract the irregularity (type II) of an audio spectrum.
- SkewnessLow Level FeaturesExtract the skewness of a range of values.
- Average DeviationLow Level FeaturesExtract the average deviation of a range of values.
- Spectral Crest MeasureLow Level FeaturesExtract the spectral crest measure of an audio spectrum.
- RMS AmplitudeLow Level FeaturesExtract the RMS amplitude of an audio signal.
- Spectral Standard DeviationLow Level FeaturesExtract the standard deviation of an audio spectrum.
- AutocorrelationLow Level FeaturesExtract the autocorrelation of an audio signal.
- Non-zero countLow Level FeaturesExtract the number of non-zero elements in an input spectrum.
- Spectral KurtosisLow Level FeaturesExtract the kurtosis of an audio spectrum.
- Mel-Frequency Cepstral CoefficientsLow Level FeaturesExtract MFCC from an audio spectrum.
- Zero Crossing RateLow Level FeaturesExtract the zero crossing rate of an audio signal.
- Highest ValueLow Level FeaturesExtract the highest value from a given range.
- Sum of ValuesLow Level FeaturesExtract the sum of the values in a given range.
- Spectral FlatnessLow Level FeaturesExtract the spectral flatness of an audio spectrum.
- KurtosisLow Level FeaturesExtract the kurtosis of a range of values.
- Odd/even Harmonic RatioLow Level FeaturesExtract the odd-to-even harmonic ratio of an audio spectrum.
- Spectral CentroidLow Level FeaturesExtract the spectral centroid of an audio spectrum.
- Standard DeviationLow Level FeaturesExtract the standard deviation of a range of values.
- Harmonic SpectrumVisualisationExtract the harmonics from an audio spectrum.
- Peak SpectrumVisualisationExtract the spectral peaks from an audio spectrum.
- SpectrumVisualisationExtract the spectrum of an audio signal.
Simple CepstrumChris CannamA simple Vamp plugin to calculate and return cepstrum values from DFT bins. Useful as a preliminary tool for looking at cepstral data for simple pitch or envelope methods.- Simple CepstrumLow Level FeaturesReturn simple cepstral data from DFT bins. This plugin is intended for casual inspection of cepstral data. It returns a lot of different sorts of data and is quite slow; it's not a good way to extract a single feature rapidly.
- Mazurka PluginsThe Mazurka ProjectSpectral visualisation and feature extraction plugins from the Mazurka project.
- Spectral FluxLow Level FeaturesSpectral Flux.
- ChronogramVisualisationChronogram.
- Nevermore SpectrogramVisualisationNevermore Spectrogram.
- Harmonic SpectrogramVisualisationHarmonic Spectrogram.
- Power CurveLow Level FeaturesPower Curve.
- Spectral RefluxLow Level FeaturesSpectral Reflux.
Queen Mary plugin setQueen Mary, University of LondonPlugins from the Centre for Digital Music at Queen Mary, University of London.- ChromagramVisualisationExtract a series of tonal chroma vectors from the audio.
- Constant-Q SpectrogramVisualisationExtract a spectrogram with constant ratio of centre frequency to resolution from the input audio.
WhisperIRCAM- Chordino and NNLS ChromaMatthias MauchHarmony and chord extraction plugins by Matthias Mauch at C4DM.
- NNLS ChromaVisualisationThis plugin provides a number of features derived from a DFT-based log-frequency amplitude spectrum: some variants of the log-frequency spectrum, including a semitone spectrum derived from approximate transcription using the NNLS algorithm; and based on this semitone spectrum, different chroma features.
- TuningKey and TonalityThe tuning plugin can estimate the local and global tuning of piece. The same tuning method is used for the NNLS Chroma and Chordino plugins.
- ChordinoNotesChordino provides a simple chord transcription based on NNLS Chroma (as in the NNLS Chroma plugin). Chord profiles given by the user in the file chord.dict are used to calculate frame-wise chord similarities. Two simple (non-state-of-the-art!) algorithms are available that smooth these to provide a chord transcription: a simple chord change method, and a standard HMM/Viterbi approach.
BBC Vamp PluginsBBCA collection of audio feature extraction algorithms from BBC Research and Development.- EnergyLow Level FeaturesCalculates the RMS energy and low energy ratio of a signal.
- IntensityLow Level FeaturesCalculates the intensity of a signal and the intensity ratio for a number of sub-bands.
- Spectral ContrastLow Level FeaturesCalculates the peak and valleys of the spectral contrast feature.
- Speech/Music segmenterClassificationCalculates boundaries between speech and music.
- PeaksLow Level FeaturesCalculates peak and trough values of a signal.
- Spectral FluxLow Level FeaturesCalculates the spectral flux.
- RhythmLow Level FeaturesCalculates rhythmic features of a signal, including onsets and tempo.
Fan Chirp F0gramAudio Processing Group, Universidad de la Republica, UruguayFundamental-frequency salience visualisation based on the Fan Chirp Transform, from the Universidad de la Republica, Uruguay.- Fan Chirp Transform F0gramVisualisationThis plug-in produces a representation, called F0gram, which exhibits the salience of the fundamental frequency of the sound sources in the audio file. The computation of the F0gram makes use of the Fan Chirp Transform analysis. It is based on the article "Fan chirp transform for music representation" P. Cancela, E. Lopez, M. Rocamora, International Conference on Digital Audio Effects, 13th. DAFx-10. Graz, Austria - 6-10 Sep 2010.
- Lossy Encoding DetectorQueen Mary, University of LondonTests and reports whether audio appears to have been previously compressed using a lossy encoder such as MP3.
- Lossy Encoding Detector (Quick)Tests and reports whether audio appears to have been previously compressed using a lossy encoder such as MP3. Unlike the full version of the plugin, this one examines only a tiny part of the input.
- Constant-QQueen Mary, University of LondonA plugin implementing the Constant-Q transform of a time-domain signal.
- Constant-Q Spectrogram (MIDI pitch range)VisualisationExtract a spectrogram with constant ratio of centre frequency to resolution from the input audio, specifying the frequency range in MIDI pitch units.
- ChromagramVisualisationExtract a Constant-Q spectrogram with constant ratio of centre frequency to resolution from the audio, then wrap it around into a single-octave chromagram.
- Constant-Q Spectrogram (Hz range)VisualisationExtract a spectrogram with constant ratio of centre frequency to resolution from the input audio, specifying the frequency range in Hz.
- MIR.EDUMIR.EDU by Justin SalamonAn open source Vamp plug-in library written in C++ which implements a basic set of descriptors useful for teaching MIR.
- MIR.EDU: MFCCCompute the Mel Frequency Cepstral Coefficients (MFCC) for each frame. MFCCs provide a concise representation of the spectral envelope of a sound, which in turn is related to the sound's timbre. Please refer to the code in MFCC.cpp and the reference provided in MFCC.h for a detailed explanation of how MFCCs are computed.
- pYINMatthias MauchpYIN is a modification of the well-loved YIN algorithm for fundamental frequency (F0) estimation in monophonic audio.
- Local Candidate PYINMonophonic pitch and note tracking based on a probabilistic Yin extension.
- pYinPitchMonophonic pitch and note tracking based on a probabilistic Yin extension.
RGU Mel-Frequency SpectrumRobert Gordon University- Silvet Note TranscriptionQueen Mary, University of London
- MATCH Vamp PluginSimon Dixon and Chris Cannam