AI music tag

Gwern Branwen

See Also
Links
Miscellaneous
Link Bibliography

[Warning: JavaScript Disabled!]

[For support of key website features (link annotation popups/popins & transclusions, collapsible sections, backlinks, tablesorting, image zooming, sidenotes etc), you must enable JavaScript.]

Links

“A Disney Director Tried—and Failed—to Use an AI Hans Zimmer to Create a Soundtrack”, Heikkilä 2023

“A Disney director tried—and failed—to use an AI Hans Zimmer to create a soundtrack”

“Whisper-AT: Noise-Robust Automatic Speech Recognizers Are Also Strong General Audio Event Taggers”, Gong et al 2023

“Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers”

“Voice Conversion With Just Nearest Neighbors”, Baas et al 2023

“Voice Conversion With Just Nearest Neighbors”

“SoundStorm: Efficient Parallel Audio Generation”, Borsos et al 2023

“SoundStorm: Efficient Parallel Audio Generation”

“ImageBind: One Embedding Space To Bind Them All”, Girdhar et al 2023

“ImageBind: One Embedding Space To Bind Them All”

“TANGO: Text-to-Audio Generation Using Instruction-Tuned LLM and Latent Diffusion Model”, Ghosal et al 2023

“TANGO: Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model”

“CLaMP: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval”, Wu et al 2023

“CLaMP: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval”

“Speak, Read and Prompt (SPEAR-TTS): High-Fidelity Text-to-Speech With Minimal Supervision”, Kharitonov et al 2023

“Speak, Read and Prompt (SPEAR-TTS): High-Fidelity Text-to-Speech with Minimal Supervision”

“Archisound: Audio Generation With Diffusion”, Schneider 2023

“Archisound: Audio Generation With Diffusion”

“Msanii: High Fidelity Music Synthesis on a Shoestring Budget”, Maina 2023

“Msanii: High Fidelity Music Synthesis on a Shoestring Budget”

“Rock Guitar Tablature Generation via Natural Language Processing”, Casco-Rodriguez 2023

“Rock Guitar Tablature Generation via Natural Language Processing”

“VALL-E: Neural Codec Language Models Are Zero-Shot Text to Speech Synthesizers”, Wang et al 2023

“VALL-E: Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers”

“Robust Speech Recognition via Large-Scale Weak Supervision”, Radford et al 2022

“Robust Speech Recognition via Large-Scale Weak Supervision”

“High Fidelity Neural Audio Compression”, Défossez et al 2022

“High Fidelity Neural Audio Compression”

“Hierarchical Diffusion Models for Singing Voice Neural Vocoder”, Takahashi et al 2022

“Hierarchical Diffusion Models for Singing Voice Neural Vocoder”

“RealSinger: Ultra-Realistic Singing Voice Generation via Stochastic Differential Equations”, Anonymous 2022

“RealSinger: Ultra-Realistic Singing Voice Generation via Stochastic Differential Equations”

“AudioLM: a Language Modeling Approach to Audio Generation”, Borsos et al 2022

“AudioLM: a Language Modeling Approach to Audio Generation”

“MeloForm: Generating Melody With Musical Form Based on Expert Systems and Neural Networks”, Lu et al 2022

“MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks”

“AI Composer Bias: Listeners like Music Less When They Think It Was Composed by an AI”, Shank et al 2022

“AI composer bias: Listeners like music less when they think it was composed by an AI”

“Musika! Fast Infinite Waveform Music Generation”, Pasini & Schlüter 2022

“Musika! Fast Infinite Waveform Music Generation”

“Multitrack Music Transformer: Learning Long-Term Dependencies in Music With Diverse Instruments”, Dong et al 2022

“Multitrack Music Transformer: Learning Long-Term Dependencies in Music with Diverse Instruments”

“CLAP: Learning Audio Concepts From Natural Language Supervision”, Elizalde et al 2022

“CLAP: Learning Audio Concepts From Natural Language Supervision”

“BigVGAN: A Universal Neural Vocoder With Large-Scale Training”, Lee et al 2022

“BigVGAN: A Universal Neural Vocoder with Large-Scale Training”

“Tradformer: A Transformer Model of Traditional Music Transcriptions”, Casini & Sturm 2022

“Tradformer: A Transformer Model of Traditional Music Transcriptions”

“SymphonyNet: Symphony Generation With Permutation Invariant Language Model”, Liu et al 2022

“SymphonyNet: Symphony Generation with Permutation Invariant Language Model”

“It’s Raw! Audio Generation With State-Space Models”, Goel et al 2022

“It’s Raw! Audio Generation with State-Space Models”

“General-purpose, Long-context Autoregressive Modeling With Perceiver AR”, Hawthorne et al 2022

“General-purpose, long-context autoregressive modeling with Perceiver AR”

“FIGARO: Generating Symbolic Music With Fine-Grained Artistic Control”, Rütte et al 2022

“FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control”

“Steerable Discovery of Neural Audio Effects”, Steinmetz & Reiss 2021

“Steerable discovery of neural audio effects”

“Semi-Supervised Music Tagging Transformer”, Won et al 2021

“Semi-Supervised Music Tagging Transformer”

“AudioCLIP: Extending CLIP to Image, Text and Audio”, Guzhov et al 2021

“AudioCLIP: Extending CLIP to Image, Text and Audio”

“MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis”, Tae et al 2021

“MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis”

“PriorGrad: Improving Conditional Denoising Diffusion Models With Data-Dependent Adaptive Prior”, Lee et al 2021

“PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior”

“DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism”, Liu et al 2021

“DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism”

“Symbolic Music Generation With Diffusion Models”, Mittal et al 2021

“Symbolic Music Generation with Diffusion Models”

“Interacting With GPT-2 to Generate Controlled and Believable Musical Sequences in ABC Notation”, Geerlings & Meroño-Peñuela 2020

“Interacting with GPT-2 to Generate Controlled and Believable Musical Sequences in ABC Notation”

“HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis”, Kong et al 2020

“HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis”

“AI Song Contest: Human-AI Co-Creation in Songwriting”, Huang et al 2020

“AI Song Contest: Human-AI Co-Creation in Songwriting”

“DeepSinger: Singing Voice Synthesis With Data Mined From the Web”, Ren et al 2020

“DeepSinger: Singing Voice Synthesis with Data Mined From the Web”

“Learning Music Helps You Read: Using Transfer to Study Linguistic Structure in Language Models”, Papadimitriou & Jurafsky 2020

“Learning Music Helps You Read: Using Transfer to Study Linguistic Structure in Language Models”

“15.ai”, Fifteen-kun & Project 2020

“15.ai”

“Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions”, Huang & Yang 2020

“Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions”

“Writing the Next American Hit: Using GPT-2 to Explore the Possibility of Creating Successful AI-Generated Song Lyrics Possibility of Creating Successful AI-Generated Song Lyric”, Barrio 2020

“Writing the Next American Hit: Using GPT-2 to Explore the Possibility of Creating Successful AI-Generated Song Lyrics Possibility of Creating Successful AI-Generated Song Lyric”

“GPT-2 Preference Learning for Music Generation”, Gwern 2019

“GPT-2 Preference Learning for Music Generation”

“Encoding Musical Style With Transformer Autoencoders”, Choi et al 2019

“Encoding Musical Style with Transformer Autoencoders”

“GPT-2 Folk Music”, Branwen & Presser 2019

“GPT-2 Folk Music”

“Parallel WaveGAN: A Fast Waveform Generation Model Based on Generative Adversarial Networks With Multi-resolution Spectrogram”, Yamamoto et al 2019

“Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram”

“Low-dimensional Embodied Semantics for Music and Language”, Raposo et al 2019

“Low-dimensional Embodied Semantics for Music and Language”

“MuseNet: a Deep Neural Network That Can Generate 4-minute Musical Compositions With 10 Different Instruments, and Can Combine Styles from Country to Mozart to the Beatles”, Payne 2019

“MuseNet: a deep neural network that can generate 4-minute musical compositions with 10 different instruments, and can combine styles from country to Mozart to the Beatles”

“Generative Modeling With Sparse Transformers: We’ve Developed the Sparse Transformer, a Deep Neural Network Which Sets New Records at Predicting What Comes next in a Sequence—whether Text, Images, or Sound. It Uses an Algorithmic Improvement of the attention Mechanism to Extract Patterns from Sequences 30× Longer Than Possible Previously”, Child & Gray 2019

“Generative Modeling with Sparse Transformers: We’ve developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence—whether text, images, or sound. It uses an algorithmic improvement of the attention mechanism to extract patterns from sequences 30× longer than possible previously”

“Music Transformer: Generating Music With Long-Term Structure”, Huang et al 2018

“Music Transformer: Generating Music with Long-Term Structure”

“FloWaveNet: A Generative Flow for Raw Audio”, Kim et al 2018

“FloWaveNet: A Generative Flow for Raw Audio”

“Piano Genie”, Donahue et al 2018

“Piano Genie”

“Music Transformer”, Huang et al 2018

“Music Transformer”

“This Time With Feeling: Learning Expressive Musical Performance”, Oore et al 2018

“This Time with Feeling: Learning Expressive Musical Performance”

“The Challenge of Realistic Music Generation: Modelling Raw Audio at Scale”, Dieleman et al 2018

“The challenge of realistic music generation: modelling raw audio at scale”

“The Sound of Pixels”, Zhao et al 2018

“The Sound of Pixels”

“Efficient Neural Audio Synthesis”, Kalchbrenner et al 2018

“Efficient Neural Audio Synthesis”

“Generating Structured Music through Self-Attention”, Huang et al 2018

“Generating Structured Music through Self-Attention”

“Towards Deep Modeling of Music Semantics Using EEG Regularizers”, Raposo et al 2017

“Towards Deep Modeling of Music Semantics using EEG Regularizers”

“Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models”, Guimaraes et al 2017

“Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models”

“Neural Audio Synthesis of Musical Notes With WaveNet Autoencoders”, Engel et al 2017

“Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders”

“Tuning Recurrent Neural Networks With Reinforcement Learning”, Jaques et al 2017

“Tuning Recurrent Neural Networks with Reinforcement Learning”

“SampleRNN: An Unconditional End-to-End Neural Audio Generation Model”, Mehri et al 2016

“SampleRNN: An Unconditional End-to-End Neural Audio Generation Model”

“WaveNet: A Generative Model for Raw Audio”, Oord et al 2016

“WaveNet: A Generative Model for Raw Audio”

“The Abc Music Standard 2.1: §3.1.1: `X:` - Reference Number”, Walshaw 2011

“The abc music standard 2.1: §3.1.1: X: - reference number”

“Staring Emmy Straight in the Eye—And Doing My Best Not to Flinch”, Hofstadter & Cope 2001

“Staring Emmy Straight in the Eye—And Doing My Best Not to Flinch”

“Connectionist Music Composition Based on Melodic, Stylistic, and Psychophysical Constraints [Technical Report CU-CS–495–90]”, Mozer 1990

“Connectionist Music Composition Based on Melodic, Stylistic, and Psychophysical Constraints [Technical report CU-CS–495–90]”

Sort By Magic

Annotations sorted by machine learning into inferred 'tags'. This provides an alternative way to browse: instead of by date order, one can browse in topic order. The 'sorted' list has been automatically clustered into multiple sections & auto-labeled for easier browsing.

Beginning with the newest annotation, it uses the embedding of each annotation to attempt to create a list of nearest-neighbor annotations, creating a progression of topics. For more details, see the link.