The Curious Engineer

All blogs / AI / ML

Magenta

magenta.tensorflow.org

A research project exploring the role of machine learning in the process of creating art and music.

AI / MLMusicAudio / hi-fi

’16’17’18’19’20’21’22’23’24’25’26
Posts
100 from 1 Jun 2016 to 24 Jul 2026
Posting
monthly (11 in the last year)
Kind
project news
Feed
https://magenta.withgoogle.com/feed.xml

2026 6

  1. From Hackathons to Instruments: MRT2 Out in the World
  2. From Hackathons to Instruments: MRT2 Out in the World
  3. Magenta RealTime 2: Open & Local Live Music Models
  4. Magenta RealTime 2: Open & Local Live Music Models
  5. Open-sourcing The Infinite Crate DAW plugin
  6. Open-sourcing The Infinite Crate DAW plugin

2025 10

  1. Lyria Camera: Soundtrack your life
  2. Lyria Camera: Soundtrack your life
  3. Space DJ: Navigating a Musical Universe
  4. Space DJ: Navigating a Musical Universe
  5. Lyria RealTime VST: The Infinite Crate
  6. Lyria RealTime VST: The Infinite Crate
  7. Magenta RealTime: An Open-Weights Live Music Model
  8. Magenta RealTime: An Open-Weights Live Music Model
  9. Introducing Lyria RealTime API
  10. Introducing Lyria RealTime API

2023 4

  1. Magenta Studio 2.0
  2. Magenta Studio 2.0
  3. The 2023 I/O Preshow – Composed by Dan Deacon (with some help from MusicLM)
  4. The 2023 I/O Preshow – Composed by Dan Deacon (with some help from MusicLM)

2022 6

  1. The Wordcraft Writers Workshop: Creative Co-Writing with AI
  2. The Chamber Ensemble Generator and CocoChorales Dataset
  3. Autoregressive long-context music generation with Perceiver AR
  4. DDSP-VST: Neural Audio Synthesis for All
  5. MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling
  6. Paint With Music

2021 9

  1. HCI and ML: Putting People First
  2. Modern Evolution Strategies for Creativity
  3. Music Transcription with Transformers
  4. Hip-Hop EP co-produced using Machine Learning
  5. Natya*ML
  6. Maestro: An AI-guided vocal coach
  7. DearDiary.ai
  8. BitRate: Recap
  9. Stepping Towards Transcultural Machine Learning in Music

2020 11

  1. AI Song Contest: Human-AI Co-Creation in Songwriting
  2. Tone Transfer
  3. Lo-Fi Player
  4. The Musician in the Machine
  5. BitRate: Machine Learning & Music Series
  6. Make a song together
  7. Improving Perceptual Quality of Drum Transcription with the Expanded Groove MIDI Dataset
  8. Making an Album with Music Transformer
  9. Listen to Transformer
  10. Encoding Musical Style with Transformer Autoencoders
  11. DDSP: Differentiable Digital Signal Processing

2019 13

  1. DrumBot: your real-time ML drummer
  2. SVG VAE: Generating Scalable Vector Graphics Typography
  3. Generating Piano Music with Transformer
  4. YACHT's new album is powered by ML + Artists
  5. MidiMe: Personalizing MusicVAE
  6. Visualizing the Bach Doodle Dataset
  7. ML-Jam: Performing Structured Improvisations with Pre-trained Models
  8. Magenta + Deeplocal + The Flaming Lips = Fruit Genie
  9. GrooVAE: Generating and Controlling Expressive Drum Performances
  10. WiMIR Workshop 2018
  11. Coconet: the ML model behind today’s Bach Doodle
  12. GANSynth: Making music with GANs
  13. Magenta Studio

2018 13

  1. Porting Arbitrary Style Transfer to the Browser
  2. Music Transformer: Generating Music with Long-Term Structure
  3. ML as Collaborator: Composing Melodic Palettes with Latent Loops
  4. The MAESTRO Dataset and Wave2Midi2Wave
  5. Piano Genie: An Intelligent Musical Interface
  6. A train window
  7. Piano Transcription in the Browser with Onsets and Frames
  8. Multitrack MusicVAE: Interactively Exploring Musical Styles
  9. Connecting with Music Through Magenta.js
  10. Magenta.js
  11. MusicVAE: Creating a palette for musical scores with machine learning.
  12. Hands on, with NSynth Super
  13. Onsets and Frames: Dual-Objective Piano Transcription

2017 11

  1. Real-time Performance RNN in the Browser
  2. Using NSynth to win the Outside Hacks Music Hackathon 2017
  3. Performance RNN: Generating Music with Expressive Timing and Dynamics
  4. Draw Together with a Neural Network
  5. Generate your own sounds with NSynth
  6. Waybackprop
  7. Making a Neural Synthesizer Instrument
  8. SketchRNN model released in Magenta
  9. NSynth: Neural Audio Synthesis
  10. Magenta returns to Moogfest
  11. Learning from A.I. Duet

2016 10

  1. Magenta wins "Best Demo" at NIPS 2016!
  2. Tuning Recurrent Neural Networks with Reinforcement Learning
  3. Multistyle Pastiche Generator
  4. Human Learning What WaveNet Learned from Humans
  5. Magenta MIDI Interface
  6. Generating Long-Term Structure in Songs and Stories
  7. Music, Art and Machine Intelligence (MAMI) Conference
  8. Reading List
  9. A Recurrent Neural Network Music Generation Tutorial
  10. Welcome to Magenta!

Undated 7

  1. Plugins
  2. Demos
  3. Research
  4. Magenta RealTime 2
  5. Infinite crate
  6. Ddsp vst
  7. Studio