How to use it
- 1Choose an instrument by the kind of motion you want to explore.
- 2Enable sound, start playback, and identify the visual event that creates each note.
- 3Adjust timing when available or export the audiovisual result.
Generative music labSee the
See the
sound.
Six visual instruments where motion writes the melody. Press play, turn on sound, and download the result as an MP4.
Physics · rhythm · harmony
Six instrumentsPick a motion.
Pick a motion.
Make a song.
Every instrument includes synthesized audio, adjustable timing, and MP4 export with sound.
Instrument 01
Polyrhythm Balls
Separate clocks. One perfect unison.
Instrument 02
Pendulum Orchestra
Gravity keeps the tempo.
Instrument 03
Ripple Piano
Every drop leaves a note.
Instrument 04
Orbit Chords
A solar system that composes.
Instrument 05
Gravity Harp
Falling becomes melody.
Instrument 06
Spiral Sequencer
Round and round becomes a beat.
How Generative Music Lab
actually works.
The Music Lab is a collection of visual instruments in which pendulums, ripples, orbits, gravity, spirals, and polyrhythms schedule synthesized notes. Motion is both the interface and the score.
Written by WeSimSims · Last meaningfully updated August 30, 2026
What the model demonstrates
Each instrument converts discrete simulation events—such as an endpoint, collision, orbit crossing, or ripple contact—into notes. A shared transport keeps visible motion and synthesized audio aligned.
Controls that matter
- Instrument
- Selects a distinct mapping between motion and musical events.
- Playback and sound
- Control the shared timeline and browser-generated audio.
- Export
- Records a supported canvas and audio stream into a downloadable video.
Experiments to try
- Identify the event-to-note rule before reading the description.
- Compare periodic pendulum motion with expanding ripple timing.
- Listen for repetition, then watch which visible paths produce it.
How to read an outcome
Regular motion creates recognizable pulse, while overlapping cycles create denser patterns. The instrument stays coherent because notes remain attached to visible events.
Limitations and accessibility
Autoplay restrictions require user interaction before sound. Recording formats and audio timing vary by browser, and these instruments are intended for creative play rather than professional mastering.
Animations may include rapid motion, flashes, synthesized sound, and dense particle effects. Pause playback, mute sound, or reduce graphics quality whenever needed.
Frequently asked questions
Where does the music come from?
Notes are synthesized locally in the browser when simulation events occur.
Why is sound initially off?
Browsers generally require a user gesture before starting audio.