Schwung’s AI-assisted code helps a blind musician shape his own sound

Andre Louis chooses the sounds and builds the track. In a May account of his Ableton Move demonstration, Sound Without Sight described the blind musician selecting drum hits, bass sounds, synthesisers and effects, then playing the parts into a layered composition. He used the Move with a keyboard and demonstrated its added screen-reader functions. The music remained a sequence of decisions he could make for himself.[1]

The software behind those spoken controls is Schwung, an independent project created by Charles Vestal. It runs alongside the Move’s usual software, adding instruments, effects and a parallel interface. Vestal says coding agents wrote much of the code under human supervision, and credits Louis for his work on accessibility. Here the AI contribution sits in the construction of an instrument’s working environment.[2]

That distinction gives the project a particular place in the AI music debate. A musician may already know exactly what sound they want. The obstacle can be finding a setting, identifying a selected sample or knowing how far a control has moved. Making those actions audible gives the musician information at the moment a choice has to be made.

Drake Music selected Louis’s work with the Move for its 13 October London event on AI and accessible music-making. Its programme brought him together with researchers and composers exploring other uses of AI, including participatory work with people living with dementia. The organisation’s account identifies him as a composer, producer, accessibility consultant and teacher of blind Logic Pro users.[3]

A voice attached to the controls

Schwung’s current manual describes an optional screen reader with adjustable speech speed, pitch, volume and announcement delay. It can be toggled with a double press of Shift and Note/Session, whether or not the parallel interface is active. The on-device help viewer is also read aloud. Those settings matter in a musical workspace: a voice has to deliver useful information without unnecessarily occupying the performer’s attention.[4]

Louis has also released Move Speech, a separate modification addressing controls that otherwise remain silent. Its current documentation covers sampling menus, slice settings, sample start and end values, and the velocity of an individual sequencer step. Version 1.0.2 adds spoken positions expressed as percentages of a sample, making a change to a start point audible as a value rather than merely announcing the control’s name.[5]

Hearing “start” tells a player where they are. Hearing the changing position tells them what their adjustment did. That small difference captures why accessibility work often continues after an interface can technically speak. A useful instrument needs to communicate its state as the musician explores it.

Move Speech feeds restored text into the Move’s existing accessibility path. It can work with browser-based speech or an existing Schwung voice setup. Its documentation distinguishes physical-device confirmation on firmware 2.1.5b2 from offline compatibility checks on 2.1.5b1 and 2.1.1. These are separate modifications with separate maintenance requirements, rather than one universal accessibility update.[5]

Available, with a real installation commitment

Schwung provides desktop installers for macOS, Windows and Linux, and describes the installer itself as accessible to screen readers. Installation requires a Move on Wi-Fi and a computer on the same network. The project advises backing up sets and samples and understanding the device’s recovery procedure. It is not approved or supported by Ableton.[6]

Vestal also describes Schwung as experimental software that is not yet stable enough to treat as an everyday production system. The benefit documented in Louis’s demonstration is therefore specific: a working creative route for an experienced musician, not a measured outcome for every blind user or a promise of trouble-free installation.[2][1]

The revealing contribution is the musician’s role in shaping the tool. Louis appears in this story as a performer, accessibility collaborator and software author. The result is a set of controls that gives more of the instrument back to the person playing it.

Report an error or suggest a correction