About WAM extensions
WAM Extensions are optional additions to the WAM 2.0 API that add tighter integration between WAM plugin and host, better solving user interface problems and creating new use-cases for WAMs to solve.
See https://github.com/boourns/wam-extensions for details and the interfaces hosts and wams should implement. Few examples are provided below but more will come.
Example WAM extensions
1 - The Note extension
The Notes extension allows one WAM to publish a list of relevant notes with names, and other connected WAMs to receive the note list. This enables a better user interface when sequencing typical drum machines or samplers where only certain MIDI notes can be received.
Note how the look & feel of the piano roll changed (thanks to the Note Extension):
2 - The Video extension
The Video extension adds video generation and processing capabilities to the WAM ecosystem. The WAM host manages a WebGL2 context, and plugins register render handlers to generate and process WebGL2 textures. Video WAMs can also process audio, allowing audio reactivity or simultaneous audio/video stream generation.
Below: the Butterchrun plugin (port from WinAmp) can generate GLSL shaders that react to the sound:
Preliminary example of a host that implements the video extension. Note that 90% of the code in this codepen is from the extension itself, and will certainly be hosted under webaudiomodules.com soon, reducing the example to about 30 lines of code.
3 - The Asset extension
With the Asset extension, WAM hosts control asset loading and saving. Individual WAM plugins can rely on the host for cloud storage, and users can manage all files related to a musical project in the host without having each WAM plugin store files in separate cloud services or accounts
Drum Sampler WAM using the Asset Extension to allow the host to control asset load/save:
4 - Modulation extension
The ModulationTarget extension enables plugin developers to create plugins whose purpose is to modulate, or control, the parameters of another WAM plugin. WAM Modulation plugins exist for parameter randomization, parameter sequencing, envelope following of an audio signal and LFO control. By using modulation WAMs, hosts enable deep parameter automation similar to modular synthesis.
Randomizer plugin uses the Modulation Target extension to randomize the Synth-101 patch: