expending creative coding spaces

20152022

This series explores the spatial expansion of code-based design practices beyond the screen. It focuses on translating digital content into physically perceptible media through light, space, and real-time interaction.

table of contents

With the release of Processing in 2001, designers and artists were, for the first time, able to engage creatively with programming in a low-threshold and accessible way. While the field of Creative Coding and Generative Design had existed before, Processing opened up new pathways and continues to shape generations of creative practitioners to this day.

Despite the wide variety of visual forms made possible through code, the medium of display has largely remained the same: the rectangular, two-dimensional screen or projection. This represents a regrettable and unnecessary limitation—especially considering the rich potential of these contents to extend into physical space or be remixed in real time, as is common practice with linear visuals using software like Resolume.

Around 2013/2014, the affordable availability of individually addressable LEDs (e.g., WS2812/B) and low-cost microcontrollers with built-in Wi-Fi functionality (ESP8266/ESP32) made it possible to reconceive these LEDs as a distributed display. Individual pixels could now be controlled directly from Processing—based on their physical arrangement in space—and supplied with data wirelessly in real time.

In response to this development, custom software was created that enabled multiple Processing sketches to be combined and controlled live during events—similar to how Resolume functions in the video realm. Using the developed engine, pixel data could be streamed to their respective receivers in real time.

Over the years, both the application and the supporting hardware have continued to evolve. The underlying protocols transitioned from proprietary custom implementations to industry standards like DMX ArtNet, and the engine itself was ported from Java to P5.js. The range of use cases also expanded—from early applications in underground event culture to media art installations and experimental chandeliers. To this day, the software forms the foundation for a wide range of individual and collaborative creative experiments aimed at making Creative Coding content physically tangible in space.

Software

Hardware

Chandelier

2020

A simple fresnel construction with addressable warm-cold-amber LEDs to cast a pattern to ceiling, where the individual LEDs communicate status from a data stream.

Chandelier

Based on the underlying paradigm of “Expanding Creative Coding Spaces,” a chandelier was developed that captures specific color values from visual effects generated in P5.js or Processing and translates them into an abstract, spatial light visualization.The RGB color space derived from the captured pixels in P5.js/Processing is translated into WWA LEDs. This means that each RGB value—for example, red (0–255)—is mapped to amber (1800–2000 K), green to warm white (2700–3000 K), and blue to cool white (6000–7000 K). While this approach does not allow for representative color rendering in the traditional sense, it creates a distinct color space focused on the white spectrum. Compared to the artificially additive white tones produced by RGB pixels, this results in a lighting effect that appears more natural in the context of ambient room illumination.The chandelier contains a total of 60 individually addressable pixels, enabling 45,900 possible individual color combinations. These light points are projected onto the ceiling above via a Fresnel lens, creating the chandelier’s characteristic light visualization.The underlying P5.js/Processing sketches are transmitted in real time to the chandelier via the Art-Net protocol. However, the original visual content differs significantly from the physical light projection, as the Fresnel lens introduces a strong abstraction. This transformation generates a unique aesthetic in form and motion, depending on the lens’s position and angle of rotation.

electronics

development

Gravity

2019

in collaboration with Jannik Bussmann, Dirk Erdmann

The installation “20grad” is setting out to abstractly visualize the sonority in temporary environments.

Gravity

Light and sound, as we usually interpret them, are elements without gravity and mass. The represented iteration "GRAVITY" adds another layer by kinetics. The elements of light, sound and mechanical movement are placed in narrative relation to each other and go beyond the expected behaviour. The setup includes six steles, each containing four rotating and emitting light elements. Through the continual interaction of intensity, rotation and speed, in combination with sound, a unique audiovisual composition is created.

Video

Specifications

dimensions: 200 cm x 1000 cm 24 light elements motors, custom made steles kinetics audiovisual installation – exhibition – loop (12min)

Exhibitions

GRAVITY was exhibited during the European Media Art Festival EMAF 2019 in Felix-Nussbaum-Haus and Kunsthalle Osnabrück.

Previs

20grad

2018

in collaboration with Jannik Bussmann

The installation series "20grad" explores the visualization of sound in temporary spaces.

20grad

Light is used as a key design element to tell abstract stories as well as to construct and deconstruct spatial atmospheres. The lighting system is lightweight and modular designed to create different sculptures and shapes for a wide range of room conditions. Each LED element is individually controllable with real time feedback by a custom software.

Aalto

In its design, the "AALTO" setup takes up the phenomenon of light as a wave. The individual elements are arranged statically, while the light floats through the form in rhythm with the sound.

Specifications

dimensions: 100 cm x 400 cm28 light elementsevent installation - backdrop

Exit

The setup is composed of four diagonally running groups of elements, which converge towards the centre on a stroboscope in the shape of a rhombus. The lights are extended by two screens, also in the shape of a rhombus, on which live visuals are projected. The setup was used for various performances at the "EXIT" event series. The arrangement is based on the logo of the crew.

Specifications

dimensions: 250 cm x 250 cm24 light elementscustom-made projection screensevent installation - backdrop

Metrik

The glowing branches grow through the shady leaves. The light makes the crowd blossom. Each element is intertwined, their DNA is the code. Between chaos and order, coincidence and intention, a subtle form of meta-language is created, which turns the place into an immersive dance experience. The interactive installation "METRIK" comprises a system that explores in an abstract way the interactions and interactions of form, light and sound in connection with processes in nature.

Specifications

dimensions: ~ 40 sq.m.120 light elementsceilling installation – festival, event

Interface

The main problem with video content or processing sketches is that they cannot be easily transferred to larger LED installations. The created software gets rid of this problem. It can import those sketches or video files and interpreted them as effects that can be combined or manipulated via the interface and are outputted on the LED Bars.The Interface views are splitted in four different parts. The left one is an preview of the selected effect. The middle view is a raw visual impression of all active effects. The right view is a simulation of the current state of the installation. It can be controlled with common MIDI Interfaces.

Hardware

Magnetic and Coders

2017

in collaboration with Jannik Bussmann, Dirk Erdmann

The installation and live performance „magnetic and coders“ messes with the viewer‘s perception of space and creates an immersive experience through the synergy of sculpting soundscapes. Stacked cubes construct and deconstruct the room continuously with kinetic movement and are enhanced by a projection mapping.

Magnetic and Coders

Installation

The installation is splitted axisymmetric into two parts. Each part contains 4 rows with 7 cubes dimensioned 30x30 cm. Every column of cubes can be adjusted individually in the y-axis with a stepper motor which is attached to a control plate at the ceiling of the room.

Teaser

Sequence

If a row shall move to a user defined position it starts to move to the given position as well as confirming its current position to the control software. With this current positioning data the software is able to calculate the optical distortion. The software is calibrated to the absolute minimum and maximum y- axis mapping positions and interpolate these with the given data to the current mapping which is outputted to the projector. So it is possible to move the kinetic installation as well as projection map visual content onto its surface while moving.

Visuals

The installation is completed by an cinemascope visual mapping placed at the center of the stage. Organic seeming visuals interacting with the mapping content of the installation as well as with the live performed music.

All content even the music, the installation and every visual was created exclusively for this performance. The idea of this project was to create a synergy of all different parts of this performance. The installation is driven by the music as well as by the visuals. The other way round the music is manipulated by the current state of the installation. Each part of the performance affecting each other to unite auditive and visual content to a whole experience.

Impression

Setup