p5.js, tone.js, html, css
Explore your Toccata
Toccata is a piece about decay, about the impermanent. The emergence over time or, rather, progression of entropy is a key characteristic of our universe. Everything evolves to nothing. We as mortal beings have sometimes trouble reconciling with this idea. Humans have sought immortality for millennia, be it through ancient potions or modern medicine, be it from leaving a legacy that we feel will stand the test of time. It will, only to decay later than us.
Toccata is a piece about change. Change lies at the heart of human cognition and human nature. Our thoughts and our emotions happen over time, and are a function of the change that is both around us and at the very core of our selves. Change comes in nature in cycles. Seasons of growth, seasons of ripe fruits of life, seasons of decay, of death, rebirth.
Toccata is music. We find music to convey some of the deepest streams of human condition, connecting it to some other form of being. Music also happens over time, and music happens because of change. Music encodes our feelings better than any other aid we may have.
When we started talking about the collaboration, back in early March 2022, the war in Ukraine had just broken out. Things we once took for granted, suddenly were turned upside down. As humankind, we were forced to re-align and take new perspectives. Without any doubt, this situation of uncertainty in the world has influenced this collaboration as well. Suddenly, everyone could see decay in their everyday, and we felt the need to reflect that in our piece.
The general theme of musicality came up as a characteristic that resonated to both of us. In our early conversations we shared ideas and discussed how to approach a music piece that wouldn't necessarily be a music piece. A music piece with visuals that were not a visualization of the music, and music that doesn't react to the visuals and vice versa. Yet keeping some relation, and expressing decay over time. How does music wear out? Music is intangible, is a set of instructions, and instructions need not be subject to decay. However, performance of music is subject to decay, as it's physical. Playing the same record over and over again does wear it out. Performing a piece live many times over would let diverse effects of degradation appear.
Andreas brought the Toccata in D minor, Op. 11, by Sergei Prokofiev to the conversation. Since then, the project's unofficial name (and official as well) has been Toccata. A fascinating piece that creates an incredible atmosphere. A piece with strong narrative power. From there, the collaboration started to take shape with the different ideas and discussions and the musical references we brought in.
Marcelo added the idea of layering perforated shapes, composed from contracting and expanding openings. Rotating in ever-changing rhythms, creating unexpected windows into new layers of time. The visuals evolved from the initial simple ideas into more complex concepts that built on top of the simple elements.
The music incorporates variations we composed, as well as tributes to certain pieces that are dear to us, subjected to the generative mechanics of this work. Across all variations of the music, one constant remains: the piano. It was fully sampled from a piano very special to Andreas — the piano he learned to play on as a kid. Sampled on a warm summer day this July, at the place of his parents, it transports the remnant warmth of the past into the very present of the piece, an embodiment of decaying childhood memories and the cycles of change that lie dormant within the things around us.
Collectors will be able to extract audiovisual passages from the piece that we can mint officially with our signature and transfer to their wallet, as snapshots of the pieces to be exhibited easily in virtual galleries. This will be executed from the artwork’s official homepage to ensure maximum video and audio quality of the excerpts. Details to be announced in the coming weeks. There will be a limit to the number of extracts that can be minted per token, it will have an associated cost.
About the work
Toccata is a generative musical-visual piece that evolves over time and exhibits periods of degradation and decay, to recover and go back to periods of bloom. Degradation periods affect both the music, which will present distortion, as well as the visuals, which will both present visual distortion / glitches, as well as spatial arrangement of elements. Objects will be distorted and exhibit noisy behaviour.
As the music evolves, the piece proposes different views on its visuals. Both the music and visuals depend on a birth date for the piece: it sounds and looks different as time moves forward. The birth date is set to March 6th, 2022, the date when the first words were written about this collaboration. From that date onwards, the piece goes through the mentioned cycles of decay and bloom. The piece can be set to be experienced on a given date by passing the parameter “date” in the URL (see end of this text for details).
The music is generated from a set of variations that we composed and prepared. Much like we set the type of visuals that can be used, with a range of parameters, effectively defining a visual grammar, we do the same with the music. Preparing some precomposed fragments, and setting a wide range of parameters that the generative music system can play with, we let the algorithm make choices over time that yield a forever evolving music piece that depends on both the birthdate of the piece, the date when it is being experienced and the fxhash given by the platform.
The visuals trigger changes in the viewpoint that yield different perceptions of the reality contained therein. Much like in life, to obtain an integral knowledge of a situation it is necessary to gain different viewpoints, to step back, to contemplate the world around us with clean eyes and integrate this perception into the previous knowledge. Also, different views trigger different emotions. The piece might eventually leave a trail as it moves, filling the space with the echoes of the previous movement. Oftentimes we do the same in our lives, viewing our environment under the effect of our previous emotions. Emotions that can be of decay or bloom, thus casting a gloomy or cheerful tint over our daily errands.
The observer can fix a viewport to contemplate the piece from that point for an extended period of time. The piece will then refrain from changing the view automatically. The observer can also choose to set the piece to leave a trail constantly or to avoid it constantly. Both viewpoint and visual echo can be reset back to the piece’s automatic behaviour, and can be also set to a given value via an URL parameter.
The piece lets the viewer record a video with the music and save it locally. The piece exports a video in the WebM format, which can be played in most modern browsers as well as specialized video players such as VLC. It can be converted to other formats such as .mp4 either with online tools or, for the more technically inclined, using ffmpeg.
It also lets the viewer save a still of the current view, or set the piece to automatically save a still every time the view changes, so the user will keep images of intermediate states in the piece.
The features of the piece include the mood of the work, and the period of one complete circle of decay and rebirth.
Collecting Toccata means collecting a window into the piece. The piece moves, the window remains the same. Close it, open it, forget it, live with it. The piece will continue to live. Born with the beginning of this collaboration, the variations of Toccata will live on, they will outlive you, and slowly decay. Some faster, some slower. And at some point, they will be reborn, in a constant cycle of change.
Technical aspects
The piece is intensive in computing power use. It will check performance automatically and will degrade its visuals to achieve better performance. The viewer can disable performance check and potential degradation of the piece by appending “performance.checkPerformance=0” to the URL.
Works best with Chrome. Tested on Chrome, Firefox, Safari on macOS and iOS. Limited compatibility with Android, and plenty of uncertainty with Windows.
To hear the music on iOS, the device's silent mode must be switched off.
Controls
- Click on the piece or press spacebar to start it (WebAudio requires user intervention for the music to start). Once the music has started, again click or press spacebar to play/pause.
- Press “s” to save a still at the current resolution
- Press “i” to automatically save a still every time the view changes. Press “i” again to disable it
- Press “r” to start recording a video at the current resolution, then “r” again to stop.
- Press “t” followed by “1” to force trail on, “2” to remove it, “0” to reset automatic behaviour.
- Press “v” followed by a number from 1 to 9 to set a fixed viewport, 0 to set automatic behaviour.
- Press “d” followed by a number from 1 to 9 to add that amount to the pixel density, 0 to reset to default.
- Press “k” followed by + or - to get closer / further. Taking a step back to see things in perspective.
- &date=2022-10-30: will set the piece to be experienced as in October 30th, 2022. Date is in YYYY-MM-DD format.
- &view=1: sets the viewport to 1 (it can be any number between 1 and 9)
- &density=3: sets the pixel density to 3 (any arbitrary number, can be decimal;; if it’s too high or low then the piece will most probably be blank)
- &trail=1 or 2: trail on permanently, trail off permanently)
- &fullscreen=1: sets the piece to use all window size available (1), otherwise defaults to its default aspect ratio)
- &reveal=1: reveals the visuals of the piece immediately, though the need for user interaction to start the music remains
- &k=5 (a number between -3 and 3) to specify how close/far we want to be from the scene.
URL parameters
The live view on fxhash uses the hash as the first URL param (?fxhash=). Therefore, as opposed to what is stated in the little user manual in the description on fxhash, you should append other parameters using an "&". See options below:
WebM audio-video recording performed using the library RecordRTC by https://muazkhan.com/, MIT licence.
Web | https://andreasrau.eu |
@andreasrau_eu | |
@andreasrau.eu |
Web | https://www.iillucid.com |
@msoriaro | |
@msoriaro |
The artists share a common interest for music, and ever-changing generative systems. In Toccata, they got to combine these interests in their first long-form exploration of a fully animated audio-visual piece minted on the Tezos blockchain.