A pipeline for music generation and modification driven by procedural and/or AI systems.

The AI-Driven Generative Music Pipeline project, a collaboration between SIRT and Spawnify, aimed to create a system for the automated modification of existing music tracks. Driven by the potential of AI, the project involved an environmental scan, prototype design, and iterative development based on user testing. The prototype incorporates audio operations like stem splitting/recombining, tempo and mode changes, key transposition, and audio effects.

The Motivation Behind Automated Music Modification

The collaboration between SIRT and Spawnify was motivated by the desire to explore and prototype a system that could automatically modify existing music tracks. This project was driven by the potential to streamline music modification processes using AI-based approaches. An initial environmental scan of possible approaches was conducted. The primary goal was to enable specific modifications to existing music tracks automatically.

The Prototype System for Music Modification

The project has produced a prototype system designed for the automated modification of music tracks. Key aspects of the prototype included implementation of audio operations such as splitting and recombining tracks, a user-friendly web interface, client-server architecture and a class structure for operations.

Spawnify was satisfied with the result of the research project and continues to work on it internally.