Live Multimedia Production ​

Live Multimedia Production

Producing music, visuals, interactive experiences and art installations involving both live human actions and technological environment as the context.

Live Multimedia Production ​

Producing music, visuals, interactive experiences and art installations involving both live human actions and technological environment as the context. LMP course 2 in the Chromatone Courses.

Multimedia and Intermedia ​

Definitions and overview of mediums Module 1 in the LMP course.

Core Concepts ​

• Definition of Multimedia: Integration of multiple sensory media
• Intermedia: Blending and crossing traditional artistic boundaries
• Exploration of sensory mediums:
  • Sound (Auditory)
  • Visual (Image/Video)
  • Kinetic (Movement)
  • Tactile (Touch)
  • Digital Interactions

Sound Design and Music Production ​

Synthesis techniques and workflow Module 2 in the Chromatone Courses.

Instruments and Sound Generation ​

1. Synthesizers
   • Hardware Synthesizers
     • Analog synthesizers
     • Digital synthesizers
     • Modular synthesizer systems (Eurorack, etc.)
   • Software Synthesizers
     • VST plugins
     • Standalone software synths
     • Web-based synthesizers
2. Synthesis Techniques
   • Subtractive Synthesis
   • Additive Synthesis
   • FM (Frequency Modulation) Synthesis
   • Wavetable Synthesis
   • Granular Synthesis
   • Physical Modeling
3. Sound Production Workflow
   • Recording techniques
   • Signal processing
   • Effects and modulation
   • Mixing and mastering
   • Distribution platforms

Recording and Production Ecosystem ​

• Digital Audio Workstations (DAWs)
  • Ableton Live
  • Logic Pro
  • FL Studio
  • Reaper
• Audio interfaces
• Microphones and recording techniques
• Monitoring and acoustics

Video Production and Manipulation ​

Video Capture and Generation ​

1. Camera Technologies
   • DSLR and Mirrorless Cameras
   • Professional Video Cameras
   • Webcams and Streaming Cameras
   • Mobile Device Cameras
2. Generative Video Techniques
   • Live Coding Environments
     • Hydra
     • Processing
     • TouchDesigner
   • Real-time Visual Synthesis
   • Algorithmic Video Generation
3. Video Production Tools
   • Adobe Premiere Pro
   • Final Cut Pro
   • DaVinci Resolve
   • Open-source alternatives (OpenShot, Kdenlive)
4. Streaming Technologies
   • OBS Studio
   • Twitch streaming
   • YouTube Live
   • RTMP protocols

3D and Generative Visualization ​

3D Software and Techniques ​

• Fusion (Blackmagic Fusion)
• Blender
• Womp
• Cinema 4D
• Unity and Unreal Engine for real-time rendering

MIDI and Synchronization ​

MIDI Protocol ​

• MIDI basics and history
• MIDI Controllers
• Hardware and software routing
• MIDI interfaces

Synchronization Technologies ​

• Metronome and Tempo Mapping
• MIDI Clock
• Timecode synchronization
• Networked performance systems

Workflow and Publishing ​

Content Creation Cycle ​

• Rapid prototyping
• Short development sprints
• Iterative design process
• Collaborative frameworks

Publishing Platforms ​

• YouTube
• Vimeo
• Twitch
• Personal websites
• Specialized multimedia platforms

Final Project: Live Performed Multimedia Piece ​

Project Objectives ​

• Create an integrated multimedia performance
• Demonstrate proficiency in multiple mediums
• Develop a cohesive artistic vision
• Technical execution and creative expression

Evaluation Criteria ​

• Technical complexity
• Artistic innovation
• Seamless integration of mediums
• Performance quality
• Documentation and presentation

Additional Recommended Technologies ​

• Max/MSP
• Pure Data
• SuperCollider
• Resolume Arena
• VDMX
• Isadora

Emerging Technologies to Explore ​

• AI-assisted multimedia generation
• VR/AR performance environments
• Blockchain and NFT multimedia platforms
• Networked collaborative tools