Netz is an AI-powered, hand-controlled XR musical instrument that enables musicians to learn, play and create music and control studio software in mixed reality. It uses AI algorithms for real-time tracking of hand gestures, leveraging them for musical expression.
Performance/demo:
Netz has the following features:
It’s is a fully integrated XR experience, allowing you to create, record and perform music in XR. It has its own sound engine running on-device, which ensures maximum performance and low latency. There’s several presets to choose from, and you can create your own sounds and upload them to the instrument. Netz runs on Meta Quest headsets and will support the Apple Vision Pro in the future. However, it is not a VR instrument: while you play, you can still see the real world around you, talk to people and interact with your environment.
Netz uses machine learning algorithms that enable real-time tracking of hand gestures, leveraging them for musical expression. Netz can recognise a variety of hand gestures and use them to control the musical elements within the instrument. You can also create your own control gestures for playing, recording and performing music.
Netz integrates seamlessly with modern digital audio workstations (DAWs) like Ableton Live, Logic Pro and FL Studio. It comes with a VST plugin that allows you to control synthesizers and effects through MIDI messages.
Netz uses a unique note layout developed specifically for the instrument. For this, we have collaborated with a musician and music producer to create a layout that enables you to play scales and chords in an easy-to-learn way. Notes in Netz have MIDI MPE capabilities, enabling performers to individually control their dynamics, pitch bend and timbre, as well as other assignable attributes.