Hi everyone, it is a long text, but I’m interested in implementing a special core feature in MG3: real-time detection of playing techniques (fingers, pick, strumming, etc.) across three cumulative levels.
Each stage provides immediate, massive benefits for live performance—allowing users to modulate effects, MIDI channels, or synth parameters dynamically based on how they strike the strings:
Level 1: Separate detection of finger and pick strikes
Objective: The engine detects whether a string was struck with a finger/fingernail or with a guitar pick.
Benefit: Musicians can control their sound highly dynamically during live performances. For example, playing with a pick can trigger a crisp lead synth, while switching to fingers in the middle of a song automatically switches MG3 to a soft electric piano or blends in internal effects (reverb/delay).
Level 2: Integrating strumming into hybrid picking
Objective: The engine distinguishes between strummed chords and individual picking/fingerstyle playing. Strumming is detected based on the time window in which multiple strings are struck in quick succession (within a few milliseconds) and are thus perceived as a chord. Additionally, the system detects whether the strumming is performed with fingers, fingernails, or a pick to enable further control options.
Benefit: Strummed chords can be routed to a separate MIDI channel and processed with dedicated MIDI/audio effects—such as pad sounds, string and horn overdubs, or varying levels of guitar audio distortion.
Level 3: Full expansion with Tapping
Objective: Ultimate expressiveness for complex styles. Each type of strike within the same performance is isolated and simultaneously controls its own instruments or effect assignments across Audio and MIDI units. As soon as a tapping note is detected, the system automatically adjusts the MIDI velocity to match the softer tapping dynamics and routes it to a separate MIDI channel.
Benefit: The ability to perform complex hybrid techniques, such as hybrid picking (thumb and index finger using the pick while middle and ring fingers pluck simultaneously) combined with finger tapping in the higher register. A combination of strummed pad sounds and additional tapping sounds (e.g., strings/piano) is also possible.
I believe that with such a phased approach, the MG3 Core engine can be expanded steadily, step by step, while users gain new creative possibilities right from Level 1. 