MR-based Swarm Drone Operation & Control
A swarm cannot be flown one machine at a time. Here the operator wears the interface instead of sitting at one.
Mixed reality replaces the console. Tactical options arrive from an AI as the situation changes, and the operator answers with a gesture rather than a cursor.
The hardware is not ready, and that is the design problem rather than a caveat attached to it. Gesture recognition is less exact than a mouse and takes more steps to say the same thing, so the question is what may be entrusted to it now and what has to wait.
We worked heuristically, on the actual equipment, arguing the interface out in front of it. A gesture cannot be judged on paper.