Event cameras are bio-inspired sensors that report pixel-wise intensity changes with ms-level resolution, capturing high-speed motions without blurring, ideal for fast-tracking tasks. Event cameras offer ms-level sampling latency, which harmonizes exceptionally with the high sampling frequencies of mmWave radar. Their 2D imaging capability also complements radars' limited spatial resolution, similar to how traditional frame cameras operate. Such temporal consistency and spatial complementarity across both modalities inspire us to upgrade frame cameras with event cameras to pair with radar for accurate and fast drone localization.
The mmE-Loc comprises two key modules:
(i) The CCT (Consistency-instructed Collaborative Tracking) for noise filtering, drone detection, preliminary localization of the drone. This module utilizes temporal consistency of both modalities and drone's periodic micro-motion to eliminate noise and error detections, and preliminary localize the drone.
(ii) The GAJO (Graph-informed Adaptive Joint Optimization) for fine localization and trajectory optimization of the drone. This module employs the spatial complementarity from both modalities to unleash the potential of event camera and mmWave radar in landing drone localization.