NEWS‎ > ‎

[22/07/2016] Our ECCV'16 paper has been accepted as an oral presentation!

posted 22 Jul 2016, 04:26 by Hanme Kim   [ updated 6 Oct 2016, 13:52 ]
I am excited to share our latest work on "Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera" in collaboration with Stefan Leutenegger and Andrew Davison which will be presented at ECCV 2016!

We propose a method which can perform real-time 3D reconstruction from a single hand-held event camera with no additional sensing, and works in unstructured scenes of which it has no prior knowledge. It is based on three decoupled probabilistic filters, each estimating 6-DoF camera motion, scene logarithmic (log) intensity gradient and scene inverse depth relative to a keyframe, and we build a real-time graph of these to track and model over an extended local workspace. We also upgrade the gradient estimate for each keyframe into an intensity image, allowing us to recover a real-time video-like intensity sequence with spatial and temporal super-resolution from the low bit-rate input event stream. To the best of our knowledge, this is the first algorithm provably able to track a general 6D motion along with reconstruction of arbitrary structure including its intensity and the reconstruction of grayscale video that exclusively relies on event camera data.

Link to the paper:

Link to the video:

Link to the presentation: