Semantic Alignment of LiDAR Data at City Scale


Abstract

This paper describes an automatic algorithm for global alignment of LiDAR data collected with Google Street View cars in urban environments. The problem is challenging because global pose estimation techniques (GPS) do not work well in city environments with tall buildings, and local tracking techniques (integration of inertial sensors, structure-from-motion, etc.) provide solutions that drift over long ranges, leading to solutions where data collected over wide ranges is warped and misaligned by many meters. Our approach to address this problem is to extract "semantic features" with object detectors (e.g., for facades, poles, cars, etc.) that can be matched robustly at different scales, and thus are selected for different iterations of an ICP algorithm. We have implemented an all-to-all, non-rigid, global alignment based on this idea that provides better results than alternatives during experiments with data from large regions of New York, San Francisco, Paris, and Rome.

Paper

Fisher Yu, Jianxiong Xiao and Thomas Funkhouser
Semantic Alignment of LiDAR Data at City Scale
Computer Vision and Pattern Recognition, 2015

Download [PDF] [Supplementary]

Video


Download [Highres(266.3MB)] (The point clouds look better in the high resolution video.)

Slides


Download [PDF] [Keynote]

Poster


Download [PDF]

Bibtex

@inproceedings{yu15semantic,
  Author    = {Fisher Yu, Jianxiong Xiao and Thomas Funkhouser},
  Title     = {Semantic Alignment of LiDAR Data at City Scale},
  Booktitle = {28th IEEE Conference on Computer Vision and Pattern Recognition},
  Year      = {2015},
}