This paper presents a scheme for building detection from LIDAR data and high resolution satellite imagery. The proposed scheme comprises two major parts: (1) segmentation, and (2) classification. Spatial registration of LIDAR data and high resolution satellite images are performed as data pre-processing. It is done in such a way that two data sets are unified in the object coordinate system. Then, a region-based segmentation and object-based classification are integrated for building detection.