Thanks to the proliferation of LIDAR scanners point cloud data of 3D models is becoming commonplace. While there is existing work on fast direct rendering for 3D point clouds, there is almost no work on using them for simulation (e.g. collision detection and response). This is a pity, as the available data could be used effectively for a variety of applications.