The connected component clustering does not do too well when different objects are actually connected, say because they are touching, or one is resting on the other. Usually, however, the objects might have differing local normals at the interface where they are touching. Let's add normal agreement to the connected component clustering to see how the normals can be used to differentiate parts of the scene.

Perform a region growing clustering strategy using the connected components for the region expansion candidate, and using the angular difference between normals to assess membership to the same cluster.

/*Read the slides on normal vector estimation.

For Matlab folks, an exemplar implementation of normal vector estimation can be found here. Try to implement your own estimator.

For PCL folks, you may refer to the sample code. Try to implement your own estimator. */

Back