Density-based Clustering for 3D Stacked Pipe Object Recognition using Directly-given Point Cloud Data on Convolutional Neural Network

  • Alfan Rizaldy Pratama Pratama Politeknik Elektronika Negeri Surabaya
  • Bima Sena Bayu Dewantara Politeknik Elektronika Negeri Surabaya
  • Dewi Mutiara Sari Politeknik Elektronika Negeri Surabaya
  • Dadet Pramadihanto Politeknik Elektronika Negeri Surabaya
DOI: https://doi.org/10.24003/emitter.v10i1.704
Keywords: Industrial object, Density-based clustering, 3D object recognition, Convolutional neural network

Abstract

One of the most commonly faced tasks in industrial robots is bin picking.  Much work has been done in this related topic is about grasping and picking an object from the piled bin but ignoring the recognition step in their pipeline. In this paper, a recognition pipeline for industrial bin picking is proposed. Begin with obtaining point cloud data from different manner of stacking objects there are well separated, well piled, and arbitrary piled. Then followed by segmentation using Density-based Spatial Clustering Application with Noise (DBSCAN) to obtain individual object data. The systems then use Convolutional Neural Network (CNN) that consume raw point cloud data. Performance of the segmentation reaches an impressive result in separating objects and network is evaluated under the varying style of stacking objects and give the result with average Accuracy, Recall, Precision, and F1-Score on 98.72%, 95.45%, 99.39%, and 97.33% respectively. Then the obtained model can be used for multiple objects recognition in one scene.

Downloads

Download data is not yet available.

References

Le T-T and Lin C-Y, Bin-Picking for Planar Objects Based on a Deep Learning Network: A Case Study of USB Packs, Sensors, vol. 19, no. 16, 2019. DOI: https://doi.org/10.3390/s19163602

Yan W, Xu Z, Zhou X, Su Q, Li S, and Wu H, Fast Object Pose Estimation Using Adaptive Threshold for Bin-Picking, IEEE Access, vol. 8, pp. 63055-63064, 2020. DOI: https://doi.org/10.1109/ACCESS.2020.2983173

Sari DM, Pratama AR, Pramadihanto D, and Marta BS, 3D Object Detection Based on Point Cloud Data, Inform : Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 7, no. 1, pp. 59-66, 2022. DOI: https://doi.org/10.25139/inform.v7i1.4570

Kameshwaran K and Malarvizhi K, Survey on Clustering Techniques in Data Mining, (IJCSIT) International Journal of Computer Science and Information Tehcnologies, vol. 5, no. 2, pp. 2272-2276, 2014.

Rusu RB, Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments, Ph.D thesis, Technische Universität München, 2010. DOI: https://doi.org/10.1007/s13218-010-0059-6

Ester M, Kriegel H-P, Sander J, and Xu X. A, Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise, Proceedings of 2nd International Conference on Knowledge Discovery and Data Mining, pp. 226-231, 1996.

Lim GH, Lau N, Pedrosa E, Amaral F, Pereira A and Luís Azevedo J, Precise and efficient pose estimation of stacked objects for mobile manipulation in industrial robotics challenges, Advanced Robotics, vol. 33, no. 13, pp. 636-646, 2019. DOI: https://doi.org/10.1080/01691864.2019.1617780

Zongming L, Jianxun L, Guodong L and Dong Y, Pose Estimation of Rigid Object in Point Cloud, 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, pp. 708-713, 2016.

Tombari F, Salti S, and Stefano LD, Unique Signatures of Histograms for Local Surface Description, ECCV'10: Proceedings of the 11th European Conference on Computer Vision, pp. 356-369, 2010. DOI: https://doi.org/10.1007/978-3-642-15558-1_26

Rusu RB, Blodow N and Beetz M, Fast Point Feature Histograms (FPFH) for 3D registration, 2009 IEEE International Conference on Robotics and Automation, pp. 3212-3217, 2009. DOI: https://doi.org/10.1109/ROBOT.2009.5152473

Rusu RB, Bradski G, Thibaux R and Hsu J, Fast 3D recognition and pose using the Viewpoint Feature Histogram, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2155-2162, 2010. DOI: https://doi.org/10.1109/IROS.2010.5651280

Wohlkinger W and Vincze M, Ensemble of shape functions for 3D object classification, 2011 IEEE International Conference on Robotics and Biomimetics, pp. 2987-2992, 2011. DOI: https://doi.org/10.1109/ROBIO.2011.6181760

Fernandes D, Silva A, Névoa R, Simões C, Gonzalez D and Guevara M, Point-cloud based 3D object detection and classification methods for self-driving applications: A survey and taxonomy, Information Fusion, vol. 68, pp. 161-191, 2020. DOI: https://doi.org/10.1016/j.inffus.2020.11.002

Khaliluzzaman Md, Abu Bakar Siddiq Sayem Md, and Misbah KL, HActivityNet: A Deep Convolutional Neural Network for Human Activity Recognition. EMITTER International Journal of Engineering Technology, vol. 9, no. 2, pp. 357-376, 2021. DOI: https://doi.org/10.24003/emitter.v9i2.642

Bello SA, Yu S, Wang C, Adam JM and Li J, Review: deep learning on 3D point clouds, Remote Sensing, vol. 12, no. 11, pp. 1729, 2020. DOI: https://doi.org/10.3390/rs12111729

Guo Y, Wang H, Hu Q, Liu H, Liu L and Bennamoun M, Deep Learning for 3D Point Clouds: A Survey, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 12, pp. 4388-4364, 2020. DOI: https://doi.org/10.1109/TPAMI.2020.3005434

Qi CR, Su H, Niessner M, Dai A, Yan M and Guibas LJ, Volumetric and Multi-View CNNs for Object Classification on 3D Data, 2016 IEEE Conferene on Computer Vision and Pattern Recognition (CVPR), 2016. DOI: https://doi.org/10.1109/CVPR.2016.609

Zhang Y and Rabbat M, A Graph-CNN for 3D Point Cloud Classification, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018. DOI: https://doi.org/10.1109/ICASSP.2018.8462291

Qi CR, Su H, Mo K and Guibas LJ, PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation, 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017.

Hanh LD and Duc LM, Planar Object Recognition For Bin Picking Application. 2018 5th NAFOSTED Conference on Information and Computer Science (NICS), pp. 211-215, 2018. DOI: https://doi.org/10.1109/NICS.2018.8606884

Sun Z, Li Z and Liu Y, An Improved Lidar Data Segmentation Algorithm Based on Euclidean Clustering, Proceedings of the 11th International Conference on Modelling, Identification and Control (ICMIC2019), pp. 1119-1130, 2019. DOI: https://doi.org/10.1007/978-981-15-0474-7_105

Ahmed SM and Chew CM, Density-Based Clustering for 3D Object Detection in Point Clouds, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10608-10617, 2020. DOI: https://doi.org/10.1109/CVPR42600.2020.01062

Czerniawski T, Sankaran B, Nahangi M, Haas C and Leite F, 6D DBSCAN-based segmentation of building point clouds for planar object classification, Automation in Construction, vol. 88, pp. 44-58, 2018. DOI: https://doi.org/10.1016/j.autcon.2017.12.029

Campello RJGB, Moulavi D and Sander J, Density-Based Clustering Based on Hierarchical Density Estimates, Advances in Knowledge Discovery and Data Mining, vol. 1819, pp. 160-172, 2013. DOI: https://doi.org/10.1007/978-3-642-37456-2_14

Published
2022-06-20
How to Cite
Pratama, A. R. P., Bima Sena Bayu Dewantara, Dewi Mutiara Sari, & Dadet Pramadihanto. (2022). Density-based Clustering for 3D Stacked Pipe Object Recognition using Directly-given Point Cloud Data on Convolutional Neural Network. EMITTER International Journal of Engineering Technology, 10(1), 153-169. https://doi.org/10.24003/emitter.v10i1.704
Issue
Vol 10 No 1 (2022)
Section
Articles

Copyright (c) 2022 EMITTER International Journal of Engineering Technology

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The copyright to this article is transferred to Politeknik Elektronika Negeri Surabaya(PENS) if and when the article is accepted for publication. The undersigned hereby transfers any and all rights in and to the paper including without limitation all copyrights to PENS. The undersigned hereby represents and warrants that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required. The undersigned represents that he/she has the power and authority to make and execute this assignment. The copyright transfer form can be downloaded here .

The corresponding author signs for and accepts responsibility for releasing this material on behalf of any and all co-authors. This agreement is to be signed by at least one of the authors who have obtained the assent of the co-author(s) where applicable. After submission of this agreement signed by the corresponding author, changes of authorship or in the order of the authors listed will not be accepted.

Retained Rights/Terms and Conditions

  1. Authors retain all proprietary rights in any process, procedure, or article of manufacture described in the Work.
  2. Authors may reproduce or authorize others to reproduce the work or derivative works for the author’s personal use or company use, provided that the source and the copyright notice of Politeknik Elektronika Negeri Surabaya (PENS) publisher are indicated.
  3. Authors are allowed to use and reuse their articles under the same CC-BY-NC-SA license as third parties.
  4. Third-parties are allowed to share and adapt the publication work for all non-commercial purposes and if they remix, transform, or build upon the material, they must distribute under the same license as the original.

Plagiarism Check

To avoid plagiarism activities, the manuscript will be checked twice by the Editorial Board of the EMITTER International Journal of Engineering Technology (EMITTER Journal) using iThenticate Plagiarism Checker and the CrossCheck plagiarism screening service. The similarity score of a manuscript has should be less than 25%. The manuscript that plagiarizes another author’s work or author's own will be rejected by EMITTER Journal.

Authors are expected to comply with EMITTER Journal's plagiarism rules by downloading and signing the plagiarism declaration form here and resubmitting the form, along with the copyright transfer form via online submission.