Skip to main navigation menu Skip to main content Skip to site footer
International Journal of Robotics and Automation Technology

Articles

Vol. 11 (2024)

Research on Few-Shot Defect Detection Algorithm Based on Federated Learning

DOI
https://doi.org/10.31875/2409-9694.2024.11.08
Submitted
November 18, 2024
Published
17.11.2024

Abstract

The algorithm based on deep learning has been widely used in defect detection in all walks of life, but the performance of the deep learning model depends mainly on rich annotation data. However, in the actual scene, obtaining large-scale, high-quality data to ensure users' privacy and safety is challenging, which limits its further promotion in specific application fields. To solve this problem, we propose a federated few-shot defect detection framework, which uses the privacy protection of the federated framework to jointly train independent few-shot tasks distributed on different clients to obtain a few-shot model that can quickly adapt to new tasks with limited data. We have done many experiments to evaluate our framework's effectiveness, and the results show that our framework is superior to the baseline and achieves the same performance as the model trained with a lot of data.

References

  1. Luo Q, Fang X, Liu L, et al. Automated visual defect detection for flat steel surface: a survey. IEEE Transactions on Instrumentation and Measurement 2020; 69: 626-644. https://doi.org/10.1109/TIM.2019.2963555
  2. Cheng X, Yu J. Retinanet with difference channel attention and adaptively spatial feature fusion for steel surface defect detection. IEEE Transactions on Instrumentation and Measurement 2021; 70: 1-11. https://dx.doi.org/10.1109/tim.2020.3040485
  3. Chen R, Yu G, Qin Z, et al. Patch matching for few-shot industrial defect detection. IEEE Transactions on Instrumentation and Measurement 2024; 73: 1-11. https://dx.doi.org/10.1109/TIM.2024.3413170
  4. Song G, Song K, Yan Y. EDRNet: encoder–decoder residual network for salient object detection of strip steel surface defects. IEEE Transactions on Instrumentation and Measurement 2020; 69: 9709-9719. https://dx.doi.org/10.1109/tim.2020.3002277
  5. Gao Y, Lin J, Xie J, et al. A real-time defect detection method for digital signal processing of industrial inspection applications. IEEE Transactions on Industrial Informatics 2021; 17: 3450-3459. https://dx.doi.org/10.1109/tii.2020.3013277
  6. Li Z, Wang H, Swistek T, et al. Enabling the network to surf the internet. arXiv.cs.CV: 2102.12205 2021. https://doi.org/10.48550/arXiv.2102.12205
  7. Li F, Rob F, Pietro P. A bayesian approach to unsupervised one-shot learning of object categories. Proceedings Ninth IEEE International Conference on Computer Vision 2003; 1134-1141. https://doi.org/10.1109/ICCV.2003.1238476
  8. Kang B, Liu Z, Wang X, et al. Few-shot object detection via feature reweighting. Proceedings of the IEEE/CVF international conference on computer vision 2019; 8420-8429. https://dx.doi.org/10.1109/iccv.2019.00851
  9. Yan X, Chen Z, XU A, et al. Meta r-cnn: towards general solver for instance-level low-shot learning. Proceedings of the IEEE/CVF International Conference on Computer Vision 2019; 9577-9586. https://dx.doi.org/10.1109/iccv.2019.00967
  10. Fan Q, Zhuo W, Tang C K, et al. Few-shot object detection with attention-rpn and multi-relation detector. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2020; 4013-4022. https://dx.doi.org/10.1109/cvpr42600.2020.00407
  11. Perez R, JM, Zhu X, et al. Incremental few-shot object detection. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2020; 13846-13855.
  12. Agboka KM, Tonnang H E Z, Abdel-Rahman E M, et al. Data-driven artificial intelligence (AI) algorithms for modelling potential maize yield under maize–legume farming systems in East Africa. Agronomy 2022; 3085. https://doi.org/10.3390/agronomy12123085
  13. Liu C. Research on the perfection of personal information legal protection in the age of big data. Open Journal of Legal Science 2023; 11: 1445-1451. https://dx.doi.org/10.12677/ojls.2023.113206
  14. Mcmahan HB, Moore E, Ramage D, et al. Communication-efficient learning of deep networks from decentralized data. Artificial intelligence and statistics. PMLR 2017; 1273-1282. https://doi.org/10.48550/arXiv.1602.05629
  15. Fan C, Huang J. Federated few-shot learning with adversarial learning. 19th International Symposium on Modeling and Optimization in Mobile. IEEE 2021; 1-8. https://doi.org/10.48550/arXiv.2104.00365
  16. Zhao Y, Li M, Lai L, et al. Federated learning with non-iid data. arXiv preprint arXiv:1806.00582 2018. https://doi.org/10.48550/arXiv.1806.00582
  17. Xu D, Tian Y. A comprehensive survey of clustering algorithms. Annals of Data Science 2015; 165-193. https://dx.doi.org/10.1007/s40745-015-0040-1
  18. Cao H, Jia L, Si G, et al. A clustering-analysis-based membership functions formation method for fuzzy controller of ball mill pulverizing system. Journal of Process Control 2013; 34-43. https://dx.doi.org/10.1016/j.jprocont.2012.10.011
  19. Jinyin C, Xiang L, Haibing Z, et al. A novel cluster center fast determination clustering algorithm. Applied Soft Computing 2017; 539-555. https://doi.org/10.1016/j.asoc.2017.04.031
  20. Narendra, Kumpati S, Thathachar M, et al. Learning automata-a survey. IEEE Transactions on systems, man, and cybernetics 1974; 323-334. https://doi.org/10.1109/TSMC.1974.5408453
  21. Chen T, Kornblith S, Norouzi M, et al. A simple framework for contrastive learning of visual representations. International conference on machine learning. PMLR 2020; 1597-1607. https://doi.org/10.48550/arXiv.2002.05709
  22. Mnih V, Kavukcuoglu K, Silver D, et al. Human-level control through deep reinforcement learning. Nature, 2015; 518: 529-533. https://dx.doi.org/10.1038/nature14236
  23. Girshick R. Fast R-CNN. arXiv preprint arXiv:1504.08083 2015; 1440-1448. https://dx.doi.org/10.1109/iccv.2015.169
  24. Ren S, He K, Girshick R, et al. Faster R-CNN: towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497 2017; 1137-1149. https://dx.doi.org/10.1109/tpami.2016.2577031
  25. Dalal N, Triggs B. Histograms of oriented gradients for human detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005; 1: 886-893.https://dx.doi.org/10.1109/cvpr.2005.177
  26. Bay H, Tuytelaars T, Van Gool, et al. SURF: speeded up robust features. Lecture Notes in Computer Vision 2006; 404-417.
  27. Mao T, Ren L, Yuan F, et al. Defect recognition method based on hog and SVM for drone inspection images of power transmission line. International Conference on High Performance Big Data and Intelligent Systems 2019; 254-257. https://dx.doi.org/10.1109/hpbdis.2019.8735466
  28. Zhao C, Chen Y, MA J. Fabric defect detection algorithm based on MFS and SVM. International Conference on Image and Video Processing and Artificial Intelligence 2018; 10836: 77-82. https://doi.org/10.1117/12.2513987
  29. Pasadas D J, Ramos H G, Feng B, et al. Defect classification with SVM and wideband excitation in multilayer aluminum plates. IEEE Transactions on Instrumentation and Measurement 2020; 241-248. https://doi.org/10.1109/TIM.2019.2893009
  30. Liu W, Anguelov D, Erhan D, et al. SSD: single shot multibox detector. Springer International Publishing 2016; 21-37. https://doi.org/10.1007/978-3-319-46448-0_2
  31. Zeng W, You Z, Huang M, et al. Steel sheet defect detection based on deep learning method. International Conference on Intelligent Control and Information Processing 2019; 152-157. https://doi.org/10.1109/ICICIP47338.2019.9012199
  32. Jin X, Wang Y, Zhang H, et al. Dm-ris: deep multimodel rail inspection system with improved MRF-GMM and CNN. IEEE Transactions on Instrumentation and Measurement 2019; 1051-1065. https://doi.org/10.1109/TIM.2019.2909940
  33. Hao R, Lu B, Cheng Y, et al. A steel surface defect inspection approach towards smart industrial monitoring. Journal of Intelligent Manufacturing 2021; 32: 1833-1843. https://doi.org/10.1007/s10845-020-01670-2
  34. Tian Y, Wang Y, Krishnan D, et al. Rethinking few-shot image classification: a good embedding is all you need. Computer Vision 2020; 266-282. https://doi.org/10.1007/978-3-030-58568-6_16
  35. Mcmahan, Moore E, Ramage D, et al. Communication-efficient learning of deep networks from decentralized data. Artificial intelligence and statistics 2017; 1273-1282. https://doi.org/10.48550/arXiv.1602.05629
  36. Yang Q, Liu Y, Chen T, et al. Federated machine learning: concept and applications. ACM Transactions on Intelligent Systems and Technology 2019; 10: 1-19. https://doi.org/10.1145/3298981
  37. Zhu H, Xu J, Liu S, et al. Federated learning on non-iid data: a survey. Neurocomputing 2021; 465: 371-390.
  38. https://doi.org/10.1016/j.neucom.2021.07.098
  39. Oord, Li Y, Vinyals, et al. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 2018. https://doi.org/10.48550/arXiv.1807.03748
  40. Hsu, QI H, Brown, et al. Measuring the effects of non-identical data distribution for federated visual classification. arXiv preprint arXiv:1909.06335 2019. https://doi.org/10.48550/arXiv.1909.06335
  41. Yu, Bagdasaryan, Eugene, et al. Salvaging federated learning by local adaptation. arXiv preprint arXiv:2002.04758 2020. https://doi.org/10.48550/arXiv.2002.04758
  42. He, Zhang X, Ren S, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 2015; 37: 1904-1916. https://doi.org/10.1109/TPAMI.2015.2389824
  43. Redmon J, Divvala S, Girshick R, et al. You only look once: unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition 2016; 779-788. https://doi.org/10.48550/arXiv.1506.02640