LAPSE:2025.0420
Published Article

LAPSE:2025.0420
Automated Interpretation of Chemical Engineering Diagrams Using Computer Vision
June 27, 2025
Abstract
This paper presents state-of-the-art object detection and object identification algorithms for digitizing and interpreting chemical engineering diagrams, including, Block Flow Diagrams (BFDs), Process Flow Diagrams (PFDs), and Piping and Instrumentation Diagrams (P&IDs), using computer vision techniques. These diagrams are essential for visualizing plant processes and equipment but are often stored as image-based PDFs, making manual digitization/interpretation labor-intensive and error-prone. The proposed algorithm automates tasks such as detecting unit operations and identifying them using a set of rule-based and predefined approaches including edge and contour-based rules, spatial arrangement rules, and geometric rules. This method avoids data requirements and computational requirements of deep learning approaches, offering a scalable and efficient solution for preliminary extraction of complex process information.
This paper presents state-of-the-art object detection and object identification algorithms for digitizing and interpreting chemical engineering diagrams, including, Block Flow Diagrams (BFDs), Process Flow Diagrams (PFDs), and Piping and Instrumentation Diagrams (P&IDs), using computer vision techniques. These diagrams are essential for visualizing plant processes and equipment but are often stored as image-based PDFs, making manual digitization/interpretation labor-intensive and error-prone. The proposed algorithm automates tasks such as detecting unit operations and identifying them using a set of rule-based and predefined approaches including edge and contour-based rules, spatial arrangement rules, and geometric rules. This method avoids data requirements and computational requirements of deep learning approaches, offering a scalable and efficient solution for preliminary extraction of complex process information.
Record ID
Keywords
Chemical Engineering Diagrams, Computer Vision for Chemical Engineering, Features Extraction in Diagrams, Object Detection, Object Identification, Optical Character Recognition OCR
Subject
Suggested Citation
Eid M, Ave GD. Automated Interpretation of Chemical Engineering Diagrams Using Computer Vision. Systems and Control Transactions 4:1670-1675 (2025) https://doi.org/10.69997/sct.129214
Author Affiliations
Eid M: W Booth School of Engineering Practice and Technology
Ave GD: Chemical Engineering Department, McMaster University, Canada
Ave GD: Chemical Engineering Department, McMaster University, Canada
Journal Name
Systems and Control Transactions
Volume
4
First Page
1670
Last Page
1675
Year
2025
Publication Date
2025-07-01
Version Comments
Original Submission
Other Meta
PII: 1670-1675-1161-SCT-4-2025, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2025.0420
This Record
External Link

https://doi.org/10.69997/sct.129214
Article DOI
Download
Meta
Record Statistics
Record Views
828
Version History
[v1] (Original Submission)
Jun 27, 2025
Verified by curator on
Jun 27, 2025
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2025.0420
Record Owner
PSE Press
Links to Related Works
References Cited
- Waller, A., LeDoux, J., & Newstetter, W. What makes an effective engineering diagram? a comparative study of novices and experts.. https://doi.org/10.18260/1-2--22751
- Yang, L., Zhang, J., Li, H., Ren, L., Yang, C., Wang, J., & Shi, D. (2024). A comprehensive end-to-end computer vision framework for restoration and recognition of low-quality engineering drawings. Engineering Applications of Artificial Intelligence, 133, 108524. https://doi.org/10.1016/j.engappai.2024.108524
- A rule-based approach for visual pattern inspection. (1988, January 1). IEEE Journals & Magazine | IEEE Xplore. https://ieeexplore.ieee.org/abstract/document/3867
- Moon, Y., Lee, J., Mun, D., & Lim, S. (2021). Deep Learning-Based Method to Recognize Line Objects and Flow Arrows from Image-Format Piping and Instrumentation Diagrams for Digitization. Applied Sciences, 11(21), 10054. https://doi.org/10.3390/app112110054
- Deep learning for text detection and recognition in complex engineering diagrams. (2020, July 1). IEEE Conference Publication | IEEE Xplore. https://ieeexplore.ieee.org/document/9207127 https://doi.org/10.1109/IJCNN48605.2020.9207127
- Kim, H., Lee, W., Kim, M., Yoochan, M., & others. (2021). Deep-learning-based recognition of symbols and texts at an industrially applicable level from images of high-density piping and instrumentation diagrams. Expert Systems with Applications, 183, 115337. https://doi.org/10.1016/j.eswa.2021.115337
- DalleAveLab. (n.d.). Computer vision chemical simulation: Images. GitHub. https://github.com/DalleAveLab/ComputerVisionChemicalSimulation/tree/main/images
- Bradski, G. (2000). The OpenCV Library. Dr. Dobb's Journal of Software Tools
- Canny, J. (1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6), 679-698. https://doi.org/10.1109/TPAMI.1986.4767851
- Suzuki, S., & Abe, K. (1985). Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 30(1), 32-46. https://doi.org/10.1016/0734-189X(85)90016-7
- Haralick, R. M., Sternberg, S. R., & Zhuang, X. (1987). Image analysis using mathematical morphology. IEEE Transactions on Pattern Analysis and Machine Intelligence, 9(4), 532-550. https://doi.org/10.1109/TPAMI.1987.4767941
- Beucher, S., & Meyer, F. (1993). The morphological approach to segmentation: The watershed transformation. In Mathematical Morphology and Its Applications to Image Processing (pp. 433-441) https://doi.org/10.1201/9781482277234-12
- Du, Y., Li, C., Guo, R., Yin, X., Liu, W., Zhou, J., Bai, Y., Yu, Z., Yang, Y., Dang, Q., & Wang, H. (2020). PP-OCR: A Practical Ultra Lightweight OCR System. arXiv preprint arXiv:2009.09941. Available at: https://arxiv.org/abs/2009.09941 | PaddleOCR Contributors. (2023). PaddleOCR: Awesome multilingual OCR toolkits based on PaddlePaddle. GitHub repository. Available at: https://github.com/PaddlePaddle/PaddleOCR
- Theisen, M. F., Flores, K. N., Balhorn, L. S., & Schweidtmann, A. M. (2023). Digitization of chemical process flow diagrams using deep convolutional neural networks. Digital Chemical Engineering, 6, 100072. https://doi.org/10.1016/j.dche.2022.100072
(1.13 seconds) 0.11 + 0.05 + 0.52 + 0.13 + 0.01 + 0.08 + 0.07 + 0 + 0.05 + 0.09 + 0 + 0.02

