|
|
河北工业大学、大连理工大学等三位专家讲述智能三维视觉 |
|

直播时间:2025年4月8日(周二)20:00-21:30
直播平台:

科学网APP
https://weibo.com/l/wblive/p/show/1022:2321325153172623851732
(科学网微博直播间链接)

科学网微博

科学网视频号
北京时间4月8日晚八点,iCANX Youth Talks第92期邀请到了河北工业大学机械工程学院教授张宗华、大连理工大学机械工程学院副教授蔡引娣、天津工业大学教授宋丽梅担任主讲,中国科学院长春光学精密机械与物理研究所副研究员于海担任研讨嘉宾,清华大学深圳国际研究生院副教授李星辉担任主持人,期待你一起加入这场知识盛宴。
【嘉宾介绍】

张宗华
河北工业大学
相位偏折镜面形貌三维测量
【Abstract】
With the development of aerospace, advanced manufacturing, automotive industry and integrated circuits, there is an urgent need to obtain 3D (Three-Dimensional) shape data of mirror surfaces quickly and accurately for quality control and functional evaluation. The fringe reflection profilometry based on phase calculation, also known as PMD (Phase Measuring Deflectometry), has been widely studied and applied due to its advantages of high precision, rapidity, full-field coverage, large dynamic range, non-contact operation and automatic data processing. However, PMD still faces unresolved problems in the measurement of mirror surfaces with different geometric shapes (non-continuous and large curvature), simultaneous clear imaging of the mirror surface and display screen, environmental light influence, and large-sized surface shape measurement.This presentation will introduce some recent works of our research group in the field of PMD. Specifically, it includes: 1) DPMD (Direct PMD), which solves the measurement problem of non-continuous mirrors; 2) PMD based on a curved display screen, enabling high-precision measurement of large curvature mirrors with a wide field of view; 3) PMD assisted by a concave mirror for focusing, addressing the problem of simultaneously clear acquisition of fringes on the display screen and the measured mirror surface; 4) IRPMD (Infrared PMD), which effectively eliminates the influence of external environmental light on the measurement results; 5) Robotic NCPMSD (Near optical Coaxial Phase Measuring Stitching Deflectometry), not only overcoming the field-of-view constraints inherent in conventional measurement systems, but also facilitating measurement of large-scale mirror surfaces and enabling flexible in-situ metrology through robotic control.
随着航空航天、先进制造、汽车工业和集成电路等领域的发展,急需快速精确地获取镜面三维形貌数据以进行质量控制和功能评价。基于相位计算的条纹反射轮廓法,也称为相位偏折测量术PMD(Phase Measuring Deflectometry),以其高精度、快速、全场、大动态范围、非接触和自动数据处理等优点而被广泛研究和应用。但PMD在不同镜面几何形貌(非连续和大曲率)测量、待测镜面和显示屏同时清晰成像、环境光干扰、大尺寸面形测量等方面仍存在未解决的难题。本次演讲将介绍我们课题组最近在偏折测量方面的一些工作,具体包括:1)直接相位偏折测量术DPMD(Direct PMD),解决非连续镜面的测量难题;2)基于曲面显示屏的PMD,实现大曲率镜面的高精度测量;3)基于凹面镜辅助对焦的PMD,解决显示屏上条纹和被测镜面同时清晰采集的难题;4)红外相位偏折测量术IRPMD (InfraRed PMD),有效消除外界环境光对测量结果的影响;5)基于机械臂的近光学同轴相位偏折测量拼接术Robotic NCPMSD(Near optical Coaxial Phase Measuring Stitching Deflectometry),不仅解决测量视场限制的问题,而且在机械臂的控制下可用于大尺寸镜面的灵活在线测量。
【BIOGRAPHY】
Zonghua Zhang is a full professor of the School of Mechanical Engineering, Hebei University of Technology, Tianjin, China. In 2000, he graduated with a PhD in Instrument Science and Technology from Tianjin University. He was a post-doctor in the School of Mechanical Engineering, Tianjin University from 2001 to 2002. He worked in Hongkong Polytechnic University, Ruhr University Bochum of Germany, Queen’s University of Canada, Heriot-Watt University and University of Leeds of UK, from 2003 to 2009. His research interests include 3D optical measurement, fringe projection profilometry, and phase measuring deflectometry. He has presided over or participated in more than 20 scientific research projects and published over 280 academic papers. He has also obtained more than 40 invention patents. He was selected for the Ministry of Educations New Century Excellent Talents Support Program in 2011. From 2016 to 2018, he was an EU Marie Curie Individual Fellow in University of Huddersfield of UK. He is an Associate Editor for “Optics Express” and “Visual Intelligence”, Editorial Board Member for “Optica and Precision Engineering” and “Infrared and Laser Engineering”. As the first inventor, he has won the China Patent Excellence Award, the Tianjin Patent Gold Award, the First Prize of Hebei Province Technological Invention, the First Prize of Technological Invention of the Chinese Society for Optical Engineering, the Second Prize of Hebei Province Technological Invention, and the Second Prize of Technological Invention of the China Instrument and Control Society.
张宗华,河北工业大学机械工程学院教授,2000年获得天津大学测试计量技术及仪器的博士学位,2001-2002年在天津大学机械工程学院从事博士后研究。2003-2009年在香港理工大学、德国波鸿鲁尔大学、加拿大女皇大学、英国赫瑞瓦特大学、英国利兹大学工作多年。他的研究方向包括光学三维测量、条纹投影轮廓术和相位偏折测量术。主持了国家自然科学基金“叶企孙”联合基金重点项目、国家重大科学仪器设备开发专项课题、国家自然科学基金等20多项国家与部省级重点项目,发表论文280余篇,授权国家发明专利40余项。荣获教育部新世纪优秀人才等称号。受欧盟玛丽•居里学者项目资助,2016-2018年在英国哈德斯菲尔德大学工作。现任《Optics Express》和《Visual Intelligence》的Associate Editor、《光学精密工程》和《红外与激光工程》的编委。作为第一完成人,荣获中国专利优秀奖、天津市专利奖金奖、河北省技术发明一等奖、中国光学工程学会技术发明一等奖、河北省技术发明二等奖、中国仪器仪表学会技术发明二等奖。

宋丽梅
天津工业大学
智能三维视觉与分析识别
【ABSTRACT】
Three-dimensional imaging technology is one of the important research directions in the field of advanced imaging and information processing for acquiring three-dimensional information from the real world. It has numerous applications in industry, agriculture, and everyday life. Taking intelligent manufacturing as an example, three-dimensional vision is an important way for robots to perceive their environment and has become an essential part of intelligent manufacturing. High-precision intelligent three-dimensional reconstruction technology plays a significant role in various industries of the national economy. It can provide robots with high-precision three-dimensional "eyes" and intelligent "brains," facilitating the transition from automation to intelligence.This report focuses on introducing the high-precision intelligent three-dimensional reconstruction and analysis methods that our team has primarily researched, as well as their applications in the fields of intelligent welding, intelligent grinding, intelligent sorting, and intelligent manufacturing.
三维成像技术是先进成像与信息处理领域的中获取现实世界三维信息的重要研究方向之一,在工业、农业及生产生活中有很多的应用。以智能制造业为例,三维视觉是是机器人感知的重要方式,已成为智能制造的重要组成部分。高精度智能化三维重建技术在国民经济各行各业均有重要的应用,可以为机器人提供高精度的三维立体“眼睛”和智慧的“大脑”,由自动化向智能化转变。本报告重点介绍本团队主研的高精度智能三维重建与分析方法,并介绍其在智能焊接、智能打磨、智能分拣以及智能制造等领域的应用。
【BIOGRAPHY】
Song Limei is a professor and doctoral supervisor at Tianjin Polytechnic University. She completed her undergraduate, masters, doctoral, and postdoctoral studies at Tianjin University from 1995 to 2006. She was selected as a first-tier candidate in Tianjins "131 Innovative Talent Development Program," the leader of an innovative team at Tianjins higher education institutions, an outstanding entrepreneurial and innovative postdoctoral fellow nationwide, and an outstanding mentor for Tianjins engineering professional degree students. She also serves as a member of the Fifth Tianjin Municipal Discipline Evaluation Group and a member of the Professional Degree Teaching Guidance Committee of the Fifth Tianjin Municipal Peoples Government Degree Committee.She has received numerous honors, including the National Model for Womens Achievements, Tianjin May Day Labor Medal, Tianjin March 8th Red Banner Holder, Tianjin Most Beautiful Female Teacher, and the Hong Kong Sengma Teaching Award. She has won three second prizes and two third prizes in Tianjins Science and Technology Progress Awards. Additionally, she was awarded the first prize in the second Tianjin "Haihe Talent" Postdoctoral Entrepreneurship and Innovation Competition, as well as one national bronze award in both the innovation and entrepreneurship groups of the National Postdoctoral Entrepreneurship and Innovation Competition.
宋丽梅,天津工业大学教授,博士生导师。 1995年-2006年在天津大学完成本科、硕士、博士和博士后研究工作,入选天津市“131创新型人才培养工程”第一层次人选,天津市高等学校创新团队带头人,全国创新创业优秀博士后,天津市工程专业学位优秀指导教师,担任天津市第五届学科评议组委员,第五届天津市人民政府学位委员会专业学位教学指导委员会委员。曾获全国巾帼建功标兵、天津市五一劳动奖章、天津市三八红旗手、天津市最美女教师、香港桑麻奖教金等荣誉称号。获天津市科技进步奖二等奖3项、三等奖2项。获第二届天津市“海河英才”博士后创业创新赛一等奖,全国博士后创新创业大赛创新组和创业组全国铜奖各1项。

蔡引娣
大连理工大学
制造过程中特征参数在线测量技术
【ABSTRACT】
In the cross-scale measurement during high-performance welding and additive manufacturing of major equipment, issues such as interference from arc light and powder particles, large span of feature sizes, high manufacturing temperatures leading to difficult image acquisition, easy distortion, poor reduction accuracy, lens distortion in the measurement system, and thermal influence errors in the system exist. These problems make the cross-scale measurement methods based on traditional machine vision measurement technology unable to perform online real-time detection, resulting in low detection accuracy and poor practicability.This presentation will introduce how our research group realizes in-line measurement in the manufacturing process, including: (1) Innovative research and development of binocular fringe structured light measurement system, combined with adaptive fringe coding algorithm, successfully built an experimental platform suitable for three-dimensional topography and deformation measurement of large and complex components, and realized non-contact real-time full-field measurement with micron-level accuracy; (2) Develop a visual inspection system for manufacturing defects based on deep learning to realize online identification of micron-level cracks and deformation defects in the environment of strong noise and multi-light interference; (3) Establish a pose measurement model and build a verification test bench for the pose measurement model to provide high-precision references for the closed-loop control of intelligent manufacturing equipment; (4) Design a measurement system for the motion accuracy of the linear axes of the welding platform to ensure the stability of welding motion.
重大装备高性能焊接与增材制造过程中跨尺度测量中,存在弧光和粉末颗粒等干扰、特征尺寸跨度大、制造温度高导致图像难获取、易失真、还原精度差、测量系统镜头畸变及系统存在热影响误差等问题,使得基于传统的机器视觉测量技术的跨尺度测量方法无法在线实时检测、检测准确率低、实用性不高。本次演讲将介绍我们课题组如何实现制造过程中的在线测量,具体内容包括:(1)创新研发双目条纹结构光测量系统,结合自适应条纹编码算法,成功搭建适用于大型复杂构件三维形貌与变形测量的实验平台,实现微米级精度的非接触式实时全场测量;(2)开发基于深度学习的制造缺陷视觉检测系统,在强噪声、多光照干扰环境下实现微米级裂纹、变形缺陷的在线识别;(3)建立位姿测量模型,搭建位姿测量模型验证实验台,为智能制造装备的闭环控制提供高精度基准;(4)设计焊接平台线性轴运动精度测量系统,保障焊接运动稳定性。
【BIOGRAPHY】
Yindi Cai is an associate professor and doctoral supervisor at the School of Mechanical Engineering, Dalian University of Technology. Research Field: Precision Improvement Technology of Manufacturing Equipment; multi-sensor fusion and intelligent monitoring technology; Precision measurement and control technology in the manufacturing process. Facing the strategic needs of national high-end processing equipment, focusing on processing equipment such as ultra-precision wafer thinning machines, precision wafer dicing machines and precision\/ultra-precision CNC machine tools, we have long been engaged in research on the accuracy generation of the whole machine, the performance improvement of functional components, and intelligent measurement and control. In the past five years, he has presided over a number of national\/provincial scientific research projects such as the National Key R&D Program, the National Natural Science Foundation of China, and the Liaoning Provincial Innovation Consortium Science and Technology Major Project, as well as a number of scientific research projects commissioned by enterprises and institutions. He has published more than 20 papers, including 14 SCI papers as the first author\/corresponding author; 13 national invention patents have been authorized, including 8 patents authorized by the first inventor; He served as a member of the editorial board of "Optics and Precision Engineering" and the young editorial board of "Nanomanufacturing and Metrology"; Won the third prize of the 4th Central Enterprise Yixing Innovation and Creativity Competition organized by the State-owned Assets Supervision and Administration Commission of the State Council.
蔡引娣,大连理工大学机械工程学院副教授,博士生导师。研究领域:制造装备精度提升技术;多传感融合与智能监测技术;制造过程精密测控技术。面向国家高端加工装备战略需求,聚焦超精密晶圆减薄机、精密晶圆划片机和精密/超精密数控机床等加工装备,长期从事整机精度生成、功能部件性能提升、智能测控等相关研究。近五年,主持国家重点研发计划课题、国家自然科学基金、辽宁省创新联合体科技重大专项等多项国家级/省部级科研项目,及多项企事业单位委托科研项目;发表论文20余篇,其中第一作者/通讯作者SCI/EI论文14篇;授权国家发明专利13项,其中第一发明人授权专利8项;担任《光学精密工程》编委和《Nanomanufacturing and Metrology》青年编委;获国务院国资委组织的第四届中央企业熠星创新创意大赛三等奖。
【主持人】

李星辉
清华大学
【研讨嘉宾】

于海
中国科学院长光所
特别声明:本文转载仅仅是出于传播信息的需要,并不意味着代表本网站观点或证实其内容的真实性;如其他媒体、网站或个人从本网站转载使用,须保留本网站注明的“来源”,并自负版权等法律责任;作者如果不希望被转载或者联系转载稿费等事宜,请与我们接洽。