基于CNN和Transformer融合网络的机械臂视觉 定位算法

Robot Arm Visual Localization Algorithm Based on CNN and Transformer Fusion Network

  • 摘要: 品等挑战。因此,本文提出了一种基于CNN和Transformer融合网络的机械臂视觉定位算法:提出的融合网络有效地利用 全局和局部特征来分割目标;定位后处理算法基于分割图像的轮廓特征计算抓取中心和旋转角度;引入的边缘特征加强模 块增强分割边缘的特征;损失函数衡量了分割边缘与真值之间的偏差,以及计算的中心点与真值之间的偏差。在自建数据 集上的试验结果表明,本文提出的方法在平均交并比达到了0.987。在抓取中心x、抓取中心y和旋转角度A上,平均绝对 误差分别达到2.78像素、5.75像素和2.43°,优于其他先进方法。此外,在工业零部件数据集T-LESS上的对比试验结果表明, 本文方法具有较好的适用性。

     

    Abstract: segmentation,high-precision component localization,and the necessity to accommodate products of the same category but differing models. Therefore,this paper proposes a vision localization algorithm for robotic arms based on a fusion network of CNN and Transformer. The proposed fusion network effectively utilizes global and local features to segment targets;The post-processing algorithm for localization calculates the grasping center and rotation angle based on the contour features of segmented images;The introduced edge feature enhancement module enhances the features of segmented edges;The loss function measures the deviation between the segmentation edge and the true value,as well as the deviation between the calculated center point and the true value. Experimental results on custom dataset demonstrate that the proposed method achieves a mean Intersection over Union of 0.987. The Mean Absolute Errors for grabbing center x,grabbing center y,and rotation angle A are 2.78 pixels,5.75 pixels,and 2.43°respectively, outperforming other state-of-the-art methods. Furthermore, comparative experimental results on the industrial component dataset T-LESS demons that the proposed method exhibits good applicability.

     

/

返回文章
返回