基于机器视觉的仿生手研制

Research on Vision-Based Bionic Hand Development

  • 摘要: 针对老年人和残疾人抓取物品困难的问题,设计了一种基于机器视觉的仿生手,该仿生手可根据使用人员嘴部姿势的变化,自动完成抓握动作。根据人手的结构特点及长度比例,设计并制作了仿生手的机械结构。利用Visual Studio 软件,基于Dlib 模型设计了面部表情识别算法,通过提取预测点中的嘴部关键点位置计算嘴部长宽比,再通过判断长宽比变化确定嘴部状态。仿生手控制系统以STM32单片机为核心,采用串口通信的方式,实现视觉系统与控制系统的数据传输。实验证明,设计的仿生手能够快速正确判断人脸表情变化并稳定完成抓握动作,为下一步仿生机械臂的设计奠定了基础。

     

    Abstract: To address the difficulty of grasping objects for the elderly and people with disabilities, this study designs a machine vision-based bionic hand that automatically performs grasping actions by detecting changes in the user's lip posture. Based on the structural characteristics and proportional dimensions of the human hand, the mechanical structure of the bionic hand was designed and fabricated. A facial expression recognition algorithm was developed in Visual Studio using the Dlib model, which extracts key lip points to calculate the lip aspect ratio and determines lip states through ratio variations. The control system, centered on an STM32 microcontroller, achieves data transmission between the vision and control modules via serial communication. Experiments demonstrate that the bionic hand can rapidly and accurately recognize facial expressions and execute stable grasping actions, laying a foundation for future bionic robotic arm development.

     

/

返回文章
返回