Imagine a cane that not only guides you but also warns you about changes in the terrain and obstacles ahead. This is what researchers have created with a new low-cost smart cane for visually impaired people. The cane uses two cameras and an ultrasonic sensor to detect obstacles and terrain changes, such as potholes or curbs. Thanks to an artificial intelligence system, it classifies obstacles based on danger and provides real-time audio alerts. Tests have shown that the cane is accurate in detecting obstacles and terrain changes, with a distance error of only 0.3 cm for obstacles and 4.22 cm for terrain changes. Additionally, the system is fast, with an average of 0.6 seconds to process each situation. This smart cane could really make a difference in the lives of those who have difficulty seeing!
The smart cane uses an innovative method called Pathway Surface Transition Point Detection (PSTPD) to detect pathway transition points. This method combines depth mapping with weighted bounding boxes to accurately estimate the distance of obstacles and terrain changes. The system consists of three main modules: obstacle detection and classification, pathway surface detection, and auditory notifications. The obstacle detection module classifies obstacles into three levels of severity: mild, moderate, or severe. The pathway surface detection module is able to recognize eight different types of surfaces, such as asphalt, grass, or cobblestones, and estimate the distance of transition points. Finally, the auditory notification module provides real-time audio alerts to warn the user of dangers. Tests have shown that the system has a mean Average Precision (mAP@50) of 0.70 for obstacle detection and 0.92 for surface classification. Additionally, the system is efficient, with an average of 0.6 seconds to process each instance.
