SnapStick: Merging AI and Accessibility to Enhance Navigation for Blind Users

Abstract:
Navigational aids play a vital role in enhancing the mobility and independence of blind and visually impaired (VI) individuals.
However, existing solutions often present challenges related to discomfort, complexity, and limited ability to provide detailed environmental awareness.
To address these limitations, we introduce SnapStick, an innovative assistive technology designed to improve spatial perception and navigation.
SnapStick integrates a Bluetooth-enabled smart cane, bone-conduction headphones, and a smartphone application powered by the Florence-2 Vision Language Model (VLM) to deliver real-time object recognition, text reading, bus route detection, and detailed scene descriptions.
To assess the system’s effectiveness and user experience, eleven blind participants evaluated SnapStick, and usability was measured using the System Usability Scale (SUS).
In addition to the 94% accuracy, the device received an SUS score of 84.7%, indicating high user satisfaction, ease of use, and comfort.
Participants reported that SnapStick significantly improved their ability to navigate, recognize objects, identify text, and detect landmarks with greater confidence.
The system’s ability to provide accurate and accessible auditory feedback proved essential for real-world applications, making it a practical and user-friendly solution.
These findings highlight SnapStick’s potential to serve as an effective assistive device for blind individuals, enhancing autonomy, safety, and navigation capabilities in daily life.
Future work will explore further refinements to optimize user experience and adaptability across different environments.
Published:
11 July 2025
RAISE Affiliate:
Spoke 1
Name of the Journal:
Technologies
Publication type:
Contribution in journal
DOI:
10.3390