Skip to main content

Designing Android/Linux App for Cognitive Assistance Navigation using Sony Eye Glass

Primary Investigators:
Aniruddha Gokhale 

Brief Description of Project:
This project seeks two undergraduate students who will work together on a project seeking to design and implement a cognitive assistance navigation application for the visually impaired. The programming platform will involve both Android smartphone and a Linux-based IoT device, such as Raspberry Pi or Minnowboard. The IoT devices will interact with Sony Eye Glass, which captures images and also provides audio feedback to the user. The goal is for the App to then interact with a web/cloud-hosted server that performs image/object detection and provides safe navigation feedback to the user. Other IoT devices, such as Amazon Echo may also be involved.

Desired Qualifications:
CS 3251 or equivalent; Knowledge of Android app and/or Linux-based IoT device programming (e.g., Raspberry Pi or Minnowboard) required; Knowledge of Web and Cloud programming an added plus; Knowledge of operating systems also an added plus;
Nature of Supervision:
Mentoring by the faculty member and graduate students, and weekly meetings with the professor and graduate students.
A Brief Research Plan (period is for 10 weeks):
Focus will be on adding the smartphone/IoT device-based capability to interact with a cloud-based object detection inferencing service. Write a report and prepare poster for presentation; Research will involve working with the graduate students and professor. There may be a possibility to work on one or more publications, and participating in demos of the technology. Weekly status update meetings through the 10-week period.
Number of Open Slots: 2
Contact Information:
Name: Aniruddha Gokhale
Department: Electrical Engineering and Computer Science