Magnifi-AR | Augmented Reality Magnification Aid For Low Vision Patients

Magnifi-AR

Augmented Reality Magnification Aid For Low Vision Patients

Proposal

Abstract

Augmented reality (AR) systems that enhance visual capabilities could make text and other fine details more accessible for low vision users, improving independence and quality of life. In this project, I will make the augmented reality magnifier for low vision patients. The main purpose of Magnifi-AR is improving to low vision patients experience in visual contents (books, photos, videos). Magnifi-AR is head-mounted, hands-free wearable projection technology. This project will be an ideal solution for people with Macular Degeneration. A patient will become capable of controlling content’s size, colour, contrasts by using camera and projection device. The output of head-worn AR magnifier device will improve the patient‘s visual experience and comfort on different visual contents. This device will be powered by the Android operating system so that more application can be added such as object & face detection applications in future.

Introduction

Concept

Augmented Reality (AR) is trending technology and have the capacity to revolutionize industrial and individual use in future generations. When this technology is used by medical purposes, it is obvious that a good quality and useful concept will be created. So, I want to apply this technology to help people who is low vision patients. In this system, the user or patient will be able to control visual content easily and magnified with projector. In the project that I want to do, I will create a new approach to low vision aids it is the head mounted magnifier with projector. In this prototype, users will able to control visual contents easily and can see content where they want to see. Because head mounted magnifier will use Pico laser projector which is not necessary focus so that user can be display content without focusing problem

In the future, this project will be able to determine in advance the possible emergencies by adding in the machine learning feature, and it can draw up a new content controller with self-learning.

Objectives

As I have mentioned in the Concept part, Augmented Reality big area and trending technology. My goal in this project is to bring together AR and medical purposes to improve and facilitate patients experience in visual content. This system will be different other low visual aids projects and application. In this project can see content where he/she wants. Because a projector and camera can be moveable. The final design of prototype will be head-mounted display based on the projector with powered by image processing. Other mobile phone application can be added in the future. For example, controlling content with phone wirelessly. Also outside world patients can want to help online with camera and users

Background

Before I start this project, the most important issue to decide is how projector and camera need to communicate with each other. After researching many articles and project drafts on the internet, I saw that Pico projector was the most suitable projection system. I also found that the most suitable system for converting HDMI to USB is S-link display adapter with this adapter I can connect projection and camera with same time. My other research subjects were image processing and pattern recognition to magnify content and controlling content colour and alignment. I decided to use OpenCV library in that case.

The other part of the project, low vision aid, came as a completely different issue. After researching a few articles and projects, I realized that patients don’t want to wear big and complex devices on the head. Also, they want to less interaction between devices and content. So that I will be careful about that.

While I am working on this project, I will work with patients who have low vision medical issue. I try to best design for patients. My aim is finding 20 patients and take feedback them when each development step.

S/T methodology and associated work plan

Methodology

Firstly, I had to decide which projector and camera to use for designing head mounted display. It is important for the project’s processing. After some researching I decided to use Pico laser projector because this projector has use laser light so that when open the projector no need the focusing.

Another important thing the camera which is good for image processing and optical character recognition. After some researching, I decide use OpenCV library because it have support cross platform and open source library. I draw final concept for use in this project at Figure 2.1.1. In this project, addition camera takes picture of each frame and OpenCV try to optical character recognition which is context is text and magnify selected content and create new camera feed after that Android device mirror the screen to projector with display adaptor and user can projected magnified content wherever he/she wants. This communication example showing at Figure2.1.2.

The software part of this project will be based on the OpenCV communication protocol but in this project, I use different programming language for the different purpose. I design software architecture as appropriate to develop. Because project can be change with feedbacks from patients.


Figure 2.1.1

Figure 2.1.2

References

[1] https://www.android.com

[2] http://www.polecam.com/antelope-pico

[3] https://opencv.org/

[4] https://www.java.com/

[5] https://developer.android.com/studio/index.html

Leave a Reply

Your email address will not be published. Required fields are marked *