04 · Accessible screening

A vision check students can run themselves.

Outcome: a computer-based screening prototype that randomizes the E chart, gives voice prompts, recognizes hand gestures, and returns a result without constant staff operation.

RandomizedE directions
Gesture AIcamera input
Voicestep-by-step prompts
One devicecomputer or tablet
Vision test prototype in use
Self-guided test prototypeSchool screening concept
Why

Reduce queues and repetitive manual work.

School screenings require staff to point at charts all day, while students wait—and a fixed chart can be memorized.

How

Random prompt, gesture answer, immediate check.

The program chooses an E orientation, announces the target, captures the student’s gesture, compares it with the answer, and advances.

Tools

Use existing AI where it solves the bottleneck.

  • Mind+ visual programming
  • Baidu AI gesture API
  • Camera and microphone
  • Random variables and scoring logic
Technical judgment

Simple technology can still solve the real problem.

The project combines available recognition with clear interaction logic instead of building an unnecessary vision model from scratch.

Engineering evidence

The interface closes the loop from instruction to result.

Vision test start interface
Prompt: randomized targets prevent memorizing a fixed chart.
Vision test result interface
Response: gesture input is compared and the screening result is displayed.
Materials needed for the final pageA cleaner screen recording; result-upload workflow or screenshot; test protocol including viewing distance and display calibration; comparison against a standard eye chart.
Future plan

Turn a convenient demo into a trustworthy screening tool.

These are proposed next steps, not medical claims.

01

Calibrate

Account for screen size, resolution, viewing distance, and lighting.

02

Validate

Compare repeatability and agreement with a supervised standard screening.

03

Report safely

Upload results securely to school while clearly separating screening from diagnosis.