About Vaani

🎯 The Problem We're Solving

63 million people in India live with significant hearing impairment. Yet, most live events, classrooms, and meetings remain inaccessible.

The Challenge:

• Live lectures & meetings rarely have real-time captions
• Complex vocabulary makes captions hard to follow for many Deaf users
• Sign language interpreters are expensive and not always available
• Existing solutions require expensive hardware or complex setup
• Low-resource environments lack access to assistive technology

The Deaf and Hard-of-Hearing community faces daily communication barriers that limit their participation in education, workplace, and social settings.

💡 Our Solution

Vaani is a browser-based accessibility tool that provides:

• Real-Time Captions — Instant speech-to-text transcription
• AI Simplification — Complex sentences converted to easy-to-read English
• Sign Language Videos — Automatic ISL video playback for each word

All running 100% in the browser — no installations, no backend servers, no waiting.

�️ Technology Stack

• Frontend: HTML5, CSS3, JavaScript (ES6+)
• Speech Recognition: Web Speech API
• AI Processing: Google Gemini 1.5 Flash
• Animations: GSAP (GreenSock)
• Sign Language: Pre-recorded ISL MP4 videos (150+ signs)
• Hosting: Vercel (Static)
• Design: Atkinson Hyperlegible Font (Accessibility-optimized)

Why This Stack?

• No Backend = No cold starts, no server costs, instant availability
• Web Speech API = Native browser support, no external dependencies
• Gemini Flash = Fast, accurate AI at minimal latency
• Static Hosting = 99.99% uptime, global CDN distribution

🌍 Social Impact

Who Benefits?

• Deaf Students — Follow lectures in real-time without interpreters
• Hard-of-Hearing Professionals — Participate fully in meetings
• Sign Language Learners — Learn ISL through visual word-to-sign mapping
• Educators — Make classrooms more inclusive
• Event Organizers — Provide instant accessibility at events

Impact Potential:

• 63M+ Deaf individuals in India can benefit
• Zero cost removes economic barriers
• Browser-based ensures universal access
• No training required for immediate adoption

� Future Scope

• Regional Languages — Hindi, Tamil, Marathi caption support (🔄 Planned)
• Custom Vocabulary — Domain-specific word simplification (🔄 Planned)
• Offline Mode — Cached videos + local speech recognition (🔄 Research)
• Mobile App — React Native / Flutter apps (🔄 Planned)
• AI Sign Generation — Real-time avatar-based signing (🔄 Research)
• Classroom Integration — LMS plugins (Moodle, Canvas) (🔄 Planned)
• Multi-Speaker Detection — Identify and label different speakers (🔄 Research)

👥 Our Team

Vaani is developed by a passionate team committed to creating inclusive technology:

Built with ❤️ for TechSprint 2026

🌐 Live Demo

Try Vaani now: https://vaanii.vercel.app

Demo Instructions:

• Open the link in Chrome or Edge
• Allow microphone access when prompted
• Click "Start Listening"
• Speak clearly into your microphone
• Watch real-time captions and sign language videos appear!

🎙️ Vaani — Making Every Voice Visible
Built for accessibility. Designed for everyone.