BoryGlass Solution

BoryGlass Solution | Bory Lip-Reading and Speech Recognition AR Glasses Solution |

An AR glasses solution that combines lip-reading AI, speech recognition, and AR caption display technology to build hearing-assistance services

 

BoryGlass Solution is an AR-based hearing-assistance solution that combines lip-reading AI, speech recognition, real-time caption generation, and AR glasses display technology to support conversation understanding for people who are deaf or hard of hearing and for older adults.

In everyday conversations, meetings, lectures, consultations, education, and video-viewing environments, it is often difficult to understand content through speech alone. Speech recognition may also be insufficient when there is background noise, rapid speech, mask use, distance, or multiple people speaking at once.

 

BoryGlass Solution uses both audio information and visual lip-movement information to convert conversations into text and display the resulting captions on AR glasses, smartphones, tablets, and web screens.

It can be applied by welfare organizations, educational institutions, hospitals, research institutions, companies, hearing-assistance service providers, and organizations developing accessibility services based on AR devices.

 

[Solution Deployment Inquiry][Hearing-Assistance AR Service Consultation][PoC Development Inquiry][Request a Proposal]

Customer Challenges

 

People who are deaf or hard of hearing can easily miss parts of conversations

People who are deaf or hard of hearing, including users with age-related hearing loss, often miss what others say during face-to-face conversations, meetings, lectures, and consultations.

BoryGlass Solution converts conversations into real-time captions and displays them on AR glasses or connected device screens to support the user's understanding.

 

There are situations where speech recognition alone is not enough

Speech-recognition results may be unstable in noisy places, when the speaker is far away, when speech is fast, or when pronunciation is unclear because of mask use.

BoryGlass Solution can combine speech recognition with lip-reading AI so that audio information and visual lip-movement information jointly support caption generation.

 

Conventional caption services require users to look at a separate screen

Smartphone caption services can be inconvenient because users must keep looking downward during a conversation.

BoryGlass Solution displays captions on AR glasses so users can read the conversation while continuing to look at the person speaking.

 

Hearing-assistance systems must be tailored to each institution's service goals

Welfare organizations, educational institutions, hospitals, companies, and research institutions have different purposes and operating methods.

BoryGlass Solution can be built for various customer goals, including personal hearing assistance, institution-wide distribution services, caption support for education and lectures, meeting accessibility, and research or pilot data collection.

 

Solution Overview

BoryGlass Solution is an AI captioning, lip-reading, speech-recognition, and AR-display solution for building hearing-assistance AR glasses services.

 

Key functions include the following.

• Real-time caption generation based on speech recognition
• Caption assistance based on lip-reading AI
• Caption display on AR glasses
• Smartphone, tablet, and web-screen integration
• Glasses Mode screen
• Conversation caption recording and review
• Video caption generation
• Plain-language conversion
• Key-content summarization
• Personalized caption UI
• Institutional user management
• Training-data collection and management
• Hearing-assistance service API integration
• Research and pilot data-management screen

 

Key Features

 

1. Caption Assistance Based on Lip-Reading AI

BoryGlass Solution can analyze visual lip-movement information and use it to generate conversation captions.

When audio alone is difficult to recognize, lip-reading AI can provide supplementary information and can be configured to work together with speech-recognition results according to the customer-service objective.

 

2. Real-Time Caption Generation Based on Speech Recognition

The other person's speech is converted into text through speech recognition and displayed as captions in a form the user can understand.

It can provide real-time caption assistance in meetings, consultations, lectures, everyday conversations, and guidance situations.

 

3. Caption Display on AR Glasses

BoryGlass Solution can be configured to display conversation captions on an AR glasses screen.

Users can view captions within their field of vision without constantly looking at a smartphone, helping preserve natural face-to-face communication.

 

4. Smartphone, Tablet, and Web Integration

The solution can be used with smartphones, tablets, and desktop web screens as well as AR glasses.

Depending on the usage environment, it can include a mobile app, web service, administrator screen, and glasses-mirroring screen.

 

5. Glasses Mode Support

Glasses Mode is a screen layout designed to display captions, video, guidance messages, and learning content on AR glasses.

Depending on the service objective, it can be extended into conversation mode, video-caption mode, learning mode, consultation mode, customer-support mode, and other configurations.

 

6. Personalized Caption UI

Caption size, position, color, display speed, background transparency, high-contrast mode, and other settings can be adjusted according to the user's vision, environment, and preferences.

The screen can be designed with visual accessibility as well as hearing assistance in mind.

 

7. Video Caption Generation

BoryGlass Solution can be used not only for real-time conversations but also to generate captions for video content.

It can provide STT captions, lip-reading-assisted captions, and editable caption screens for lecture videos, consultation videos, educational content, and guidance videos.

 

8. Plain-Language Conversion and Summarization

The solution can be extended to rewrite long or complex guidance into easier language or display a summary of the key points.

It can be used in education, consultations, public guidance, hospital guidance, and welfare-service environments.

 

9. User and Institution Management

When an institution provides BoryGlass services to multiple users, it can manage user accounts, device information, usage histories, caption settings, and inquiry records.

It is suitable for distribution services operated by welfare organizations, educational institutions, research institutions, and companies.

 

10. Research and Pilot Data Management

A research screen can be built to collect and manage video, audio, captions, and user-feedback data for improving lip-reading AI and hearing-assistance services.

Whether data is collected, the storage scope, anonymization method, and consent procedure are designed separately according to the customer institution's personal-data processing standards.

 

Available Deployment Configuration

 

Basic Deployment Configuration

• AR glasses integration module
• Speech-recognition module
• Lip-reading AI analysis module
• Real-time caption generation module
• Glasses caption display screen
• Smartphone or web integration screen
• User caption settings
• Conversation-mode screen
• Video-caption-mode screen
• Basic administrator screen

 

Extended Deployment Configuration

• Desktop, tablet, and smartphone web service
• Glasses Mode mirroring
• Caption editing
• Speaker identification
• Plain-language conversion
• Key-point summarization
• Training-data collection screen
• Institutional user management
• Customer-support and FAQ screen
• Consultation history management
• Video upload and caption generation
• Real-time recording and streaming
• External service API integration
• Cloud server deployment
• On-premises server deployment
• Research-institution data-management dashboard

 

Application Scenarios

 

Personal Hearing-Assistance AR Service

The service can be built so people who are hard of hearing or deaf and older users can wear AR glasses and view captions for everyday conversations.

It can reduce the communication burden on users during conversations, consultations, meetings, and guidance situations.

 

Education and Lecture Caption Assistance

An instructor's speech can be displayed as captions in classrooms, seminars, training venues, and online lectures.

Students can view lecture content through AR glasses or a connected screen and, when needed, use caption records and summaries as learning materials

.

 

Meeting and Workplace Accessibility Support

Real-time caption assistance can be provided to employees who need hearing accessibility in corporate or institutional meetings.

It can be integrated with meeting captions, summaries, key-statement organization, and conversation-recording functions.

 

Institutional Distribution Service for Welfare Organizations

Welfare organizations, disability-support organizations, and local governments can build services that distribute or lend AR hearing-assistance devices to people who are deaf or hard of hearing.

Institutions can operate user management, device management, consultation support, and service-inquiry response functions.

 

Hospital and Consultation Environment Support

The system can provide caption assistance in environments where accurate conversation understanding is important, including hospital consultations, examination guidance, rehabilitation consultations, psychological counseling, and welfare consultations.

Users can review consultation content in real time, with summaries or guidance messages provided when needed.

 

Research and Pilot Service

Universities, research institutions, and corporate laboratories can use the solution for pilots involving lip-reading AI, speech recognition, AVSR, AR UI, and hearing-accessibility services.

Depending on the research objective, functions can include video upload, real-time recording, caption-result review, feedback collection, and data management.

 

Expected Benefits

 

Improved Conversation Accessibility

People who are deaf or hard of hearing and older users can view conversation captions, improving accessibility in everyday life and social activities.

 

More Natural Face-to-Face Communication

Displaying captions on AR glasses allows users to look at the other person rather than continuously checking a smartphone.

 

Compensation for Speech-Recognition Limitations

By using both audio information and visual lip-movement information, the solution can be designed to mitigate caption-recognition limitations caused by noise, pronunciation, distance, and environmental changes.

 

Institution-Specific Hearing-Assistance Services

User management, device management, caption screens, data management, and service-operation functions can be built according to the needs of welfare organizations, educational institutions, companies, hospitals, and research institutions.

 

Improved Accessibility for Video and Educational Content

Captions and summaries can be added to lecture videos, guidance videos, and educational content to improve hearing accessibility.

 

Data-Driven Improvement of Hearing-Assistance Services

Hearing-assistance services and lip-reading AI models can be continuously improved using user feedback, caption results, and video and audio data.

 

Deployment Process

 

1. Requirements Review

Confirm the customer institution's service objectives, target users, usage environment, AR glasses model, caption-display method, and data-processing standards.

 

2. Usage-Environment Analysis

Analyze conversation locations, lighting, noise, network conditions, camera positions, microphone configuration, user movement, and glasses-wearing environment.

 

3. Screen-Structure Design

Design the AR glasses caption screen, smartphone screen, web screen, administrator screen, video-caption screen, and user-settings screen.

 

4. PoC Deployment

Conduct speech recognition, lip-reading AI, caption display, Glasses Mode, and usability verification with selected users or in a specific usage environment.

 

5. Service Deployment

Build user management, device management, caption UI, video captions, summarization, administrator screens, and API integration according to the customer institution's operating method.

 

6. Operational Verification and Enhancement

Review and improve caption quality, wearing comfort, screen readability, user feedback, and data-management methods in the actual usage environment.

 

What BoryGlass Solution Can Do

 

• Build a lip-reading-AI-based caption-assistance system
• Build a speech-recognition-based real-time captioning system
• Build an AR glasses caption-display service
• Build smartphone, tablet, and web integration screens
• Configure Glasses Mode screens
• Provide a personalized caption UI
• Configure large-text and high-contrast caption screens
• Generate captions from uploaded videos
• Display real-time conversation captions
• Provide meeting and lecture caption assistance
• Integrate plain-language conversion
• Integrate conversation summarization
• Build a user and device management system
• Build a research and pilot data-collection screen
• Build an institution-wide hearing-assistance service for welfare organizations
• External service API integration

 

Deployment Inquiries

 

BoryGlass Solution can be proposed as a personal, institution-wide distribution, education and lecture, meeting-accessibility, or research and pilot solution according to the customer institution's objectives, target users, AR glasses configuration, and service-operation method.

• Inquiry about deploying a lip-reading and speech-recognition AR glasses solution
• Inquiry about building a hearing-assistance AR service
• Inquiry about building an institution-wide BoryGlass service for a welfare organization
• Inquiry about a lecture-captioning service for an educational institution
• Inquiry about a meeting-accessibility support system
• Inquiry about video-caption and conversation-caption services
• Inquiry about a lip-reading AI PoC
• Inquiry about AR glasses caption UI development
• Inquiry about a research and pilot data-management system
• Request a Proposal

 

Important Information

BoryGlass Solution is an AI-based hearing-assistance solution designed to improve conversation understanding and hearing accessibility for people who are deaf or hard of hearing and for older adults.

This solution supports communication by displaying conversations as captions and does not guarantee perfect recognition of every spoken word or lip movement.

 

Speech-recognition and lip-reading AI results may vary depending on background noise, lighting, camera position, the user's gaze direction, the speaker's speech habits, mask use, occluded lip movements, and network conditions.

BoryGlass Solution is intended to support hearing and improve accessibility and is not presented as a medical device for the diagnosis, treatment, or prevention of disease.

 

If conversation video, audio, captions, user information, or usage histories are stored or transmitted, prior consultation is required regarding personal-data processing standards and data-security policies.

Before deployment, the intended use, target users, AR glasses model, camera and microphone configuration, caption-display method, server configuration, and personal-data processing method must be reviewed.

---

BORY.ai Key Services Overview

Bory Co., Ltd. develops products, solutions, platforms, and services for industrial, medical, public-sector, healthcare, and barrier-free applications based on AI technologies involving speech, language, video, sensors, and data.

Below are the main representative domains currently operated or being prepared by Bory Co., Ltd. 

 

Primary Domain	Service/Brand	Description
bory.ai	BORY.ai	The official AI brand website of Bory Co., Ltd., serving as the company’s main website for the integrated presentation of its products, solutions, platforms, and services
borysense.com	BORY SENSE	An AI-powered hearing assistance platform that supports communication for people with hearing disabilities and older adults through real-time captioning, lip-reading AI, and AR glasses integration
borytalk.com	BORY TALK	A web-based conversational AI chatbot service designed for civil service inquiries, consultations, information guidance, and customer support
borykiosk.com	BORY KIOSK	A barrier-free AI kiosk service for older adults and people with disabilities, featuring voice guidance, captioning, and easy-to-use interfaces
boryservice.com	BORY SERVICE	A service portal introducing Bory’s AI services and custom-built AI offerings for industrial, public-sector, and everyday applications
borysong.com	BORY SONG	A music AI service that supports AI-powered composition, music generation, and sound content production