Skip to content

Latest commit

 

History

History
233 lines (178 loc) · 12 KB

File metadata and controls

233 lines (178 loc) · 12 KB

LINE Desktop Accessibility Add-on for NVDA

Overview

This add-on enhances the NVDA screen reader's support for the LINE Desktop application on Windows (Qt6 version). It uses OCR (Optical Character Recognition) and coordinate-based automation to improve the accessibility of chat list navigation, message reading, and making phone calls.

Important

Some features in this add-on rely on OCR (Optical Character Recognition), so the recognition results may not be 100% accurate.

Features

  • Improved navigation experience for chat lists and the message input field.
  • Voice and Video Calls: Initiate calls directly from the friends tab.
  • Incoming Call Handling: Answer and reject incoming calls, and check caller information.
  • OCR Support: Automatically attempts to read text that cannot be accessed through standard accessibility APIs.
  • Debug Tools: Provides shortcuts to inspect the UI structure, making troubleshooting easier.
  • Accessible Message Reader: Export the current chat and browse it in a simple reader dialog.
  • Context-Sensitive Confirmation Keys: Temporarily provides single-key actions for recall and "Convert to text" consent dialogs.
  • Status Feedback: Announces tab changes plus microphone/camera state, and plays a short sound after a message is actually sent.

Usage Tips and Reminders

  • Establish Connection: Before using this version to send a message to someone, it is recommended to send a message first using a mobile phone or the Chrome web version. Having chat history makes it easier for the add-on to locate UI elements.
  • Sending Messages:
    1. Search for a friend's name. Enter specific keywords so the search result yields only one friend to avoid errors.
    2. In the message list or sidebar, press Shift+Tab to move to the edit field.
    3. Type your message and press Enter to send.
  • Making Calls: Currently, you cannot initiate calls directly from the chat tab using this add-on. Please follow these steps:
    1. Press Control+1 to switch to the friends tab.
    2. Search for the friend's name, select them, and open the chat room.
    3. Press NVDA+Windows+C to make a voice call, or NVDA+Windows+V to make a video call.
  • Pre-check: Before sending a message or making a call, always check the chat history to ensure you are contacting the right person.

Sound Effects

  • Default (Copy Success): If the message is read via the context menu copy method, no special sound effect is played.
  • OCR Fallback Sound: If the message is read via OCR, the ocr.wav sound effect will be played to indicate that the content may not be fully accurate.
  • Send Sound: When you press Enter in the message input and LINE really sends the message, the add-on plays a short sound. If Enter only confirms IME composition, no sound is played.

Warning

OCR (Optical Character Recognition) results are not 100% accurate. If you hear the ocr.wav sound effect, be aware that the text may differ from the actual message content. To verify the exact content, it is recommended to check the message on your phone or another platform.

Message Reading and Copying

  • Reading Messages: When navigating through the message list, the add-on uses a "copy-first" approach to read messages. It automatically right-clicks the message → selects "Copy" → reads the clipboard content. The original clipboard content is restored after reading.
  • Copying Messages: Press Control+C in the message list, and the add-on will copy the message text to the clipboard via the right-click context menu.
  • OCR Fallback: If copying via the context menu fails (e.g., the menu or menu item cannot be found), the add-on will automatically fall back to OCR (Optical Character Recognition) to read the message content.

Message Reader, Context Menus, and Temporary Keys

  • Message Reader (NVDA+Windows+J): The add-on opens the chat room's "More options" menu, chooses "Save chat", parses the exported text, and opens an accessible reader dialog.
  • Reader Navigation: In the message reader, use UpArrow and DownArrow to move between messages and Escape to close the window. Date separators are preserved, and the current position is announced.
  • Message Context Menu (Applications / Shift+F10): In the message list, this opens a virtual context menu for the focused message, making actions such as copy, reply, recall, and "Convert to text" easier to use.
  • Recall Confirmation Keys: After you choose recall, the add-on temporarily binds Y = Recall, N = Cancel, and P = Stealth recall (Premium required). If you do nothing for 10 seconds, the add-on cancels the action automatically.
  • Photo-to-Text Consent Keys: When LINE shows the first-run "Convert to text" photo upload notice, the add-on temporarily binds A = Agree and D = Decline. If you do nothing for 10 seconds, the add-on declines automatically.

Virtual Windows

What are Virtual Windows?

Virtual Windows are special interfaces provided by this add-on to improve access to certain LINE features that are difficult to access through standard accessibility APIs. When you use specific shortcuts, the add-on creates a virtual menu or dialog box, allowing you to operate these features more conveniently.

Types of Virtual Windows

This add-on currently provides the following virtual windows:

  1. Chat Room More Options Menu: Press NVDA+Windows+O to open
  2. Message Context Menu: Used for copying, replying, recalling messages, and other operations
  3. Verification Code Window: Reads out the verification code when logging into LINE for the first time; enter this code on your mobile device
  4. System Tray Menu: Used to access LINE options in the system tray

How to Use Virtual Windows

  1. Open Virtual Window: Use the corresponding shortcut (e.g., NVDA+Windows+O)
  2. Navigate Options: Use the up and down arrow keys to move between options
  3. Select Option: Press Enter to execute the selected option
  4. Close Window: Press Escape to close the virtual window

Notes

  • Virtual windows are simulated interfaces; actual operations are still performed by the add-on through coordinate automation
  • Some virtual window options may vary depending on the LINE version or interface state
  • If a virtual window does not work properly, ensure your LINE window is in a normal state and not obscured by other windows

Keyboard Shortcuts

Note

In the "Category" column, "Add-on" indicates shortcuts provided by this add-on, "Add-on (temporary)" indicates context-specific shortcuts that are only active while a dialog is open, and "LINE" indicates built-in LINE Desktop shortcuts.

Tip

You can customize these shortcuts through "NVDA Menu → Preferences → Input Gestures".

Calls & Incoming Calls

Shortcut Category Action
NVDA+Windows+C Add-on Make a voice call
NVDA+Windows+V Add-on Make a video call
NVDA+Windows+A Add-on Answer an incoming call
NVDA+Windows+D Add-on Reject an incoming call
NVDA+Windows+S Add-on Check caller information
NVDA+Windows+F Add-on Focus the call window
Ctrl+Shift+A LINE Toggle microphone on/off; during calls the add-on announces the new state
Ctrl+Shift+V LINE Toggle camera on/off; during calls the add-on announces the new state

Message Actions

Shortcut Category Action
Control+C Add-on Copy the current message (in message list; normal copy in edit fields)
NVDA+Windows+R Add-on Reply to the current message
NVDA+Windows+Delete Add-on Recall (unsend) the current message
NVDA+Windows+T Add-on Read current chat room name
NVDA+Windows+K Add-on Open Save As dialog (Files can only be downloaded for 7 days after upload)
Applications / Shift+F10 Add-on Open the virtual context menu for the current message

Temporary Confirmation Keys

Shortcut Category Action
Y Add-on (temporary) Confirm message recall
N Add-on (temporary) Cancel message recall
P Add-on (temporary) Stealth recall (Premium required)
A Add-on (temporary) Agree to LINE's photo upload notice for "Convert to text"
D Add-on (temporary) Decline LINE's photo upload notice for "Convert to text"

Basic Shortcuts

Shortcut Category Action
Ctrl+W LINE Close window
Ctrl+L LINE Enable lock mode
Ctrl+1 LINE Go to Friends tab
Ctrl+2 LINE Go to Chats tab
Ctrl+3 LINE Go to Add Friends tab
Ctrl+Shift+P LINE Capture screen
Ctrl+Shift+K LINE Open Keep Memo
F1 LINE Show shortcut key tips (Note: screen readers cannot read this content; please refer to this document instead)

Chat Room Tab Navigation

Shortcut Category Action
NVDA+Windows+1 Add-on Navigate to All Chats tab
NVDA+Windows+2 Add-on Navigate to Friends tab
NVDA+Windows+3 Add-on Navigate to Groups tab
NVDA+Windows+4 Add-on Navigate to Communities tab
NVDA+Windows+5 Add-on Navigate to Official Accounts tab

Friends & Chat List

Shortcut Category Action
Ctrl+Shift+F LINE Search
Ctrl+Tab LINE Move to previous chat room

Chat Room

Shortcut Category Action
Enter LINE Send message; the add-on plays a sound only when sending succeeds
NVDA+Windows+J Add-on Open the message reader
NVDA+Windows+O Add-on Click more options button
Shift+Enter LINE New line
Ctrl+F LINE Search
Ctrl+N LINE Open notes
Ctrl+E LINE Open sticker window
Ctrl+O LINE Send file
Ctrl+K LINE Open Keep Memo
Ctrl+P LINE Capture screen

Text Formatting

Shortcut Category Action
Ctrl+B LINE Bold
Ctrl+I LINE Italic
Ctrl+Shift+X LINE Strikethrough
Ctrl+Shift+C LINE Red text box
Ctrl+Shift+D LINE Paragraph box

Media Player

Shortcut Category Action
NVDA+Windows+K Add-on Save voice message
NVDA+Windows+P Add-on Play voice message
Ctrl+S LINE Save file
Ctrl+C LINE Copy file
Enter LINE Full screen
Space LINE Play/Pause
Ctrl+Left / Right LINE Fast forward/rewind video 5 seconds
Ctrl+Up / Down LINE Increase/decrease video volume
Ctrl+Shift+Plus / Ctrl+Minus LINE Zoom in/out image

Screen Capture

Shortcut Category Action
Space LINE Reset capture area
Ctrl+Z LINE Undo
Ctrl+Shift+Z / Ctrl+Y LINE Redo
Ctrl+C LINE Copy
Ctrl+S LINE Save
Shift LINE Draw straight lines, rectangles, and circles

Chat Room Categories

Shortcut Category Action
Alt+Left / Right LINE Move category

Debug Tools

Shortcut Category Action
NVDA+Shift+K Add-on Debug: Check UIA and OCR (contents dumped to clipboard)
NVDA+Shift+V Add-on Report LINE version, language, window type, and Qt accessibility status
NVDA+Shift+J Global Report information about the currently focused app and process

Community and Support

  • LINE User Group: Join Group Feel free to join the group to suggest features, report issues, or discuss with the development team.
  • Source Code & Issue Tracker: GitHub Repository If you have feature suggestions or find bugs, feel free to open an Issue; if you are willing to contribute code, Pull Requests are entirely welcome.
  • Contact Developer: Contact Ken Chang (LINE)

Supported Versions

  • LINE Desktop for Windows (Standard installer or Microsoft Store version).
  • NVDA 2022.1 or higher.