Guide for Jieshuo / Commentary screen reader

This is a guide for jieshuo / commentary screen reader.

Contents

Chapter 1: Introduction………………………………………………………………………………………………………. 1

1.2. System requirements……………………………………………………………………………………………….. 2

1.3. Permissions…………………………………………………………………………………………………………….. 2

1.4. Getting help……………………………………………………………………………………………………………. 2

Chapter 2: Installation………………………………………………………………………………………………………… 2

Chapter 3: Gestures…………………………………………………………………………………………………………… 2

3.1. Basic gestures listing…………………………………………………………………………………………………. 3

3.1.1. General……………………………………………………………………………………………………………. 3

3.1.2. Call interface…………………………………………………………………………………………………….. 3

3.1.3. Media player interface………………………………………………………………………………………… 3

3.1.4. Word by word navigation mode……………………………………………………………………………. 3

3.1.5. Node browsing mode………………………………………………………………………………………….. 4

3.1.6. Slider Controls…………………………………………………………………………………………………… 4

Chapter 4:  Main menu………………………………………………………………………………………………………. 4

4.1. General settings………………………………………………………………………………………………………. 4

4.2. TTS settings…………………………………………………………………………………………………………….. 4

4.2.1. System TTS settings……………………………………………………………………………………………. 4

4.2.2. Other TTS settings………………………………………………………………………………………………. 5

4.3. Feedback settings…………………………………………………………………………………………………….. 5

4.4. Action settings…………………………………………………………………………………………………………. 5

4.4.1. Gestures settings……………………………………………………………………………………………….. 5

4.4.2. Alternative gestures settings………………………………………………………………………………… 6

4.4.3. Scrolling settings………………………………………………………………………………………………… 6

4.5. Content presentation settings…………………………………………………………………………………….. 6

4.6. Notification settings…………………………………………………………………………………………………. 6

4.7. Advanced settings……………………………………………………………………………………………………. 6

4.8. Download additional resources…………………………………………………………………………………… 7

4.9. Plugins and tools……………………………………………………………………………………………………… 7

4.10. Miscellaneous options…………………………………………………………………………………………….. 7

Chapter 5. Global menu……………………………………………………………………………………………………… 7

Chapter 6. Action menu……………………………………………………………………………………………………… 8

Chapter 7. Node browsing mode………………………………………………………………………………………….. 8

Chapter 8. Edge gestures……………………………………………………………………………………………………. 8

Chapter 9. Text editing……………………………………………………………………………………………………….. 9

9.1. Basic text editing……………………………………………………………………………………………………… 9

9.2. Split editing…………………………………………………………………………………………………………….. 9

9.3. Text selection………………………………………………………………………………………………………….. 9

9.4. Advanced copying……………………………………………………………………………………………………. 9

9.5. Clipboard manager…………………………………………………………………………………………………… 9

Chapter 10. Registering in the screen reader………………………………………………………………………… 10

Chapter 11. Purchasing the screen reader……………………………………………………………………………. 10

 

Also visit

download latest commentary screen reader

Commentary Screen Reader: user guide

Chapter 1: Introduction

1.1. What is Commentary?

Commentary is a screen reader for Google’s Android operating system. With built-in OCR, object description, language translation, voice assistant, CAPTCHA recognition, and more, Commentary is the most innovative screen reader for the Android market.

1.2. System requirements

Before using Commentary, make sure your system meets the following requirements:

  • Your device should be an ARM X86 or ARM X64 compatible device. Commentary is not guaranteed to work on any other CPU architecture like Android X86 or others.
  • Memory: Commentary Screen Reader requires at least 50 MB ROM and 1 GB RAM to run smoothly. While Commentary may work with less memory, this is not guaranteed.
  • Operating System: At minimum, Commentary requires Android 4.4.2 to run.

However, some features are only available for Android 8 and above.

1.3. Permissions

The program requires some special permissions to make it fully usable. These include:

  • Microphone: used for interacting with the build in voice assistant.
  • Managing phone calls: used for proper TTS configuration in various use cases, e.g. making phone and video calls.
  • Memory permissions: used for reading installed plugins, extensions, sound themes and other third-party components.
  • Location: used for interacting with the build in GPS service.
  • Camera: used for some OCR-dependent services, like object recognition, scene recognition ETC.

Other permissions are required for proper functioning of Commentary. It is strongly suggested that these be enabled for optimal functioning. Denying these is not advisable.

1.4. Getting help

There are a number of ways you can contact the support team. The most reliable one is

Telegram. To join Commentary Screenreader’s official group, please navigate here

You can also contact us via the email address at the top of this manual. Lastly, you can contact us at our forum which can be found  here

Chapter 2: Installation

After you’re done downloading the file, navigate to the path where the file exists and execute it.

Warning! On most Android devices you will be prompted for disabling the security feature which prevents external applications from being installed. It is strictly recommended to reenable it just after the installation process finishes.

In order to enable the screen reader you have to navigate to your accessibility settings and enable the Commentary Screen Reader service.

Warning! Remember to suspend your previous screen reader before enabling Commentary, as gesture conflicts may occur.

Chapter 3: Gestures

Commentary Screen Reader has an extensive, flexible set of gestures. In short, they can be classified into five main categories. These are:

  • Basic gestures
    • mostly performed with one or two fingers.

○ Angles are drawn by making the first line longer than the second, i.e. the first line should reach across the whole screen and the other half is shorter.

  • Fingerprint reader gestures
    • performed on the fingerprint reader. This feature is available from Android 8 and above. However, not all devices support it.

○ It is known that the feature is supported on All Huawei Devices and on some Xiaomi devices. However the exact model numbers are not known.

  • Multipart gestures
    • made of two or more basic gestures.

○ There is no default setup for any multipart gestures. They must be setup on your own. ● Edge gestures

○ performed at the very edge of the screen.

○ Due to their potential difficulty, there is no default setup for them. They must be set up on your own.

  • Miscellaneous
    • Lastly, the program might also be used with keyboard, volume buttons and headset buttons, if applicable.

3.1. Basic gestures listing

The following listing shows default mapping for all the gestures which are supported by default.

3.1.1. General

  • Up swipe: move to the previous element
  • Down swipe: move to the next element
  • Left swipe: jump back in a large group of items like a list ● Right swipe: jump forward in a large group of items like a list.
  • Double tap: activate the focused element
  • Down right swipe: open the global menu
  • Up right swipe: open the actions menu Down left swipe: activate voice assistant ● Up left swipe: open the extensions menu.
  • Left right swipe: home screen
  • Right left swipe: recent apps
  • Up down swipe: move to the top of the current screen
  • Down up swipe: move to the bottom of the current screen.
  • Left down swipe: Toggle between focus mode and Word By Word mode.
  • Right down swipe: open item browsing
  • Left up swipe: open the notification panel
  • Right up swipe: read the whole screen
  • Swipe up with two fingers: scroll up
  • Swipe down with two fingers: scroll down
  • Swipe left with two fingers: go to the next page
  • Swipe right with two fingers: go to the previous page

3.1.2. Call interface

  • Swipe right: answer, toggle hands free mode
  • Swipe left: reject, hang up

3.1.3. Media player interface

  • Swipe left: previous track
  • Swipe right: next track

3.1.4. Word by word navigation mode

  • Up swipe: go to the previous line
  • Down swipe: go to the next line
  • Right swipe: go to the next character
  • Left swipe: go to the previous character
  • Double tap on a line: browse words in that given line ● Up left swipe: go to the previous paragraph.
  • Up right swipe: go to the next paragraph
  • Right down swipe: selection mode
  • Left right swipe: go to the previous word.
  • Right left swipe: go to the previous word.

3.1.5. Node browsing mode

  • Left swipe: move to the parent node
  • Right swipe: move to the child nodeRight swipe: Go to the next node
  • Up swipe: move to the previous element in the current node
  • Down swipe: move to the next element in the current node ● Double left swipe: go to the root node.

3.1.6. Slider Controls

  • Left swipe: decrease slider
  • Right swipe: increase slider

Chapter 4:  Main menu

The main menu can be opened in two ways. The first one is just to open the Commentary Screenreader app from within your Android launcher.

The second one is to select “Program settings” from the global menu (down right swipe) gesture.

4.1. General settings

  • TTS speed: alters the global TTS speed of the whole operating system.
  • TTS volume: alters the global TTS volume of the whole operating system.
  • Read usage hints: Toggles announcements of usage hints for the currently focused item.
  • Read the list range: Toggles the announcement of the index of the currently focused item.
  • Read notifications: Toggles the announcements of notifications.
  • Use custom gestures: toggles applied custom gestures package.
  • Custom gesture settings: opens settings related to custom gesture packs.

4.2. TTS settings

  • Main TTS engine: The engine used for reading all the content spoken by the screen reader, except notifications. (These will be handled separately).
  • Secondary TTS engine: The engine used for reading notifications. If you select the same engine as the first one, only the main TTS engine will be used.
  • Use a single TTS engine: Uses only the main TTS engine.
  • System TTS settings: opens global system TTS settings, meaning they will be altered for the whole operating system.
  • unisound TTS settings: extended TTS options for Unisound, a chinese TTS engine. ● Other TTS settings: more TTS settings

4.2.1. System TTS settings

  • TTS Overrate: allows to make your TTS speak faster than it’s default max speed is.

This function is in beta form and it is known to crash some speech engines like Espeak..

  • TTS volume: the TTS volume, set for the whole Android Operating System.
  • TTS Speed: The TTS speed, set for the whole Android operating system.
  • TTS Pitch: the TTS pitch, set for the whole Android operating system. ● System TTS settings: opens the Android’s default TTS interface.

4.2.2. Other TTS settings

  • System TTS volume: you can set the TTS volume here.
  • Queue notifications for reading: Determines whether notifications should be queued for reading. If activated, the reading of the current notification will cease when a new notification occurs.
  • Audio ducking: determines if other sounds should be suppressed when the TTS is speaking.
  • Slow down speed when in word by word mode: slows down the TTS by 50% when in the word by word browsing mode.
  • Use accessibility volume: makes the screen reader use the accessibility volume, not the media volume. Only available in Android 8 and higher.
  • Use ringtone volume: determines if the ringtone volume should determine the volume of caller info.
  • Use the proximity sensor: stops reading when the proximity sensor is touched.
  • Use wakelock: determines if the screen reader should prevent the screen from locking if the long text is being spoken. Please note: It has some problems while interacting with Youtube.
  • Enhanced wakelock: if the above option does not work, please try this one.
  • Read numbers by digit: determines if the numbers should be read as whole numbers or digits.
  • Speak punctuation: determines if punctuation should be announced while reading.
  • Use pinyin TTS when in edit mode: Determines if extended support for the chinese keyboard should be enabled.
  • Report capital letters when navigating keyboard: determines if the state of the Shift or Caps Lock keys will be reported while moving around the keyboard.

4.3. Feedback settings

  • Audible feedback: Toggles audio feedback cues from the currently chosen sound theme on and off.
  • Sound theme volume: controls the volume of the currently selected sound theme.
  • Sound themes: controls which of the currently installed sound themes is used.
  • Vibration feedback: toggles haptic feedback on and off.
  • Vibration intensity: controls the strength of the haptic feedback.

4.4. Action settings

Gesture themes: controls which of the currently installed gesture themes is used.

Gestures description: outputs the current gesture themes’ help file, if any.

Gesture settings: allows the user to create, modify and delete gesture themes.

Per-app gesture themes: allows the user to select a per-app gesture theme as a main gesture theme.

Use the gamer mode: Allows to automatically suspend the application upon the application launch (useful for games).

Alternative gestures settings: settings related to the alternative gesture theme, where up down swipes are exchanged with left right swipes.

Scrolling settings: Settings related to scrolling lists

Edge gestures settings: settings related to the edge gestures. (See “Edge Gestures” further down in the manual).

Shortcut keys settings: allows users to modify the behavior of physical buttons on the device. Onclick action settings: Miscellaneous settings related to clicking and activating items. Multipart gestures settings: settings related to the multipart gestures.

Fingerprint reader gestures settings: settings related to the gestures performed on the device’s fingerprint reader.

Other settings: miscellaneous action settings.

4.4.1. Gestures settings

Create the global gesture theme: allows to create a global gesture theme.

Create the per-app gesture theme: Allows to create a gesture theme that will be used in its given application.

The rest of the screen is occupied by the gesture themes that have been created by the user or

downloaded from the resource center.

4.4.2. Alternative gestures settings

Left/right swipes move quickly between list items: Determines the behavior of left/right swipes in terms of lists. While unchecked, the commands behave like standard Android swipes, else there’s no scrolling animation while swiping which improves the experience.

Left swipe shortcut actions: allows to add and modify elements executable by swiping left. For example the left swipe is used to hang up the call in some dialer applications.

Right swipe shortcut actions: Allows to add and modify elements executable by swiping right. For example the right swipe is used to answer the call in some dialer applications.

4.4.3. Scrolling settings

Use left/right swipes to navigate: exchange left/right swipe commands with up/down swipe commands, respectively.

Browse by control on webpages: determines if switching granularity on webpages will be enabled. Use the legacy focus handling method: If you experience focus losses in some applications, checking this option might resolve the issue.

Automatically scroll pages: scroll to the previous/next page when you reach the border of the current one.

4.5. Content presentation settings

Hints settings: settings related to the general reading behavior.

List settings: settings related to interacting with lists.

Label presentation settings: settings related to presentation of labels and dealing with unlabelled controls.

Dynamic content settings: settings related to the dynamic content, like web pages. Screen state reporting: settings related to announcement of changing screen states such as orientation.

Dictionary settings: Settings related to the custom dictionary and presentation of single characters. Content filtering settings: settings related to the content filtering feature, allowing for filtering web pages from unwanted, disruptive content.

4.6. Notification settings

Read notifications: controls if the screen reader should or should not read incoming notifications. Notification reading settings: settings related to controlling of which notifications should be read aloud.

Notification black list: allows for adding various applications or phrases to the black list.

Notification white list: allows for adding various application or phrases to the white list.

Other settings: miscellaneous notification settings

Notification summary: controls whether notifications should be read as a whole or only briefly summarized.

Read notifications while the screen is locked: controls whether the notifications should be read while the device’s screen is locked.

Read source of the notification: controls whether the name of the source application should be read.

4.7. Advanced settings

Voice assistant settings: settings related to the voice assistant, OCR and the build in translation service.

Timer settings: settings related to the build in simple timer.

Automatically running plugins: controls which plugins should be preloaded at the screen reader’s startup.

Manage resources: allows to manage the program resources including sound and gesture themes, plugins, ETC.

Action settings: more advanced action settings.

Power settings: settings related to screenreader’s power usage. Other settings: miscellaneous settings.

Enable Auto updater: controls whether the program should automatically update itself for each new version.

Automatic use of OCR recognition: controls whether OCR functionality should be executed every time an unlabelled item is discovered.

Label sharing: controls whether your defined labels should be posted to the Jieshuo server.

Custom dictionary: controls whether the screen reader should preload the custom dictionary (if any).

Use multi column menu: controls whether the menu should be split into two columns

Customize main menu: allows to customize the global menu of the screen reader.\

Customize multi column menu: allows users to customize the multi column variant of the global menu.

Use the floating menu: controls whether the floating menu should be used (See “Floating Menu” further down).

Floating menu settings: allows to customize the floating menu.

Backup and restore settings: allows users to backup and restore the screen reader’s settings. Warning! Gesture themes, plugins, sound themes should be backed up separately.

4.8. Download additional resources

The program has a powerful database of all resources related to it, like gesture themes, sound themes, plugins, voice assistant expansions, tutorials and other useful files.

However, because of how the database is rendered, it may change very often. That means we cannot provide a thorough guide on how to use it

4.9. Plugins and tools

This menu allows for executing external plugins. In other words, plugins which have their own interface can be launched from here.

4.10. Miscellaneous options

Accessibility settings: opens the system accessibility settings.

User center: opens a user center where one can login, register, get information about their license and contact the support team.

Help and feedback: Information regarding the screen reader.

Chapter 5. Global menu

Global menu is opened by swiping down and right while using the default gesture theme. It allows users to execute the most frequently used functions of the Jieshuo Screen Reader. You can customize it to better suit your needs. (See chapter 4 for further details.) The default menu layout consists of the following options:

  • Navigation menu: Navigate by words, paragraphs, sentences, characters.
  • List browsing: replaces the current screen view with more simplified and user-friendly list view controls.
  • Read The Whole Screen: reads the current screen while moving the cursor along with the speech.
  • *Voice assistant: Opens the voice assistant. Users may speak designated commands, which are then executed via a single tap.
  • Extensions: Opens the extensions screen allowing you to configure, delete and manage your installed extensions.
  • Program settings: opens Jieshuo’s main menu. (See chapter 4.)
  • Suspend voice feedback: suspends voice feedback and gestures. Used primarily for selfvoicing applications like games.
  • Cancel: Exits the menu and returns to prior screen.
  • More: while the multi-column menu is disabled, this opens the second column of the menu (See “Multi-Column Menu” below)
  • Action menu: opens the action menu (See “Action Menu” below.)
  • Advanced settings: opens the advanced settings screen. (See chapter 4.)
  • Automatic browsing: Same as “read the whole screen”, however it will automatically scroll through lists, if any.
  • Reading mode: extracts useful information from current webpage and speaks it aloud, without unnecessary interruptions. The screen is not being scrolled with accordance to the speech.
  • Full text browsing: Allows to do the selection of text.
  • Select all: highlights the whole screen.
  • Text recognition: recognizes the current control
  • Jieshuo camera: opens the built in camera, allowing to recognize various objects.
  • Suspend browse by touch: suspends the gestures only, leaving speech on.
  • Notification box: opens the panel, where one can read their notifications, save them to a file ETC.
  • Warning! The menu might contain some other options, depending on the context it’s being executed in.

Chapter 6. Action menu

The action menu can be opened by doing the up right gesture. It allows to execute various actions related to the screen and the elements on it.

It’s default layout is presented below:

  • Clear the currently focused textbox: deletes the content of the textbox which is currently focused.
  • Selection menu: allows to do the simple selection of text.
  • Copy: copies the current control’s text to the clipboard. If the currently focused control is a textbox, it’s content is being copied, and the caption is left.
  • Append copy: same as “copy” but it leaves the current clipboard content intact.
  • Clipboard menu: allows to manage the clipboard contents, save it to a file, load a previously saved snapshot ETC.
  • Favorites: opens the favorites menu.
  • Editing: allows for the precise text editing.
  • Advanced text copying: copies the whole screen to the clipboard.
  • More: expands the second column of the action menu(works in the premium version only)
  • Cancel: exits the action menu
  • Show keyboard: forces showing of the keyboard on the current control. Warning! If the control is invalid, the program might crash. Use the function wisely.
  • Text recognition: allows to recognize the current text
  • Translation: translated last spoken text
  • Captcha recognition: recognizes the current captcha.

Chapter 7. Node browsing mode

The node browsing mode is a feature that allows users to browse parts of the window which are otherwise inaccessible. It can be used in the following scenarios:

*When a group of controls is presented as a single element, requiring the user to click on a precise spot of the clickable element. Node browsing makes it possible to split the group of controls into multiple, easier to navigate objects.

*The application uses the full power of the Android interface node framework. For example in the LINE messenger, it is possible to navigate by the exact date of the message.

The node browsing mode can also be used in other, very specific situations which needs to be discovered by the user.

Chapter 8. Edge gestures

The number of features in the Commentary Screen Reader makes it difficult for users to assign gestures to every function of the program, that’s why the concept of the edge gestures has been introduced.

The way this feature works is that the small part of the screen is excluded from the standard operation of the program. It can be used for performing the edge gestures.

It is also possible to use the edge gesture menu. The way this particular menu works is the following: When this function is active, you can drag a finger from one of the sides of the screen to move around the edge gesture menu options. When you lift your finger off the screen, the currently focused option is activated.

It is possible to customize both the edge gesture and trigger range of it.

Some mobile phones require the trigger range to be set at its maximum, while on other devices this makes the screen almost unusable. That’s why the user needs to check and customize the options to their liking.

Chapter 9. Text editing

Commentary screen reader has a lot of different text editing modes. Each one created for different purposes.

9.1. Basic text editing

Basic text editing allows you to navigate the text by character, word ETC and perform basic editing operations like deleting and changing parts of the text .

In order to navigate the text, swipe left and right or up and down while in the alternative gesture mode.

Warning! Some keyboards require you to stay directly on the textbox in order to successfully  move around the text.

It is also possible to navigate the text with your volume buttons, however that option needs to be enabled first. (See chapter 4 for details.)

9.2. Split editing

split editing allows you to split the text into specific parts (words, lines, paragraphs) making it possible

for you to edit only the text you need, without affecting the whole work.

In order to access the split editing mode, go to the action menu and select it from the available options.

The split editing screen is divided into two parts. The upper one contains the text you are editing, and the lower one consists of the controls allowing you to select the granularity you desire.

Double tapping on a part of the text brings up the text box where you can edit the text as you want. Clicking “OK” will return you back to the main split editing screen. However, no changes are made unless you save the text by clicking the “save” button at the bottom of the screen.

9.3. Text selection

The text selection screen is similar to the split editing screen, however double tapping on a part of the text will select it instead of opening the textbox for editing.

After you select the text you desire, swipe right (or up while in the alternative gestures mode) to copy it, or choose a different action with the buttons at the bottom of the screen.

9.4. Advanced copying

Advanced copying allows you to copy the whole screen, for example the webpage or the long text document which is not in a standard Android textbox.

In order to use this feature, select the appropriate option from within the action menu. When the copying is in progress yapping the screen will abort the process without modifying the current clipboard content.

9.5. Clipboard manager

Clipboard manager allows you to handle text which was previously copied to the clipboard. The manager holds all items which were copied to the clipboard unless you clear it.

In order to open the clipboard manager, select the appropriate option from within the action menu.

As in the previous case, the screen is divided into two parts (the upper one being the saved content, while the lower one serves as as a controller).

Double tapping on the line of text will paste it in the currently focused textbox. If no textbox is currently focused, an error will occur.

Chapter 10. Registering in the screen reader

Registration gives some benefits, the most important one being the ability to purchase the program.

Other advantages include an ability to use the resource center, cloud labels, ETC.

In order to register please do the following

  • Open the main menu of the program
  • Click on “resource center”
  • Click “sign up”
  • Fill in the following fields:

○ User name: the name used for logging in, it should be between 6 and 15 latin characters.

○ Password: The password used for logging in, it should be between 6 and 15 latin characters.

○ Referee’s ID: User name of the referring person. It should be typed exactly as given.

  • After you fill out the form and click “sign up”, you will be taken to the confirmation screen and you will be able to review the entered data. Clicking OK will save your

account on the server and clicking cancel will allow you to change information entered. After successful registration you are automatically logged in to your new account and you can purchase the screen reader.

Chapter 11. Purchasing the screen reader

You can purchase a one year license, two years license or three years license,(100 chinese yuan) per year. Please check the exchange rate for your country, as it may vary.

In order to purchase the screen reader, do the following:

  • Register in Commentary. (Please refer to chapter 10 for details.)
  • Please make a note of your user name and ID exactly as written
  • Please make the payment by going here
  • Make the payment (please write your user name and ID in the notes box) ● 5. Wait for your license activation (it will take up to 24 hours).

subscribe us on YouTube for various tutorials

join our telegram channel for interesting updates

Leave a Comment