Utterly Voice icon image Utterly Voice

Mouse Control

Utterly Voice provides several methods to control the mouse. Here is a list of commands that are useful in most scenarios:

Command Description
show Left click something on the screen.
show double Double click something on the screen.
show right Right click something on the screen.
show hover Hover the mouse over something on the screen.
show links Click a link on a web page.
scroll up Scroll up a certain number of ticks. For example, "scroll up four".
scroll down Scroll down a certain number of ticks. For example, "scroll down four".

These and other commands are described in detail below.

Screen Analyzer

The Utterly Voice Screen Analyzer performs image analysis on your screen when initiated. It finds all objects on the screen that may be useful to click or hover, then shows number labels for each of these objects on your screen. To open the screen analyzer, say one of the following commands:

  • "show": for left click
  • "show double": for double click
  • "show middle": for middle click
  • "show right": for right click
  • "show hover": for hovering the mouse

Many number labels appear on your screen. Say one of the numbers. The mouse is clicked or simply moved to that location, depending on which command you used to open the screen analyzer. You can also say "cancel" instead of a number to close the screen analyzer without taking any action.

The screen analyzer is very effective for clicking most things on the screen. However, it doesn't always find web links that are contained within paragraphs of small text. This is where the Vimium browser extension described in the next section helps. Between these two methods for controlling the mouse, you can click nearly anything on the screen.

Vimium Browser Extension

The Vimium browser extension technically does not control the mouse, but it can effectively click on web page elements. Once you have it installed and configured the extension, visit a web page and try one of the following:

  • "show links": for clicking links
  • "show new links": for opening links in a new tab
  • "show force links": for clicking links while your text cursor is in an editable field

Many number labels appear on the page. Say one of the numbers. The corresponding element is clicked.

Scrolling

You can scroll in all four directions using commands like:

  • "scroll up five"
  • "scroll down two"
  • "scroll left two"
  • "scroll right one"

You can also use the automatic scroll feature. You can start and stop scrolling by saying "start scrolling" or "stop scrolling". When activated, the mouse scrolls down a few ticks every few seconds. This is useful when skimming long content or social media.

In the settings, you can configure whether it scrolls up or down, the number of ticks, and the scroll period. You can also create multiple automatic scrolling commands, each configured with different values.

Mouse Position

You can click anywhere on the screen by saying "mouse position", two numbers, and "click". Try the following:

  1. Say "mouse position". Vertical lines appear on the screen, where each line has a label showing the pixel distance from the left edge of the display (the x coordinates). A line is shown for every 100 pixels. There are also green crosshair lines showing where your mouse is currently.
  2. Look at the location you want the mouse to be, approximate the pixel coordinate using the guide lines, and say that number. For example, if the location is in the middle between 300 and 400, say "three fifty".
  3. The vertical lines go away, and horizontal lines appear. These lines show the pixel distance from the top edge of the display (the y coordinates). Approximate the pixel coordinate and say the number.
  4. If the mouse is where you want it, you can say "click", "double click", "right click", "middle click", "hold" (hold the left mouse button down), "release" (release the left mouse button), or "cancel". If not, you can continue selecting coordinates until you have the mouse where you want it.

Mouse Grid

The "mouse grid" command opens a grid on the screen, that can be zoomed in with a few number selections. Try the following:

  1. Say "mouse grid". A 3x3 grid appears on the screen, where each grid cell is labeled with a number from 1 to 9.
  2. Say one of the numbers. A new 3x3 grid appears in the selected cell.
  3. Continue this process until the mouse is where you want it.
  4. Say "click", "double click", "right click", "middle click", "hold" (hold the left mouse button down), "release" (release the left mouse button), or "cancel".

Mouse Go Direction

You can move the mouse in any direction by a certain number of pixels. This is useful when the mouse is already close to where you want it. It is also useful for certain system windows that do not allow labels to appear above them. Examples:

  • "mouse go up three hundred"
  • "mouse go down two hundred"
  • "mouse go left thirty"
  • "mouse go right ten"

Mouse Clicks

If the mouse is already where you want it, you can use the following commands:

  • "mouse click"
  • "mouse double click"
  • "mouse right click
  • "mouse middle click"

Mouse Go To

If you know the pixel coordinates where you want to your mouse to be, you can use the "mouse go to" command to move the mouse there. For example, you can say "mouse go to one hundred other three hundred". This command is rarely useful on it's own, but if you frequently click in the same location on the screen, you can create custom commands that use the same functionality to click a location on the screen without having to provide the coordinates. For example, you could create a command called "click start menu" that requires no arguments. See the Customize documentation for help.

Dragging

To accomplish dragging:

  1. Use one of the methods above (except screen analyzer) to position the mouse where you want to start the drag.
  2. If you used the "mouse position" or "mouse grid" command, say "hold". Otherwise, say "hold mouse".
  3. The mouse left button is pressed and held. You can confirm this in the mode and state list on the user interface.
  4. Use one of the methods above (except screen analyzer) to position the mouse where you want to finish the drag.
  5. If you used the "mouse position" or "mouse grid" command, say "release". Otherwise, say "release mouse".
  6. The mouse left button is released. You can confirm this in the mode and state list on the user interface.