Mouse Control

Utterly Voice provides several methods to control the mouse. Here is a list of commands that are useful in most scenarios:

These and other commands are described in detail below.

Screen Analyzer

The Utterly Voice Screen Analyzer performs image analysis on your screen when initiated. It finds all objects on the screen that may be useful to click, drag, or hover; then shows number labels for each of these objects on your screen. To open the screen analyzer, say one of the following commands:

Many number labels appear on your screen. Say one of the numbers. Depending on which command you used to open the screen analyzer, the mouse is clicked, dragged, or simply moved to that location. If you used the "show multi" command, the labels will reappear after a brief pause, so you can click again. You can also say "cancel" instead of a number to close the screen analyzer without taking any further action.

Mouse drags are a two step process:

1. Say "show start drag".
2. Say the number for one of the labels that appears. This is marked as the drag starting point.
3. Say "show finish drag".
4. Say the number for one of the labels that appears. This is the drag finish point. The mouse is now dragged from the starting point to the finish point.

The screen analyzer is very effective for clicking most things on the screen. However, it doesn't always find web links that are contained within paragraphs of small text. This is where the Vimium browser extension described in the next section helps. Between these two methods for controlling the mouse, you can click nearly anything on the screen.

Vimium Browser Extension

The Vimium browser extension technically does not control the mouse, but it can effectively click on web page elements. Once you have it installed and configured the extension, visit a web page and try one of the following:

Many number labels appear on the page. Say one of the numbers. The corresponding element is clicked.

Scrolling

You can scroll in all four directions using commands like:

• "scroll up five"
• "scroll down two"
• "scroll left two"
• "scroll right one"

You can also use the automatic scroll feature. You can start and stop scrolling by saying "start scrolling" or "stop scrolling". When activated, the mouse scrolls down a few ticks every few seconds. This is useful when skimming long content or social media.

In the settings, you can configure whether it scrolls up or down, the number of ticks, and the scroll period. You can also create multiple automatic scrolling commands, each configured with different values.

Mouse Position

You can click anywhere on the screen by saying "mouse position", two numbers, and "left". Try the following:

1. Say "mouse position". Vertical lines appear on the screen, where each line has a label showing the pixel distance from the left edge of the display (the x coordinates). A line is shown for every 100 pixels. There are also green crosshair lines showing where your mouse is currently.
2. Look at the location you want the mouse to be, approximate the pixel coordinate using the guide lines, and say that number. For example, if the location is in the middle between 300 and 400, say "three fifty".
3. The vertical lines go away, and horizontal lines appear. These lines show the pixel distance from the top edge of the display (the y coordinates). Approximate the pixel coordinate and say the number.
4. If the mouse is where you want it, say one of the following:
   • "left" (left click the mouse)
   • "double" (double click the mouse)
   • "right" (right click the mouse)
   • "middle" (middle click the mouse)
   • "start drag" (mark the mouse position as the beginning of a drag)
   • "finish drag" (mark the mouse position as the finish point for a drag)
   • "cancel" (clear the lines and take no action)
5. If the mouse is not where you want it yet, you can continue selecting coordinates until you have the mouse where you want it.

Mouse drags are a two step process:

1. Say "mouse position".
2. Follow the process described above to position the mouse at the starting point for a drag.
3. Say "start drag".
4. Say "mouse position".
5. Follow the process described above to position the mouse at the finish point for a drag.
6. Say "finish drag". The mouse is now dragged from the starting point to the finish point.

Mouse Grid

The "mouse grid" command opens a grid on the screen, that can be zoomed in with a few number selections. Try the following:

1. Say "mouse grid". A 3x3 grid appears on the screen, where each grid cell is labeled with a number from 1 to 9.
2. Say one of the numbers. A new 3x3 grid appears in the selected cell.
3. Continue this process until the mouse is where you want it, then say one of the following.
   • "left" (left click the mouse)
   • "double" (double click the mouse)
   • "right" (right click the mouse)
   • "middle" (middle click the mouse)
   • "start drag" (mark the mouse position as the beginning of a drag)
   • "finish drag" (mark the mouse position as the finish point for a drag)
   • "cancel" (clear the lines and take no action)

Mouse drags are a two step process:

1. Say "mouse grid".
2. Follow the process described above to position the mouse at the starting point for a drag.
3. Say "start drag".
4. Say "mouse grid".
5. Follow the process described above to position the mouse at the finish point for a drag.
6. Say "finish drag". The mouse is now dragged from the starting point to the finish point.

Mouse Go Direction

You can move the mouse in any direction by a certain number of pixels. This is useful when the mouse is already close to where you want it. It is also useful for certain system windows that do not allow labels to appear above them. Examples:

• "mouse go up three hundred"
• "mouse go down two hundred"
• "mouse go left thirty"
• "mouse go right ten"

Direct Mouse Clicks

If the mouse is already where you want it, you can use the following commands:

• "mouse click"
• "mouse double click"
• "mouse right click
• "mouse middle click"
• "hold mouse" (holds the left button down for the beginning of a drag)
• "release mouse" (releases the left button)

Mouse Go To

If you know the pixel coordinates where you want to your mouse to be, you can use the "mouse go to" command to move the mouse there. For example, you can say "mouse go to one hundred other three hundred". This command is rarely useful on it's own, but if you frequently click in the same location on the screen, you can create custom commands that use the same functionality to click a location on the screen without having to provide the coordinates. For example, you could create a command called "click start menu" that requires no arguments. See the Customize documentation for help.

If you are using multiple monitors, this command uses virtual screen coordinates. This means that if you have a monitor to the left of or above your primary monitor, the coordinates might be negative.

Mouse Drag Summary

Many of the commands described above are capable of mouse drags. This section provides a summary of using various commands to perform mouse drags.

Using "show" (works well for drag and drop of files):

1. "show start drag"
2. choose a number
3. "show finish drag"
4. choose a number

Using "mouse position" (works well for selecting non-editable text):

1. "mouse position"
2. choose a sequence of numbers
3. "start drag"
4. "mouse position"
5. choose a sequence of numbers
6. "finish drag"

Using "mouse grid" (works well when you don't need much precision):

1. "mouse grid"
2. choose a sequence of numbers
3. "start drag"
4. "mouse grid"
5. choose a sequence of numbers
6. "finish drag"

Combining "show", "mouse position", and "mouse grid":

1. "show start drag"
2. choose a number
3. "mouse position" or "mouse grid"
4. choose a sequence of numbers
5. "finish drag"

Using "mouse hold" and "mouse release" (works well when the mouse is already where you want the drag to start):

1. "hold mouse"
2. "mouse go up/down/left/right some-number" one or more times
3. "release mouse"

Multiple Monitors

All Utterly Voice mouse control options support multiple monitor workstations.

The Screen Analyzer ("show"), Mouse Position ("mouse position"), and Mouse Grid ("mouse grid") methods for mouse control open labels on the monitor where the mouse is currently positioned. This means you need to position the mouse on the desired monitor before using these commands. The "windows" mode has the following commands for moving the mouse and windows from one monitor to another: