Skip to content

Master Plan AsTeRICS Ergo

Benjamin Klaus edited this page Aug 30, 2018 · 9 revisions

Master Plan

In this page the big picture of AsTeRICS Ergo is described in the master plan (see fig. 1)

Also see Architecture for a more technical description of the general AsTeRICS Ergo concept.

Master plan of the AsTeRICS Ergo program, describing current and future functionalities Fig. 1: Master Plan of AsTeRICS Ergo

Input modalities

The UI of AsTeRICS Ergo mainly contains big buttons which can be operated easily by many alternative input devices already. But in some cases it is necessary to add functionality to better support certain input modalities. The following list provides examples

Speech/Voice recognition

The Web Speech API is standardized by the W3C community group and currently best implemented in chrome browsers. There is no need for extra installation of SW or language files and the service can be used for free.

  • Integrate voice recognition and speech synthesis including configuration wizards.
  • Integrate voice recognition actions into UI e.g. by showing codes at UI buttons which could directly be addressed by commands.

Buttons (FABI)+Scanning

The AsTeRICS Ergo UI cannot directly be operated by 1-switch or 2-switch modalities. Add support for off the shelf buttons and the FABI low-cost buttons.

  • Add scanning support to UI (see example for scanning)
  • Learn buttons (keys) and assign them to scanning actions

Lipmouse (FLipMouse)

The FLipMouse is a low-cost finger- and lipmouse and allows PC control with very low-force and low-range movements of fingers and lips.

  • Add configuration panel for important flipmouse settings (e.g. calibration, assignment of gestures and actions)
  • add link to documentation,...

Face tracking (Camera Mouse)

The AsTeRICS Camera Mouse uses face tracking to detect head movements and control the mouse.

  • Release as standalone application and extend it by a webbased configuration wizard for camera and mouse settings.

Eyetracking

The Tobii EyeX eyetracker is a low-cost eyetracker for gaming. In order to activate UI buttons in AsTeRICS Ergo they must support hovering.

  • Add hovering support for UI elements
  • Add configuration panel to trigger calibration and configure properties.

Installation Scenarios

AsTeRICS Ergo contains a webbased UI in Javascript (angular JS) and a server program (AsTeRICS ARE). Both can either be installed on 1 PC (tested on Windows only) or on 1 server device (tested on windows only) with many end user devices (e.g. Laptop, Tablet, SmartPhone). Currently only Windows was tested extensively and has support for a native installer and desktop integration.

Actions (Apps)

AsTeRICS Ergo can be extended by Apps, as for example:

Augmentative and Alternative Communication (AAC)

The Open Voice Factory project allows creating communication grids. In AsTeRICS Ergo similar functionality should be integrated reusing the grid-technology in the UI.

  • Provide support to create grids with symbols and text and certain actions.
  • Provide speech synthesis for cells
  • Provide adding/changing of symbols
  • Support importing existent grids from library??

Environmental Control

  • Control infrared devices e.g. TV, HiFi: implemented using IrTrans HW
  • Control lights and electrical appliances: implemented using FS20 HW

Other Apps e.g. Gaming Control