 |
Bringing the speech technology to the Web through Multimodal Interfaces |
 |
Research Purpose:
We are investigating the necessary support for the construction of Multimodal Web Interaction projects based on Design Rationale and Design Patterns.
Objectives
1) Allow for more intuitive user interfaces, using simulations and Design Rationale in the early stages of project
2) Facilitate the identification and the solution of usability problems.
3) Propose a theoretical framework to support the GUI + Voice Multimodal Interface generation from a Web project and a voice interface project
4) Consider the issues related to accessibility, usability, user experience and reasoning from previous projects.
5) Consider the data obtained from the interaction of real users to improve the interaction before the final project is deployed.
6) Contribute to the Human Computer Interaction community providing an approach that facilitates the knowledge capture, storage and dissemination.
Research Current Stage:
We are conducting a Case Study in order o verify the user interaction in a multimodal interface that allows the usage of conventional graphical interaction, voice interaction and both at the same time.
This Case study is composed by one Scenario in which you'll be asked to interact in order to pay your ficticious telephone bill.
We'd like to thank you in advance for your contribution and participation in our case study.
Sorry, but this Experiment runs only within the Opera Browser :
To install Opera, please follow the instructions bellow:
Quick Start-up (from Opera: http://www.opera.com/voice/)
1. Download Opera 9 (http://www.opera.com/download/)
2. Enable the Voice option by selecting "Tools" > "Preferences" > "Advanced" > "Voice" and then enable Voice.
3. After enabling the option, you will be asked to confirm that you want to install the voice libraries.
Select confirm.
Voice is now available.
4. To initiate a voice command, click the "Voice" button on the View toolbar, or press the Scroll Lock key.
Then say the command, for example, "Opera reload". After issuing the command, let go of the button.
5. For a list of voice commands, click on the voice button and say "Opera voice commands".
 |
Contact: Americo Talarico Neto (americo@icmc.usp.br)
University of São Paulo.
Institute of Mathematics and Computer Science.
P.O.BOX 668, São Carlos, São Paulo, Brazil.
|