| |
 |
|
Baldi, the virtual tutor developed with NSF funding,helps hearing-
and speech-impaired children model speech and build vocabulary
by demonst rating audiovisually how the mouth shapes word sounds
|
Representative FY 2003 agency activities
NSF: Innovative IT applications for learning; stochastic models
of human interaction; interactive multimodal devices and assistive
technologies; technologies for collaborative work
DARPA: Spoken dialogue systems; enhanced cognitive processing
NIH: Modeling and simulation tools for exploring biomedical data
NASA: Use neuro-engineering to develop and integrate technologies
for task management, enhanced cognitive performance of teams; model
knowledge use in context of work; develop "smart" software
and autonomous devices
DOE Office of Science: Integrated set of software tools for scientific
collaboratory environments
NIST: Evaluation methods for spoken language technologies; methods
to improve usability of automated systems; testing and commercialization
of devices for universal access to information
ODDR&E: University-based research in computer-assisted tutorial
systems
|
NITRD research to advance U.S. computing
and networking capabilities to the highest levels of performance,
reliability, and security is complemented by significant efforts
to expand the scope of what digital technologies can do to serve
human needs and goals. One key emphasis of NITRD efforts is to make
computing capabilities and devices easier for people in all circumstances
and walks of life to use. A second emphasis is to develop technical
innovations that broaden the range and types of services that information
technologies can provide.
In FY 2003, the NITRD agencies will support research in multiple
modalities of human-computer interaction, such as by voice, sound,
gesture, touch, and vision. Development of systems integrating multimodal
forms of interaction is particularly important for advanced military
and aerospace applications, where operators need hands-free, untethered
devices for communications, command and control functions, and intelligence
management. Language-engineering technologies, which are a major
focus in this area of NITRD research, play a vital role in advanced
national defense and national security activities and international
commercial development. Capabilities under development include rapid
automated translation between languages and between spoken and written
languages, and spoken-language query systems for intelligence gathering
and analysis.
Multimodal attributes also have vital applications in technologies,
tools, and devices that enable people to live full and independent
lives, regardless of their physical limitations. NSF-sponsored IT
research, for example, has generated "Baldi," a talking
and listening virtual tutor who helps hearing-impaired students
understand and produce spoken language.
Major Research Challenges
- Advanced functionalities (language technologies; spoken, aural,
and multimodal interfaces; sensor technologies)
- Cognitive performance-based interactive system design -
to present the right information in the right form for increased human capability; computer-assisted prosthetics for motion, sight, and
hearing; monitoring systems; and remote consultation technologies
- Methods and technologies for modeling and sharing expertise;
models and metrics for collaborative performance of complex tasks
|
