AssistiveKitchen
Context-Aware Intelligent Environments
Intelligent sensor equipped environments can be of much greater help if they are capable of recognizing the actions and activities of their users, and inferring their intentions.
Understanding human activities and characterizing them into expressive and detailed activity models is one of the key issues of today's current pervasive computing systems. If such a system could recognize and understand automatically its user's behavior, it could interact in a more efficient and friendly manner. Unfortunately, the current model construction techniques are based on supervised learning and require specifications from their human counterparts, such as labeling the acquired sensor data. Our vision is to build technical cognitive systems that create and use models in a straightforward manner, by combining already existing online information with the system's context history.
Preliminary results have shown that we can build and cluster object usage in an intentional activity, by mining web sites such as ehow.com and extracting the appropriate instructions for that activity. After processing the information though several filters (such as Wordnet), we managed to create detailed representations of what objects are used and in what way in a certain daily activity.
We are experimenting with fusion of sensor data streams through the usage of
wireless sensor networks and Player/Stage, for generating motion
blueprints which can be used as a starting point in building and learning
complex robotic arm movements. Our tests are being conducted on Powercube
6-DOF arms, mounted on a B21 mobile robot.
In the context of plan-based controllers, by modeling activities from sensor
data, and combining it with the existing knowledge about a certain activity,
we can create better plans. Detailed recognition of the objects involved in
an activity can lead to better image tracker routines which in turn, support
a higher accuracy of the plan's execution routines.
AssistiveKitchen Team
- Principal Investigators
- Researchers
- Student Researchers
- Alumni
- Philipp Kemmeter

















