Detecting and Characterising Novelty with Qualitative Abstractions of a Physical Environment
People
Supervisor
Description
Novelty occurs all the time in the world: new things appear, and known things change. Robust AI agents acting in an open world must be able to recognise novelty, characterise it, and adapt to it.
We explore novelty in the context of the physics-simulation puzzle game Angry Birds. Despite its simple appearance, solving this game excercises many aspects of the same reasoning capabilities that will be needed by AI agents acting in the real world, and it is the platform for an AI challenge and competition. The images below show an example of how novelty can appear: In the normal game (top row), the red bird falls to the ground after hitting (and destroying) the stone block. In the right image, the behaviour of the bird has changed, and it instead bounces off the block.
The goal of this project is to develop a system that computes a characterisation of novelty, in the form of a description in a formal knowledge representation language. From observation of the standard game being played, we extract a description of what can normally happen. This description uses a qualitative abstraction of spatial relations in the world, i.e., concepts like "left of", "moving towards", "touching", rather than concrete positions and velocities. Novelty becomes apparent when this description no longer matches what is observed, and the characterisation is then made by computing the changes to the description that are needed to cover the new observations.
Requirements
This project requires strong programming skills, as well as a talent for research. The project requires a substantial time commitment, and thus is suitable for students undertaking a 24-unit (honours) project or possibly a 12-unit project in one semester.
Background Literature
Duckworth, "Unsupervised Human Activity Analysis for Intelligent Mobile Robot" (https://doi.org/10.1007/s13218-018-0558-4). An example of the use of qualitative spatial representation to activity analysis.
Dylla et al., "A survey of qualitative spatial and temporal calculi: algebraic and computational properties" (http://dx.doi.org/10.1145/0000000.0000000). An overview of different qualitative calculi for spatial and temporal relations.