Active physical inference via reinforcement learning
Abstract
When encountering unfamiliar physical objects, children and adults often perform structured interrogatory actions such as grasping and prodding, so revealing latent physical properties such as masses and textures. However, the processes driving and supporting these curious behaviors are still largely mysterious. In this paper, we develop and train an agent able to actively uncover latent physical properties such as the mass and force of objects in a simulated physical "micro-world". Concretely, we used a simulation-based-inference framework to quantify the physical information produced by observation and interaction with the evolving dynamic environment. We used model-free reinforcement learning algorithm to train an agent to implement general strategies for revealing latent physical properties. We compare the behaviors of this agent to the human behaviors observed in a similar task.
Keywords
Bibtex entry:
@inproceedings{li2019active,
abstract = {When encountering unfamiliar physical objects, children and adults often perform structured interrogatory actions such as grasping and prodding, so revealing latent physical properties such as masses and textures. However, the processes driving and supporting these curious behaviors are still largely mysterious. In this paper, we develop and train an agent able to actively uncover latent physical properties such as the mass and force of objects in a simulated physical "micro-world". Concretely, we used a simulation-based-inference framework to quantify the physical information produced by observation and interaction with the evolving dynamic environment. We used model-free reinforcement learning algorithm to train an agent to implement general strategies for revealing latent physical properties. We compare the behaviors of this agent to the human behaviors observed in a similar task.},
address = {Austin, TX},
author = {Li, S. and Sun, Y. and Liu, S. and Wang, T. and Gureckis, T.M. and Bramley, N.R.},
booktitle = {Proceedings of the 41st Annual Conference of the Cognitive Science Society},
editor = {Goel, A.K. and Seifert, C.M. and Freksa, C.},
publisher = {Cognitive Science Society},
title = {Active physical inference via reinforcement learning},
year = {2019}}QR Code:
Download SVG