We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from https://www.projectaria.com/datasets/aea/. We are also providing open-source implementations and examples of how to use the dataset in Project Aria Tools https://github.com/facebookresearch/projectaria_tools.
Aria Everyday Activities Dataset
The AEA Dataset includes multimodal sensor and machine perception data from daily activities, enabling applications like neural scene reconstruction and prompted segmentation.
- Year
- 2024
- Venue
- arXiv 2024
- Authors
- 24
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2402.13349v2ARXIV-DEFAULT
- TL;DR
- Semantic Scholar
Abstract
Authors
24Zhaoyang LvNicholas CharronPierre MoulonAlexander GaminoCheng PengChris SweeneyEdward MillerHuixuan TangJeff MeissnerJing DongKiran SomasundaramLuis PesqueiraMark SchwesingerOmkar ParkhiQiao GuRenzo De NardiShangyi ChengSteve SaarinenVijay BaiyyaYuyang ZouRichard NewcombeJakob Julian EngelXiaqing PanCarl Ren