This page introduces Toyota Smarthome dataset.

Smarthome has been recorded in an apartment equipped with 7 Kinect v1 cameras. It contains 31 daily living activities and 18 subjects. The subjects, senior people in the age range 60-80 years old.

The videos were clipped per activity, resulting in a total of 16,115 video samples. The dataset has a resolution of 640×480 and offers 3 modalities: RGB + Depth + 3D skeleton. The 3D skeleton joints were extracted from RGB. For privacy-preserving reasons, the face of the subjects is blurred. Check out our demo video at https://www.youtube.com/watch?v=b0uZQanPbP4

The dataset is available on request. Please fill the form below.

For more details mail us at toyotasmarthome@inria.fr

Comments are closed.

  • License

    The dataset is provided for academic research only. The full license can be found here. Please read carefully the terms and conditions of the license and any accompanying documentation before you download and/or use the Toyota Smarthome dataset. By downloading and/or using the Data, you acknowledge that you have read these terms and conditions, understand them, and agree to be bound by them. If you do not agree with these terms and conditions, you must not download and/or use the Software. Any infringement of the terms of this agreement will automatically terminate your rights under this License.

  • Activity Distribution

  • Samples of Activities

  • Demo video

  • Real World Challenges



  • State-of-the-art on Toyota Smarthome

    For evaluation, we follow Cross-Subject and Cross-View protocols (more details in the paper).

    For each criterion, we report the mean per-class accuracy (in %).

  • Link for the Paper

  • Bibtex of Toyota Smarthome Trimmed Dataset:

    author = {Das, Srijan and Dai, Rui and Koperski, Michal and Minciullo, Luca and Garattoni, Lorenzo and Bremond, Francois and Francesca, Gianpiero},
    title = {Toyota Smarthome: Real-World Activities of Daily Living},
    booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
    month = {October},
    year = {2019}
  • Toyota Smathome Data Request

    Request to download the dataset

    Please fill-up the form below to download the dataset. By clicking the submit button you acknowledge that you have read the license (link), understand it, and agree to be bound by it.

  • *This dataset complies with GDPR European Regulation.

  • Toyota Smarthome Untrimmed Dataset

    We introduce a new untrimmed daily-living dataset that features several real-world challenges: Toyota Smarthome Untrimmed (TSU). TSU contains a wide variety of activities performed in a spontaneous manner.

    Activities are collected in real-world settings, which results in non-optimal viewpoints.

    The dataset contains dense annotations including elementary, composite activities and activities involving interaction with objects.
    We provide an analysis of the real-world challenges featured by TSU dataset, highlighting the open issues for detection algorithms.
    We show that the current state-of-the-art methods fail to achieve satisfactory performance on the TSU dataset.

    Paper Link – Toyota Smarthome Untrimmed: Real-World Untrimmed Videos for Activity Detection


    We are updating the Licence for releasing this dataset. For urgent requirement of TSU dataset email us at toyotasmarthome@inria.fr

  • Bibtex of Toyota Smarthome Untrimmed Dataset:

          title={Toyota Smarthome Untrimmed: Real-World Untrimmed Videos for Activity Detection}, 
          author={Rui Dai and Srijan Das and Saurav Sharma and Luca Minciullo and Lorenzo Garattoni and Francois Bremond and Gianpiero Francesca},