What’s that sound? Audio event detection

The Challenge

Data

The dataset consists of sensor data that provide information about a person’s movement in space, recorded using a motion capture system. In addition, the muscle activity of the arms was measured. The data is available for five different individuals.

Twelve hand activities are distinguished, with the prefix „la-“ ndicating an activity of the left hand, and the prefix „ra-“ indicating an activity of the right hand:

  • la-object-pick / ra-object-pick The hand grabs an object.
  • la-object-carry / ra-object-carry The hand holds an object.
  • la-object-place / ra-object-place The hand places and object.
  • la-object-switch-hands / ra-object-switch-hands An object is passed from one hand to the other.
  • la-object-orient / ra-object-orient The hand moves a lying object.
  • la-nothing / ra-nothing The hand performs none of the previous actions.
2020.1
2020.2
2020.3
2020.4

Task

Segmentation and classification of hand movements while setting a table for an unseen person based on sensor data. That is, the specific activity must be predicted, as well as the start and end times of each activity.

Results

Student Track

RankScoreTeam NameMember Name(s)
🥇10.24465AIMastersAndreas Baude, Timo Urban, Jonas Klaff
🥈20.34087Bremens Last TopmodelMerlin Burri, Marlon Flügge, Tilman Ihrig
🥉30.37546Me and the BoysTim von Oehsen
       40.38167SEBoySimon Teiwes
        50.41639PerunetJasmin Uhlhorn
2021
2019