Dr. Kapidis’ successful thesis defense

On June 10, Georgios Kapidis successfully defended his thesis “A Modular Approach for the Detection and Interconnection of Objects, Hands, Locations, and Actions for Egocentric Video Understanding“. Congratulations to the young dr.! Thanks to all committee members. It was my pleasure to supervise Georgios with prof. Remco Veltkamp over the past years!

Multi-dataset multitask learning accepted for PAMI

Georgios Kapidis‘ work on multi-dataset multitask learning has been accepted to IEEE Transactions on Pattern Analysis and Machine Intelligence! Congratulations! We propose a method to improve egocentric action recognition using additional datasets with potentially different label sets, and different classification and regression tasks. We can thus learn by considering only weakly related data and tasks.

The paper will be available soon. A preliminary version of the research was presented at the EPIC workshop at ICCV 2019.

Learn to cycle paper in Pattern Recognition Letters

Alex Stergiou‘s paper “Learn to cycle: Time-consistent feature discovery for action recognition” now appears in Pattern Recognition Letters. We present a new method that can flexibly extract spatio-temporal patterns with varying temporal scales. We show state-of-the-art performance on benchmark datasets, including Kinetics-700, Moments in Time and HACS. The code is available!

Nominated for Klokhuis science award 2020, vote now!

Our lie detection research with Sophie van der Zee has been nominated for the Klokhuis science award. Klokhuis was that kids program that made you become curious about science. We are honored that our research on lying in families has been nominated for their 2020 science award. Everyone can vote for any of the 10 finalists. An episode about the topic of the winner will be made and aired. Cast your vote here! (We are “Kun jij beter liegen dan je ouders?”)

Thanks to Daan van Alkemade for the 8-second teaser video!

Article on measuring the effectiveness of group play therapy

Group play appears to have a positive effect on the physical and mental development of children. However, it is unclear what the effective elements of a group play intervention are. With colleagues from the Wilhelmina Children’s Hospital in Utrecht, we set out to thoroughly evaluate their “This is Me” sports- and play-based cognitive behavior therapy program. Major challenge was to systematically measure those aspects that measure play and wellbeing. The preprint of our article in Clinical Child Psychology and Psychiatryfigure_x(b) is now online. We are looking forward to hear from other groups that focus on measuring the process of group-based play therapy.

In-car phone use detection now ready for deployment

The number of car incidents is rising again, after years of steady decline. One explanation is car drivers’ use of phones. The Dutch police is now introducing automated ticketing for drivers holding a phone, based on camera footage. The pilot for this technique has been developed in 2018 by my MSc student Jannes Elings. The Dutch police has continued to develop the technique, which is now ready for deployment on the public roads.

Popular Dutch media NOS (Acht uur journaal), RTL (RTL Nieuws) and nu.nl have reported on this breakthrough.


In-car phone use – Photo courtesy of the Dutch police

Georgios Kapidis Multi-Task Learning paper at ICCV-EPIC workshop

Georgios Kapidis will present his recent work on Multi-Task Learning for the recognition of actions in ego-centric videos at the EPIC workshop of ICCV. By predicting multiple outputs such as gaze targets and hand locations, we can improve the network structure which benefits other tasks such as action recognition. We demonstrate state-of-the-art results on the EGTEA Gaze+ dataset, and show nice improvements over only action recognition on EPIC Kitchens.


Alex Stergiou has three papers accepted!

Alex Stergiou had a good run: three papers were accepted recently at ICIP (paper), ICMLA (paper) and the ICCV workshop on Interpreting and Explaining Visual Artificial Intelligence Models (paper). The papers deal with the visualization of what 3D CNNs learn for video recognition. Congrats on the acceptance!

Moreover, the survey on vision-based analysis of human-human interactions has appeared in Computer Vision and Image Understanding (CVIU). It can be downloaded for free.2019_alex_iccvw