Next generation AI is here

IIIT-Hyderabad among the global consortium of 13 varsities and labs participating in the ambitious programme

Imagine a robot or an AI assistant giving you a nudge before you add more salt to your food, plan your next family outing or guide a doctor in a complex surgery. The next generation AI is well and truly here with ‘Ego4D’, a project initiated by Facebook AI in collaboration with Facebook Reality Labs Research (FRL Research) and other institutes from UK, Italy, Japan, Saudi Arabia, Singapore, and the United States.

International Institute of Information Technology (IIIT)-Hyderabad is the only Indian institute in the global consortium of 13 universities and labs participating in this ambitious programme. In November, a mammoth and unique dataset comprising over 2,200 hours of first-person videos in the wild, of over 700 participants engaged in routine, everyday activities will be unveiled.

The dataset comprises video footage from a first person’s perspective. “These videos show the world from the centre of the action, rather than the sidelines,” said lead research scientist, Facebook AI Kristen Grauman. The footage has been collected via head-mounted devices combined with other egocentric sensors to track the wearer’s gaze and capture the interactions.