In the fast-evolving field of artificial intelligence, a new frontier is emerging: video understanding. Jae Lee, co-founder of Twelve Labs, believes that AI models adept at interpreting videos as well as they do text could unlock groundbreaking applications.
Twelve Labs is pioneering this space by offering functionalities such as precise searches within video content, clip summarization, and responses to context-based queries like "When did the person in the red shirt enter the restaurant?" These capabilities have garnered investments from major tech firms such as Nvidia, Samsung, and Intel.
To Lee, a data scientist by training, traditional keyword searches, which only pull up titles, tags, and descriptions, never made sense for videos because they fail to access the actual content of the clips. Frustrated by the inadequacies of existing solutions, Lee and his team developed a model that maps text to video content, including actions, objects, and sounds, offering a more nuanced search capability that surpasses basic keyword tagging. Twelve Labs has developed a “'video-first” approach, prioritizing video data over other formats and customizing solutions that integrate seamlessly with users' existing data, setting it apart from other offerings in the market.
With technological innovation comes ethical responsibility. A significant concern is the potential for AI models to learn and perpetuate biases as highlighted by a 2021 study. Twelve Labs is proactive in addressing these issues, developing ethical benchmarks and datasets to prevent biases in their AI models.
Smartphones have become integral to daily life, raising increasing apprehensions about their impact on attention, productivity and overall digital habits. As reliance on smartphones has grown, so has…
Developer Rockstar Games and publisher Take-Two Interactive recently opened pre-orders for Grand Theft Auto VI (“GTA 6”), marking the first franchise instalment in thirteen years. Since the launch of…
A new iOS app called Sniff is taking a different approach to social networking by connecting dog owners within the same neighbourhood. Rather than encouraging users to build broad online communities…
The fully autonomous ridesharing service, Waymo, is looking to add a new ridesharing option for Torontonians with self-driving vehicles. Waymo is a driverless taxi service where users can hail an…
Four years after Canada shut Huawei out of its 5G networks, one of its former subsidiaries is hoping for a second chance in the Canadian market. Honor Device Co., a Chinese consumer electronics…
Quantum computers have long been promised to reshape the leading edge of computing technology, facilitating machines capable of completing operations unthinkably time-intensive for classical computers…
