In the fast-evolving field of artificial intelligence, a new frontier is emerging: video understanding. Jae Lee, co-founder of Twelve Labs, believes that AI models adept at interpreting videos as well as they do text could unlock groundbreaking applications.
To Lee, a data scientist by training, traditional keyword searches, which only pull up titles, tags, and descriptions, never made sense for videos because they fail to access the actual content of the clips. Frustrated by the inadequacies of existing solutions, Lee and his team developed a model that maps text to video content, including actions, objects, and sounds, offering a more nuanced search capability that surpasses basic keyword tagging. Twelve Labs has developed a “'video-first” approach, prioritizing video data over other formats and customizing solutions that integrate seamlessly with users' existing data, setting it apart from other offerings in the market.
With technological innovation comes ethical responsibility. A significant concern is the potential for AI models to learn and perpetuate biases as highlighted by a 2021 study. Twelve Labs is proactive in addressing these issues, developing ethical benchmarks and datasets to prevent biases in their AI models.
Author: Mikaela Wang
Photo Credit: https://unsplash.com/@sxth
Authors
Expertise
Insights
-
Technology
Shrinking Nuclear Power’s Biggest Hardware Challenge: Apollo Atomics’ 40x Smaller Steam Generator
Apollo Atomics (“Apollo”), founded in 2025 by Assil Halimi and Drew Walker, is seeking to make nuclear energy more affordable by redesigning its steam generator. Steam generators are one of the… -
Technology
Newlight Hydrogen-Hybrid Energy System Expansion
Maritime energy technology company Newlight has announced the successful completion of its first ever long-range commercial voyage using its hydrogen-hybrid energy system. Throughout the… -
Technology
From Club Penguin to Imagine Island: A New Era of Children’s Online Gaming
Magic Potion Games, a game studio based in Kelowna, British Columbia, has created a new online multiplayer game, Imagine Island. The studio’s executive team is composed of seasoned industry… -
Technology
C$500M Tech Growth Fund: Ottawa’s Move from Policymaker to Direct Investor
Canada’s new AI Strategy signals a fundamental shift in how the Canadian government intends to support the country’s innovation ecosystem. Backed by more than C$2 billion in investments, the… -
Technology
Waymo Releases New Custom Chip
Waymo has introduced its 5nm ASIC, a purpose-built chip engineered exclusively for the real-time conversion of raw sensor data from robotaxis’ lidar, radar and camera sensors before they reach the… -
Technology
Brick by Brick: How a New Wave of Products Is Fighting Back Against Screen Addiction
Smartphones have become integral to daily life, raising increasing apprehensions about their impact on attention, productivity and overall digital habits. As reliance on smartphones has grown, so has…