In the fast-evolving field of artificial intelligence, a new frontier is emerging: video understanding. Jae Lee, co-founder of Twelve Labs, believes that AI models adept at interpreting videos as well as they do text could unlock groundbreaking applications.
Twelve Labs is pioneering this space by offering functionalities such as precise searches within video content, clip summarization, and responses to context-based queries like "When did the person in the red shirt enter the restaurant?" These capabilities have garnered investments from major tech firms such as Nvidia, Samsung, and Intel.
To Lee, a data scientist by training, traditional keyword searches, which only pull up titles, tags, and descriptions, never made sense for videos because they fail to access the actual content of the clips. Frustrated by the inadequacies of existing solutions, Lee and his team developed a model that maps text to video content, including actions, objects, and sounds, offering a more nuanced search capability that surpasses basic keyword tagging. Twelve Labs has developed a “'video-first” approach, prioritizing video data over other formats and customizing solutions that integrate seamlessly with users' existing data, setting it apart from other offerings in the market.
With technological innovation comes ethical responsibility. A significant concern is the potential for AI models to learn and perpetuate biases as highlighted by a 2021 study. Twelve Labs is proactive in addressing these issues, developing ethical benchmarks and datasets to prevent biases in their AI models.
Cellar Insights Inc. (“Cellar Insights”), an agricultural technology company, is advancing post-harvest potato storage using sensor technology, data analytics and predictive modelling. Its system…
Ever loved someone ‘to the Moon and back’? Well, thanks to an American start-up, you can now pay to have their ashes shot into space.Space Beyond is a vertically integrated aerospace service that is…
Wing, the Alphabet-owned company specializing in drone delivery of medicine, groceries and fast-food, has announced a major expansion of its partnership with Walmart to expand its grocery delivery…
As TechCrunch recently reported, YouTube has won the rights to stream the Oscars, Hollywood’s glitziest awards ceremony, exclusively on its platform beginning in 2029. For these rights, the online…
Xposure Technology Inc. (“Xposure Music”), a technology-driven financing and investment platform, leverages data analytics and artificial intelligence to identify and acquire music catalogs that it…
Lego’s new Smart Play system has added interactive Lego blocks to the well-known analog franchise. The new system makes use of smart bricks, smart tag tiles and smart minifigures which interact with…
