Mobius Labs Unveils Breakthrough Multimodal AI Video Search Empowering Organizations to “Chat” with Their Content Libraries
Superhuman Vision™ is next generation computer vision technology by Mobius Labs that empowers journalists by taking over the many time-consuming and mundane activities, leaving them focused on the human side of reporting.
In recent years, computer vision solutions have helped break some of the biggest international news stories. Elsewhere, this technology combats the spread of fake news and bolsters the narrative skills of photo-editors.
Here are just some of the areas where computer vision supports these activities, as well as the skills that journalists need to flourish in this new environment.
Computer vision has played a role in breaking some of the biggest international stories of recent years. For example, the ‘Panama Papers’ exposé, where machine learning helped an international team of researchers to identify loan agreements in more than 13 million records that were leaked to the press.
Journalists were able to ‘follow the money’ exposing the practices of offshore tax havens and the businesses taking advantage of tax loopholes. Machine learning also played a valuable role in the Implant Files investigation. Here, it sifted through reports sent to the U.S. Food and Drug Administration, and helped to uncover patient deaths potentially caused by faulty medical devices.
For now, most machine learning is supervised by software engineers. But in the future, ‘domain experts’, including journalists will play a greater role. If machine learning can help doctors assess valuable information from x-rays and CT scans in order to triage patients, then it should be able to further assist journalists. As the opportunities for big-data investigations increase, reporters may need to acquire skills to instruct machine-learning research.
Digital photography has transformed the business models of photo agencies. Gone are the days of thousand-dollar invoices for the exclusive rights to a photograph. Instead agencies are moving to a high volume, low margin, royalty-free model.
For this to be viable, many agencies are adopting computer vision technology, a form of deep learning that can tag images with their contents including objects, people and emotions. This makes it easier for broadcast media to find, and then purchase, images to illustrate their own content.
Such technology includes facial recognition, essential when classifying archives that contain millions of photographs gathered over dozens of years. The most advanced systems, like Superhuman Vision™, also include an ‘aesthetic ranking feature’, which enables photographers to filter their best images based on composition, depth of field, position of subject, contrast and others.
Computer Vision, in this case machine learning, enables specialists to focus on their core strengths. Photo-editors have more time to examine the narrative possibilities of new pictures. Photographers, who may take thousands of images at a single event, no longer have to sift through every single image. Instead the software recommends a much smaller set of images to work from.
Artificial intelligence can write news articles, just not very complicated ones. In most cases, such systems rely on what is known as robo-journalism, the automated writing of stories based on structured data. This works well for deadline-driven stories based on sports results, financial news, weather and elections to name but four.
The Radar News Service, in the UK, is a good example of this approach at scale. Launched in 2018, its five reporters filed 250,000 articles in the first 18 months of service. The journalists use specialist NLG (natural language generation) technology, to draft articles based on data sets released by the UK government.
Using their investigative skills, the journalists identify data sets from which they can derive a story and then build a template into which the data and standard phrases can be assembled. Stories are then published to subscribers, especially local news outlets who may publish the original content or use it as the basis for their own reporting.
For journalists to flourish in this environment, being able to work with automation templates is essential. Some simple programming knowledge is also required. It’s another good example of AI empowering news reporters, helping them to be more effective at their jobs.
Technology has impacted fact checking in several ways. It supports the collaboration of literally hundreds of journalists and fact checkers across different offices. In the case of the Implant Files story, fact-checking involved a team of 11 people manually sifting the results, to make sure that every case flagged by the algorithm was correctly identified (see 1 above).
Machine learning has a role to play in other fact checking scenarios, either supporting human specialists, or validating information itself. On the one hand, it can help separate out sentences with claims, making it easier for fact checkers to focus on statements that require validation. On the other, it can verify claims autonomously, checking against databases of information in real time.
Machine learning also plays a valuable part in the technological arms race against fake news and its propagators. As the volume of misinformation increases it will play an ever-greater role detecting such content and preventing it from contaminating articles authored by journalists and robo-journalists.
Newsrooms today need to keep delivering quality content on-the-go. Superhuman Vision™ offers features like Few-shot Learning, facial expression analysis and conceptual image tagging which return better search results and help press agencies sort their huge visual archives in a matter of seconds. Furthermore, it improves business efficiency by undertaking time-consuming research and fact checking activities.
This cutting-edge technology is not meant to replace journalists, but to empower them. At a time when free speech and honest broadcasting are under threat, it frees up reporters to focus on what they do best: nurturing sources, coordinating research, and assembling articles using professional expertise and creative skills. Welcome to a new era of journalism, more human and more relevant than ever. Are you ready?