Intel Labs Advances Computer Vision Development with Two New AI Models
March 24, 2023 | IntelEstimated reading time: 2 minutes
Depth estimation is a challenging computer vision task required to create a wide range of applications in robotics, augmented reality (AR) and virtual reality (VR). Existing solutions often struggle to correctly estimate distances, which is a crucial aspect in helping plan motion and avoiding obstacles when it comes to visual navigation. Researchers at Intel Labs are addressing this issue by releasing two AI models1 for monocular depth estimation: one for visual-inertial depth estimation and one for robust relative depth estimation (RDE).
The latest RDE model, MiDaS version 3.1, predicts robust relative depth using only a single image as an input. Due to its training on a large and diverse dataset, it can efficiently perform on a wider range of tasks and environments. The latest version of MiDaS improves model accuracy for RDE by about 30% with its larger training set and updated encoder backbones.
MiDaS has been incorporated into many projects, most notably Stable Diffusion 2.0, where it enables the depth-to-image feature that infers the depth of an input image and then generates new images using both the text and depth information. For example, digital creator Scottie Fox used a combination of Stable Diffusion and MiDaS to create a 360-degree VR environment. This technology could lead to new virtual applications, including crime scene reconstruction for court cases, therapeutic environments for healthcare and immersive gaming experiences.
Intel Introduces MiDaS 3.1 for Computer Vision
While RDE has good generalizability and is useful, the lack of scale decreases its utility for downstream tasks requiring metric depth, such as mapping, planning, navigation, object recognition, 3D reconstruction and image editing. Researchers at Intel Labs are addressing this issue by releasing VI-Depth, another AI model that provides accurate depth estimation.
VI-Depth is a visual-inertial depth estimation pipeline that integrates monocular depth estimation and visual-inertial odometry (VIO) to produce dense depth estimates with a metric scale. This approach provides accurate depth estimation, which can aid in scene reconstruction, mapping and object manipulation.
Incorporating inertial data can help resolve scale ambiguity. Most mobile devices already contain inertial measurement units (IMUs). Global alignment determines appropriate global scale, while dense scale alignment (SML) operates locally and pushes or pulls regions toward correct metric depth. The SML network leverages MiDaS as an encoder backbone. In the modular pipeline, VI-Depth combines data-driven depth estimation with the MiDaS relative depth prediction model, alongside the IMU sensor measurement unit. The combination of data sources allows VI-Depth to generate more reliable dense metric depth for every pixel in an image.
Suggested Items
LG Display to Mass Produce World's First Gaming OLED Panel With Switchable Refresh Rate and Resolution
04/24/2024 | PRNewswireLG Display, the world's leading innovator of display technologies, announced that it has developed the first-ever Gaming OLED panel with a switchable refresh rate and resolution. The company has begun mass production of the 31.5-inch panel this month, accelerating its push into the high-end gaming display market with new concept products.
Arrow Electronics Launches Intelligent Vision Ecosystem
03/27/2024 | BUSINESS WIREArrow Electronics, Inc. is utilizing the onsemi Imager Access System (IAS) module standard for developing intelligent vision solutions for use in robotics, machine vision, commercial cameras and other uses.
Qualcomm Continues to Bring the Generative AI Revolution to Devices and Empowers Developers with Qualcomm AI Hub
02/26/2024 | Qualcomm Technologies, Inc.Qualcomm Technologies, Inc. unveiled its latest advancements in artificial intelligence (AI) at Mobile World Congress (MWC) Barcelona. From the new Qualcomm® AI Hub, to cutting-edge research breakthroughs and a display of commercial AI-enabled devices, Qualcomm Technologies is empowering developers and revolutionizing user experiences across a wide range of devices powered by Snapdragon® and Qualcomm® platforms.
Saki’s Latest AXI Machines Complete the Full Demo Lineup at Shanghai Solution Center
02/26/2024 | Saki CorporationSaki Corporation, an innovator in the field of automated optical and X-ray inspection equipment, is pleased to announce that its Shanghai Solution Center now offers the complete line up of inspection solutions with the addition of its award-winning, state-of-art X-ray automated inspection system (AXI) 3Xi-M110.
Würth Elektronik Brand Relaunch is WINNER of the German Brand Award
12/22/2023 | Wurth ElectronicsThe Würth Elektronik Group, based in the state of Baden-Württemberg, and DIE NECKARPRINZEN – the supporting communications and design agency from Heilbronn – are delighted about the successful brand relaunch.