Automotive

Multiplatform Turn-Key Solutions
Accelerated Development For Automotive
Cameras

AUTOMOTIVE COMPETENCE ARIAS

Using our rich experience in the development of camera solutions as a stepping stone, we at MM Solutions JSC created a specialized
automotive imaging framework in 2015.

We developed memory-efficient, fast, and accurate solutions for AE, AWB, and WDR according to automotive industry standards, support for leading HW ISP (Texas Instruments, Renesas, NXP, Qualcomm, and ARM), adaptations for various sensor and ISP drivers, and designs for automotive use cases such as SRV, CMS, and machine vision.

The already existing MMS algorithms were upgraded, further optimized, and improved. These include support for LFM, adaptive LFM, AE, and AWB harmonization for Surround View and multicamera use cases.

With the development and help of a PC-based tuning tool to the framework, new features were added, allowing image quality real-time adjustment and improving for any light and road conditions.

Learn more about MMS Automotive products:

AUTOMOTIVE
CAMERA DEVELOPMENT KIT

CAMERA DEVELOPMENT KIT

Provides all hooks to achieve outstanding video quality at a low cost.

Production-quality pre-integrated imaging frameworks and algorithms (AEC, AWB, Wide Dynamic Range Management, Color Management).

Automated PC Tuning Tool with Real-Live Tuning Support.

No deep ISP expertise is needed to achieve good image quality.

Long-term solution, 10 years of support.

Already in production and ongoing projects with several Tier 1.

Flexible and feature-rich, incorporating all ISP control functions, mandatory image quality algorithms, support for profiling, logging, debugging, etc.

Applicable for all automotive camera use cases, including but not limited to surround view (SRV), camera monitor and mirror (CMS), front or rear camera, multiple camera stitching, machine vision and human vision.

Single-source solution, providing a full camera stack and tools for high-quality automotive cameras.

Easy to customize and port on new ISP platforms, operating systems, and image sensor modules.

Low support overhead, straightforward integration with ECU control software, no hardware dependencies, easy to deploy on new ECU.

Easy to integrate customer imaging algorithms.

IMAGING AUTOMOTIVE GRADE ALGORITHMS

Designed for automotive use cases – SRV, CMS, machine vision.

Provisions to cope with corner cases such as HDR and LDR scenes, high-speed changing scenes, tunnel entry and exit , dual pixel color and sensitivity mismatch, internal sensor limitations, etc.

Robust operation with a broad range of automotive image sensors – HDR sensors (2 and 3 frames), linear and compressed image data, RCCB, RGB IR, RCCC, and RGGB sensors.

AEC/WDR algorithms incorporate advanced tone mapping and wide dynamic range control algorithms and provide settings for local/global brightness enhancement, gamma, and merger modules in addition to analog/digital gain and exposure for 1, 2, or 3 sensor frames.

AWB algorithm incorporates color management algorithm to provide settings for CCM and RGB2YUV processing and 3D LUT if a corresponding HW is available.

AWB has no limitations with respect to light type and color temperature handle.

AEC/WDR, and AWB provides special modes to facilitate multi-camera harmonization and stitching, WYSIWYG mode, etc.

Both algorithms support:

Multiple ROIs and weights support
Manual and automatic modes.
No factory line camera module. calibration is needed for both AEC/WDR and AWB.

FLEXIBLE INTEGRATION FOR DIFFERENT SW AND HW PLATFORMS

Integrated with many automotive custom and off-the-shelf operating systems (OS)

Different HW ISP supported

Most popular image sensor vendors supported

Baseline solution for

TI TDI2Px/3x, TDA4, Renesas V3M and V3H

APPLICATION SCENARIOS

MMS CAMERA MIRROR

The Camera Mirror System is used to replace conventional side view mirrors with compact cameras that provide live HDR images to the dedicated screens inside the vehicle.

HDR images increase the visibility of the surroundings and give a better view to the driver.

MM Solutions imaging algorithms and camera tuning approaches are already integrated into various vehicle brands and models, providing the best driving experience to the end customer.

MMS SURROUND VIEW

No cameras splitting lines (seamless stitching)

Uses a GPU for fast and low-power stitching.
Runtime ground plane estimation and adaptation (GPE).
Adaptive stitching seam.
Adaptive color and brightness. correction (ACC).
Maintains various views and a few views in the output window
Draws a 3D car model, animations for doors and lights, parking guide lines, sonar distance information, 3D walls, and shows text and icons.
Maintains transparent car chassis on top view and 3D views.
Adaptive quality for system load Inline factory calibration.

A common problem with SVM algorithms is the large distance between the cameras, hence, the objects look very differently. Stitching such different objects inevitably leads to artifacts. To mitigate the problem, the MMS SVM solution uses adaptive seam, which can walk around the objects.

When a pedestrian stands exactly on the seam line between two cameras, starting from a car corner, only her/his shoes are visible in the stitched image. A side-by-side comparison of fixed seam vs. adaptive seam illustrates the problem when an object passes by the car corners:

MACHINE VISION

Machine vision technology is used in automatic driver assistance systems, including sensors and cameras installed in vehicles. MMS machine vision can detect whether the car is well positioned on the road, whether there are obstacles ahead, or whether other vehicles are crossing the car’s direction of movement.

The detection capabilities use 3D image data to prevent traffic accidents and increase safety. Furthermore, machine vision technology will help in the development of autonomous vehicles.

If you are considering introducing our technology or products, or if you are interested in co-creation with us, please feel free to contact us from here.

TUNING TOOL

The MM Solutions Tuning Tool application is a quick and efficient way to accomplish amazing camera tuning. With a simple, minimalistic, and straight-to-the-point UI, you can accomplish the most desired tuning options on the market with ease. We’ve arranged its blocks and options to be best suited for our clients’ needs and the technology they’ll be using it on.

The MMS Tuning Tool is a flexible and efficient image quality tuning system for achieving excellent image quality within a short deadline. It allows to delink the software development from the image tuning process and produces a tuning database in human-readable form (XML) in binary form (to be linked with or run-time loaded into Auto CDK). The tool has an extendable architecture – new image pipe components and algorithms can be added as plugins to it.

PRODUCTION LEVEL IMAGE QUALITY TUNING

Production-level tuning is the final stage of every automotive project before it reaches its clients. Such tuning includes coverage of TUV requirements for different system classes as well as customized system looks based on client preferences.

In order to achieve excellent Image Quality we test under multiple weather, light, and scene conditions, such as tunnels, multilevel and underground parking lots, rural and urban areas, highway, multi-lane roads, and more from sunny days to rainy nights.