01 What is ADAS and AVM

ADAS is short for Advanced Driving Assistant System, a system to help the driver in the driving process. When designed with a safe Human-Machine Interface, they should increase car safety and more generally road safety.It's developed to automate, adapt and enhance vehicle system for safety and better driving.

Visual related ADAS can much enhance driving safety by equipping vehicles with front, rear and side cameras and also ECU. Popular applications including lane departure warning(LDW), high-beam/ low beam (HB/ LB) adjustment, traffic signal recognition(TSR), parking-assist, rear view/ around view, anti-collision, and so on.

1. Frount Camera

Camera is used for video processing in ADAS, which can help to enhance driving safety by provide necessary traffic information, such as LDS, LKA, HB/ LB and TSR. Image sensor of front black& white camera will transfer video frame to dual-core MCU expanded by DSP to do image processing, other software related requirements, such as relevant physical communication interface, power, optional DRAM and lower cost embedded flash are also needed.

2. Rear Camera

Rear cameras can be used for doing native video analysis to detect objects and pedestrians. Further more, they are available for full native image processing and graphic overplot creating. The cameras are able to do distance measurement and trigger brake intervention. All of these are helful in improving car backing safety.

3. Surround Parking Assistant System

Multiple around visual cameras are used for image collecting around the car, and the images will be played on screen in form of virtual top views. Visual angle will move with wheel path to collect images around the car.Generally, an advanced system is equiped with LVDS, fast Ethernet and other economical and efficient links, and 4 to 5 HDR 1.0MP cameras. To take video compacting to reduce requisite communication band width and lower lining standard (eg. non-blocking twisted pair or coaxial cable)

02 Realize The Solution based on FET5718-C System on Module

A complete ADAS consists of processor, analog components and sernsors. TI processors have a powerful advantage in DSP. ADAS series processors are developed from OMAP. This AM5718 is a processor belongs to Sitara series SoC which integrates with a single Cortex-A15 core@ 1.5GHz, a DSP of C66X@ 750MHz, two dual-core M4@ 213MHz and two dual-core PRUs@ 200MHz, has good performance in 2D, 3D and hardware video codec.

1.Front/ rear/ around cameras expanding solution

DS90UB964-Q1 from TI is a multi-functional camera hub which can take FPD-Link III interface to expand 4 saperate cameras to collect video data. When it works with DS90UB913A/913Q, the processor can receive data from a 1.0 MP camera sensor, and can support 720p/800p/960p@ 30Hz or 60Hz FPS, which is used in ADAS applications, such as around visual system, camera mornitoring system, sensor fusion and security mornitoring system.

2. DS90UB913Q serializer and DS90UB914Q deserializer

DS90UB913Q serializer and DS90UB914Q deserializer strength the FPD-Link III automiative chipsets related product group.This serializer/ deserializer chipset provides camera modules with precise video and data interface without any software related cost and simpler lining, which is favorable to ADAS solution providers to lower power consumption, reduce cost and lighten the weight. System-level serializer/ deserializer enhanced functions will speed up the camera security system promotion in midrange and entry-level auto market segments. The chipset could be widely used in applications, such as auto front cameras for anti-collision or recognition of traffice signals and padestrian; rear cameras for protection of tailstock. Here below is a solution for visual around cameras.

3.HD interface (scalable for dual-display)

SoM FET5718-C can support up to 3x LCD and HDMI interfaces with resolution up to 1920x 1080@ 60Hz, both resistive and capacitive touching are supported. Dual-display combination of LCD and HDMI is supported with sync or async visions frames. It supports single-channel playback  of multi-channel video records and sync playback of 4 external cameras on saperate screens. Meanwhile, smart rear-view mirror function is also scable.

4. Video Processing and Coding

Two dual-core Cortex-M4 IPU1 and IPU2 are available in AM5718, IPU2 is used for IVA video codec, below forms are all supported

• ■ Video Decode: H264, MPEG4, MPEG2, and VC1
• ■ Video Encode: H264, and MPEG4
• ■ Image Decode: MJPEG
• ■ Image Encode: MJPEG

H264 can compact storage of multiple cameras at the same time. The storage system could be expanded by high-capacity external eMMC.

High definition voice playing system can support voice playing in preority and composite multi-voice playing, which combine alarm, navigation and entertainment all in one.

5. Powerful DSP

SoM FET5718-C is integrated with a DSP@ 750MHz and PRU@ 100MHz, which could be used for LWD, TSR, physical objects dection. OpenCV, OpenCL and OpenGL deomos are all kindly provided, which take it a great convenience to users' development.

OK5718-C single board computer is with all interface available and ready-to-test