The Road to Full Autonomous Driving: Mobileye and STMicroelectronics to Develop EyeQ®5 System-on-Chip, Targeting Sensor Fusion Central Computer for Autonomous Vehicles
5th-generation System-on-Chip, scheduled to sample in H1 2018, builds on long-standing cooperation between Mobileye and ST and market success of EyeQ technology, available now or in the near future on vehicles from25 car manufacturers Jerusalem and Geneva / 17 May 2016
Mobileye (NYSE:MBLY) and STMicroelectronics (NYSE:STM) today announced that the two companies are co-developing the next (5th) generation of Mobileye’s SoC, the EyeQ®5, to act as the central computer performing sensor fusion for Fully Autonomous Driving (FAD) vehicles starting in 2020.
To meet power consumption and performance targets, the EyeQ5 will be designed in advanced 10nm or below FinFET technology node and will feature eight multithreaded CPU cores coupled with eighteen cores of Mobileye's next-generation, innovative, and well-proven vision processors. Taken together, these enhancements will increase performance 8x times over the current 4th generation EyeQ4. The EyeQ5 will produce more than 12 Tera operations per second, while keeping power consumption below 5W, to maintain passive cooling at extraordinary performance. Engineering samples of EyeQ5 are expected to be available by first half of 2018.
The EyeQ5 continues Mobileye’s long-standing cooperation with STMicroelectronics. Leveraging its substantial experience in automotive-grade designs, ST will support state-of-the-art physical implementation, specific memory and high-speed interfaces, and system-in-package design to ensure the EyeQ5 meets the full qualification process aligned with the highest automotive standards. ST will also contribute to the overall safety- and security-related architecture of the product.
“EyeQ5 is designed to serve as the central processor for future fully-autonomous driving for both the sheer computing density, which can handle around 20 high-resolution sensors and for increased functional safety,” said Prof. Amnon Shashua, cofounder, CTO and Chairman of Mobileye. "The EyeQ5 continues the legacy Mobileye began in 2004 with EyeQ1, in which we leveraged our deep understanding of computer vision processing to develop highly optimized architectures to support extremely intensive computations at power levels below 5W to allow passive cooling in an automotive environment.”
“Each generation of the EyeQ technology has proven its value to drivers and ST has proven its value to Mobileye as a manufacturing, design, and R&D partner since beginning our cooperation on the EyeQ1,” said Marco Monti, Executive Vice President and General Manager Automotive and Discrete Group, STMicroelectronics. “With our joint commitment to the 5th-generation of the industry’s leading Advanced Driver Assistance System (ADAS) technology, ST will continue to provide a safer, more convenient smart driving experience.”
Technical Details
EyeQ5’s proprietary accelerator cores are optimized for a wide variety of computer-vision, signal-processing, and machine-learning tasks, including deep neural networks. EyeQ5 features heterogeneous, fully programmable accelerators, with each of the four accelerator types in the chip optimized for its own family of algorithms. This diversity of accelerator architectures enables applications to save both computational time and energy by using the most suitable core for every task. This optimized assignment ensures the EyeQ5 provides "super-computer" capabilities within a low-power envelope to enable price-efficient passive cooling. Mobileye’s investment in several programmable domain-specific accelerator families is enabled by its focus on the ADAS and autonomous- driving markets.
Autonomous driving requires an unprecedented level of focus on functional safety. EyeQ5 is designed for systems that meet the highest grade of safety in automotive applications (ASIL B(D), according to the ISO 26262 standard).
Mobileye has built the EyeQ5’s security defenses based on the integrated Hardware Security Module. This enables system integrators to support over-the-air software updates, secure in-vehicle communication, etc. The root of trust is created based on a secure boot from an encrypted storage device.
EyeQ5 will be delivered to carmakers and Tier1s along with a full suite of hardware accelerated algorithms and applications that are required for autonomous driving. Along with this, Mobileye will support an automotive-grade standard operating system and provide a complete software development kit (SDK) to allow customers to differentiate their solutions by deploying their algorithms on EyeQ5. The SDK may also be used for prototyping and deployment of Neural Networks, and for access to Mobileye pre-trained network layers. Uses of EyeQ5 as an Open Software Platform are facilitated by such architectural elements as hardware virtualization and full cache coherency between CPUs and accelerators.
Autonomous driving requires fusion processing of dozens of sensors, including high-resolution cameras, radars, and LiDARs. The sensor-fusion process has to simultaneously grab and process all the sensors’ data. For this purpose, the EyeQ5’s dedicated IOs support at least 40Gbps data bandwidth.
EyeQ5 implements two PCIe Gen4 ports for inter-processor communication, which could enable system expansion with multiple EyeQ5 devices or for connectivity with an application processor.
High computational and data bandwidth requirements are supported with four 32-bit LPDDR4 channels, operating at 4267MT/s.
Availability
Engineering samples of EyeQ5 are expected to be available by first half of 2018. First development hardware with the full suite of applications and SDK are expected by the second half of 2018.
About Mobileye
Mobileye N.V. is the global leader in the development of computer vision and machine learning, data analysis, localization and mapping for Advanced Driver Assistance Systems and autonomous driving. Our technology keeps passengers safer on the roads, reduces the risks of traffic accidents, saves lives and has the potential to revolutionize the driving experience by enabling autonomous driving. Our proprietary software algorithms and EyeQ® chips perform detailed interpretations of the visual field in order to anticipate possible collisions with other vehicles, pedestrians, cyclists, animals, debris and other obstacles. Mobileye’s products are also able to detect roadway markings such as lanes, road boundaries, barriers and similar items; identify and read traffic signs, directional signs and traffic lights; create a Roadbook™ of localized drivable paths and visual landmarks using REM™; and provide mapping for autonomous driving. Our products are or will be integrated into car models from 25 global automakers. Our products are also available in the aftermarket. Further information about Mobileye can be found at: http://www.mobileye.com/
About STMicroelectronics
ST is a global semiconductor leader delivering intelligent and energy-efficient products and solutions that power the electronics at the heart of everyday life. ST’s products are found everywhere today, and together with our customers, we are enabling smarter driving and smarter factories, cities and homes, along with the next generation of mobile and Internet of Things devices. By getting more from technology to get more from life, ST stands for life.augmented.
In 2015, the Company’s net revenues were $6.90 billion, serving more than 100,000 customers worldwide. Further information can be found at www.st.com.
Forward-Looking Statements
This press release contains certain forward-looking statements. Words such as “believes,” “intends,” “expects,” “projects,” “anticipates,” and “future” or similar expressions are intended to identify forward-looking statements. These statements are only predictions based on each of STMicroelectronics’ and Mobileye’s current expectations and projections about future events. You should not place undue reliance on these statements. Many factors may cause actual results to differ materially from any forward-looking statement, including the risk factors and other matters set forth in STMicroelectronics’ and Mobileye’s respective filings with the U.S. Securities and Exchange Commission. Neither Mobileye nor STMicroelectronics undertakes any obligation to update or revise any forward-looking statement, whether as a result of new information, future events or otherwise, except as may be required by law.
For more information, contact:
Mobileye
Dan Galves
CCO / SVP
dan.galves@mobileye.com
