For the full video of this presentation, please visit: https://www.embedded-vision.com/platinum-members/alliedvision/embedded-vision-training/videos/pages/may-2017-embedded-vision-summit-melle For more information about embedded vision, please visit: http://www.embedded-vision.com Michael Melle, Sales Development Manager at Allied Vision, and Felix Nikolaus, Firmware Designer at Allied Vision, presents the "A Multi-purpose Vision Processor for Embedded Systems" tutorial at the May 2017 Embedded Vision Summit. This presentation gives an overview of an innovative vision processor that delivers the superior image quality of industrial cameras while enabling the embedded vision system designer to meet the cost, size and power requirements of embedded vision applications. In addition to delivering superior image quality, the processor functions as a sensor bridge, an ISP and signal transmitter for downstream processing. The processor facilitates the transformation of industrial cameras, which are equipped with more expensive and larger commercial processors, to embedded applications that require smaller form factors, lower power and advanced image processing. Through an extensive library of pre-processing and image processing functions, designers can shift more image processing to the camera, reducing the demands on data transfer and host processing. The processor accepts inputs from most image sensors on the market and can process high data rates and image resolutions.

1. Copyright © 2017 Allied Vision 1
Michael Melle, Felix Nikolaus
May 2, 2017
Multi-purpose vision processor for
embedded systems

2. Copyright © 2017 Allied Vision 2
Corporate Information
• Industrial and Machine Vision camera supplier since 1989
• >300 employees
• Headquarters in Germany
• Worldwide sales and distribution

3. Copyright © 2017 Allied Vision 3
Machine Vision merges with Embedded Systems
Machine Vision
delivers:
• Sensor variety
• Robust Designs
• Configuration
and control
• Standard
interfaces
Embedded
Vision needs:
• Small
• Low Power
• Embedded
Interface
• Simple
integration
• Low Cost

4. Copyright © 2017 Allied Vision 4
New Multi-purpose Vision Processor
Allied Vision’s Alvium
SoC delivers
Solutions for
Embedded Vision

5. Copyright © 2017 Allied Vision 5
Alvium SoC delivers:
• Image processing beyond industrial vision
cameras and camera modules
• Direct interface for many sensors
• Camera triggering and timing capabilities
• Standard protocols including MIPI CSI-2
• User configurable processing functions
Alvium at a high level

6. Copyright © 2017 Allied Vision 6
ALVIUM
CPU System
MIPI CSI-2
4 Lane D-PHY
USB 3.0 GPIO
Buffer
Trigger I²C
Line IO
PHY
HighSpeed
Expansion
Interface
Sequencer
Flexible Sensor
Interface
HighPrecision
Sensor Timing
Chunk
MJPEG
Image
Processing
Unit
Sensors
up to 21MPix
Sony IMX
Python
Aptina
e2v
Solution
Up to 4 Lanes
6 Gbps
5 Gbps
Option to add
functionalities by a
Companion Chip
Up to 600 Mpx/s
and 7.2 Gbps

7. Copyright © 2017 Allied Vision 7
Solution – Image Processing
All image processing functions support full 600Mpix/s speed.

8. Copyright © 2017 Allied Vision 8
Solution – Multi Region of Interest
Less pixel transferred  increase FPS
Individual settings for each
Region of Interest
Increased
contrast
Applied
RGB
look-up
table

9. Copyright © 2017 Allied Vision 9
Solution – Image Processing
Highlighted modules support different settings for up to 4 Region of Interest

10. Copyright © 2017 Allied Vision 10
Solution – Acquisition Mode
Frame 2Frame 1
Trigger Signal
Exposure & Readout
Wait for Trigger
TimeALVIUM
GPIO
Trigger
Flexible Sensor
Interface
HighPrecision
Sensor Timing
Trigger from external source starts a frame within milliseconds
Acquisition Mode
• Continuous: Set the frame rate you need
• Single Frame: Get a frame when needed

11. Copyright © 2017 Allied Vision 11
Get meta data about the frame by using chunk data.
Solution – Chunk Data
Image Data Chunk Data
Exp. Time = 80 ms
Acquisition Start
Timestamp = 32642 ns
Gain = 2 dB
Gamma = 2.0

12. Copyright © 2017 Allied Vision 12
CSI-2 Interface: Integration
CCI – Basic Control Mode
• Read and write camera registers directly
• Used for V4L
• All CSI-2 defined pixel formats: RAW8/10/12, RGB888, YUV422, YUV420, …
• MJPEG compressed images
Vimba Control Mode
• Direct use of Allied Vision Vimba SDK
• Easy to use feature based control
• Pixel formats as defined in Gen<I>Cam standard by emva
• MJPEG compressed images

13. Copyright © 2017 Allied Vision 13
USB 3.0 Interface
USB3 SuperSpeed 5Gbps
• USB 3 Vision Standard complied
– Direct use of Allied Vision Vimba SDK
– Direct support of third party software
• UVC Mode
– Use it like a web cam
– Compatible with Android tablets

14. Copyright © 2017 Allied Vision 14
Market need fulfilled!
• Design a video front end that is compatible with
most commercial image sensors
• Move repetitive, fundamental (and advanced) image
processing functions to dedicated hardware
• Provide standard interfaces (video and serial) to
host
• Reduce complexity, size, power and cost

15. Copyright © 2017 Allied Vision 15
Alvium as a product
• Alvium is incorporated into the Allied Vision 1 Product Line
• The full capability of the SoC will be validated and
documented through integration with our cameras
• Alvium will be available as a product based on market
demand

16. Copyright © 2017 Allied Vision 16
Embedded Vision Alliance website
• MIPI Alliance Overview and Interface Specification Details
http://www.embedded-vision.com/industry-analysis/video-interviews-demos/mipi-alliance-
overview-and-interface-specification-details
• How Does Camera Performance Affect Analytics?
http://www.embedded-vision.com/platinum-members/apical/embedded-vision
training/documents/pages/camera-performance-analytics
Allied Vision Website
http://www.embeddedrevolution.com/
Resources