CHC5 Open Camera System, For Hardware Accelerated Advance Machine Vision , Part 2
Get link
Facebook
X
Pinterest
Email
Other Apps
This project is the next project in the series of camera projects that have been published on CircuitValley. I started with the first-ever open-source USB UVC stack, making the first-ever PIC32 USB camera. Then I moved to a camera based on the CYUSB USB 3.0 controller. Then came the Lattice MachXO3-based high-speed camera. After that I made the Lattice CrossLink-NX cameras. This is going to be the 5th generation of the CircuitValley open camera system that you can actually buy and use in your application, customize, or get adapted to your application.
CHC5 is the world's first commercially available modular camera system that can be customized and adapted to different applications with not just a different lens objective, but also a different sensor, at the click of a button. This is the world's first camera that allows interchangeable sensors.
The CHC5 camera platform is based on the Zynq-7000 FPGA SoC. It contains a decent-size FPGA integrated with a dual-core Arm Cortex-A9 CPU. This creates a really high-speed integrated system that contains a really high-performance CPU for really complex tasks, while the FPGA part takes care of high-speed calculation and correction on the image itself. With this large FPGA available at the disposal of the CPU, AI/machine-vision-specific algorithms and complex low-latency hardware acceleration can be put onto the PL, in part or in full.
Camera Platform Specification
Interchangeable Lens Mount
Minimum flange distance of 8.75mm makes it possible to connect almost any lens
Currently available lens mounts:
C-Mount
CS-Mount
Canon RF-Mount (Manual Controls)
Sony E-Mount (Manual Controls)
M42 Mount with Multiple Flange Distance
S Mount
M43 or Custom Lens Mount
Frame Rate
Virtually no frame rate limit
600 Mpixel/second ISP processing rate
ISP max:
640×480 ~2000 FPS
1080p ~170 FPS
4K ~40 FPS
Supported Sensor Specs
Sensors : Supports all Sensor that meets Sensor Specs
Interface : All MIPI D-PHY/LVDS/Sub LVDS/Low Voltage LVDS/SLVS Sensors
Resolution : ~128Mpixel Max, No Min limit
Shutter : Global or Rolling Shutter
Number of Data Lanes : upto 8 Lanes, 4 Lanes x1ch or 4Lane x2ch
Number of Sensors: 2 (4 Lanes), 3 (2 Lanes)
Max Data rate : 1.25Gbps/Lane, max 10Gbps with 8Lanes
Pixel format: RAW8, RAW12, RAW14 , PWL HDR
Freely user configurable Frame rate
Frame rate is sensor and Streaming Interface Dependent
Frame rate Details provided in individual Sensor specs
CHC5 Enclosure and Mounting System
Camera Enclosure Designed to Accommodate Any Sensor mount or no sensor mount at all. There is Internal Filter and M43 Thread for Standard External Filter
Sensor PCB mount Supports Internal Filter and Internal Reflection Mitigation Device
Lens Mount Can be exchanged Externally , 6x M3 Counter Sunk Screws are used to Secure These Mount
Canon RF Mount
CHC5 Enclosure Core
CHC5 Enclosure Back
CHC5 Back Thermal Contact
Currently Available Sensors
Available Sensor list will add more sensors over time. If user is looking for Specific sensor then he can contact us for new sensor addition.
Rolling Shutter
IMX477 : 12.3M Generic High quality
IMX485: 8.4M Low Light, High Sensitivity Large Pixel/Senor
IMX678 : 8.4M Low Light, Very High Sensitivity
IMX585 : 8.4M Color Low Light, Even Higher Sensitivity Larger Pixel/Sensor
IMX585: 8.4M Mono Even Higher Sensitivity then IMX585 Color
IMX283 : 20.3M Large 1inch Sensor size
IMX294 : 10.7M Massive 4/3 Format, Low Light, High Sensitivity
OX08B40 : 8.3M 140 dB Extreme Dynamic Range PWL HDR Automotive Sensor
External, user-changeable standard 43mm filter mount
Camera Interface
USB3 5 Gbps - USB UVC, USB3 Vision
Ethernet 1 Gbps - GigE Vision, Optional PoE
HDMI 1080p
Simultaneous streaming over all 3 interfaces
Streaming Protocols
USB3 : UVC (Standard Web Cam), USB3 Vision
Ethernet: GigE Vision , Optional PoE
HDMI: Standard
Aux I/O
1× Isolated input, user-configurable
1× Isolated output, user-configurable
ISP Specification
Full fledged ISP All Standard and Enhance Features Dedicated handling of Color and Mono Sensors.
ISP Specifications
Camera ISP on FPGA Logic
Black Level Correction
Demosaic
3A Engine
Auto White Balance
Auto Exposure
Auto Focus
Auto Gain
Color Space Conversion
Gamma Correction
Video Processing for HDMI
Dedicated USB , Ethernet and HDMI Pipeline
Simultaneous USB , Ethernet and HDMI operation
Dedicated GigE Vision, USB3 Vision, UVC and HDMI Pipeline
Frame Rate Conversion Specifically for HDMI
Supports 1 to 4 Pixel Per Clock
150Mhz Video Pipeline Clock
~600Mpixel/Second Peak Processing Rate
CHC5 ISP
Hardware Platform
So I picked the SoC to use for CHC5 because the There is lot going on it being a Camera Platform Rather than Just a embedded fix function camera with Zynq has the FPGA part and also the ARM Cortex-A9 thingy that does it all inside one single chip. All FPGA solution would either need a Soft Core CPU or lot of Fabric will be wasted on Web and Stuff.
I Picked Zynq 7000 because its well respected SoC Well Supported. I chose to have linux as platform rather than Embedded due the number of components involved. Linux V4L2 Proved a standard Path and Template for Component and Driver Development and worked Real Well. Ethernet Stack along With DDR3 Control with Multiple DMAs and VDMA and Web Software having everything in Bare metal would have need lot of low level tweaks and Attention to work So Linux was obvious and This made a SoC Rather than just Bare FPGA an obvious thing to chose.
Core Board is 14 Layer, Really High Density board This is words Smallest publicly known Fully featured Zynq7000 board. Populated Primarily with Zynq7000 SoC and Most Expensive part of the System DDR3 1GByte Memory with 32Bit interface 1066 , Total Bandwidth around 34Gbps. There is Ethernet PHY , USB 2.0 OTG of Zynq 7000 For USB Peripheral Expansion, Can be used to Connect Maybe additional Low Speed Network or Debugging Connection.
There are 3 High Density High Speed connector . These Connectors
MIPI Connector 100pin Carries I2C + Some Single Ended Controls, 8 Data + 2 Clock MIPI Lanes , Total 14 Differential Pairs Routed , Supports 8 Lanes MIPI, LVDS , Sub LVDS/Low Voltage LVDS, SLVS And other Interfaces , Supports 1 to 4 Sensors , May be even Many More 1 Lane Sensors
PL Connector 29 Pairs Differential Routed ,for 32GPIF along with Many Control Lines HDMI Pairs
PS Connector Carry Ethernet/USB OTG and Other PS Specific Connections
Board has 1Gbit Flash memory along with uSD connector . Both available at same time as Shipped Firmware will be loaded to Flash. Both Can be used for Boot, I will ship Firmware on Flash and uSD card Can be used for Recovery just in case something totally made device not to boot.
As whole point of this camera is adaptability and molecularity, There are multiple Interface Boards available fitting to Various needs. Board are available with 10Gbps USB 3.0 5Gbps USB 3.0 , With or Without PoE. Down blow is Arch of CHC5IO5G Board with 5Gbps Interface with Infineon CYUSB FX3 5Gbps This Chip is Core at 5G board. While PL Connector Connects to 100MHz 32bit GPIF This is the Primary Interface over Which FPGA Streams into FX3. On Other Side there HDMI Connector from FPGA and USB C 2.0 OTG
CH5IO5G PoE board Does not have HDMI and Also no USB2.0 OTG, Uses PCB room to Implement PoE Power Supply.
CH5IO5G Board Specially Prepared for High Speed Streaming and Debugging with Full Size JTAG and Both Zynq and FX3 Interface Available. There a solderable jumper to Select Boot media either Flash or uSD , There is Factory Restore Button to Reset Camera config Along with Status LED for USB and Core System.
I have Regress quality control over everything that is manufactured by external suppliers. PCB is one of them i am coming from aerospace background PCB are filed and internal layer verified to inspect with PCB Visa are correctly formed and PCB Copper layer thickness is appropriate and copper expension around visa is also correct
.gif)
.gif)
Comments
Post a Comment