ViPro: 128x128-pixel CMOS Imager and Spatio-Temporal Video Processor

This project encompasses the design, prototyping and experimental characterization of a CMOS imager and video processor. The processor performs a wide range of spatial and temporal image filtering operations on a 128 x 128 pixel video signal in real time, with 8-bit digital output. These include convolution with a programmable spatial template (used for variable resolution imaging, edge detection, and wavelet feature extraction), motion detection, as well as raw image readout. The computation is performed locally in focal plane in both analog and digital VLSI technologies, with projected energy efficiency and integration density well above those of modern digital signal processors. The applications of the mixed-signal VLSI imager/processor range from image acquisition and front-end video compression (DCT-based JPEG and DWT-based JPEG2000) to feature extraction for real-time pattern recognition microsystems.