Research Area Smart Image Sensor

Smart Image Sensor

Wireless image sensors are integral components of many critical applications such as surveillance, remote monitoring, intelligence gathering, unmanned vehicles, to name a few. We are interested in exploring fundamental research concepts on intelligent computing, energy-efficiency, and security, to create smart and autonomous image sensors. Our goal is to explore smart sensors at different operating specifications, ranging from high speed high resolution sensors to self-powered low frame rate sensors. The key contributions in this field are: 

  1. Self-powered Image Sensor: We are exploring design of image sensors where the on-chip pixel-array can be dual-purposed to both sense image as well as harvest energy. The design of innovative pixel arrays coupled with efficient power conversion/regulation and lightweight image processing are being explored to create a truly self-powered image sensor for remote surveillance applications.  
  2. High-performance Sensor with Integrated Machine Learning: We are exploring system architecture for high-performance smart sensors with integrated deep learning accelerators. 3D stacking of sensors, read-out circuits, memory, and computing logic is being explored as a system integration approach to achieve this goal. 
  3. Lightweight Algorithms for Complex Vision Processing: We are  innovating lightweight algorithms for vision processing tasks for resource-/energy- constrained platforms. A key goal is to explore algorithmic approaches to reduce memory demand of conventional as well as deep learning based image/vision processing algorithms. 
  4. Environment Adaptive Sensors with Real-time Control: The sensors operate in uncontrolled environment with potentially high variations in input quality, communication bandwidth, or available energy. We are developing real-time control algorithms to maintain quality-of-serive under varying environment by simultaneously tuning vision algorithms and sensor hardware.