What is a Neuromorphic camera?

26-08-2023

10:07 AM

timer
1 min read
What is a Neuromorphic camera? Blog Image

Overview:

Researchers at the Indian Institute of Science (IISc) have developed a novel technique that combines optical microscopy with a neuromorphic camera aided by machine learning algorithms that can go beyo

About Neuromorphic camera:

  • A neuromorphic camera mimics the way the human retina converts light into electrical impulses.

How does it work?

  1. In a typical camera, each pixel captures the intensity of light falling on it for the entire exposure time the camera focuses on the object. All these pixels are pooled together to reconstruct an image of the object.
  2. In neuromorphic cameras, each pixel operates independently and asynchronously, generating events or spikes only when there is a change in the intensity of light falling on that pixel.
  3. This generates sparse and lower amounts of data compared to traditional cameras, which capture every pixel value at a fixed rate, regardless of whether there is any change in the scene.
  4. This allows a neuromorphic camera to "sample" the environment with much higher temporal resolution because it is not limited by a frame rate like normal cameras and also performs background suppression.
  • Neuromorphic cameras have a very high dynamic range ( >120 dB) which means they can be used in different conditions ranging
  • from a very low-light environment to very high-light conditions. 

 What is meant by diffraction limit in Optical Microscopy?

  • The resolution of a microscope is proportional to the size of its objective and inversely proportional to the wavelength of light being observed.
  • In 1873 the German physicist Ernst Abbe discovered how microscopes were limited by the diffraction of light. He revealed that the resolution of a microscope is not controlled by the instrument’s quality but by the wavelength of light used and the aperture of its optics.
  • Due to this phenomenon, a microscope cannot resolve two objects located closer than λ/2NA, where λ is the wavelength of light and NA is the numerical aperture of the imaging lens. This is known as the diffraction limit.
  • Thus diffraction limits the ability of the microscope to distinguish between two objects divided by a lateral distance of less than half the wavelength of light used to image the sample.

 


Q1) What is meant by temporal resolution?

Temporal resolution is the time to take the multiple measurements of the cross-section and then reconstruct the image. This time is important for process tomography systems, as changes can often occur within the system in a space of time that is shorter than the one required to record the measurements.

Source: IISc shows how neuromorphic camera, machine learning aid nanoscopic imaging