Technical Background

Multi-faceted inspection and image processing tasks require adequate image acquisition systems consisting of optics, camera and PC. Each component feature has a significant effect on task fulfilment. In terms of cameras, you may first think of resolution, frame rate and interface for PC data transmission.

However, a less “obvious” factor must be considered for camera selection: Exposure, meaning the shutter feature. By principle, there is a difference between global shutter and rolling shutter.

Compared to global shutter, rolling shutter readout is less complex and therefore more cost-efficient. Furthermore, a limited number of transistors will generate less heat and electronic noise. Another advantage is inferior pixel pitch which allows for higher resolutions in relation to the active sensor surface.

 


Shutters

Like mechanical shutters in analog film cameras, these fully electronic shutters in digital cameras control exposure time and this way the amount of light which is converted into electrons (charge carriers) in the sensor pixels.

Different pixel architectures entail different methods of exposure. Shutters define the time during which charge carriers are generated (exposure time) and how this is done.

As long as the camera is under power supply, the sensor pixels are active. Light is continuously “captured”, however charge carriers are not accumulated but deleted over and over. Start of exposure will stop deletion and start charge carrier accumulation. Pixel read out is after the end of exposure.

To this point, sensors behave the same in both methods of exposure – the devil is in the details.

 

Global Shutter

Global shutters can be compared to conventional lens shutters in analog film cameras. Like the iris in the human eye they resemble lens aperture and are probably what you have in mind when thinking of shutters.

VT_Lens_shutter_in_analog_film_cameras_2.png
Lens shutter in analog film cameras

The shutter is to open quick as lightining when released and to shut immediately at the end of exposure time. Between open and shut, the film segment to take the image is entirely exposed all at once (global exposure). 

Sensors with digital global shutter do the same: Charge carrier accumulation in each pixel starts simultaneously (globally). Same applies to the end of exposure and readout.

VT_Global_shutter.png
Global Shutter

Simultaneous, global pixel exposure will “freeze” the scene, reason why this method (short-time exposure) is appropriate for image acquisition on rapidly moving objects.

 

Rolling Shutter

Rolling shutter exposure resembles analog film cameras. It helps understand the function principle and transfer it to the digital equivalent. In conventional technology, rolling shutters regulate film exposure and shading.

Rolling shutters look like a metal disc missing a segment, as in the illustration below. The disc is mounted on a rotating shaft in front of the film strip.

 

VT_Rolling_shutter_schematic_sketch.png
Rolling shutter (schematic sketch)

For a better illustration, the rolling shutter is sketched semi-transparently below. 

Start of exposure (1). The rolling shutter gradually uncovers the film segment, which is exposed to light to take the image (2). Fully open, the entire image respectively film segment is exposed (3). The shutter is closing (4) until fully shading the segment again(5).

VT_Rolling_shutter_1-5.png

Though the exposure time for each image pixel is the same, exposure is not global (all pixels at the same time) but sequential (line by line), causing blur with fast-moving objects. All in all, with the same exposure time more time will elapse in total between shutter opening (start of exposure) and closing (fully shaded). Continued object movement in this time will cause image distortion.

VT_Rolling_Shutter.png
Rolling shutter

Rolling shutters operate on sequential line-by-line carrier accumulation and exposure. Each pixel is exposed for the same time, but not all pixels in the image at the same time (globally).

Notice
For this reason, rolling shutter sensors are not a general recommendation in image acquisition on moving objects.

 

 

Rolling shutter effect

Image blur resulting from object movement in line-by-line exposure is known as Rolling Shutter effect. The graphs below show the time offset in line-by-line rolling shutter exposure versus global shutter.

Blur is rather present in Rolling Shutter exposure.


 

VT_Rolling_shutter_effect.png
Rolling shutter effect

The degree of blur not only depends on exposure time considering object speed and amount of light available, but also on the sensor’s readout capacity: State-of-the art sensors reduce rolling shutter effects by higher readout speed rather than sensors operating on previous technologies.

 

Linear movement
VT_Linear_movement.png
Linear movement

Object movement in linear direction in front of the camera during the time of image acquisition will create rolling shutter effects in the form of horizontal blur.

VT_Linear_movement_global_shutter_vs_rolling_shutter.png
Linear movement: Global shutter vs rolling shutter

The illustrations below show where the blur comes from: left is the moving object with line-by-line-exposure (orange line). Right you see the acquired image content at pixel level.

VT_Rolling_Shutter_Effect_blur_by_horizontal_object_movement.png
Rolling shutter effect – blur by horizontal object movement
Rotating objects

Object rotation for the time of image acquisition will blur contours as illustrated by the four colored quadrants in the picture below.

VT_Global_shutter_and_rolling_shutter_effect_on_rotating_object.png
Global shutter and rolling shutter effect on rotating objects

The illustrations below show where the rather bizarre looking rolling shutter effect comes from. The interaction of line-by-line exposure (orange line) and object rotation is visualized at pixels level in the acquired image (left).

VT_Rolling_shutter_effect_blur_by_rotation.png
Rolling shutter effect – blur by rotation
How to compensate the rolling shutter effect

Some rolling shutter sensors provide a special feature, so-called global reset. Like in global shutter exposure, charge carrier accumulation in each pixel starts at the same time. Readout however is line by line with a time offset – typical for rolling shutter sensors.

 

VT_Rolling_shutter_exposure_with_global_reset_feature.png
Rolling shutter exposure with global reset feature

Each line is exposed for a different length of time which is visualized by the brightness gradient.

VT_Brightness_gradient_resulting_from_different_exposure_times_in_rolling_shutter_exposure_with_global.png
Brightness gradient resulting from different exposure times in rolling shutter exposure with global reset feature

The global reset feature alone would not suffice to compensate rolling shutter effects. Exposure time remains the same and hence the potential risk of blur in image acquisition on moving objects.

This can be remedied by combining global reset feature, flash and ambient light suppression.

 

VT_Flash_used_with_rolling_shutter_sensors_with_global_reset_feature.png
Flash used with rolling shutter sensors with global reset feature

The illustration shows the basic function principle: Flash is on when starting exposure and active for the time of exposure. Make sure any ambient light is suppressed until exposure of the last line has been completed.

In this way, rolling shutter sensors “simulate” global shutter behavior in image acquisition on moving objects.

VT_Simulated_global_exposure_and_shading_by_rolling_shutter_sensors_with_global_reset_feature.png
Simulated global exposure and shading by rolling shutter sensors with global reset feature

Support

Please contact our Technical & Application Support Center with any questions.

Phone: +49 3528 4386 845
E-mail: [email protected]

맨 위로