Sensors, Gimbals and Cameras
The camera and sensor payload is often the entire reason a commercial drone flight happens at all, yet the technology behind it — shutter type, gimbal stabilization, and sensor selection — is rarely explained in plain terms. This lesson covers the common sensor types used on sUAS, the critical difference between rolling and global shutter designs and the "jello effect" that rolling shutter can produce, how 3-axis gimbal stabilization actually works, and how mission type drives sensor selection, building directly on the wind and vibration content already introduced in Module 5.
RGB (visible light) sensors
The standard visible-light camera, capturing red, green, and blue color channels, is the default sensor on the overwhelming majority of sUAS and the one used for conventional photography, video, and general-purpose photogrammetry mapping. Everything from real estate photography to a routine progress-photo inspection typically relies on a standard RGB sensor.
Thermal (infrared) sensors
Thermal sensors detect infrared radiation emitted by objects based on their temperature, rendering a heat-based image rather than a color photograph. Some thermal sensors are radiometric, meaning they report a calibrated, quantifiable temperature value for each pixel, useful for genuine diagnostic work; others are non-radiometric, showing only relative "hotter versus cooler" contrast without a precise calibrated temperature figure. Thermal sensors are widely used for infrastructure inspection (identifying overheating electrical connections, faulty solar panel cells, or insulation gaps in a building's roof) and for search and rescue, where a person's body heat can stand out clearly against a cooler background even in low visibility.
Multispectral sensors
Multispectral sensors capture image data across several specific, narrow wavelength bands, often including bands outside the range visible to the human eye, such as near-infrared and red-edge bands. This is not simply "extra colorful" imagery; it is data captured at scientifically meaningful wavelengths that plants and other materials reflect and absorb differently depending on their condition. This makes multispectral sensors especially valuable in agriculture, where combining specific band data (commonly into vegetation health indices) can reveal crop stress, irrigation problems, or disease before it becomes visible to the naked eye in ordinary photography.
LiDAR sensors
LiDAR (Light Detection and Ranging) sensors work differently from camera-based sensors: they emit rapid pulses of laser light and measure the time each pulse takes to reflect back, calculating precise distance measurements that build up into a dense three-dimensional point cloud of the surveyed area. LiDAR is especially valuable in mapping and surveying applications, and it has a genuine advantage in forestry and vegetated terrain, since some laser pulses can pass through small gaps in a tree canopy and reflect off the ground beneath, allowing LiDAR to model terrain that a camera-based sensor, which can only see the canopy's visible surface, cannot capture as effectively.
How a rolling shutter sensor captures an image
Most consumer and prosumer drone cameras use a rolling shutter sensor, which captures an image by scanning across the sensor's rows of pixels sequentially, typically from top to bottom, rather than capturing the entire frame in a single instant. This design is significantly cheaper to manufacture and generally performs well in good lighting for static or slow-moving subjects, which is why it is so widely used across consumer electronics, not just drones.
How a global shutter sensor differs
A global shutter sensor exposes every pixel across the entire sensor simultaneously, capturing a true single instant in time for the whole frame. This eliminates the timing-related distortion that a rolling shutter can introduce, at the cost of typically higher manufacturing complexity and expense, which is why global shutter sensors are more common on higher-end or mission-specific sUAS payloads rather than budget consumer drones.
The jello effect: what it looks like and what actually causes it
Because a rolling shutter captures each row of the image at a very slightly different moment in time, if the camera itself is moving, vibrating, or rotating rapidly during that brief capture window, each row ends up recording a slightly different position of the scene. The result is visible image distortion: straight vertical lines can appear to wobble, skew, or bend, and the overall footage can take on a wavy, gelatin-like quality commonly nicknamed the "jello effect." This is fundamentally a timing-and-motion problem, not a defect in the sensor itself under normal conditions.
Connecting back to Module 5: wind and vibration are the real-world trigger
Module 5 covers how wind gusts and turbulence affect small drones operationally — forcing rapid attitude corrections and inducing airframe vibration as the flight controller fights to maintain stable flight. This lesson explains the direct visual consequence of that same wind and vibration on rolling-shutter footage: a sudden wind gust that forces the aircraft to rapidly pitch or roll to correct its position, or vibration transmitted from the motors and propellers into the camera mount, is a leading real-world cause of jello-effect artifacts. A remote pilot shooting video-critical work in gusty conditions is not just fighting for stable flight for its own sake; that same instability is what shows up as visibly warped, unusable footage if it reaches the camera. This is exactly why professional video and mapping operators pay close attention to wind forecasts before scheduling a shoot, not only for basic flight safety but for footage quality itself.
3-axis gimbal stabilization: purpose and mechanism
A gimbal is a motorized mount that holds the camera and actively counteracts unwanted movement across three axes: pitch (tilting up and down), roll (tilting side to side), and yaw (rotating left and right). Using small, fast motors on each axis, guided by feedback from inertial sensors, a 3-axis gimbal continuously makes tiny real-time corrections to keep the camera pointed and leveled as intended, even as the aircraft itself pitches, rolls, or yaws in response to pilot input or wind. This is what keeps the horizon looking level and footage looking smooth, rather than tilting and swaying every time the aircraft maneuvers.
A gimbal meaningfully reduces, but does not completely eliminate, jello-effect risk. Gimbals are generally very effective at counteracting the slower, larger-scale attitude changes of the aircraft itself, but higher-frequency vibration, such as motor and propeller vibration transmitted directly into the gimbal and camera mount, can partially bypass the gimbal's correction if the mount lacks adequate vibration isolation (often addressed with rubber dampeners or similar isolating mounts between the gimbal and the airframe). A well-designed gimbal system combines active stabilization with passive vibration isolation to address both problems together.
Rolling shutter's row-by-row capture causes the jello effect under motion or vibration; global shutter captures the entire frame at once.
View Larger
How a 3-axis gimbal actively stabilizes the camera, combined with passive vibration isolation.
View LargerScenario: a survey-grade mapping mission for a construction site
A remote pilot is contracted to produce a survey-grade orthomosaic map of a construction site, where the deliverable's accuracy directly affects earthwork volume calculations the client relies on. Orthomosaic mapping software works by stitching together hundreds of overlapping photos captured while the aircraft flies a continuous grid pattern; if individual photos contain rolling-shutter distortion from the aircraft's forward motion during each exposure, that distortion introduces small positional errors that compound across the stitched map, reducing overall geometric accuracy. Recognizing this, the pilot selects an aircraft equipped with a mechanical shutter payload, which achieves a true near-simultaneous exposure similar in effect to a global shutter, specifically to avoid this distortion, rather than using a cheaper rolling-shutter-only camera that would be perfectly adequate for a casual video shoot but risky for this accuracy-critical mapping deliverable.
| Mission type | Preferred sensor consideration | Why it matters | Example use case |
|---|---|---|---|
| Survey-grade orthomosaic mapping | Mechanical or global shutter | Avoids rolling-shutter positional distortion that compounds across stitched images | Construction site volume calculations |
| Infrastructure inspection | Radiometric thermal sensor | Calibrated temperature data identifies overheating components precisely, not just relative contrast | Electrical substation or solar panel inspection |
| Agricultural crop monitoring | Multispectral sensor | Near-infrared and red-edge band data reveal crop stress before it is visible to the eye | Vegetation health index mapping |
| General video and photography | Standard RGB with a well-isolated gimbal | Rolling shutter is adequate for most casual or promotional footage when vibration is controlled | Real estate photography, promotional video |
Choosing the right sensor and shutter type for a mission
Work through this before booking equipment for a new type of job, not after arriving on site.
Identify what the deliverable actually requires
Determine whether the client needs a survey-grade measurement, a diagnostic inspection reading, an agricultural health analysis, or simply attractive video/photo content.
Match sensor type to the deliverable
Select a radiometric thermal sensor for calibrated inspection data, a multispectral sensor for agricultural health analysis, LiDAR for canopy-penetrating terrain mapping, or standard RGB for general visual content.
Consider shutter type if accuracy or motion is a factor
For accuracy-critical mapping work, prefer a mechanical or global shutter payload; for general video, a well-stabilized rolling shutter is typically adequate.
Confirm the gimbal and vibration isolation are in good condition
Inspect gimbal mounts and vibration-isolating dampers before a critical mission, since worn or damaged isolation mounts increase the chance of vibration-induced footage artifacts.
| Mistake | Why it happens | Correct understanding | Source |
|---|---|---|---|
| Assuming a gimbal completely eliminates any chance of jello effect | Gimbals are marketed heavily around "smooth, stable footage," creating the impression they solve motion artifacts entirely | Gimbals counteract slower aircraft attitude changes well, but higher-frequency vibration can still cause jello-effect artifacts without adequate vibration isolation | Gimbal stabilization fundamentals |
| Assuming every drone camera uses a global shutter | The distinction between shutter types is rarely explained to casual users | Most consumer and prosumer drone cameras use a rolling shutter; global or mechanical shutter is more common on higher-end or mission-specific payloads | Rolling vs. global shutter fundamentals |
| Treating "thermal camera" and "multispectral sensor" as the same technology | Both are non-standard sensors used for specialized data collection beyond ordinary photography | Thermal sensors detect infrared heat radiation; multispectral sensors capture data across multiple specific wavelength bands, often including near-infrared, primarily used for vegetation and material analysis | Sensor type fundamentals |
| Assuming any onboard thermal camera provides precise, calibrated temperature readings | Thermal imagery is often assumed to inherently show exact temperatures | Only radiometric thermal sensors report calibrated temperature values; non-radiometric thermal sensors show only relative heat contrast | Thermal sensor fundamentals |
What causes the "jello effect" in drone video?
The jello effect comes from a rolling shutter sensor capturing image rows sequentially rather than all at once; if the camera is moving or vibrating during that capture window, the result is visible wobble or skew, often triggered in real flight by wind gusts or unisolated motor/propeller vibration.
Why do professional mapping drones often use a mechanical shutter?
Mapping software stitches together many overlapping photos; rolling-shutter distortion in individual photos introduces small positional errors that compound across the final map. A mechanical shutter avoids this by capturing each photo as a true near-instantaneous snapshot.
What is the difference between thermal and multispectral sensors?
Thermal sensors detect infrared heat radiation and render a heat-based image. Multispectral sensors capture data across several specific wavelength bands, often invisible to the human eye, primarily used to analyze vegetation health and material condition rather than to show temperature.
Test Your Knowledge
Answer the questions below to check your understanding. Every answer can be found in the lesson above.