We’ve all seen pretty pictures of outer space, with swirling patterns and bright stars against a dark background. With the ease of taking color photos on an iPhone, you might think that advanced space telescopes can automatically produce color photos as well.
However, all digital cameras—from your phone to the James Webb Space Telescope—cannot actually see in color. Digital cameras capture images as a series of ones and zeros, measuring the amount of light hitting their sensors. Each pixel has a colored filter over it (either red, green, or blue), which only allows specific wavelengths of light to pass through. These filters are arranged in a specific pattern (typically a four-pixel repeating square known as the Bayer pattern), which enables the camera’s computing hardware to merge the captured data into a full-colored image. Some digital cameras distribute the colored filters across three individual sensors, and their data can also be combined into a full-color image. However, telescope cameras have to capture images with one filter at a time, requiring experts to later combine them into a composite image. Bayer pattern
Processing scientific data into beautiful color images is actually a full-time job.
In our smartphones, the combination of layers happens incredibly fast—but telescopes are complicated scientific behemoths, and it takes a bit more effort to get the stunning results we know and love. Plus, when we’re looking at the cosmos, astronomers use wavelengths of light that our eyes can’t even see (e.g. infrared and X-rays), so those also need to be represented with colors in the rainbow. There are lots of decisions to be made about how to colorize space images, which begs the question: who is making these images, and how do they make them?
For the spectacular results we’ve been seeing from JWST, processing scientific data into beautiful color images is actually a full-time job. Science visualization experts at the Space Telescope Science Institute in Baltimore stack images together and combine observations from different instruments on the telescope. They also remove artifacts, which are things in the image that aren’t real, but rather just results of the telescope equipment and how digital data is processed. These could be streaks from stray cosmic rays, oversaturation of the brightest stars, or noise from the detector itself. Black and white to color
Before they even think about color, these specialists need to balance out the dark and light values in the image. Scientific cameras are designed to record a wide range of brightnesses beyond what our eyes can perceive. This means that the raw images from telescopes often appear very dark to our eyes, and you have to brighten up the image to see anything.
Once they have black and white images where the details are visible, they start adding color. “Different telescopes have filters that are made to be sensitive to only certain wavelengths of light, and the colorful space images we see are combinations of separate exposures taken in these different filters” similar to the earlier description of a phone camera, explains
Katya Gozman, a scientist at the University of Michigan. “We can assign each filter to a different color channel—red, green or blue, the primary colors of visible light. When placed on top of each other, we get the impressive color image that we’re used to seeing in the media,” she says.
This is where it becomes a bit of an art, choosing colors based on not only scientific accuracy, but also what looks best. For JWST and Hubble, the usual routine is to use blue for the shortest wavelengths, green for in between, and red for the longest wavelengths.
The final result, of course, also depends on the type of data the image specialists have to work with initially. The team often selects different colors to emphasize the fact that NIRCam and MIRI—two of Webb’s infrared cameras—are observing different wavelengths (near-infrared and mid-infrared, respectively), and therefore different physical structures. For instance, in the Cassiopeia A supernova remnant, JWST’s observations revealed a bubble of something giving off a specific wavelength of light, shown as green in the MIRI image and thus called the “Green Monster.” Without this visualization, astronomers may not have noticed such an interesting feature that provides insight into how giant stars die—and after some investigation, they figured out the Green Monster is a region of debris disturbed by the huge blast from the supernova explosion.