Why do I see a saddle in this picture of a computer screen?

coreyman317 07/16/2018. 3 answers, 13.342 views
optics differential-equations

I am not entirely sure this is an appropriate question for PSE, however since many of you have such diverse backgrounds, I'll give it a shot.

I have noticed that when one takes a picture of a computer, TV screen with a phone, you can "see" what looks like a saddle phase portrait.

Why does this happen? Does it have any relevance to differential equations or other areas of math?

3 Answers


Emilio Pisanty 07/17/2018.

What you're seeing is a moiré pattern caused by beating between the regular grid of the screen's pixels and the regular grid of your camera sensor's pixels.

The departure of the pattern from straight lines is likely due to a slight deformation away from planarity in the screen. You can test for this by keeping the camera fixed on a tripod and mildly flexing the screen with your fingers, upon which the saddle pattern should shift slightly.

Edit: As pointed out in the comments, the saddle pattern could also be caused by distortions caused by perspective as well as by the camera optics. The fact that similar hyperbolae appear in this related question, involving only straight grids at an angle, provides a good deal of support for the perspective-effect explanation.


The paper

Simulation and Analysis of Overall Raster Moire Patterns on Color CRTs. T. Inoue et al. Soc. Inf. Display: International Symposium, Digest of Technical Papers 33, 256 (2012)

seems to contain relevant results for your case.


Acccumulation 07/17/2018.

The issue is that both the screen you're taking a picture of and your camera's sensors are discrete: they are made up of pixels and those pixels don't always line up.

For example, if the pixels on the screen are slightly smaller than the camera's pixels, then each camera pixel will pick up a screen pixel plus a little bit of the next pixel. As you go from one camera pixel to the next, the camera will be picking up less and less of the "current" pixel, and more and more of the next, until it is centered a pixel ahead.

So for instance, if the screen pixels are 9 units and the camera's are 10, then the camera's first pixel will see 9 units of the first screen pixel and 1 of the next, the camera's second pixel will be 8 units of the second screen pixel and 2 of the third screen pixel, and so on. Eventually the camera will get a full pixel ahead of the screen, and the screen pixel will once again be centered on the camera pixel.

This will cause the camera to show periodic patterns as screen pixels go from being centered to not and back again. Where the curves come from is the fact that the period (the number of pixels to get centered again) is constantly changing because the distance between the camera and the screen is different for different parts of the screen, so the apparent size of the screen pixels (and therefore the relative size between screen and camera pixels) is changing.


Don Hatch 07/29/2018.

As others have said, this is a moire pattern, for which there are good references on the web such as the moire pattern wikipedia entry. More specifically, the r,g,b contours you see are a shape moire (that is, a magnified distorted image) of the r,g,b scanlines of the computer screen in the photo.

The interesting part of this question to me is "why a saddle?", which I don't see answered elsewhere, so that is what I'll investigate in this answer.

Why a saddle?

The OP's photograph looks to me like it has several different instances of the saddle phenomenon overlayed on each other, making it difficult to sort out what's going on. So I took my own photograph of my computer screen using my phone's camera, and was able to get a cleaner view of what's happening, which I can inspect at the pixel level to see what these contours are really made of. I included on the computer screen a small test pattern of fully saturated colors, to help identify which aspects of the picture were due to the computer screen and which were due to the camera.

photo of my computer screen taken with my phone

Scrutinizing this photograph, what I see is, roughly, two grids:

  1. A luminance grid. This is the more-or-less rectangular grid of relatively bright spots which make up the photo. I think of this grid as being the pixels of the photo or camera (which is certainly a vast simplification of what's really going on).
  2. An rgb grid. This consists of more-or-less horizontal stripes of color in the photo. From bottom to top, the horizontal stripes are ordered red,green,blue,red,green,blue,... I think of these as the scan lines of the computer screen in the photo (again, this is a mental model that's a simplification of what's really going on).

The correspondence between the two grids is, of course, a perspective warp. To get more of an idea of what this warp is like, we can inspect the photo some more, and identify that, near the top-left of the picture, the almost-horizontal lines of the luminance grid are sloping slightly downwards with respect to the rgb grid:

and near the bottom-left of the picture, they are sloping upwards instead:

So, roughly halfway between top and bottom, the slopes of the two grids' more-or-less-horizontal lines have exactly the same slope, so the interference pattern seems to go away along that line. This is the first point in the investigation that I can start to make out where the saddle shape is coming from: that horizontal line of stillness is in fact the horizontal "axis" of the saddle shape, at which the interference behavior has slowed to zero and in fact reverses, in a sense.

And, evidently, there is a second reversal going on too: the other, more-or-less vertical, "axis" of the saddle. What's going on there? The answer is that it's where the two grids have exactly the same spacing between horizontal grid lines. To the left of that axis, the rows of pixels are spaced farther apart than the rgb scanlines; to the right of that axis, they are closer together.

Okay, now maybe we have enough understanding to be able to recreate the phenomenon in a simulation.

Here is a picture of rgb scanlines, and another picture of a pixel grid. Only one of the pictures needs to be perspective-warped with respect to the other, so I chose to warp only the rgb scanlines. I chose the warp in such a way as to recreate roughly the same arrangement as in the photo: that is,

  • the top half of the picture has rgb scanlines sloping slightly upward with respect to the pixel rows, the bottom half has them sloping slightly downward.
  • the left half-or-so of the picture has pixel rows spaced more widely than the rgb scanlines, and the right half-or-so has them spaced more tightly.
  • the vertical-ish line that we expect to manifest as the vertical-ish axis of the saddle is not exactly vertical, to keep it interesting.

+

When we overlay the two pictures, the saddle appears, as expected:pixel grid overlaid on rgb scanlines

Inspection of the combined picture gives me a sense of why the contour lines have to go the way they do, including the saddle shape showing where the two lines-of-reversal-of-behavior intersect. The horizontal axis of the saddle is where the horizontal-ish lines of the two grids have the same slope, and the vertical-ish axis of the saddle is where the horizontal-ish lines of the two grids have the same spacing.

overlayed with contours

Are they hyperbolas?

Notice that the same kind of saddle shape appears in the contour curves of mathematical functions such as $z = x y$; these saddle-shaped contour lines are hyperbolas. The saddle shapes we see here are perspective warps of the contours of $z = x y$; therefore they too are hyperbolas (or other conic sections such as parabolas or elliptical arcs or circular arcs, but I don't see how those could manifest here).

In summary, saddle shapes (more specifically, hyperbolas) are what you get as colored contour lines of interference when a rectangular grid of pixels is overlayed on a picture of rgb scanlines such that the correspondence between the two pictures is a perspective warp, as is the case when you take a photograph of your computer screen with your phone.

The vertical grid lines don't matter

Actually, the vertical lines of the pixel grid don't matter; we can omit them and the phenomenon still happens in full force. On the other hand, if we omit the horizontal lines of the pixel grid, the phenomenon doesn't happen at all.


HighResolutionMusic.com - Download Hi-Res Songs

1 BLACKPINK

Kiss And Make Up flac

BLACKPINK. 2018. Writer: Soke;Kny Factory;Billboard;Chelcee Grimes;Teddy Park;Marc Vincent;Dua Lipa.
2 Martin Garrix

Waiting For Tomorrow flac

Martin Garrix. 2018. Writer: Pierce Fulton;Mike Shinoda;Martijn Garritsen;Brad Delson.
3 Martin Garrix

Access flac

Martin Garrix. 2018. Writer: Martin Garrix.
4 John Legend

Written In The Stars flac

John Legend. 2018. Writer: Kiana Brown;Santoy;Kevin White;Mike Woods;MZMC;The Heavy Group;Rice N' Peas.
5 Martin Garrix

Yottabyte flac

Martin Garrix. 2018. Writer: Martin Garrix.
6 Alan Walker

Diamond Heart flac

Alan Walker. 2018. Writer: Alan Walker;Sophia Somajo;Mood Melodies;James Njie;Thomas Troelsen;Kristoffer Haugan;Edvard Normann;Anders Froen;Gunnar Greve;Yann Bargain;Victor Verpillat;Fredrik Borch Olsen.
7 Cardi B

Taki Taki flac

Cardi B. 2018. Writer: Bava;Juan Vasquez;Vicente Saavedra;Jordan Thorpe;DJ Snake;Ozuna;Cardi B;Selena Gomez.
8 Bradley Cooper

Shallow flac

Bradley Cooper. 2018. Writer: Andrew Wyatt;Anthony Rossomando;Mark Ronson;Lady Gaga.
9 Post Malone

Sunflower flac

Post Malone. 2018. Writer: Louis Bell;Billy Walsh;Carter Lang;Swae Lee;Post Malone.
10 Dyro

Latency flac

Dyro. 2018. Writer: Martin Garrix;Dyro.
11 Zara Larsson

Ruin My Life flac

Zara Larsson. 2018. Writer: Delacey;Michael Pollack;Stefan Johnson;Jordan Johnson;Sermstyle;Jackson Foote.
12 ZAYN

Fingers flac

ZAYN. 2018. Writer: Zayn Malik;Alex Oriet;David Phelan.
13 Halsey

Without Me flac

Halsey. 2018. Writer: Halsey;Delacey;Louis Bell;Amy Allen;Justin Timberlake;Timbaland;Scott Storch.
14 Lady Gaga

I'll Never Love Again flac

Lady Gaga. 2018. Writer: Benjamin Rice;Lady Gaga.
15 Sia

I'm Still Here flac

Sia. 2018. Writer: Sia.
16 Dewain Whitmore

Burn Out flac

Dewain Whitmore. 2018. Writer: Dewain Whitmore;Ilsey Juber;Emilio Behr;Martijn Garritsen.
17 Little Mix

Woman Like Me flac

Little Mix. 2018. Writer: Nicki Minaj;Steve Mac;Ed Sheeran;Jess Glynne.
18 Mako

Rise flac

Mako. 2018. Writer: Riot Music Team;Mako;Justin Tranter.
19 Blinders

Breach (Walk Alone) flac

Blinders. 2018. Writer: Dewain Whitmore;Ilsey Juber;Blinders;Martin Garrix.
20 Rita Ora

Let You Love Me flac

Rita Ora. 2018. Writer: Rita Ora.

Related questions

Hot questions

Language

Popular Tags