Manifest Technology
        Making Sense of Digital Media Technology
        By Douglas Dixon
  BLOG
  ARTICLES
 - PC Video
 - Web Media
 - DVD & CD
 - Portable Media
 - Digital
     Imaging
 - Wireless
     Media
 - Home Media
 - Technology
     & Society
  GALLERIES
 - Video - DVD
 - Portable
  TECHNICAL
     RESOURCES
  ABOUT
 - What's New
<<< HOME 

 

  HOME DIGITAL MEDIA ARTICLES

  Manifest Technology Blog -- Site: | Articles | Galleries | Resources | DVI Tech | About | Site Map |
    Articles: | PC Video | Web Media | DVD & CD | Portable Media | Digital Imaging | Wireless Media | Home Media | Tech & Society |
    Home Media: | Home Media Articles | Home Networked Media Gallery |

3D - The Next Dimension  (11/2010)

Part 1 - Seeing 3D: Market, Technology, Formats

    by Douglas Dixon


Are you ready for 3D? Have you enjoyed 3D movies? Interested in enjoying 3D movies or games at home? Or intrigued by the possibilities of shooting, creating, and sharing your own 3D pictures and videos?

The consumer electronics industry is ready to help out, with 3D HDTVs, 3D Blu-ray Disc players, and 3D video games -- Plus early cameras, camcorders, and lenses for shooting your own 3D material. Even better, software tools are becoming available to create your own 3D images and video -- and you can get started at minimal cost with your existing equipment.

This article and associated presentation explores these possibilities from two viewpoints:

  • Seeing 3D: Discusses the 3D market, and explores the history, technology, and formats for stereo viewing
  • Using 3D: Explores 3D TV and PC products for the home, cameras for 3D shooting, and software for 3D editing

  Seeing 3D: Market, Technology, Formats
 Using 3D: Products, Shooting, Editing

(See my Digital Media Galleries for more on trends and sample products in these categories)


3D - the Next Dimension


Have you seen Avatar or other 3D movies? And did you enjoy them? The consumer electronics industry certainly hopes so, as 3D is being positioned as the next great revolution in home entertainment, as you can bring those movies home to enjoy in on your living room screen.

There's no rest for consumers from the advance of technology, no pause to enjoy what you have, no time for upgrade fatigue. We've just completed the digital television transition in the U.S., thrown out our tube sets for thinner flat panels, and stepped up to the glory of high definition widescreen home theater with HD widescreen displays, HD cable boxes, and HD Blu-ray Disc players. So it must be time to immediately move on to the next great technology revolution -- 3D TV.

  Avatar Special Edition - Courtesy RealD

With this push to 3D starting earlier this year, you already can dive in to 3D with new 3D HDTVs and 3D Blu-ray, plus explore other ways of experiencing and experimenting with 3D, including 3D on PCs, 3D cameras and camcorders, and editing software.

So is 3D poised to be the next great success like HD? The Consumer Electronics Association (CEA) trade association sees this transition playing out much like the deployment of HD TV, driven initially by sports programming and action / adventure entertainment. However, the development of 3D is going to be a more gradual process over a period of years. But the groundwork is being prepared: the CEA projects that by 2013 over a quarter of TV sets sold will be 3D TVs.

And you don't need to wait to get started, or make a big investment in new equipment -- you can begin experimenting with 3D and thinking about possible applications at minimal cost and using your existing gear.


3D Movies in the Theater

According to the CEA, consumers have gotten excited about 3D from seeing 3D movies in theaters, and therefore are interested in enjoying 3D entertainment at home. The CEA reports that over 27 percent of U.S. adults saw a 3D movie or event in 2009.

    
     3D movies in the Theater - Courtesy RealD

According to the MPAA, the 3D market was a key growth driver in 2009:

  • 3D Revenue - 11% of the U.S./Canada box office were 3D showings ($1.1 billion) (up from 2% in 2008)
    • (Total U.S./Canada box office was $10.6 billion in 2009, up 10.1% over 2008, up 20.3% over five years ago)
  • 3D Releases - 4% of domestic releases (20 films) were released with digital 3D versions (more than double 2008)
  • 3D Screens - 6% of screens worldwide (8,989) are digital 3D (more than tripled in 2009)
    • Digital 3D is about half (55%) of all digital screens in the world (46% in U.S./Canada)
  • Source: Theatrical market statistics 2009, MPAA

If you saw a 3D movie in the theater, then you probably used glasses from RealD, described as the leading 3D technology provider for movie theaters, used by 17 of the 18 largest exhibitors in the world. The RealD Cinema System was introduced in 2005, and, as of June 2010, RealD 3D was in use on some 7,500 screens worldwide, with an additional 4,000 screens under contract to be installed. Beyond the theater, RealD also provides its 3D format, active and passive eyewear, and display and gaming technologies for 3D in the home. Its 3D technologies also have been used for piloting the Mars Rover, heads-up displays for military jets, and robotic medical procedures.

References:

Top


3D TV and Blu-ray 3D in the Living Room

The first step in building momentum for 3D requires getting 3D displays in the home so consumers can actually view in 3D. The CEA estimates that some 8 to 9 percent of U.S. households will have a "3D-ready" display by the end of 2011. However, these are "ready" in that they can display a stereo image, but you still need to add the appropriate accessories to complete the job, including 3D glasses and the associated emitter box.

Then to deliver the 3D content, there's a new Blu-ray 3D format for Full HD 3D on spinning discs, since, unlike with the advent of HD, broadcasters and cable services are not leading the market to the new format. DEG: The Digital Entertainment Group reports that nearly 40 Blu-ray titles will be available by the end of the year.
(MESA - http://mesalliance.org/blog/2010/11/16/deg-data-shows-increased-awareness-of-home-3d/)

In addition, some 3D video formats can be piggybacked on existing devices like set-top boxes and existing cabling without requiring changing the entire delivery infrastructure to the home.

  
  3D in the living room, Courtesy Sony
  • Big push for 3D at CES 2010 - LG, Panasonic, Samsung, Sony, Toshiba
  • 3D TV products in 2010 - 3D TV (with glasses), "3D ready" with separate accessories
  • Content will be driven by Blu-ray and cable boxes, not broadcast (yet)
  • Requires glasses - Focused, not casual viewing
  • Event-driven, but not 10's of glasses for large party
  • But : Consumer upgrade fatigue: Digital transition / HDTV
    • Blu-ray / high-def DVD "format war" collateral damage
  • Industry sees ramped adoption like HDTV and DVD
    • Not mass-market push like Blu-ray
    • Hopefully not like enthusiast niche like DVD-Audio and SACD

As a result, the movement to 3D will be primed by purchases of higher-end displays and Blu-ray players that have 3D capabilities built in. Even if consumers are not initially using the 3D capabilities, they then will have the necessary components ready when they do get interested, since the price premium for 3D support is already small and growing smaller.

Futuresource reports that at least 10% of all Blu-ray devices shipped this year are expected to offer 3D playback, rising to more than 25% in 2011. By 2014, nearly 40% of homes across the three key regions – Western Europe, the USA and Japan – will own a 3D Blu-ray player, recorder or home theatre. Jack Wetherill, research consultant at Futuresource, says that "sales of HD-capable and 3D-capable TVs, coupled with dramatic reductions in Blu-ray player prices are continuing to fuel interest. Add to that the burgeoning 3D Blu-ray market segment, and we'll see the format continue to gather momentum in all major markets across the globe."
  (Digital2Disc - http://www.digital2disc.com/2010/10/01/q4-to-see-11-million-blu-ray-player-sales/)

Jason Blackwell, director for digital home at ABI Research is less optimistic, commenting that while consumers are interested in 3D for the home, it will be important to avoid overdoing the use of 3D and having it appear gimmicky. He says that while everything looks great in HD, 3D production is more of a different look that should be reserved for special events and maybe even portions of events.

References:

Top


3D Video Games on the PC

3D also adds a new dimension to video games on the PC. The NVIDIA 3D Vision system combines the 3D graphics hardware for generating the 3D signal, a 3D capable monitor for displaying the 3D imagery, and compatible 3D glasses. NVIDIA has converted some 500 games and applications to 3D, so the software generates both the left and right eye perspective views for each frame.

3D PC systems also support additional uses, including watching HD movies on Blu-ray 3D, viewing 3D on the Web on sites including YouTube, and enjoying personal videos and photos in 3D.


  3D Gaming - Courtesy NVIDIA

The performance of PC-based games continues to increase dramatically, with faster PC systems, multi-core processors, enhanced graphics processing unit (GPU) chips, and improvements in the graphics rendering software.

References:

Top


3D Deployment -- the Next HD?

However, even more than the beginnings of HD, 3D will still be a product for early-adopter enthusiasts. Besides the usual questions for new formats -- how much consumers will lust for the format, high initial cost, and limited early content -- there are additional issues with the 3D format including the logistics of using glasses and technical obsolescence.

Content

The need for content can be partially addressed by converting existing 2D format to 3D. As with the earlier enthusiasm for colorizing back and white movies, "dimensionalizing" a film into 3D can be an expensive and painstaking process, especially in busy scenes, and may or may not produce satisfying results.

Or the player hardware can convert 2D to 3D on the fly, as with DVD players that took advantage of HD displays by upscaling from standard definition. At CES 2010, both Samsung and Toshiba announced 2D to 3D conversion features for their new product lines. This kind of processing can produce at least moderately interesting results, but typically uses a manual adjustment to tune the effect for the type of video material.

Glasses

The most obvious issue with 3D TV, though, is the requirement to wear glasses. This is not the ideal cool fashion statement for the core young adult tech enthusiast market. Glasses are clunky, especially if you already use eyewear, and are another thing to lose around the house, hidden under the cushions with the remote.

Watching entertainment with glasses also requires dedicated focus, as in the movie theater, and not informal viewing, as when switching back and forth between the game on TV and chatting with friends. And while sports are a key driver for new display technologies, hosting a Super Bowl or World Cup party with a 3D TV will be problematic when you need to buy thirty extra pairs of expensive glasses for all your friends.

Technology

Another possible concern, a "format war" between different 3D display formats, has seemingly been finessed through the use of display agnostic media (Blu-ray) and compatible HDMI cable interconnects. Basically, consumers should regard the early glasses as an accessory specific to the display, and not expect to be able to use the same glasses with different products.

But even without a format war, technical obsolescence is always a concern for early adapters, as purchasers of first-generation products like Blu-ray players without Internet and BD-Live capability can attest. And we're even earlier in the development of both 3D technology and the associated market. For content delivery, there's a Blu-ray format, but no products for satellite or cable delivery, no established paths for Internet delivery, and, oh yes, no standards for broadcast 3D -- so early-generation 3D TVs will not be compatible with these new delivery channels to come.

(Image: RealD polarized theater glasses)

Top


3D History - Viewing in Stereo


Seeing Depth - 2D Perspective

So how do we see in 3D? Part of the answer is depth cues from a scene -- which is why we see depth in 2D photos and paintings, as demonstrated by the development of geometric perspective by Renaissance artists in the early 1400's.

  • Occlusion (front covers back)
  • Known sizes (comparison to known sizes such as people or buildings)
  • Relative sizes (smaller is more distant)
  • Linear perspective (convergence of parallel edges)
  • Vertical position (higher mountains are further away)
  • Loss of detail (smaller texture further away)
  • Loss of crispness (haze, desaturation, blue shift)

(click for full res)
  Satire on "False Perspective" by William Hogarth, 1753
    Whoever makes a Design without the knowledge of Perspective
    will be liable to such absurdities as are shewn in this Frontispiece.
      
http://en.wikipedia.org/wiki/File:Hogarth-satire-on-false-pespective-1753.jpg

References:

Top


Seeing in Stereo - 3D Stereoscopy

Beyond depth cues, human stereo vision adds the perspective of combining the information from slightly different images at the two eyes for full stereoscopic views. The eyes are positioned about two inches apart, which allows us to see spatial depth and dimension. In addition, the brain uses the focus of the eye to complete the illusion of depth.

  • Stereopsis (two views with slightly different perspective)
  • Focus (accommodation of the eyeball)

Stereoscopy (also called stereoscopic or 3-D imaging) is the technique of recording three-dimensional visual information or creating the illusion of depth in an image. Charles Wheatstone developed the scientific basis for stereography in 1838, showing that the brain unifies the slightly different two-dimensional images from each eye into a single object of three dimensions.

   (click for full res)
   Norman Rockwell, Boy using a Holmes stereoscope to look at stereograph of the Sphinx
    Saturday Evening Post cover, January 14, 1922
    http://en.wikipedia.org/wiki/File:Rockwellboywithstereoscope.png

The easiest way to enhance depth perception in the brain, then, is to provide the eyes of the viewer with two different images, representing two perspectives of the same object, with a minor deviation equal to the perspectives that both eyes naturally receive in binocular vision.

References:

Top


Stereographs - Holmes Style Stereoscope Viewer

Cards with pairs of stereo images - stereographs - were developed in the 1840s, popularized in the 1850s, and eventually supplanted by other media in the 1930. ("Stereo" is derived from the Greek for "solid," so a "stereograph" is a picture that depicts its subject so that it appears solid.)

  • Stereograph cards (stereograms, stereoviews, stereocards)
    • Two side by side images about two and half inches apart, for left and right eye
  • Stereoscope viewer device for viewing stereographs
    • Combines two flat images into a single image that gives illusion of depth
  • Hood to shield the lenses from outside light
  • Lens to magnify for more detail and wider field of view
  • Lens also corrects from close focus to infinity, consistent with the parallel lines of sight, reducing eye strain
  • Partition to separate the views for each eye

(click for full res)
The stereograph as an educator - Underwood & Underwood, 1901, Library of Congress
    Woman viewing stereographs in her home;
      sitting in front of a fireplace with a cabinet for stereographs on her right
    http://commons.wikimedia.org/wiki/File:Stereograph_as_an_educator.jpg

Oliver Wendell Holmes invented a hand stereoscope viewer around 1860, which was inexpensive and easy to use with a folding handle. He chose not to patent his invention: "considering it as a quasi scientific improvement, I wished no pecuniary profit from it" [Philadelphia Photographer, 1869].

  
  Reproduction Holmes style stereoscope viewer
     http://en.wikipedia.org/wiki/File:Holmes_stereoscope.jpg

References:

Find the Holmes Stereoscope Viewer on Amazon.com

Holmes style stereoscope viewers are still available in kits and assembled, as are new and collectable stereographs as cards, in books, and as scans.

New York City in 3D: A Look Back in Time
    
Greg Dinkins, New York Stereoscopic Society, 2009

Black and white 3D stereoviews of New York City from around the 1860s to the1920s, with the first skyscrapers, old street markets, wharves, street cars and elevated trains, and New Yorkers at work and play. Includes stereoscope glasses built in to the cover flap.
Also Washington D.C., Gettysburg, London, Native Americans & the Wild West.

Find the New York City in 3D on Amazon.com

Top


View-Master

The View-Master was introduced in 1939 as a device for viewing 3D images of scenic attractions. It is now primarily a children's toy with discs of licensed characters.

The media for delivering View-Master content is paper discs with transparencies around the outer edge, containing seven pairs of stereo images, with each pair placed diametrically opposite. The lever is used to rotate the disk to step to the next image pair.


  GAF View-Master Viewer Model G in red, introduced in 1962
     http://en.wikipedia.org/wiki/File:View-Master_Model_G.jpg
  View-Master disks
    http://en.wikipedia.org/wiki/File:View-master-scheiben.jpg

Tru-Vue was an earlier company that manufactured stereoscopic horizontal filmstrips beginning in 1931. It was purchased in 1951 by Sawyer's (the manufacturer of View-Master) because Tru-Vue had an exclusive contract to make children's filmstrips based on Disney characters. Competitors included the American company Novelview from the 1930s in America and Sightseer from the 1950s in England.

References:

Find the classic red View-Master 3D Viewer on Amazon.com

Top


Free Viewing with the Naked Eye


Free Viewing Techniques

Seeing stereo images in 3D does not necessarily require special equipment, although viewing devices are helpful to position and adjust the images for a comfortable viewing experience.

You can also learn viewing techniques to perceive stereo by looking at a pair of left and right images side by side, and then controlling the focus of your eyes, forcing yourself to focus before or after the images to drift the images together to create the perception of stereo.

  • Parallel - Diverging - Focus beyond the image
    • Hold close, focus eyes through the image, so it is blurry
    • Move image away to adjust positioning
    • See double vision in each eye, overlap middle images for 3D view
    • (Hold paper down center to reduce distraction from second image)
  • Cross Eye - Converging - Focus before the image
    • Hold image at comfortable reading distance
    • Slightly cross eyes
    • (Cross eyes by focusing on finger or pencil half way to image)
    • (Hold paper with cutout half way to image to reduce distraction)

You can aid the process of focusing your eyes for these techniques by placing two dots above the image, and then adjusting your eyes until you see a third dot in the middle.

The trick with these techniques is to first adjust your eyes so the left and right images overlap, and then let your eyes relax for a period of time to allow the 3D effect to snap in and strengthen. Once you have the 3D effect started, the eyes can typically hold on to it even as you look around the image. But the result still can be stressful to the eyes after extended viewing.

Another clever viewing technique, Mirror Split, does require one simple piece of equipment -- a mirror held perpendicular to the screen. The stereo pair is then presented with the left side flipped horizontally, and then when you focus both eyes on the right image, you see the superimposed left image for a 3D effect. Mirror Split is supported by the YouTube 3D Channel (see below), which credits a video by REQ2010.

  • Mirror Split
    • Place mirror vertically from nose to screen
    • Look at right image with both eyes
    • Left eye sees reflection of left image (which must be flipped horizontally)
    • Eyes then merge both images without artificial focusing or strain


Mirror Split concept by REQ2010 (click to play YouTube video)
  http://www.youtube.com/watch?v=C7zVpDA_93k

References:


Magic Eye - Random Dot Autostereograms

Random dot autostereograms appear to be a collection of random colored dots -- but when viewed correctly an embedded 3D object emerges from the pattern. These were popularized, along with other similar designs, in the Magic Eye book series, which also used repeating patterns with recognizable shapes.

Autostereograms are viewed with the free viewing techniques discussed above. The embedded image is more of a 3D shape or depth map than a textured and colored object, and the depth effect can be reversed (into vs. out of the page) depending on how you view it.

  • 3D image hidden within random dot pattern
  • Diverge eyes as if focused on object more distant than printed page
  • Pixels in pattern shifted horizontally based on depth map of embedded image
  • Gives illusion of depth when each eye focuses on a different part of the pattern

(click for full res)
Random dot stereogram showing a 3D scene of a shark
   with shark depth map
To view, orient eyes as if focusing on an object behind the image,
causing two neighboring repetitions of the dot pattern to merge
and the shark to appear
http://en.wikipedia.org/wiki/File:Stereogram_Tut_Random_Dot_Shark.png

References:

Released in the 1990's, Magic Eye books appeared on the New York Times Bestseller List for a combined 73 weeks.

More than 20 million copies of Magic Eye books have been sold in more than 25 languages.

Find Magic Eye: A New Way of Looking at the World (1993) and Magic Eye: Beyond 3D: Improve Your Vision (2003)
on Amazon.com

Top


Wiggle Stereoscopy

A simple stereoscopic viewing technique is to quickly alternate between the left and right images of a stereogram. This works much as a flip book can animate a series of still drawings to suggest motion, and a pan shot in a movie can provide strong depth information from motion parallax, the perceived relative speed of different objects on the screen. The depth effect from panning is so strong that 3D glasses add little additional effect to a 3D movie during scenes where the camera is moving.

The parallax effect also occurs when you close one eye and move the head from side-to-side -- closer objects appear to move more than more distant objects.

Wigging between two images can be done in a web browser using Flash animation or a Java applet, or even more easily with an animated gif image.
(Wiggle Stereoscopy animated gif: http://en.wikipedia.org/wiki/File:Stereo_wiggle_3D.gif)

The result can provide a sense of the depth in a scene that is easy to view and understand, since we are experienced at seeing parallax in motion video. However, this is not true binocular stereoscopic depth perception, and the constant and jittery motion can be annoying. Adding more images as a motion video sequence can smooth the motion and provide a wider view of the 3D scene.

Top


3D Display Technology - Displays and Glasses


3D Display Mechanisms

Viewing devices like the Holmes style stereoscope and View-Master work great for presenting a 3D experience for an individual, but displaying 3D for a group requires a different approach -- a larger display, plus (for the moment at least) some form of eyewear for each viewer that can separate out the images for the left and right eyes.

The challenge with displaying 3D to a group is to somehow simultaneously present two different images on the screen, in a way that glasses can separate the two signals.

Generally, this can be done in two ways: spatial (dedicate half of the frame to each eye), or temporal (alternately display the left and right images).

  • Spatial: Both images displayed at same time (e.g. alternate lines)
    • Passive - simpler glasses (red/cyan, polarized)
    • Lower res - Lose half the image resolution
  • Temporal: Alternate frames
    • Active - more expensive glasses (with battery)
    • Requires double the frame rate
    • Darker - Lose half the light

Other approaches use holography, or spectral separation (as in Dolby 3D Digital Cinema), displaying different wavelengths of red, green, and blue for each eye.

3D Display Technology

These techniques then require corresponding glasses to separate out the left and right eye images as presented by the display. 3D glasses can be passive (just lenses mounted in the frame), or active (electrically active, and therefore battery powered), with costs ranging from pennies to over a hundred dollars.

The hope for the future are autostereoscopic displays, which provide a 3D effect to the naked eye, without requiring special glasses.

  • Anaglyphic - Passive red-cyan glasses
  • Polarized 3D - Passive polarized glasses
  • Shutter glasses - Active, temporal - alternate-frame sequencing
  • Autostereoscopic - Without glasses

References

Top


Anaglyph 3D - Passive Red-Cyan Glasses

Anaglyph is a spatial 3D display technique that creates a stereoscopic 3D effect by superimposing the two images using different colors which are offset to produce a depth effect. The two colors are usually chromatically opposite, typically red (for the left eye) and cyan (blue/green). When viewed using glasses with corresponding colored eyepieces, the eye merges the image into an integrated stereoscopic image.

Anaglyph is used for mass market consumer applications, since it requires only inexpensive (cardboard) glasses, and works with existing imaging equipment and displays as well as printed material.

  • Used for mass market consumer applications
  • Works with existing delivery formats and media (physical DVD, PCs, online)
  • Works with existing imaging equipment displays
  • Also used for printed material
  • Consumer friendly - Very inexpensive glasses
  • But: Lose color range, color shifts (improved)


  Paper glasses for viewing anaglyph images
    http://en.wikipedia.org/wiki/File:Anaglyph_glasses.png

Older anaglyph imagery that you may remember from horror films may have used red/green or red/blue lenses, sometimes with significant loss of color accuracy. With better quality red/cyan glasses, anaglyph imagery can present quite good color range (including flesh colors) with minimal color ghosting.

(click for full res)
  The stereograph as an educator - Underwood & Underwood, 1901, Library of Congress
    Woman viewing stereographs in her home;
      sitting in front of a fireplace with a cabinet for stereographs on her right
    http://en.wikipedia.org/wiki/File:Stereograph_as_an_educator_-_anaglyph.jpg

The big advantage of anaglyph is that it does not require expensive equipment to get into stereo -- It just works with your existing image and video processing workflow. You can save anaglyph images in standard JPEG and other image file formats, and videos in standard video formats. You then can store and deliver them as usual -- including on computer disk, physical media such as DVD and Blu-ray, and online on sites including YouTube. And you can display anaglyph imagery on any existing display, including TVs, PCs, media players, and smartphones.

References:

Top


Polarized 3D - Passive Polarized Glasses

Polarization is a spatial 3D display technique that creates a stereoscopic 3D effect by projecting the two images superimposed with different polarizing filters from slightly different perspectives. When viewed using glasses with corresponding polarizing filters, the eye merges the image into an integrated stereoscopic image.

Polarization is typically used for 3D movies shown in theaters, since the polarized glasses are still relatively inexpensive (although with plastic frames for better durability than cardboard), and have fewer color artifacts than anaglyph. Since the polarization is independent of viewing position, the 3D effect works well for large audiences.

  • Used for large audiences - 3D cinema (RealD)
  • Display with polarized screen
  • Polarized 90 degrees or circular opposites (can tilt head)
  • Relatively inexpensive glasses
  • Avoid color artifact issues
  • But: Lose half the horizontal resolution


  RealD polarized 3D glasses for theaters

The filters for the left and right eyes are oriented differently to pass the light polarized for the corresponding eye and block the light for the other eye. The polarization is typically circular (clockwise/counterclockwise) or at 90 degree angles (45 and 135 degrees), so the effect continues to work even if the head is tilted.

Like anaglyph and other spatial techniques, polarization splits the frame in half for each eye, reducing the horizontal resolution by half.

The RealD Cinema Eyewear is lightweight and recyclable, comes individually packaged in adult and kid sizes, and fits over prescription glasses.

References:

Top


Alternate-Frame Sequencing - Active Shutter Glasses

Alternate-frame sequencing is a temporal 3D display technique that creates a stereoscopic 3D effect by alternately displaying the two different perspectives for each eye. When viewed using active shutter glasses that alternate each eye between transparent and opaque in synch with the display, the brain merges the images into an integrated stereoscopic view.

  • Used for small groups: 3D TV, 3D on PCs
  • Natural upgrade for existing displays, still support 2D
  • Display alternating frames with opposite polarization
  • Liquid crystal shutter glasses turn transparent / dark, to open / block each eye
  • Wireless emitter to sync display rate and glasses - 240 Hz (120 per eye)
  • Full resolution image, full color, color neutral
  • But: More expensive glasses - Liquid crystal, battery powered, more rugged construction


  Samsung - Active Glasses

The active shutter glasses are significantly more expensive, with a liquid crystal layer powered by a battery to apply voltage to switch between open and dark. This active system also requires a wireless emitter that sends a timing signal so the glasses can alternately darken each eye in synchronization with the refresh rate of the screen.

To maintain the illusion of motion, active systems must boost the display rate. for example, alternately showing an image to each eye at 120 Hz, for an overall 240 Hz refresh rate. In addition, these systems have the result of darkening your view, since each eye is closed half the time.

References:

Top


Autostereoscopic Displays - Without Glasses

While today's commercial 3D displays require wearing glasses, there are a variety of developing autostereoscopic display technologies that don't require that the viewer be encumbered by special eyewear. Instead, these Auto 3D displays present different images when viewed from different perspectives.

For the moment, these technologies are being commercialized for use as small displays, as in the the LCD viewer on the Fujifilm FinePix REAL 3D W3 digital camera (see Using 3D) and the 3D display on the upcoming Nintendo 3DS handheld gaming system, due to be released in Japan in February 2011 for around $300 (which has a slider to turn the 3D display on and off).

Nintendo 3DS with 3D top display

Several common technologies use screens with vertical strips to separate the left and right portions of an image on an underlying display, and present the different views to your eyes based on their horizontal separation. Lenticular displays use a parallel array of microscopic lenses (also used for print, as familiar from 3D postcards), and parallax barrier displays use a layer of material with precision slits.

  • Screen with vertical strips to separate views horizontally
  • Lenticular - Parallel array of microscopic lenses
  • Parallax barrier - Layer of material with precision slits

The Fujifilm FinePix REAL 3D W3 digital camera uses a lenticular sheet with an array of microscopic concave lenses to produce binocular disparity and therefore a 3D image to the naked eye.

Lenticular display, courtesy Fujifilm

  1. The image is viewed through a series of magnified multiple lenticules
       aligned on a lenticular sheet from left and right angles.
  2. Each eye (left and right) receives different images.
  3. The parallax between each eye causes the image to appear three dimensional for viewing.
    (See http://www.fujifilmusa.com/products/3d/camera/finepix_real3dw3/features/page_05.html)

References:

Top

Storing 3D - File Formats


3D images and videos require new conventions and file formats for storing the pair of left and right images. These can be stored as separate files, as separate images or frames in a single combined file, or be composed together into a single image or frame.

Various 3D playback devices and 3D displays support various such file and frame formats, so the design of your 3D workflow will depend on your compatible equipment and software.

  • Separate Files
  • Single Frame: Side-by-side, Over-under, Interlaced, Anaglyph
  • Dual Stream: Both frames in single file

For the moment, 3D file formats are somewhat ad hoc, without widely-accepted standards, so expect to need to use dedicated 3D software tools to manipulate your 3D files, and even to view them.

Separate Files

One way to store pairs of stereo frames is in separate files for the left and right images or videos. These can be saved in standard formats, so they can be easily viewed and edited.

  • Photos: Separate still image files for left and right eye images (i.e., JPEG, etc.)
  • Videos: Separate video movie files for left and right eye images (i.e., AVI, etc.)

You then can import the separate photos into a 3D photo authoring tool to manipulate and export in other formats. For videos, you can import into a standard video editor to compose together into a single frame, or use a 3D video editor to edit and export in various formats.

Single Frame

Another technique for storing 3D frames in existing file formats is to compose both the left and right images into a single image or video frame. This can be done in a wide variety of ways, including splitting the frame horizontally side by side, vertically over and under, or interlaced (alternating lines). Anaglyph is another form of stereo images composed into a single frame, distinguished by color.

  • Horizontal: Side-by-side (left / right), Interlaced (alternate line)
  • Vertical: Over-under (top / bottom)
  • Anaglyph: Colors (e.g., red / cyan)
  • Lose resolution (horizontal or vertical) when squeezing two frames into one

Squeezing two images into a single frame requires resizing the original images to fit into the available space (reducing the resolution), and also distorting the aspect ratio as stored. When played back, a compatible display will then extract the separate frames, stretch as needed, and undo any distortion. (This is similar to the way DVDs use the same 720 x 480 video frame to store movies at either standard 4:3 aspect ratio, or squashed to expand horizontally for widescreen 16:9 aspect ratio.)

This is the method described for the YouTube 3D Channel (see below) -- You prepare videos into the common YouTube format by editing the two streams side by side in a single frame, and then the frames are extracted and displayed in different way during playback. The RealD Format also is an enhanced version of a side-by-side format.

Combining 3D frames for YouTube upload

Again, since both images are composed into a single frame, the stereo data can be stored and played back in standard image and video formats such as JPEG for images and video for the PC, Web, and DVD. When using standard formats, however, there is no information in the file identifying it as 3D or describing how the frames are stored, so you need to explicitly define the frame format (including which part is the left and right image).

Two examples of image formats in which stereo images are stored side by side using existing compression formats are JPEG Stereo (.JPS) and PNG Stereo (.PNS). These are standard file formats with the file type changed to indicate that the contents should be processed as (side-by-side) stereo data.

  • JPEG Stereo (.JPS) - JPEG with side-by-side pair stored in the image
  • PNG Stereo (.PNS) - Portable Network Graphic format with side-by-side pair stored in the image

References:

Dual Stream - Single File with Both Frames

.The other approach to storing 3D images is to include both the left and right frames together in a single file. This has the advantage of storing the full resolution original images. However, does require the use of non-standard file formats, or at least the extension of existing formats to include both images. As a result, viewing and editing these files does require dedicated 3D tools.

For still images, the MPO (Multi-Picture) format is an extension of JPEG with both the left and right images. The files have the type .MPO, which means they are not immediately viewable with conventional image viewers. But you can rename the files as .JPG to view the file normally (and see one of the images).

For videos, the 3D-AVI format similarly stores both the left and right sequences in a single file. And the file is playable with standard tools as a regular AVI movie (to view one of the streams).

Both the MPO and 3D-AVI formats are used by the the Fujifilm FinePix REAL 3D W3 digital camera (see Using 3D) .

  • MPO - 3D Multi-Picture format - 2 JPEG images
    • Multi-Picture (MP) format standardized by CIPA
      • Camera and Imaging Products Association
      • was JCIA (Japan Camera Industry Association)
    • Based on DCF spec - baseline compatible, images stored as JPEG
    • Supports Disparity, Multi-Angle (Multiple view / points of view), Panorama
    • Rename .MPO to .JPG to display as 2D in image viewers
  • 3D-AVI - Stereo AVI video format - 2 video channels
    • Uses AVI file wrapper format
    • Plays as conventional 2D AVI video (e.g., in Media Player)

References:

Top


3D References


General references for more on 3D stereoscopic imaging.

Top


-> Part 2 - Using 3D: Products, Shooting, Editing

Explores 3D TV and PC products for the home, cameras for 3D shooting, and software for 3D editing


Top