Archive for the ‘3D movies and gaming’ Category
Relax. Let go. Give your brain permission.
I’ve been following this VT patient’s progress reports with interest. Today’s post “Stop trying so hard and just SEE” mentions a common hurdle to diverging our eyes, the ability to RELAX those rogue eye turn-in muscles! “Stop LOOKING” my VT would often say. LOOKING to isolate something normally fixates both eyes on an object, or in my case, unconsciously fixates one eye while turning in and suppressing the out-of-alignment image of the other. “Soften your gaze” was another frequent VT exhortation.
Last week, random dots did the trick of NOT LOOKING for this VT patient, and I think I understand why. The randomness of the thing viewed eliminates the worry about getting a “right” answer, and therefore is less stressful than “Is the elephant or the fly popping out for you?” which can trigger frantic LOOKING.
Randomness is the opposite of representation, therefore the brain lets go of the need to comprehend and interpret an object. As an artist who strives to accurately represent objects, a good dose of randomness may be exactly what my brain needs to stop trying so hard.
This is why, for me, letting go also requires giving myself permission to allow a new way of seeing to emerge, to be visually open-minded.
I’m rejoicing that random dot stereograms are working for this patient to overcome her eye turn-in along with the many awesome mind-opening exercises her Vision Therapist is tailoring to wake up her brain.
By letting go and giving herself permission to see a new way, her world is opening up into the third dimension I long to experience.
Life of 3.1415926535 8979323846 2643383279 etc.
… that would be Pi
I’d read so much about the artistic use of 3D technology in Ang Lee’s film Life of Pi, I decided it was worth a strabismic test. If I did not see palpable space, with things jumping off the screen towards me, at least I would see art: imagery that would move me and delight my eyes and heart.
I learned something even before seeing the movie: I’m probably the last person on the planet to arrive at a 3D movie only to discover the theater is playing a 2D version! I’d read so much about the artful use of 3D by Ang Lee, that I completely ruled out anyone wanting to see the movie any other way. And so our first trip to the nearest theater in the next town was self-defeating. We went grocery shopping instead.
But, almost two weeks later, Pi resurfaced (with the necessary “3D” listed in the title) in the next town over. (I had given up on Pi and was looking for the Hobbit. But Middle Earth can wait.)
It was good timing for taking in a matinee today, as I had exactly one week to adjust to my new bi-focal lenses with base-right prism (but that’s another story.)
As the film began, the hummingbirds in flight brought an audible thrill to the folks to my left. Ah, but they were too quick for me! And then a short conversation began between my husband and I: “Did you see that? says he. “No” says I. After a few more similar exchanges I said “If I see something, I’ll squeeze your hand.” I believe he got one hesitant squeeze as the monkeys rushed through the trees.
Then I forgot all about how I was seeing as I became immersed in the story.
It was a delightful story with visible layers of foreground, middle-ground and background all moving on their own planes, however if only within the screen for me. More delightful were the even more layers of meaning. Naturally it is easier to take the layers of meaning with me, and enjoy them in my mind long after the visual effects fade away. Ang Lee was masterful in using the concrete layers of the story to enhance the abstract and philosophical.
I had popped sinus medication and ginger pills before the trip, and the seas did get rough! But my stomach did not once drop out from under me. (Suppression has it’s advantages.) I also did not turn green around the gills when the seas turned calm with endless random bobbing. No ginger pills needed, unlike the many times I’ve been becalmed on Lake Erie in my father’s sailboat!
But the “float” stayed with me after the movie.
When everything is floating for two and a half hours, my guess is it does open one’s brain to recognize “float” in the real world. Dr. Susan Barry describes her experience with “float”, saying “Knowing that objects are separated by volumes of space and perceiving those empty volumes are very different experiences. ”
My first thing to pop out toward me was not the whale in the movie, but my coat, hanging in front of me on a hook in the bathroom stall. It billowed towards me. (My first “sighting” since getting the new lenses.) The bathroom sink faucet took on the familiar forward projection, and doorways and all things moving in my periphery as I walked through the lobby swam in kinetic motion-parallax. A trip to Lowe’s afterwards revealed noticeable depth in the layers of paint chip racks. Empty racks of all sorts reached out toward me, and a small stand of Ohio State banners swam towards me as I walked by, like a school of fish.
I’m floating still.
Links to layers of meaning
Life of Pi: A Novel by Yann Martel By Phoebe Kate Foster http://www.popmatters.com/pm/review/life-of-pi/
‘Life of Pi’ Ending Explained by Ben Kendrick http://screenrant.com/life-of-pi-movie-ending-spoilers/
Links to layers of 3D
Life Of Pi’s Visual Effects Are Extraordinary. Here’s Why by Brendon Connelly
http://www.bleedingcool.com/2012/12/19/life-of-pis-cg-secrets-fx-supervisor-bill-westenhofer-on-tigers-magical-skies-and-more/
How did they bring the ‘unfilmable’ Life of Pi to our screens? by Nick Clark
http://www.independent.co.uk/arts-entertainment/films/features/how-did-they-bring-the-unfilmable-life-of-pi-to-our-screens-8393738.html
Ang Lee On The Filmmaking Journey Of “Life of Pi” By: Scott Pierce
http://www.fastcocreate.com/1682021/ang-lee-on-the-filmmaking-journey-of-life-of-pi
How 3D in film is improving, especially for the stereoblind
Several months ago, I was encouraged by the BBC story of a stereoblind man who gained binocular vision simply by watching a 3D movie.
In February 2012, neuroscientist Bruce Bridgeman went with his wife to see Hugo, a masterfully crafted 3D movie by Martin Scorese. Bridgmen recounts in an email to Oliver Sacks “my wife and I paid a surcharge for 3D glasses, which I thought were a waste of money for me – having been exotropic since childhood, I was nearly stereo-blind. But I took the polarizing glasses to avoid seeing annoying fringes in the film.
To my great surprise, I immediately experienced the film in vivid stereo. I was enthralled.
“But perhaps the filmmakers exaggerated the stereo disparities in the film to enhance the value of the 3D technology … Hugo’s VFX supervisor Ben Grossmann said ‘We checked and checked: We were four to six times bigger than any other 3D movie.’ But everything looked amazing …
“When the movie ended we turned in our polarized glasses and walked out into the street. I was astonished to see a lamppost standing out from the background. Trees, cars, even people were in relief more vivid than I had ever experienced. Clearly the disparities weren’t amped up on the street. Did a few hours of enhanced disparity wake up long-neglected binocular neurons in my visual cortex?”
The blogger who posted Bruce Bridgeman’s email is non other than Barry B. Sandrew, Ph.D., stereographer and founder of Legend3D, which worked with Scorese on Hugo and Director Ang Lee on Life of Pi. Like Scorese and Lee, Sandrew is more interested in how 3D technology can enhance a story to make it more life-like, instead of pushing bizarre 3D experiences on an audience. Thankfully, the trend has shifted towards creating depth scripts to enhance drama: “The actors become like a moving sculpture,” Mr. Scorsese says. “This brings it out, particularly in the faces of the actors, the drama.” 1
I am of the opinion that well-crafted, life-experience-enhancing 3D movies will provide the most powerful “handle” for my stereoblind brain to understand stereopsis. Morgan Peck, the BBC blogger, adds that breakthrough comes, according to Dr. Laurie Wilcox of York University “when the person finally figures out what to look for.”
Peck backs the idea of stereo cognition via monocular depth cues with the experimental research of Dr. Dennis Levi, where in 2011 five stereoblind adults learned to see 3D. “Levi found that his subjects were most likely to have a breakthrough if the stereoscopic images were reinforced by monocular cues like relative size and shading. This could explain why Bridgeman’s experience was so dramatic.” 2
Peck adds final affirmation from Dr. Sandrew “It’s intuitive that monocular cues, which partially stereoblind people rely on every day are essential to the quality of their 3D experience. My mantra is to incorporate monocular cues wherever possible.”
I just checked: I can still catch Life of Pi in my area. There’s still time to see Sandrew’s mantra in action. I’m onto it!
Further reading:
A Visionary Director’s Sumptuous ‘Pi’ by Joe Morgenstern Wall Street Journal
http://online.wsj.com/article/SB10001424127887323713104578132912697702772.html
“Life of Pi” Director Ang Lee to Receive Harold Lloyd Award at International 3D Society Creative Arts Awards, February 6, 2013
http://online.wsj.com/article/PR-CO-20121203-902307.html?mod=crnews
The Godfathers of Film Take On 3-D* (include Scorese’s thoughts on the application of 3D in Hugo)
http://online.wsj.com/article/SB10001424053111903918104576502090225620336.html
3D gaming and esophoria risks
In a Wall St. Journal article last Friday, it was reported that a professor in the Department of Ophthalmology, Osaka University Medical School, Japan will be studying whether children with esophoria, the tendency for the eyes to turn inward, will become at risk of more turn-in with prolonged 3D gaming.
Takashi Fujikado, a visual-science professor at Osaka University’s Graduate School of Medicine, is starting research on whether children afflicted with esophoria, who are constantly making extra effort to prevent their eyes from becoming cross-eyed, may find it difficult to return the eyes to normal position after watching 3-D images for a long period of time.
When a 3-D image pops out from a screen, it draws the eyes inward to focus on an object that appears closer. This may affect children six years old and younger because their eyes, still under development, are more sensitive to such stimuli, he said.
Children with such a condition are rare but it is difficult to determine how many there are, Mr. Fujikado said, because esophoria doesn’t necessarily have symptoms.[1]
I have a hunch that what Dr. Fujikado is looking for is whether the esophoria may develop into an esotropia, where an eye constantly or alternately turns inward. Alternating esotropia is the strabismus I mysteriously developed as a child, unknown to my parents and undetectable in photographs.
Esophoria is not a form of strabismus. It is “A muscle condition in which, when both eyes are open, each eye points accurately at the target. However, upon covering one eye the covered eye turns inwards. Also known as over-convergence.”[2]
Esophoria can be picked up during an eye exam with a cross-cover test that breaks fusion. Watch the differences between exotropia and exophoria here. With esotropia and esophoria, the deviating eye would snap back into alignment from the nose, not the ear. (Note the extreme solution of surgery is for tropias of a certain kind that cannot be corrected with vision therapy or orthoptics.)
Unlike esotropia, fusion is possible (with esophoria) and therefore diplopia (or seeing double) is uncommon.[3]
Donald J. Getz, OD, FCOVD, FAAO explains another sign of esophoria [4]
“… a child with esophoria sees things smaller than what they actually are. In order to see an object properly, it is necessary to make the object larger. The only means at the disposal of the child to make it larger is to bring it closer. Eventually, the child is observed with his head buried in a book… ”
Nintendo 3D DS: Binocular Screening for Tots?
The newest non-news in the world of 3D technology is that Nintendo has issued a warning (in kanji) for children aged 6 and under not to play it’s new 3D DS gaming system, due to hit U.S. stores in March.
The Wall Street Journal states that Nintendo joins Samsung, Toshiba, Panasonic and Sony in following “the voluntary safety guidelines set out by the Japan-based 3D consortium, an industry group of major Japanese electronics companies. The guidelines say that young children’s eyesight are still developing, but do not specify the age at which they can start looking at 3-D images.” [1]
Nintendo recommends that parents use parental controls to turn off the 3D settings for children six and under, but they can’t be serious when they offer a game that includes a cute 3D puppy that will reach up to lick a child’s face: “Nintendogs uses the built-in camera and facial-recognition technology to enable puppies to react to your real-life movements, mimicking your head tilts and jumping up to lick you as you lean in.” [2]
Since all digital 3D technology is new, no research exists to back the claim that 3D viewing may harm binocular vision development. But common sense should dictate that any activities that discourage binocular vision development should be done in moderation, which includes reading in excess, close work like sewing and coloring, most school work, television viewing and video-gaming in general. What stimulates binocular vision development are activities done out of doors: playing Frisbee or softball, riding a bicycle, playing tag and playing on monkey bars, for example.
No one else has mentioned the big bonus I see to glasses-free 3D tech coming into the home: 3D vision screening. Children who exhibit stereoblindness or have trouble seeing 3D will be diagnosed earlier. “Mommy, I don’t see the puppy reach out” or “Everything looks blurry, daddy” might just get a parent to take their child to a developmental optometrist. Parents will become aware of binocular vision development problems much sooner.
Not seeing the 3D images clearly is only one of several problems that can occur when children or adults are not binocular vision ready. Carol L. Hong, OD, FCOVD states in her article “Is Your Child Ready to Experience the Magic of 3D at Home?”
Whether you are in a movie theater or watching TV on your new 3D screen, you should still keep an eye out for any signs of a headache, nausea, or dizziness during or shortly after 3D viewing. It is recommended that you test drive 3D TV at your local electronics store before purchasing so you can watch your child to see if he can see the special 3D effects.
One can only hope and pray that, with increased awareness of stereo blindness or lack of 3D readiness, parents will be directed to a local developmental optometrist (an optometrist with FCOVD after their name), who has the most training and expertise to help a struggling young child develop a strong binocular vision system with vision therapy.
Additional insights were posted today on the College of Optometrists for Vision Development Blog
Beginning with studies at the Pennsylvania College of Optometry, evidence to date seems to pinpoint adult-like stereoscopic development by six years of age. Exercising caution until we know more about these effects seems prudent, and Nintendo is not the first company to do this.
Parents who are concerned about their child’s readiness to view 3D movies, television and games should read “Is Your Child Ready to Experience the Magic of 3D at Home?” by Carol L. Hong, OD, FCOVD
3D Movies and Stereoblindess
Hi, I’m just curious … I don’t see 3D. Would it be possible for me to get a glimpse of your 3D movie and find out what I can see?
I asked this only after purchasing tickets for the 2D version of Narnia: The Voyage of the Dawntreader Afterward, I and my friends shared a pair of glasses to briefly check out the 3D difference.
Even though I didn’t get the “Wow!” of an object jumping off the screen or moving behind the screen that my friends saw, I would still pay the extra bit to see the richness of detail the new polarized glasses create. Everything was clear, and not a blur (which happened often in the 2d version. Thoughts on why later.)
With polarization, which cuts out some glare, I saw deeper colors. [1] I studied the golden shell Edmund pulled from the pool of gold, and it appeared richer to me, even though it was not 3D. Instead, it was similar to what I experience when I see a painting by that rare artist that can translate 3D to a canvas, such as my friend and portrait artist Judith Carducci.
Unlike legacy 3d movies that required the red-cyan glasses, the new technology uses a different kind of fusion. Legacy film 3D required two projectors running film perfectly in synch, shot with cameras that had to be aligned according to a precise geometric formula during filming. [2] One camera filmed through a cyan filter, and the other filmed through a red filter. The red-cyan glasses worn by viewers would cancel out the conflicting image and the binocular function in the brain’s visual cortex would fuse the two images from each eye to create 3D. [3] It was an imprecise method and never caught on, as every imperfection would create literal headaches.
Furthermore, the stereoblind, who could not bring the non-conflicting images together with one-eyed viewing, experienced a movie that was either completely red or cyan!
The new technologies are digital. No film is used. The two cameras that do the “filming” to digital files are precisely aligned with a computer. [4] Digital post processing of CGI effects is also rendered with 3D formulas. (In the case of Dawn Treader, only the post processing was 3D. Two cameras were not used to shoot the live action. [5]) The left and right integrated “film” file is shown through only one projector, as the input from both angles is digitally fused into one movie. [4]
Both RealD and Dolby 3D projection systems use a rotating high-speed alternating filter. Left and right images alternate so quickly that the brain takes them in through the Dolby optically coated or RealD polarized glasses as one continuous image. The coatings or polarization in the glasses cancel out the conflicting alternate images in each lens. [6] [7]
What this means for the steroblind is only every other image is seen through either the right lens or the left. There is no haloing or ghosting because the opposite image is blocked by the same lens the dominant eye is using.
This is good news! No ghosting! No red or cyan viewing!
Eye problems, even with the 2D version
The newer 3D movies rely on extraordinary optical flow and motion parallax. The rapid CGI rotation and camera panning appeared blurred or jerky to me in the 2D version, annoyingly so, because all my depth cues were put on steroids. It was like watching a home video where the would-be videographer didn’t know how to pan his camera. If these scenes had lasted any length of time, I would have needed to avert my eyes to avoid nausea, a common problem I experience due to lack of stereoscopic ability.
All of the film’s CGI sequences appeared jerky, like watching a video with a slow internet connection. At the end of the film, during the credits, the background had a very annoying flicker. I wonder if this is because the producer did not bother to create alternate 2D CGI? The film underwent 8 months of 3D post processing. [5] Making alternate 2D CGI sequences may not have been in the budget, especially if the producers thought the 3D ghosting or haloing and alternating flicker would not be noticeable to most viewers.
Secondly, much of the film was was shot with a lack of depth of field, especially during the layered action scenes onboard the ship. Because I am steroblind, relative size relationships and perspective behind and before the action were out of focus. I felt somewhat lost and annoyed without these depth cues, as I was constantly subconsciously attempting to bring the whole scene into focus.
In this image, Lucy’s face is in focus, but the painting and Edmund are not. This is due to the way the scene was shot, with a lack of depth of field.
All this points to a dim future for the stereoblind movie-goer, as every 2D version of a 3D movie is not going to be as easy to watch as the simple 2D movies of old.
RealD polarized or Dolby coated glasses would cancel out any 3D flicker that may be embedded in a 2D version, but how to find out if 3D sequences are in the movie? Would the ticket person be able to hand out the glasses for 2D movies if asked? Probably not. Better to spend the extra 3 bucks and just watch the 3D version with the same flatness I see in real life.
At least I am improving my peripheral awareness to enjoy the pumped-up optic flow and motion parallax that these new films are dishing out.
Links to the technology of 3d movies for further exploration
Popular Mechanics “The Tech Behind 3D’s Big Revival” April 2009 http://popularmechanics.com
“JDSU Shares Science Behind 3D” http://www.youtube.com JDSU is the company that developed the coatings for Dolby 3D. The commentator offers some lame misinformation, as his competitor’s polarized glasses are being recycled at movie theaters and not thrown into landfills.
“To 3D Or Not To 3D: Buy The Right Chronicles Of Narnia Ticket” http://www.cinemablend.com offers a sub-par 3D analysis of the film, as the reviewer says at one point that it didn’t matter if she saw the film with the polarized glasses or not. I’m sorry, but in any 3D film, the glasses cut out the bothersome ghosting. This reviewer must have grown up with poor TV reception in West Virginia.
Tech info on RealD from wikipedia
RealD 3D cinema technology uses circularly polarized light to produce stereoscopic image projection. Circular polarization technology has the advantage over linear polarization methods in that viewers are able to tilt their head and look about the theater naturally without a disturbing loss of 3D perception, whereas linear polarization projection requires viewers to keep their head orientation aligned within a narrow range of tilt for effective 3D perception; otherwise they may see double or darkened images.[2]
The high-resolution, digital cinema grade video projector alternately projects right-eye frames and left-eye frames 144 times per second.[2] The projector is either a Texas Instruments’ Digital Light Processing device or Sony’s reflective liquid crystal display. A push-pull electro-optical liquid crystal modulator called a ZScreen is placed immediately in front of the projector lens to alternately polarize each frame. It circularly polarizes the frames clockwise for the right eye and counterclockwise for the left eye. The audience wears spectacles with oppositely circularly polarized lenses to ensure each eye sees only its designated frame, even if the head is tilted. In RealD Cinema, each frame is projected three times to reduce flicker, a system called triple flash. The source video is usually produced at 24 frames per second per eye (total 48 frames/s), which may result in subtle ghosting and stuttering on horizontal camera movements. A silver screen is used to maintain the light polarization upon reflection and to reduce reflection loss to counter the inherent losses by the polarization filters. The result is a 3D picture that seems to extend behind and in front of the screen itself.[3]
Tech info on Dolby 3D from wikipedia
Dolby 3D uses a Dolby Digital Cinema projector that can show both 2D and 3D films. For 3D presentations, an alternate color wheel is placed in the projector. This color wheel contains one more set of red, green, and blue filters in addition to the red, green, and blue filters found on a typical color wheel. The additional set of three filters are able to produce the same color gamut as the original three filters but transmit light at different wavelengths. Glasses with complementary dichroic filters in the lenses are worn which filter out either one or the other set of three light wavelengths. In this way, one projector can display the left and right stereoscopic images simultaneously. This method of stereoscopic projection is called wavelength multiplex visualization. The dichroic filters in the Dolby 3D glasses are more expensive and fragile than the glasses technology used in circular polarization systems like RealD Cinema and are not considered disposable. However, an important benefit of Dolby 3D as compared to RealD is that no special silver screen is needed for it to work.