Nature Scitable Featured1 Scientists successfully reconstruct the minds eye for the first time as a video output A group at Berkeley has just published (£) the first successful attempt to reconstruct colour video imagery from the mind using an fMRI brain scanner. The results are startling, encouraging and a little bit scary.

The method used, called fMRI, is known for its high spatial resolution (3D imaging ability) but notoriously low temporal resolution (measurements with respect to time – effectively a slow shutter speed). In the past, this has been a barrier to research on the visual cortex because of the incredibly high rate of information processing in the visual system. However, scientists have recently developed a new MRI encoding method that allows for the modelling of brain activity in the visual system at a faster rate. In the experiment conducted by the Berkeley group, participants were shown 7,200 seconds of random colour video clips one time only, while their brains were scanned using the novel fMRI sequence.  From these scans, researchers were able to create a “dictionary” of brain activity in the visual system.

Brain visualiser 1 Scientists successfully reconstruct the minds eye for the first time as a video output

The method with which the dictionary is filtered to produce video output

After a dictionary of brain activity in the visual system was created, the participants watched a fresh unseen video from YouTube while undergoing a brain scan. This resulted in video outputs that resembled the new YouTube video shown to participants. The output appears as a collage of flickering pixels that reminds me of a cross between the paintings of prosopagnosia sufferer Chuck Close and the imagery in A Scanner Darkly.

chuck Scientists successfully reconstruct the minds eye for the first time as a video output

Chuck Close (Self Portrait)

The correlation between the videos shown to the participants and the output imagery in the collage-like videos (below) is pretty astounding especially when considering there is zero overlap between the clips used for calibration and the clips used to test the system.

The study authors suggest that the method used in this paper could eventually lead to the generation of video output from participants experiencing dreams or hallucinations. Watch this space! What was once a field reserved firmly for science fiction may fast be becoming a reality.

Listen to an NPR interview with the researchers here:

Nishimoto S, Vu AT, Naselaris T, Benjamini Y, Yu B, & Gallant JL (2011). Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies. Current biology : CB PMID: 21945275

Return to Neurobonkers.com Scientists successfully reconstruct the minds eye for the first time as a video output
  • http://neuroskeptic.blogspot.com Neuroskeptic

    Now all we need is a way to manipulate neural activity to put imagery in, and then for Leonardo Di Caprio to become a world expert in the technique, and Inception will come true.

  • http://www.sessionaltherapy.com London Counselling

    Unbelievable! I am constantly being floored by what new technology is capable of. The potential that this has diagnosis, and maybe even for dream analysis is fabulous.

Looking for something?

Use the form below to search the site:


Still not finding what you're looking for? Drop a comment on a post or contact us so we can take care of it!

Visit our friends!

A few highly recommended friends...