A group at Berkeley has just published (£) the first successful attempt to reconstruct colour video imagery from the mind using an fMRI brain scanner. The results are startling, encouraging and a little bit scary.
The method used, called fMRI, is known for its high spatial resolution (3D imaging ability) but notoriously low temporal resolution (measurements with respect to time – effectively a slow shutter speed). In the past, this has been a barrier to research on the visual cortex because of the incredibly high rate of information processing in the visual system. However, scientists have recently developed a new MRI encoding method that allows for the modelling of brain activity in the visual system at a faster rate. In the experiment conducted by the Berkeley group, participants were shown 7,200 seconds of random colour video clips one time only, while their brains were scanned using the novel fMRI sequence. From these scans, researchers were able to create a “dictionary” of brain activity in the visual system.
After a dictionary of brain activity in the visual system was created, the participants watched a fresh unseen video from YouTube while undergoing a brain scan. This resulted in video outputs that resembled the new YouTube video shown to participants. The output appears as a collage of flickering pixels that reminds me of a cross between the paintings of prosopagnosia sufferer Chuck Close and the imagery in A Scanner Darkly.
The correlation between the videos shown to the participants and the output imagery in the collage-like videos (below) is pretty astounding especially when considering there is zero overlap between the clips used for calibration and the clips used to test the system.
The study authors suggest that the method used in this paper could eventually lead to the generation of video output from participants experiencing dreams or hallucinations. Watch this space! What was once a field reserved firmly for science fiction may fast be becoming a reality.
Listen to an NPR interview with the researchers here:
Nishimoto S, Vu AT, Naselaris T, Benjamini Y, Yu B, & Gallant JL (2011). Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies. Current biology : CB PMID: 21945275
The traditional polygraph or lie-detector-test as it is commonly known has been in existence for over a hundred years and in that time developments in both the technology itself and our understanding of it have been far and few between (read utterly non-existent). The traditional polygraph works in a very similar way to the traditional witch finding technique: tie them up, drop them in a river and if they live they are a probably a witch. Despite this a new breed of lie detector tests known as “Brain Finger Printing” is emerging that according to a number of experts could be even more unreliable than the status quo once it gets in to the hands of the police, the secret service, cranks and talk show hosts alike the world over.
Essentially all forms of the original polygraph are an attempt to identify when either anxiety is present or when there is prior knowledge of information that would imply guilt through examining biological indicators. The former is a much less reliable indicator than the latter due to the fact that the tests in general invariably provoke anxiety. The main technique which is slightly more reliable involves presenting certain crime scenes to a suspect and then waiting for the “ahah” moment when their blood pressure rises when they are forced to attend to the target item that they are not supposed to know about. Sadly this method assumes two things: that the suspect isn’t just worried he’s been wrongly accused and that the suspect isn’t second guessing the interrogator and freaking out at the dodgiest or most likely sounding scenario.
What do the experts say?
In the largest review of polygraph testing to date, the National Academy of Sciences found that the accuracy of the polygraph was 80-90% when tested artificially. This leaves a hell of a large window for error if you consider that critically that means that when it comes down to it the polygraph will be wrong almost one in four times. The problem with this figure however is that we still have really no idea what we are measuring, it could be in response to anxiety, emotional salience, memory of an event or most likely a combination of the three. The problem being that all three of these factors conflict and none can be identified. The 2003 review of the scientific evidence by the US National Research Council effectively concluded that further investment in the polygraph is futile because of the “inherent ambiguity of the physiological measures”.
So why in that case is the industry experiencing a boom?
Polygraphs do have one value; they often are useful for frightening the victim in to giving a confession. They are also a very easy sell to the paranoid partner and nowadays more worryingly the prying employer.
“I don’t know anything about polygraphs, and I don’t know how accurate they are, but I know they’ll scare the hell out of people.” Richard M. Nixon
So what is brain fingerprinting?
Brain Fingerprinting uses electrodes attached to the scalp (EEG) to attempt to define whether someone has experienced an event that would imply guilt. For example if the suspect gave a signal (known as the p-300) that suggests they recognised the scene of a robbery they were suspected of committing this would imply guilt. If the suspect did not recognise the scene it would imply innocence, much like real fingerprints left at a crime. This technology was used in America as long ago as 2000 by a defence council to free a convicted criminal, an interesting decision considering that it is far from impossible to suppress the P300 response.
The inevitable progression from polygraph to EEG has now lead some investigators to attempt to use a method of brain scanning (FMRI) to look for similar markers to see if certain memories are genuine. The main problem with this technique is that in many ways, when compared to the traditional polygraph the lines are even more blurred. It is very easy for an interrogator with or without bad intent and consciously or not to interpret a brain scan as indicative of guilt. This is of course the goal and the motive of the interrogator. In a stunning study published last year, scientists placed a dead salmon in an FMRI scanner and presented it with images of human faces. It was found to be recognising emotions. Even though it was dead, and a salmon.
“In fMRI, you have 160,000 darts, and so just by random chance, by the noise that’s inherent in the fMRI data, you’re going to have some of those darts hit a bull’s-eye by accident” Craig Bennet
The benefit of a salmon is you can replay this test again and again and realise that your results are just down to blind luck. With a live, human suspect however you don’t really have that option. Now the same technology is being used by prosecutors to determine the freedom of our friends across the pond and according to some reports in places like Guantanamo. How many red herrings they hit upon we will never know.
Subscribecontact directly by simply hitting reply to the email. You will never receive spam under any circumstances and you can unsubscribe at any time with one click. Alternately, use the link below to subscribe via RSS or your favourite reading platform.
Africa America Bad Science BCI Brain Computer Interfacing breaking news Cannabis Censorship Cocaine Copyright Counterfeit Drugs Daily Fail DailyFail daily mail Daily Mail Demolition Squad Drugs EEG Emotiv Fake Drugs FMRI Health Hoax Independent Misinformation Music Neuroscience Open Science Procrastination Psychology Rat Brain Robot Review Satire Science sex Skepticism Statistics Student Loans Crisis Susan Greenfield Synaesthesia Technology The confederacy of dunces Video walking War on Drugs Wikileaks
Cookie ComplianceThis site contains cookies dropped by Facebook, Twitter, Google Plus and Google Analytics. If you have ever used the internet before then you probably knew that already and ate them long before you arrived here.