Archive for the ‘EEG’ Category

Moving Mountains With the Brain

Sunday, June 8th, 2008

In today's New York Times business section there's a piece called: Moving Mountains With the Brain, Not a Joystick. I've previously discussed both of the mentioned EEG-based headsets here.The article highlights some of the problems that this type of technology will face in the consumer marketplace:

“Not all people are able to display the mental activity necessary to move an object on a screen,” he said. “Some people may not be able to imagine movement in a way that EEG can detect.”

I agree. Even though Emotiv claims that "all 200 testers of the headset had indeed been able to move on-screen objects mentally" it's very doubtful that the device will have that level of success (100%!) with real gamers.They talk about the use of facial muscle activity (EMG) in addition to the EEG signal. With proper electrode placement, I think EMG holds far more promise for enhancing the gaming experience. Even EOG could be used effectively as a feedback and control mechanism. Reliable EEG processing for this purpose is still a long way off.

UPDATE (6/17/08): More of the same: No Paralysis in Second Life

UPDATE (6/29/08): Here's a pretty good description of how these devices are being used for control purposes:  OCZ's Neural Impulse Actuator (The flying car of control schemes).

UPDATE (7/21/08): An even more thorough evaluation: OCZ NIA Brain-Computer Interface. A generally positive and realistic assessment of the technology:

...the NIA isn't a replacement for traditional input methods, it is merely a powerful supplement.

brainwaves.jpg

Are you asleep at the wheel?

Saturday, May 17th, 2008

I guess I'm a sucker for EEG related technology (see all my HCI posts). So when I run across an article like A baseball cap that reads your mind I can't help but comment on it.

A baseball cap that reads your mind

Unlike other "mind reading" systems that make unrealistic claims, I can see this research and wireless technology leading to something quite useful. The ability to discern closed eyes and drowsiness by the presence of alpha waves (8-12 Hz) in human EEG is well known.

Developing an affordable product that provides a timely audible alert to a driver that's about to fall asleep could have a huge impact. From (beware, this is a PowerPoint presentation) Fatigue and Automobile Accident Risk:

The US Department of Transportation estimates that 100,000 accidents reported are due to drowsiness and/or fatigue. These crashes result in 1550 deaths annually (4% of traffic fatalities) and $12.5 billion in monetary losses.

Even the annoyance of false alerts would be worth the lives saved. And of course it's convenient that a lot of truck drivers already wear baseball caps.

Brain Control Headset

Wednesday, February 20th, 2008

Via Slashdot, Emotiv has a new Brain control headset for gamers scheduled to come out later this year:

THOUGHT-CONTROLLED GAMING HEADSET

  • Sensors respond to the electrical impulses behind different thoughts; enabling a user's brain to influence gameplay directly
  • Conscious thoughts, facial expressions, and non-conscious emotions can all be detected
  • Gyroscope enables a cursor or camera to be controlled by head movements
  • The headset uses wi-fi to connect to a computer

I've discussed this type of Mind Reading Software before (and here).

Interpreting motion and/or motor signals (facial expressions) is one thing. I'd love to know what type of EEG processing will be used to detect conscious thoughts and non-conscious emotions. At the very least, this type of quantitative EEG analysis has to begin with high quality EEG signals. I don't know how this can be done from an unprepared scalp and electrodes that are applied without gel.

UPDATE (3/2/08):

Via Slashdot, here (and here) is another game controller from OCZ (the Neural Impulse Actuator (NIA) is not currently a listed product). The NIA works by "... reading bioptentials. These include activities of the brain, the autonomous nervous system and muscle." You can't help but be skeptical about the value of this technology for these purposes.

UPDATE (3/22/08):

More information on the Emotiv device: 'Mind Gaming' Could Enter Market This Year.

BCI: Brain Computer Interface

Friday, December 21st, 2007

I ran across Commercial brain computer systems are coming today (original article is here). This is a cool graphic:

BCI

I've talked previously about Human-Computer interface (HCI) work.

Invasive BCI technologies have incredible potential. In addition to the unique device-human interface challenges (primarily sensors), it will also require significant advancements in the basic understanding of the underlying electrophysiology (cortical and motor). As reported, EEG-based processing will continue to be a corner-stone for this work, just as it is for non-invasive systems.

This slide from the report (pp. 170) summarizes the uses and importance of this type of work:

Figure C.9. Possible applications of BCIs.

Here's a shorter overview of BMI: Mind Controlled Bionic Limbs

More Mind Reading: fMRI

Saturday, November 3rd, 2007

Earlier today I was in my auto shop's waiting area while my car had its annual smog check. I started looking through the pile of magazines and came across the November 2007 issue of Popular Mechanics. To my amazement the cover article was on fMRI (functional magnetic resonance imaging) -- Thought Police: How Brain Scans Could Invade Your Private Life.

My previous discussion on Mind Reading Software was mostly concerned with techniques that used EEG signal processing. fMRI technology is summarized by the article:

The underlying technology involved in functional magnetic resonance imaging has been around for decades. What’s new is the growing sophistication in how it is being used. Inside a massive doughnut-shaped magnet, an fMRI scanner generates powerful fields that interact with the protons inside a test subject’s body. The hemoglobin molecules in red blood cells, for instance, exhibit different magnetic properties depending on whether they are carrying a molecule of oxygen. Since regions of the brain use more oxygen when they’re active, an fMRI scanner can pinpoint which areas are busiest at a given moment. These can be correlated with our existing anatomical understanding of the brain’s functions—and, as our knowledge of these functions improves, so does the accuracy of neuroimaging data. With fMRI, then, researchers can see what is going on across the entire brain, almost in real time, without danger or discomfort to the test subject.

As the title indicates, most of the article discusses the on-going debate over the use of fMRI for things like lie-detection. There's also an overview of some fMRI research activities.

NPR's Morning Edition also ran a story on this last week: Neuroscientist Uses Brain Scan to See Lies Form.

Just like with EEG-based techniques, fMRI "mind reading" provokes many legal and ethical questions. I think there is legitimate cause for concern when companies (like No Lie MRI) are making claims that could affect people's lives.

I used quotation marks around mind reading because the current state of these technologies is not anywhere close to being able to know a person's memories, thoughts, or intentions. I wouldn't be too worried about having your private life invaded. Not for a long while anyway.

Update (05-Nov-2007):

I'm not sure if what they're doing in the UK is any different, but this technology is certainly pushing the legal system. See Groundbreaking Experiments Could Lead To New Lie Detector.

Mind Reading Software

Wednesday, September 5th, 2007

I spent quite a few years developing diagnostic Electroencephalography (EEG) systems and software. I always get a kick out of articles with titles like this one: Microsoft Working On Mind-Reading Software. It's the mind-reading part that gets me because your first impression is that Microsoft is developing technology that will allow it to somehow detect what you're thinking. This, of course, will not be happening in the near or foreseeable future.

The work that Microsoft Research is doing in this area (see here) is fundamental research on the Human-Computer Interface (HCI). The Using a Low-Cost EEG for Task Classification in HCI Research article uses standard frequency domain EEG features (delta, theta, alpha, etc.) as classifiers in a Bayesian Network for differentiating three mental tasks. What was interesting to me was that they recognized the limitations of using EEG technology alone as a human-computer interface. The understanding and use of other physiological data (e.g. motor activity) along with EEG will have to be explored as a way to improve task detection.

Not only is this type of work important for meeting the needs of the physically disabled, as the Wii and Surface have shown, innovative HCI systems can have a dramatic affect on how we all interact with computers.

'Thought-reading' system controls wheelchair and synthesizes speech is another one. The system processes larynx nerve signals for speech synthesis and wheelchair control. The technology looks very cool and has the potential to improve the lives of handicapped individuals. I suppose you could consider motor neuron activity as the output of thought, but 'thought-reading' just feels like a misnomer. Maybe it's just me.

Another 'mind-reading' technique is the use of Evoked Potentials (EP). One that got a lot of press is a few years back was Brain Fingerprinting (also see here). I'm sure there's still on-going research in the P300 area, but nothing has grabbed much attention since.

Also, checkout Computers can read your mind. Amazing!

UPDATE:

I found some companies that appear to be trying to use EEG processing algorithms for HCI. Both are focused on the gaming industry. They provide no details on how their products work, so it's hard not to be skeptical about their functionality claims.

NeuroSky

Emotiv

Also, Smart BrainGames provides more classical biofeedback development systems. All are mentioned here.

UPDATE-2:

Here's another interesting technology: Functional near-infrared spectroscopy (fNIRS) is an emerging non-invasive, lightweight imaging tool which can measure blood oxygenation levels in the brain. Check out the article here.

UPDATE-3 (15-Oct-2007):

Here's the Microsoft patent application: Using electroencephalograph signals for task classification and activity recognition (via here).

UPDATE-4 (13-Nov-2007):

Check out Brain2Robot Project which uses EEG signal processing (my highlighting):

Highly efficient algorithms analyze these signals using a self-learning technique. The software is capable of detecting changes in brain activity that take place even before a movement is carried out. It can recognize and distinguish between the patterns of signals that correspond to an intention to raise the left or right hand, and extract them from the pulses being fired by millions of other neurons in the brain. These neural signal patterns are then converted into control instructions for the computer.

If they can do this reliably, that's quite an accomplishment.