Even though it has been over 6 months, my Zeo scam post is suddenly getting some comment traction. I thought I'd respond to some of these as well as clarify my thoughts.
I'm not really sure why Krunz thinks I'm an idiot.
First, I never said that changes in life style do not affect the quality of sleep. They do indeed. For example, for OSA (obstructive sleep apnea):
Some treatments involve lifestyle changes, such as avoiding alcohol and medications that relax the central nervous system (for example, sedatives and muscle relaxants), losing weight, and quitting smoking. Some people are helped by special pillows or devices that keep them from sleeping on their backs, or oral appliances to keep the airway open during sleep.
Second, I did say that because the ZQ score is based on sleep staging (no matter how crude), I can believe that an increased ZQ is indicative of better sleep.
My problem with the Zeo device is the claim that ZQ score improvement is caused by any particular life style change. This would be very difficult to validate.
Let's say you recorded your ZQ score for 30 days without making any life style changes. There will be an inherent variability in the ZQ score that results from a variety of sources -- electrode placement, user movement during sleep, etc. Unless an introduced life style change can make a statistically significant change to the ZQ score you can not attribute causality to it. And even if there was a significant ZQ change you would still need to somehow prove that there were no other factors involved.
RobertF was not only more civil, but he took the time to detail his opinions and asked some good questions about mine. Here are my responses:
1. The red flag for me is when you make unvalidated claims. Anecdotal evidence of an improved ZQ score though "sleep coaching" is not validation.
The same is true for the "alarm clock" functionality. Zeo and others (e.g. Actigraphy) make similar claims about waking during lighter periods of sleep reducing sleep inertia. Again, there is anecdotal evidence and even some testable theories, but a lot more research needs to be done in this area.
2. On one hand, Zeo does not claim that this is a therapeutic or a diagnostic device. From their web site:
The Zeo Personal Sleep Coach is neither a medical device nor a medical program and is not intended for the diagnosis or treatment of sleep disorders.
On the other hand they also say the Zeo provides:
...personalized sleep information and customized action steps to improve your Sleep Fitness™
Think about it. In one breath they say it isn't, and then in the next they say it is! It has nothing to do with FDA approval per se. It's the contradictory claims that bother me.
3. I don't think I was incredulous about this. I've mentioned several times that I think the dry sensor EEG technology probably provides enough signal quality to do a reasonable job of sleep staging.
4. It is the lack of “clinical validation” that is the most problematic for me. Basic sleep research may be heading in this direction -- combining "sleep science, sleep education, neuroscience, behavioral psychology,..." -- but they still have a long way to go.
5. Why would anybody that doesn't have a sleep problem buy this product? If I did have sleep problems $350 would probably be well worth it, as long as it actually worked! Sergey agrees. If it didn't work, I'd want my money back -- and so would you.
6. You may not have any connection to the Zeo company, but the advisory board members are all paid to be there. I am not saying that this in any way lessens their scientific or professional credentials. On the contrary, a good advisory board should be asking tough questions and doing their best to improve the product.
Wrap Up:
OK, I'll admit it. Maybe "scam" is too harsh. The reason I chose that term was because of its definition as a confidence trick:
an attempt to defraud a person or group by gaining their confidence
When I first read about the Zeo I felt that their presentation of the sleep science and technology was an attempt to gain a customer's confidence. Beyond that there was little evidence that this product would help people.
I do not have any ill will towards Zeo. It appears that their customer service and return policies (30 day full refund) are good. As a medical device developer, I'm just pointing out what I think are important issues about this device.
I still maintain that the claims made by Zeo are misleading. You need to be able to show scientific evidence that the ZQ score actually does track with life style changes. Unless I'm missing something, Zeo has not done this.
Great Read. I hope you don’t mind me posting here. I love your site, I’ll be back for your next piece
I am considering buying a Zeo and I came across your blog while doing some research on it.
One point to make that perhaps you should consider further. Sleep disorders are highly prevalent in the general population and many, considering the unconscious state of sleep, may not be aware that they have a sleep disorder. Take this quote from NeurologyChannel, “About 50% of adults over the age of 65 have some type of sleep disorder…” (http://www.neurologychannel.com/sleepdisorders/index.shtml). So if you were to go and ask a group of 65+ people if they have a sleep disorder, do you think the response would be 50% saying “yes” and 50% saying “no”? I would hypothesize a great deal less than 50% would be aware of their sleeping disorder. I speculate that even fewer would have fully sleep study diagnosed sleeping disorders.
My point is that sleep disorders of varying severity are most likely very prevalent and under-recognized. The reason that I am considering purchasing the Zeo is not to TREAT my active or potential sleep disorder but simply to DETERMINE if my sleep is less than great! If it turns out that I get terrible sleep than I may decide to do a formal sleep study for a more precise diagnosis.
I think the Zeo is not intended to treat any disorder but simply to allow a person to track their sleeping patterns and then use that data to attempt lifestyle/environmental changes to improve their sleep.
Finally, Point Number 6 you make is somewhat ridiculous. If you are NOT insinuating that the paid advisory members are allowing the production of a useless product, then why make this point at all? You are presenting conflicting intentions here; making a jab at the validity of the advisory board while also trying to appear objective. I’m suspicious of YOUR credibility.
Hey, I loved the post. I recently celebrated 5 years of using a device at night and I am still very content with the results. My wife is happier than ever as well. Plus, I’m sure the machines are getting better as time goes on. Anyway, keep up the terrific work!
Sleep Disorders like sleep paralysis really disturbs me at night. I usually experience it when my throat gets dry.-;~
Pingback: Is the Zeo “Personal Sleep Coach” a Scam? | Bob on Medical Device Software
Hi – You mention that Zeo says at one point: “The Zeo Personal Sleep Coach is neither a medical device nor a medical program and is not intended for the diagnosis or treatment of sleep disorders.” and later contradicts this statement. In today’s litigious world Zeo pretty much has to make such a statement. It was probably put in when their attorney reviewed their literature. It’s meaningless. It’s just pablum to satisfy the FDA (in whom you seem to place a lot of, in my mind misplaced, confidence.
While I am at it, what do you think of this device: MD300W1 Sleep Monitor?
Hi there, I was reading the June 2010 Vogue and this product was the subject of a story. Basically, the author did a product review based on her own sleep, lack thereof and the Zeo. She is a young mother, sleep deprived, not scientific. The article got my attention so I tore out the article and am just getting around to researching the product for myself and some family members. I tripped over your great site and thought I would drop a line. This Vogue article and other mainstream publications are possibly the reason for the renewed market interest in this product. Just an FYI from a tired consumer.
As InfoPhile already has pointed out, your “Point Number 6” , (sounds like a nickname that we should give you), is a strange illogical disturbed comment. You are being libellous by saying “that the scientists are being paid for there services, then in the next sentence giving them praise. All in the same paragraph ! This is the only point that needs to be raised in your blog it highlights that the rest is just nonsensical gibberish.
You are one strange mixed up kid , let’s face it.
Anyway keep plugging away Bobbity.