Published
Reviewers rarely talk about reliability. Owners bring it up twice as often
A few weeks ago we compared how negative Reddit owners and YouTube reviewers are about the same products. This time we looked at what they talk about. Across 657 products in 19 categories, owners brought up reliability, durability and customer support twice as often as reviewers did, and they were far more critical of the apps that now come with almost everything.
The numbers behind the chart
| Category | Reviewers (YouTube) | Owners (Reddit) |
|---|---|---|
| Self-cleaning litter boxes | 3% (5 of 181) | 39% (23 of 59) |
| Laser engravers | 14% (15 of 106) | 41% (30 of 74) |
| Robot lawn mowers | 9% (23 of 259) | 27% (32 of 117) |
| Robot vacuums | 1% (12 of 975) | 18% (84 of 466) |
| Robot pool cleaners | 9% (31 of 337) | 25% (13 of 53) |
| 3D printers | 11% (87 of 762) | 22% (103 of 465) |
| Portable power stations | 10% (113 of 1,126) | 21% (57 of 275) |
| Electric bikes | 5% (75 of 1,527) | 11% (84 of 782) |
| Electric scooters | 13% (71 of 551) | 19% (61 of 329) |
| Smart glasses | 1% (2 of 276) | 5% (11 of 215) |
| Smart locks | 6% (10 of 170) | 10% (11 of 109) |
| Coffee machines | 17% (63 of 375) | 18% (70 of 394) |
| Smart rings | 10% (21 of 205) | 11% (15 of 138) |
| Tennis ball machines | 16% (8 of 50) | 13% (12 of 91) |
Across these 14 categories: 7.8% of reviewer opinions vs 17.0% of owner opinions. Owners bring it up more in 13 of the 14; tennis ball machines are the exception, with only 91 owner opinions. 6,900 opinions from YouTube reviews and 3,567 from Reddit threads. Left out: video doorbells, smart thermostats, mechanical keyboards and 3D scanners, where reliability isn't a topic of its own (it's folded into a broader one such as "Connection, Reliability & Support"), and pickleball machines, which have no Reddit threads yet.
Most of what breaks shows up after the review is done
- Robot vacuums: reliability comes up in 1% of reviewer opinions and 18% of owner opinions. A review covers a few weeks; the failures owners write about tend to come months later.
- Self-cleaning litter boxes: 3% vs 39%. Owners mostly describe breakdowns and how long a replacement takes.
- When owners do bring it up, 70% of what they say is negative. Reviewers who mention it are negative 15% of the time.
Apps: the same attention, the opposite verdict
Reviewers and owners talk about apps, software and connectivity about equally often (8.2% vs 9.4% of opinions). They don't agree on them: 21% of reviewer opinions on apps are negative, compared with 71% of owner opinions.
Categories with at least 20 positive or negative owner opinions on apps. Owners are more negative in all eight.
Two products show where this ends up:
- A $7,999 laser engraver ranks last of 9. The Glowforge Pro gets 8 positive and 0 negative opinions on setup and ease of use. It loses on software and connectivity (3 positive, 7 negative) and on reliability and support (2 positive, 7 negative). Owners mostly object to a paid software subscription and needing an internet connection to use the machine.
- A $350 smart lock ranks last of 20. The Eufy FamiLock S3 has 0 positive and 7 negative opinions on its app and smart-home features, mostly about a firmware update that left locks unusable. All 10 of its sources are Reddit threads.
If you're about to buy
- Search owner threads for the model plus "months" or "a year later", not just the launch reviews.
- Check whether the device still works if the app or the company's servers go away.
- Look at the warranty length and how owners describe getting a replacement.
Read this before the numbers
- Reviewers aren't hiding anything. Most reviews are made in the first days or weeks with a new unit. That's too early for most failures, and it's hard to test a company's support.
- Owners post when something goes wrong. Nobody starts a thread to say their robot vacuum still works, so these numbers show what owners worry about, not how often things break. For scale: across all topics, 56% of owner opinions and 15% of reviewer opinions are negative. Reliability (70%) and apps (71%) are still well above the owners' own average.
- Topic grouping matters. If we also count mixed topics such as "Value & Support" or "Responsiveness & Key Reliability", owners bring up reliability 2.4 times as often instead of twice, and more in all 17 categories that have owner opinions. We lead with the stricter number. The same goes for apps: mixed topics like "Connectivity & Battery" are left out.
- Some YouTube reviews are sponsored. We count them like any other source and can't reliably tell which ones are.
- An AI model labels each opinion with a topic and as positive or negative. Every opinion links back to the sentence it came from, so any of them can be checked.
Method
- Sources: YouTube reviews and Reddit threads about 657 products currently on sale in 19 categories, collected for BettaScore's rankings: 8,062 opinions from YouTube and 4,525 from Reddit. Review sites, forums and Hacker News (517 opinions) aren't in the comparison.
- What counts as an opinion: one source's view on one topic of one product. A source that covers five topics counts five times; a source that mentions a topic ten times counts once.
- Topic groups: reliability is any topic about reliability, durability, warranty, service or support; apps is any topic about apps, software, firmware or connectivity. Mixed topics are left out of both.
- Shares: opinions in a topic group ÷ all opinions from that platform, including neutral ones. Negative shares count positive and negative opinions only.
About BettaScore
BettaScore ranks products by what public reviews say about them. No brand pays to be listed or to rank higher, and our shopping links earn nothing.
The rankings
Now see who comes out on top
Each ranking shows what owners and reviewers say about every model, reliability included, with the quotes behind each score.
- 1CASA LEO Leo's Loo Too
- 2PETSNOWY SNOW+ Self-Cleaning Litter Box
- 3WHISKER Litter-Robot 4
- 1ORTUR Laser Master 3
- 2ATOMSTACK Hurricane
- 3WECREAT Lumos
- 1GARDENA SILENO minimo
- 2ECOVACS GOAT O1000 LiDAR PRO
- 3ECOVACS A3000 LiDAR PRO
- 1MOVA V50 Ultra
- 2ECOVACS Deebot X1 Omni
- 3EUREKA J15 Pro Ultra
- 1WYBOT S2 Solar
- 2WYBOT C2 Vision
- 3DOLPHIN E10 Robotic Pool Cleaner