Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Project Farm is poorly controlled, sample-size-one, poorly-designed-but-very-specific "testing." It's entertainment, not actual useful product testing, and a good example of this would be his "let's see how many bolts this impact gun can remove in X amount of time" - each time a bolt is screwed on and screwed off, it polishes the threads, changing the amount of resistance.

It's of slightly better quality than the usual youtube comparisons.

Channels like his are wildly popular because corporations prefer inexpert entertainers aka "influencers" and "creators" over product/market experts, so they shower the popular ones with free shit to "review."

This is one reason you see e-bike companies heavily courting the tech press; the tech press know fuck-all about what to look for in a bicycle, so for example, they don't notice that the bike has Chinesium bearings that won't survive being ridden in the rain, terrible no-name tires with little flat protection and high rolling resistance, and brakes made of chewing gum that perform much worse than proper offerings from major brands.



This is pretty wildly inaccurate specifically in Project Farm's case. Most "consumable" parts of tests, like bolts, are swapped out from test to test. From what I've seen he's pretty transparent when that's not the case.

He also explicitly buys all products with his own money (some by way of viewers contributing, of course) and products are sourced from what folks in the comments are asking for.


Scientifically, one should test multiple “identical” components for each test and average the results (or do something like a box and whisker plot) to incorporate manufacturing variability.

But his results are authoritative as the bar is low.


> and a good example of this would be his "let's see how many bolts this impact gun can remove in X amount of time" - each time a bolt is screwed on and screwed off, it polishes the threads, changing the amount of resistance.

He's smart enough to know that...

> Channels like his are wildly popular because corporations prefer inexpert entertainers aka "influencers" and "creators" over product/market experts, so they shower the popular ones with free shit to "review."

Does not apply in this case.


Yeah, I was wondering about that last one, are Ryobi and Craftsman supposed to be upvoting the videos or something?


Torque Test Channel does better for impacts but even they admit that they only test specific things and you can’t fully test all aspects of a tool.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: