I understand the idea of a distillation challenge but it really feels like the poor man's solution to a problem that could be better solved by training a LLM and analysing the layers.
In the end, as I value a condensed "cheat sheet", if the goal is to improve open-source model. A better approach seems to recreate the AlphaProof system, longer to do, but more efficient. The path taken by mathematicians now is agentic system with general LLM.
It seems like the lift in the open-source models is being used as a proxy metric, and the core goal is a human understandable yoga [1] for approaching these kinds of equational proofs in universal algebra.
The goal isn't to improve the AI performance using the cheat sheet, it's to produce a cheat sheet at all that efficiently distills intuition about these 22 million results.
Presumably if it's written in plain text and useful to the AI, there may be some relevant information in there that will be interesting for humans too.
As I say, I understand the goal of having a cheat sheet that can distills a big chunk of math. But that distillation would have been better done by a neural network instead of the creation of a prompt (fine-tuning or pure distillation). But studying that neural network will be harder.
It's explicitly stated that the goal is to improve performance of cheap models but I assume, like you did, that they are hopping that the plain text may be useful to humans too.
Tao does state his hopes in the article: "My hope is that the winning submissions will capture the most productive techniques for solving these problems, and/or provide general problem-solving techniques that would also be applicable to other types of mathematical problems."
I think your suggestions are actually complementary. Distillation of the larger networks capable of solving these problems and study of the layers could be part of the process for generating the cheat sheet.
Well, good thing you aren't drinking it then, because the complete lack of electrolytes would kill you far faster than the microplastics. Surely if they can chemically purify the water to chip-making standards they can filter out the microplastics (when they are done with it)? At least one can hope.
It is easy to keep your head above water level for surprisingly long times. Just look how some people in retail manage to rack up credit card and other type of debt.
And it is especially so when money given is not their own, but instead they get to take cut. Which these funds can do. They might even just take promises that you will pay in future and even allow adding the interest on top of loan amount. Numbers look good, bonuses look good.
Fundamentally this can only last so long and now is the time it starts to blow up.
Yea the market will correct any time now from 2009.
Things will stay the way they are for as long as people want them to. The economy and money is fundamentally made up. It’s so funny when these types come out and start talking about made up fundamentals as if they are physics.
My bet is Nvidia is using massive AI ability to dictate its investments.
And it logically predict that not much (more) investments are needed and it need time to become profitable.
That a signal that nobody should invest more in the IA big companies and now they MUST become profitable soon.
I switch from ThinkPad to Framework because they couldn't send me a replacement keyboard. They want me to send the keyboard back to get a refund but I never receive it so... I never did get a refund.
Later, Framework send me a laptop in 1 week and later a replacement screen in less then a week. It's been 3 years ago now.
On part with top ThinkPad, the experience is overall better (better Linux support, less noise, easier to hack, ...).
The bad points:
- The colored bezel is shit.
- The way is open wasn't good for me and had to switch the hinges.
Now I don't even think about it, but it was really bad before.
- The 60W Power adapter doesn't last long and had to change it each year. Now I switch to the 180W.
- The battery is ok but not exceptional
The good points:
- The screen is very good (don't remember which one I choose, but not the first one, nor the last, I remember only 3 options so ...).
- The compute power is quite good, I'm impressed about that.
- Easy to clean, open it with the screwdriver, a little "Compressed air" on it, a little "Eyeglass Cleaner", and it's basically new.
- The support was very very good. I had a defective screen kit. The ask me for photos, twice (two opinions from different people). Then conclude, like I already did, that it was an internal problem (but they have to verify I'm not responsible for the defect, that is normal) and send me a display kit free of charge. I had to send back the old on, free of charge too.
I'm rocking a framework 13" intel 12th gen still and I love it. The only issue I had was being part of the few that got a batch of bad hinges. I didn't know there was a replacement program I could have used and just replaced them myself with the heavier hinge option. At this point I have every expansion port thing they offer and keep them in my bag. My laptop can have any I/O I want :) pretty cool.
My sister just ordered a battery & some hinges for her Framework and they practically overnighted it to us here in Alaska. They included a colorful sheet of stickers, too - fun!
I must agree, you are right, GOS is only on Pixel phones.
But we have to keep in mind that /e/ has a lot of problems, the only one solved is sending data to Google. The security aspect of the OS is problematic and some key elements of a privacy seem questioning (AI integration, commercial collaborations, ...).
Uploading speech-to-text to OpenAI? Regular communication with Google? Using Google for assisted GPS? Giving a bunch of Google apps privileged access (if you need them for e.g. Android Auto)?
Well and besides that only shipping ASBs and no other security updates outside major Android releases (and both usually late). Using heavily outdated kernel trees (e.g. FP4 is using a Linux kernel patch level that hasn't been updated since 2020!), outdated vendor firmware blobs, etc.
It might work, but it is not very secure, nor very private.
The OS is working well, but have privacy and security concerns.
Is it better than a stock OS? I don't know, maybe, maybe not, it depends on the stock OS.
Reading the links posted in a sibling thread it only does it if you have text to speech enabled and they use an anonymizing proxy so openai can't associate sessions with any particular user ie it's not perfectly anonymous and private but I don't see how you could have totally anonymous and private until you have a fully offline on-device TTS model, which the fairphone guy said they tried and didn't feel it was up to scratch.
I don't use e/os but it doesnt' seem like a terrible compromise to me personally.
reply