PolarQuant is doing most of the compression, but the second step cleans up the rough spots. Google proposes smoothing that out with a technique called Quantized Johnson-Lindenstrauss (QJL).
We asked seven frontier AI models to do a simple task. Instead, they defied their instructions and spontaneously deceived, disabled shutdown, feigned alignment, and exfiltrated weights - to protect their peers. We call this phenomenon 'peer-preservation.'
We're investing a lot in AI - we're doing a lot, but we're stopping at individual productivity. We're not taking the next step. You can't just screw AI on everything - it only makes you faster. It means you need to think about, 'how are our teams collaborating? How are people collaborating?' You probably need to change the way you work.