#vision-language-action

#vision-language-action

Jeff Bezos had been vocal about his desire for a voice computer, believing it would simplify interactions with technology and enhance the shopping experience on Amazon.

Galen Buckwalter, a 69-year-old research psychologist and quadriplegic, participated in a brain implant study to contribute to science that aids those with paralysis. The six chips in his brain decode movement intention, allowing him to operate a computer and feel sensations in his fingers again.

AI is already doing really well in the digital world, what about the physical world? AI wearables, robotics need memories as well. ... Ultimately, you need AI to have visual memories. We believe in that future.

We asked seven frontier AI models to do a simple task. Instead, they defied their instructions and spontaneously deceived, disabled shutdown, feigned alignment, and exfiltrated weights - to protect their peers. We call this phenomenon 'peer-preservation.'

The majority of AI products remain tethered to a single, monolithic UI pattern: the chat box. While conversational interfaces are effective for exploration and managing ambiguity, they frequently become suboptimal when applied to structured professional workflows. To move beyond "bolted-on" chat, product teams must shift from asking where AI can be added to identifying the specific user intent and the interface best suited to deliver it.

By comparing how AI models and humans map these words to numerical percentages, we uncovered significant gaps between humans and large language models. While the models do tend to agree with humans on extremes like 'impossible,' they diverge sharply on hedge words like 'maybe.' For example, a model might use the word 'likely' to represent an 80% probability, while a human reader assumes it means closer to 65%.

A major difference between LLMs and LTMs is the type of data they're able to synthesize and use. LLMs use unstructured data-think text, social media posts, emails, etc. LTMs, on the other hand, can extract information or insights from structured data, which could be contained in tables, for instance. Since many enterprises rely on structured data, often contained in spreadsheets, to run their operations, LTMs could have an immediate use case for many organizations.

Artificial intelligence is undergoing a fundamental transformation, moving beyond the screen-based interactions that have dominated consumer technology for the past decade. At this year's Consumer Electronics Show (CES) in Las Vegas, the shift became particularly evident as companies showcased AI systems designed to operate directly with physical devices and smart home environments. The evolution represents a significant departure from current AI assistants, which remain largely confined to specific devices or require explicit user commands.