IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...
Tech Xplore on MSN

Can AI understand literature? Researchers put it to the test

Even with all the recent advances in the ability of large language models (like ChatGPT) to help us think, research, ...
Tech Xplore on MSN

'Neuron-freezing' technique can stop LLMs from giving users unsafe responses

Researchers have identified key components in large language models (LLMs) that play a critical role in ensuring these AI ...
Forbes

Large Behavior Models Surpass Large Language Models To Create AI That Walks And Talks

Forbes contributors publish independent expert analyses and insights. Dr. Lance B. Eliot is a world-renowned AI scientist and consultant. In today’s column, I closely explore the rapidly emerging ...

What Is Inference? Explaining the Massive New Shift in AI Computing

The focus of artificial-intelligence spending has gone from training models to using them. Here’s how to understand the ...
Ars Technica

How a big shift in training LLMs led to a capability explosion

In April 2023, a few weeks after the launch of GPT-4, the Internet went wild for two new software projects with the audacious names BabyAGI and AutoGPT. “Over the past week, developers around the ...

Beyond Basic Security: How AI is Rewriting the Safety Playbook

Many companies are learning that keeping their AI safe is about more than just adding some cloud security as a makeshift gate ...
The Conversation

Large language models: how the AI behind the likes of ChatGPT actually works

Mark Stevenson has previously received funding from Google. The arrival of AI systems called large language models (LLMs), like OpenAI’s ChatGPT chatbot, has been heralded as the start of a new ...