DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DSpark can make decoding faster, but acceptance quality still determines how much speed the system actually realizes.
IEEE

KnowSTU: Diagnosing Students’ Problem Behaviors Using Fine-Tuned LLM and RAG

Abstract: Students’ problem behaviors, which deviate from established school norms, can undermine both their well-being and academic achievement. Effectively addressing such behaviors often requires ...

Scientists decipher new secrets from ancient scrolls scorched by Vesuvius eruption: "Finally able to read them"

An 18th-century archaeological dig uncovered a library of intact but charred scrolls. Their contents have been unreadable ...

Small Language Models Outperform Frontier AI On Cost, Speed And Accuracy

Bigger has defined AI from day one. New data says task-specific small models beat frontier LLMs on accuracy, cost and speed — and save money.

OpenAI and Broadcom announce chip designed for LLM inference at scale

OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon supplier, ...