Nvidia researchers have developed a new technique, Dynamic Memory Sparsification (DMS), that can reduce the memory costs of large language model (LLM) reasoning by up to eight times without sacrificing accuracy, according to VentureBeat. The technique compresses the key value (KV) cache, the temporary memory LLMs use to process prompts and reason through information.
The DMS technique, developed by Nvidia researchers, addresses a common challenge in LLM development: the high memory demands of processing complex tasks. While other methods to compress the KV cache have been proposed, they often lead to a degradation of the model's intelligence. Nvidia's approach, however, manages to discard a significant portion of the cache while maintaining or even improving the model's reasoning capabilities, as reported by VentureBeat. Experiments showed that DMS allows LLMs to "think" longer and explore more solutions without the same memory constraints.
In other tech news, the European company Tenways launched its new CGO Compact electric bike in Europe. The bike is designed to fit into tight spaces, with a handlebar that twists and pedals that fold, allowing it to lay flat. Thomas Ricker, a deputy editor and co-founder of The Verge, noted the bike's design as an interesting development from a relatively new challenger in the e-bike market.
Meanwhile, deals on gaming laptops are available at Best Buy. The 2025 models of Acer's Predator Helios Neo 16S and Asus's Zephyrus G14 are both hundreds of dollars off, according to The Verge. These laptops offer powerful performance, OLED displays, and are suitable for both 16-inch and 14-inch models.
In the realm of entertainment, Prime Video released the first teaser for the new live-action series "Spider-Noir," based on the Marvel Comics character. The series stars Nicolas Cage as an aging private investigator and disillusioned superhero in 1930s New York. The teaser was released in two forms: black and white, reminiscent of Raymond Chandler, and color, which the showrunners are calling "True Hue," according to Ars Technica.
Finally, the Asus Zenbook S 16 laptop has dropped in price to $1,000, a $500 discount from its original retail price, according to Wired. The laptop, known for its sleek design and excellent battery life, has been a favorite among tech journalists. The price drop comes as the end of its lifespan nears, with an update expected soon.
Discussion
AI Experts & Community
Be the first to comment