🦾 Redefining AI Performance

Today's Highlights

  • Neural Magic - a leap-forward in AI tech
  • Learn - a couple of courses to further your knowledge in AI/Machine Learning
  • In Other News - a few interesting developments we're tracking.

Neural Magic - a leap-forward in AI tech

Neural Magic is a company established to address the limitations of computer GPUs and other existing hardware in handling machine learning tasks. The DeepSparse Inference Runtime, their flagship product, enables the deployment of deep learning models on easily available central processing units (CPUs) while matching GPU performance.

The landscape of machine learning inference has changed dramatically over the years, owing partly to developments in GPUs. While these units are strong and speedy, they are not without their drawbacks, which include high pricing, shorter lifespans, and significant electrical consumption. On the other hand, CPUs, while more adaptable and generally available, have typically been disregarded in machine learning due to their slower performance, particularly as models get larger.

DeepSparse Inference Runtime by Neural Magic tries to bridge the gap between these two realms. DeepSparse minimizes the computational burden required for neural network execution and speeds the resulting memory-bound computation by employing a set of innovative methods. It reduces the amount of floating-point operations by using sparsity, a notion that replicates how the human brain computes. It also makes use of CPUs' huge, fast caches to offer locality of reference while running the network depth-wise and asynchronously.

Neural Magic is not just reinventing AI software capabilities, but also pushing existing hardware constraints. The company is making AI and machine learning more accessible and efficient with its DeepSparse Inference Runtime, allowing organizations to use the potential of AI without the need for expensive and energy-intensive hardware. This potent technology is set to change the way organizations implement and manage AI, igniting the next wave of innovation in this fast growing industry.

The company was founded by Alex Matveev. It has raised $50 million dollars to date.


📚 Learn

Intel
Jousef Murad

In Other News

Coca-Cola favors AI over Web3 in marketing
Coca-Cola understands artificial intelligence plays a greater role in boosting consumer engagement versus Web3 activations, said Pratik Thakar, global head of creative strategy and integrated content. AI-driven outreach is capable of engaging a wider audience versus Web3 drops that are often too iso…
‘Sorry To Bother You’ Director Boots Riley On WGA Strike, Struggle, Solidarity, Sacrifice & AI – Guest Column
Editor’s note: As a founding member of The Coup and the director of the acclaimed Sorry to Bother You, Boots Riley has always brought a social conscious and activism to his work. Today, the c…
Google Cloud launches A.I.-powered tools to accelerate drug discovery, precision medicine
The solutions mark Google’s latest advancements in the AI arms race and hope to address a long-standing issue facing biotech and pharmaceutical companies.