🦾 Redefining AI Performance

Today's Highlights

• Neural Magic - a leap-forward in AI tech
• Learn - a couple of courses to further your knowledge in AI/Machine Learning
• In Other News - a few interesting developments we're tracking.

Neural Magic - a leap-forward in AI tech

Neural Magic is a company established to address the limitations of computer GPUs and other existing hardware in handling machine learning tasks. The DeepSparse Inference Runtime, their flagship product, enables the deployment of deep learning models on easily available central processing units (CPUs) while matching GPU performance.

The landscape of machine learning inference has changed dramatically over the years, owing partly to developments in GPUs. While these units are strong and speedy, they are not without their drawbacks, which include high pricing, shorter lifespans, and significant electrical consumption. On the other hand, CPUs, while more adaptable and generally available, have typically been disregarded in machine learning due to their slower performance, particularly as models get larger.

DeepSparse Inference Runtime by Neural Magic tries to bridge the gap between these two realms. DeepSparse minimizes the computational burden required for neural network execution and speeds the resulting memory-bound computation by employing a set of innovative methods. It reduces the amount of floating-point operations by using sparsity, a notion that replicates how the human brain computes. It also makes use of CPUs' huge, fast caches to offer locality of reference while running the network depth-wise and asynchronously.

Neural Magic is not just reinventing AI software capabilities, but also pushing existing hardware constraints. The company is making AI and machine learning more accessible and efficient with its DeepSparse Inference Runtime, allowing organizations to use the potential of AI without the need for expensive and energy-intensive hardware. This potent technology is set to change the way organizations implement and manage AI, igniting the next wave of innovation in this fast growing industry.

The company was founded by Alex Matveev. It has raised $50 million dollars to date.

📚 Learn

In Other News