Neural Magic Archives

Neural Magic

Sparsifying for Better ResNet-50 Performance on CPUs

Machine Learning Modeling Neural Magic Pruningposted by ODSC Community April 28, 2021

In this post, we elaborate on how we measured, on commodity cloud hardware, the throughput and latency of five ResNet-50 v1 models optimized for CPU inference. By the end of the post, you should be able reproduce these benchmarks using tools available in the Neural Magic GitHub... Read more

YOLOv3 on CPUs: Sparsifying to Achieve GPU-Level Performance

Machine Learning Modeling Neural Magic Pruning YOLO YOLOv3posted by ODSC Community April 27, 2021

In this post, we elaborate on how we used state-of-the-art pruning and quantization techniques to improve the performance of the YOLOv3 on CPUs. We’ll show that by leveraging the robust YOLO training framework from Ultralytics with SparseML’s sparsification recipes it is easy to create highly pruned and INT8 quantized... Read more

Sparsifying for Better ResNet-50 Performance on CPUs

YOLOv3 on CPUs: Sparsifying to Achieve GPU-Level Performance

What are Tech Layoffs Saying About the AI Industry?

Python if Not: How to Simplify Conditional Statements in Your Code

9 Ways AI is Enhancing Data Center Security