Fast, Efficient Inference

Technologies you are developing will revolutionize Deep Learning optimization and capacity availability.

Software is King. Architecture without a good compiler is like a race car without a good driver. I'm excited to be advising a company that is helping push the state-of-the-art in ML as well as help with reductions in carbon emissions.

With the breakneck pace of generative AI, we're always looking for an edge to stay ahead of the competition. One main focus is optimizing our API-as-a-Service for speed and efficiency, to provide the best experience for our customers. CentML assisted Wordcab with a highly personalized approach to optimizing our inference servers. They were patient, attentive, and transparent, and worked with us tirelessly to achieve inference speedups of 1.5x to 2x.

The most innovative Deep Learning is usually coded as a sequence of calls to large general purpose libraries. Until recently we had little or no sophisticated compiler technology that could transform and optimize such code, so the world depended on library maintainers to manually tune for each important DL paradigm and use case. Recently compilers have begun to arrive. Some are too low level and others are too specialized to high level paradigms. CentML's compiler tech is just right -- powerful, flexible, and impactful for training and inference optimization.

Amazing team, conducting cutting edge work that will revolutionize the way we are training and deploying large-scale deep learning systems.

With CentML's expertise, and seamless integration of their ML monitoring tools, we have been able to optimize our research workflows to achieve greater efficiency, thereby reducing compute costs and accelerating the pace of our research.

The proliferation of generative AI is creating a new base of developers, researchers, and scientists seeking to use accelerated computing for a host of capabilities. CentML's work to optimize AI and ML models on GPUs in the most efficient way possible is helping to create a faster, easier experience for these individuals.

CentML's compiler technology is proven to deliver impressive training and inference optimizations. We anticipate these solutions will bring significant benefits for our ML model development efforts, helping us best serve our customers.