Wallaroo

As we continue to iterate on our core capabilities, we are pleased to announce the following product improvements in our September 2022 product release:

Air Gap Installation Support:

Wallaroo Enterprise supports installation into a Kubernetes cluster that is isolated from the public internet. Organizations that need to install Wallaroo into an air gapped environment can contact their Wallaroo support representative to update their Wallaroo Enterprise license for air gap support.

Node Containment:

Organizations can install Wallaroo into specific nodes in a Kubernetes cluster.

  • This update allows organizations to tag specific nodes for Wallaroo use while using other nodes in their cluster for other services.

Kots 1.81 support:

Wallaroo now supports Kots 1.81 for versions after the September 2022 release (code name Mustang) and beyond.

  • kots 1.70.1 is preferred for versions of Wallaroo before the September 2022 release.

--

--

CPU vs. GPU?

The assumption for running machine learning models is that if you have a complex model with several parameters to evaluate and you have a short amount of time to get answers (measured in milliseconds), you will need the power of a GPU.

The problem is GPUs are expensive, have been hard to source (recently), and in some deployment scenarios, especially at the edge, are just not an option.

However, we’ve been able to surprise our clients by taking their most demanding NLP or even computer vision models, operationalizing them on standard CPUs, and generating faster inferences on less servers. That’s because we purpose built our runtime engine from the ground up in Rust specifically for machine learning.

Reach out to us if you’re ready to ditch GPUs to run even your boldest models.

Image courtesy of Hannes Grobe

--

--

The combination of 5G with AI promises new revenue streams to communication service providers (CSPs), such as private networks. But taking complex machine learning models trained in cloud or on-prem environments and deploying them at the edge is still relatively new. The dev environment can be so different from the live production environment that it could take months of reengineering before a single model can be successfully deployed at the edge. And once live, the data scientists who developed the model often have no view into the ongoing performance of their model until something goes wrong.

In this contributed article to RCR Wireless Media, Wallaroo’s Director of Architecture, Jason McCampbell, and Head of Product Marketing, Hector Leano, delve deeper into the observability and performance hurdles CSPs need to overcome in order to operationalize edge ML.

--

--

Wallaroo

Wallaroo

Wallaroo enables data scientists and ML engineers to deploy enterprise-level AI into production simpler, faster, and with incredible efficiency.