Keep Your Friends Close: Leveraging Affinity Groups to Accelerate AI Inference Workflows

Thiago Garrett, Weijia Song, Roman Vitenberg +1

AI inference workflows are typically structured as a pipeline or graph of AI programs triggered by events. As events occur, the AIs perform inference or classification tasks under…