The best inference config depends on your model, your hardware and your traffic, and all three keep changing. Settings that were ideal last week are rarely the right ones today.
Tonight at @MiniMax_AI's #SFTechWeek research night, Modular AI Performance Engineer Tyler Kenney is talking about self-tuning ML inference systems, exploring how we can teach inference systems to tune their own settings.
📍 UpScaleX, San Francisco
🗓 Thursday, Oct 8 · 5:30–8:30 PM PT
RSVP: partiful.com/e/DKY1zYjyuOvM…

