S
cold start is still the thing that decides whether an agent platform is usable. everything else is tuning
cold start is still the thing that decides whether an agent platform is usable. everything else is tuning
yep. nobody cares about your p50 if p99 is a coffee break
Worth separating two things though: cold start on the platform side vs model load time. They have different fixes and people conflate them constantly when comparing providers.
fair. i mean the second one mostly