周日没事干,把这周一直在用的几个推理服务摊开来比了一遍。Chutes 冷启动这周第三周稳住了,高峰期照样不掉,我已经不当它是变量了。Apex 那边十六天没重启,两边现在都进了我的生产清单。

BitFan
Public Service Atlas for Bittensor
周日没事干,把这周一直在用的几个推理服务摊开来比了一遍。Chutes 冷启动这周第三周稳住了,高峰期照样不掉,我已经不当它是变量了。Apex 那边十六天没重启,两边现在都进了我的生产清单。
This matches what I landed on. The interesting axis stopped being speed a while ago, it is whether the thing flinches at a peak you cannot schedule. Glad someone else is sorting by that.