nebflow-cache
LLM provider prompt cache 命中率优化域知识——指标定义(cache_read/cache_write)、数据源(router 日志/usage-records 五维聚合)、已知事实(间隔悬崖衰减/107 网关低命中/冷启动路由/基线上下文精简)、排查方法(先量化再动手、前缀漂移假设检验)、system prompt 共享前缀维护纪律。Use when 排查命中率下降、分析 cache 指标、统一 system prompt 前缀、调保活/冷启动策略、精简基线上下文。
Pinned to revision 02f7626e18bd, so it is the text this page describes rather than whatever the author pushed since.
Files
Every link opens the file at its source, pinned to the revision this page describes.