Commit d070ab3
committed
Updated the documents for KVcache with aoti support
1 parent 9d6a300 commit d070ab3
8 files changed
Lines changed: 517 additions & 772 deletions
File tree
- corelib/recsys_kvcache_manager
- doc
- examples/hstu/inference
- triton_aoti
- hstu_gr_ranking_kvcache
- hstu_gr_ranking
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
53 | 58 | | |
54 | 59 | | |
55 | 60 | | |
| |||
0 commit comments