Feat (brevitas_examples/llm): separate KV Cache quantization #1606
| Job | Run time |
|---|---|
| 29m 2s | |
| 24m 9s | |
| 13m 57s | |
| 41m 56s | |
| 31m 50s | |
| 22m 15s | |
| 34m 51s | |
| 26m 51s | |
| 16m 37s | |
| 35m 37s | |
| 26m 54s | |
| 17m 52s | |
| 35m 23s | |
| 26m 54s | |
| 18m 45s | |
| 34m 7s | |
| 27m 59s | |
| 19m 29s | |
| 36m 5s | |
| 26m 58s | |
| 19m 44s | |
| 30m 15s | |
| 24m 8s | |
| 22m 59s | |
| 41m 1s | |
| 31m 54s | |
| 21m 34s | |
| 36m 6s | |
| 26m 51s | |
| 16m 1s | |
| 36m 20s | |
| 28m 4s | |
| 16m 57s | |
| 36m 7s | |
| 26m 51s | |
| 17m 36s | |
| 34m 59s | |
| 27m 1s | |
| 17m 14s | |
| 36m 28s | |
| 26m 51s | |
| 18m 12s | |
| 19h 0m 44s |