ialacol-0.10.4

What's Changed

• Reduce memory usage for large models by @chenhunghan in #61

Full Changelog: ialacol-0.10.3...ialacol-0.10.4

ialacol-0.10.3

What's Changed

• Use quay.io for storing smoke test images by @chenhunghan in #54
• Add example codellama.yaml, ctransformer to 0.2.24, refactor get_config by @chenhunghan in #59

Full Changelog: ialacol-0.10.2...ialacol-0.10.3

ialacol-0.10.2

What's Changed

• Add pythia matching, push base image to ghrc.io, remove modelMountPath/cacheMountPath, merge volumes, update README by @chenhunghan in #53

Full Changelog: ialacol-0.10.1...ialacol-0.10.2

ialacol-0.10.1

What's Changed

• Support stablecode, improve gpt-neox CI by @chenhunghan in #52

Full Changelog: ialacol-0.10.0...ialacol-0.10.1

ialacol-0.10.0

What's Changed

• Upgrade ctransformer to 0.2.22, add GPU support for StarCoder by @chenhunghan in #51

Full Changelog: ialacol-0.9.0...ialacol-0.10.0

ialacol-0.9.0

What's Changed

• Add experimental support for GPTQ models by @chenhunghan in #50

Full Changelog: ialacol-0.8.0...ialacol-0.9.0

ialacol-0.8.0

What's Changed

• Add experimental metal support by @chenhunghan in #49

Full Changelog: ialacol-0.7.3...ialacol-0.8.0

ialacol-0.7.3

What's Changed

• Fix Helm deployment template, add missing env variables, fix logger by @chenhunghan in #48

Full Changelog: ialacol-0.7.2...ialacol-0.7.3

ialacol-0.7.2

What's Changed

• Fix the cuda 12 base image by @chenhunghan in #46

Full Changelog: ialacol-0.7.1...ialacol-0.7.2

ialacol-0.7.1

What's Changed

• Fixes syntax of cuda image building CI by @chenhunghan in #41
• Fix container image building CI for CUDA 11/12 by @chenhunghan in #42
• Add missing GPU_LAYERS env in Helm template by @ktaletsk in #44

Full Changelog: ialacol-0.7.0...ialacol-0.7.1