Commits

Commits on May 8, 2024

Modify UTF-8 encoding issue in stream mode.
charlie-xing
committed
4657315

Commits on Nov 9, 2023

hide legacy http server
chiranko
committed
9f74705

Commits on Oct 22, 2023

fix infill token preprocessing
chiranko
committed
ae9ee2d

Commits on Oct 20, 2023

fix fim special token
zhuohaoyu
committed
af6f0d9

Commits on Oct 19, 2023

fix ctx size
chiranko
committed
e0c30f8
fix default temp
chiranko
committed
7382f26
modify sampling default params
chiranko
committed
1dd2968
modify n_predict default to 64
chiranko
committed
41c7956

Commits on Oct 15, 2023

add codeshell support
chiranko
committed
00e5e88

Commits on Oct 14, 2023

Honor -ngl option for Cuda offloading in llava (#3621)
monatis
authored
11dc109

Commits on Oct 13, 2023

Commits on Oct 12, 2023

CLBlast: Fix matrix-vector multiplication (#3544)
shibe2
authored
1e0e873
examples: support LLaVA v1.5 (multimodal model) (#3436)

monatis
and
ggerganov
authored
370359e
docs : fix typo GOMP_CPU_AFFINITY (#3597)
maekawatoshiki
authored
9e24cc6
cmake : fix add_compile_options on macOS
ggerganov
committed
d28e572
typo : it is `--n-gpu-layers` not `--gpu-layers` (#3592)
ianscrivener
authored
f3040be
ci : check if there is enough VRAM (#3596)
ggerganov
authored
1a8c879
server : add completion mode (no chat) (#3582)
akx
authored
b016596
prompts : add mnemonics.txt
ggerganov
committed
6b3ae4d
server : fix kv cache management (#3588)
ggerganov
authored
57dd55e

Commits on Oct 11, 2023

main : fix session loading bug (#3400)
ggerganov
committed
b8fe4b5
server : add parameter -tb N, --threads-batch N (#3584)

m18coppola
and
Michael Coppola
authored
a8bdd65
common : fix mirostat state when using multiple sequences (#3543)
KerfuffleV2
authored
70c29da
batched : add bench tool (#3545)
ggerganov
authored
8c70a5f
examples : add batched.swift + improve CI for swift (#3562)
zshannon
authored
24ba3d8

Commits on Oct 10, 2023

Add MPT model to supported models in README.md (#3574)
Galunid
authored
9f6ede1
Minor improvements in GPT2 tokenizer (#3567)
goerch
authored
233fc1c
readme : add bloom (#3570)
xingchensong
authored
c5b4936
llm : add bloom models (#3553)

xingchensong
and
ggerganov
authored
02d2875
swift : improvements and fixes (#3564)
jhen0409
authored
0aa6595
llm : add MPT support (#3417)

authored
f5f9121
infill. : fix tokenization (#3508)
vvhg1
authored
11ea5c7

Commits on Oct 9, 2023