Add Jinja template support#11016

Merged

ochafik merged 47 commits intoggml-org:masterfrom

Jan 21, 2025

Commits on Dec 30, 2024

Commits on Jan 13, 2025

Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Wire LLM_KV_TOKENIZER_CHAT_TEMPLATE_N in llama_model_chat_template
ochafik
committed
Refactor test-chat-template
ochafik
committed
Test templates w/ minja
ochafik
committed
Fix deprecation
ochafik
committed
Add --jinja to llama-run
ochafik
committed
Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Update common_chat_format_example to use minja template wrapper
ochafik
committed
Test chat_template in e2e test
ochafik
committed
Update utils.py
ochafik
committed
Update test_chat_completion.py
ochafik
committed
Update run.cpp
ochafik
committed

Commits on Jan 14, 2025

Update arg.cpp
ochafik
authored
Merge remote-tracking branch 'origin/master' into jinja
Olivier Chafik
committed

Commits on Jan 18, 2025

Refactor common_chat_* functions to accept minja template + use_jinja option
ochafik
committed
Merge remote-tracking branch 'origin/master' into jinja
ochafik
committed
Attempt to fix linkage of LLAMA_CHATML_TEMPLATE
ochafik
committed
Revert LLAMA_CHATML_TEMPLATE refactor
ochafik
committed
Normalize newlines in test-chat-templates for windows tests
ochafik
committed
Forward decl minja::chat_template to avoid eager json dep
ochafik
committed
Flush stdout in chat template before potential crash
ochafik
committed
Fix copy elision warning
ochafik
committed
Rm unused optional include
ochafik
committed
Add missing optional include to server.cpp
ochafik
committed
Disable jinja test that has a cryptic windows failure
ochafik
committed
minja: fix vigogne (https://github.com/google/minja/pull/22)
ochafik
committed

Commits on Jan 20, 2025

Commits on Jan 21, 2025

Update minja to https://github.com/google/minja/pull/25
ochafik
committed
Update minja from https://github.com/google/minja/pull/27
ochafik
committed
rm unused optional header
Olivier Chafik
committed