Original release notes
vocab : refactor normalizer flags into options struct, add strip_accents (#24371)
- vocab : refactor normalizer flags into options struct, add strip_accents
- Update src/llama-vocab.h
Co-authored-by: Sigbjrn Skjret
- Update src/llama-vocab.cpp
Co-authored-by: Sigbjrn Skjret
---------
Co-authored-by: Sigbjrn Skjret
UI:
