Initial batched inference using llama_batch
parent
6d17f002
No related branches found
No related tags found
Showing
- java/src/org/futo/inputmethod/latin/xlm/LanguageModel.java 6 additions, 4 deletionsjava/src/org/futo/inputmethod/latin/xlm/LanguageModel.java
- native/jni/org_futo_inputmethod_latin_xlm_LanguageModel.cpp 313 additions, 24 deletionsnative/jni/org_futo_inputmethod_latin_xlm_LanguageModel.cpp
- native/jni/src/ggml/LanguageModel.cpp 10 additions, 5 deletionsnative/jni/src/ggml/LanguageModel.cpp
- native/jni/src/ggml/LanguageModel.h 9 additions, 4 deletionsnative/jni/src/ggml/LanguageModel.h
Please register or sign in to comment