Kirill A. Korinsky [kirill@korins.ky] wrote:
>
> Here a version where I:
> 1. added runtime dependency on textproc/ripgrep
> 2. patched required current_exe() usage
> 3. added README with sample how it can be used against llama.cpp server
>
I like this. I had done a similar README. In model_providers you should add:
headers = {}
query_params = {}
They might not break anything today but they are of no use to llama.cpp and
the future is less certain. They are designed for openai's interface.
No comments:
Post a Comment