This repository was archived by the owner on Sep 12, 2024. It is now read-only.
Replies: 1 comment
-
Seems rwkv.cpp will re-loading .bin from disk every time I call createCompletion |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
In the example
do we need to store the
llama
variable in global, to reuse it? Will it speedup or reduce memory usage?And I found
await llama.createCompletion
never ends, will this cause memory leak?Beta Was this translation helpful? Give feedback.
All reactions