Skip to content

User customizable context window for ollama models. Compact mode for more direct answers. Other minor fixes. #632

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 82 commits into
base: master
Choose a base branch
from

Conversation

boarder2
Copy link

@boarder2 boarder2 commented Feb 15, 2025

This PR adds:

  1. User customizable setting in the UI that lets you set context windows for ollama models.
  2. Persistence for the optimization mode, and lets you change it in the middle of a chat.
  3. Fixes a bug with rewrite where assistant history wouldn't be removed for the rewritten message.

@boarder2 boarder2 changed the title User customizable context window for ollama models User customizable context window for ollama models. Compact mode for more direct answers. Other minor fixes. Feb 16, 2025
@boarder2
Copy link
Author

Here are some screenshots of the changed areas:
image
image

@ItzCrazyKns ItzCrazyKns self-requested a review May 13, 2025 17:00
@ItzCrazyKns
Copy link
Owner

Hey, thanks for the PR! I will be reviewing this over the weekend and merge it ASAP

@boarder2
Copy link
Author

Sounds good! I've gone a little ham since opening the PR and added a lot more stuff in my fork at this point. Hit me up here or on your discord if you've got any questions or things you don't fundamentally agree with. If this isn't a direction you'd like to go with this project I understand and we can close the PR and I can break my fork and continue on my own!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants