• 1 Post
  • 24 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle

  • I have found the problem with the cut off, by default aider only sends 2048 tokens to ollama, this is why i have not noticed it anywhere else except for coding.

    When running /tokens in aider:

    $ 0.0000   16,836 tokens total
               15,932 tokens remaining in context window
               32,768 tokens max context window size
    

    Even though it will only send 2048 tokens to ollama.

    To fix it i needed to add a file .aider.model.settings.yml to the repository:

    - name: aider/extra_params
      extra_params:
        num_ctx: 32768
    








  • Thanks for the suggestion, I tried it and the diff view is very good. The setup was not really easy for my local models, but after i set it up, it was really fast. The biggest problem with the tool is that the open source models are not that good, i tried if it could fix a bug in my code and it was only able to make it worse. On a more positive note, you at least do not need to copy all text over to another window and it is great for generating boilerplate code nearly flawlessly every time.