I have found the problem with the cut off, by default aider only sends 2048 tokens to ollama, this is why i have not noticed it anywhere else except for coding.
When running /tokens
in aider:
$ 0.0000 16,836 tokens total
15,932 tokens remaining in context window
32,768 tokens max context window size
Even though it will only send 2048 tokens to ollama.
To fix it i needed to add a file .aider.model.settings.yml
to the repository:
- name: aider/extra_params
extra_params:
num_ctx: 32768
First of all i think it is a great idea to give the model access to a map. Unfortunately it seems like, that the script is missing a huge part at the end, the loop does not have any content and the Tools class is missing.