Limiting Context Size

[tom-doerr]

Almost all of the inference cost seems to come from the huge context. Is all of that really needed or could it be reduced somehow?

[tobitege]

OpenDevin does have a mechanism to condense the overall history of the chat session.
In practice I'd recommend to just start a new task, whenever you feel it's appropriate to "clear out" the built up history.