Add a new type of criteria representing the cost level of the mnodel

[gplanchat]

In the decision tree, there are 4 criteria CapabilityCriteria, ProviderCriteria, PrivacyCriteria, FeatureCriteria. Those are mostly technical criteria.

In some situations, we need to decide depending on the cost of a model. Having a CostCriteria with 4 values could do the job. Values could be FREE, CHEAP, AVERAGE, EXPENSIVE.

[wachterjohannes]

@gplanchat this makes toally sense. you can add it when you want! But what i see is that also "OLLAMA" is not totally free because the hotting costs are high. but from the developer purpose the cost per request is nearly zero so toally OK

[gplanchat]

But what i see is that also "OLLAMA" is not totally free because the hotting costs are high.

My reasoning comes from the fact there are some partnership programs for startups, where cloud hyperscalers give 10s thousands of dollars of cloud credits for free. Free seems more appropriate in those situations.