Ollama

[lenzenc]

Is there any support for or example of custom code that can be used to call local models via Ollama?

[brynn-code]

@lenzenc Currently, promptflow only support models deployed to AML through model catalog, local model is not supported. + @prakharg-msft

[HariKunapareddy]

Any update on whether Promptflow has support for locally deployed models?

[D-W-]

Hi @HariKunapareddy , we don't have plan to support locally deployed models in the near future. Please create a feature request if there's need for it. cc: @prakharg-msft

[darrkz]

@lenzenc I think you can use some api proxy system like one-api or new-api. I use it now
or ollama new version support openai api format