Use a 3-party openai provider.
It seems that the latest Wingpro version still doesn't let me use a 3-party openai provider, say, this one.
1 Answer
- Sort by
oldest newest most voted
0
No, indeed, we haven't had time to work on this or adding support for any other AI provider yet. Do you happen to know if there's a way to trick the official OpenAI API into using the one you want? If so, it might not be hard to modify the files in plugin/ai in your Wing installation. If you send us those mods we can try to get them into our code base in some form.
Comments
When you look at adding other AI providers, could you consider starting with Ollama? It's trivial to install, uses both a simple OpenAI compatible REST interface or command line and, perhaps most importantly, allows the LLM to be run on the users machine. I can see many people preferring to run their own LLM so that their code isn't being transferred to a third party. If you use the REST interface and allow the user to change the machine and port it uses, then a company could even set up Ollama on one machine and share it to all programmers with practically no effort.
Yes, that's at the top of our list for other AI providers, for the reasons you highlight. Thanks!
Any updates on this? It would be a game-changer :)
We did look at doing this but the results obtained from locally run models was so bad that we paused work on this until they work better. Have you had decent results from any of the locally run models? If so, which one?
Your Answer
Please start posting anonymously - your entry will be published after you log in or create a new account.
This space is reserved only for answers. If you would like to engage in a discussion, please instead post a comment under the question or an answer that you would like to discuss.
Comments