CORS for Local LLM Providers

Cross-origin resource sharing (CORS) is a mechanism for integrating applications. CORS defines a way for client web applications that are loaded in one domain to interact with resources in a different domain. This configuration is needed to allow local model providers to server web-applications what were loaded from a different site.

Local Ollama Server

If you want to use Ollama local OpenAI compitable API through a browser based tool, you need to allow CORS. Follow these instructions https://objectgraph.com/blog/ollama-cors/

Local LM Studio

Enable CORS in the server settings: