LLM API / Gateway

Optionally, you can configure Neural Inverse to use an external LLM API or gateway for add-on features. Neural Inverse tracing does not need access to the LLM API as traces are captured client-side.

Supported LLM APIs

Neural Inverse supports:

• OpenAI
• Azure OpenAI
• Anthropic
• Google Vertex
• Amazon Bedrock

Via the OpenAI API, many other LLM services and proxies can be used.

Features powered by LLM API

• Playground
• LLM-as-a-Judge Evaluation
• Prompt Experiments

---

---