In development — early access opens with Phase 1
Feldspar
Start any open-source model with no server of your own. Plug in the guardrails, tools, and RAG connectors you need from the marketplace.
curl $FELDSPAR_URL/v1/chat/completions \
-H "Authorization: Bearer $FELDSPAR_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "meta-llama/Llama-3.3-70B-Instruct",
"messages": [
{ "role": "user", "content": "Summarize this ticket." }
]
}'- open
"model": "meta-llama/Llama-3.3-70B-Instruct" - open
"model": "Qwen/Qwen2.5-72B-Instruct" - closed
"model": "anthropic/claude-opus-5"
One parameter changes. Nothing else in your code does.
Three ways to run a model
You pick the trade-off between cold starts and idle cost. Feldspar does not rent you a dedicated GPU unless you ask for one.
| Mode | Behavior | You pay |
|---|---|---|
| Shared | Popular models stay loaded on shared GPUs. No cold start. | Per token |
| Serverless dedicated | The model loads on demand and scales to zero. Cold starts occur. | Per GPU second |
| Always-on dedicated | The GPU stays on. For steady volume or privacy requirements. | GPU cost plus markup |
LoRA adapters run against a shared base model, so many adapters sit on one GPU. Rates are not published yet — see the roadmap below.
What happens to a request
Plugins run inside the request pipeline, not beside it. Every step is one you can see, time, and turn off.
- Gatewayauth · rate limit · balance
- Input guardrailsplugin
- RAGplugin
- Modelopen or closed
- Toolsplugin
- Output guardrailsplugin
Third-party plugins run in a sandbox and declare their permissions: network access, data access, and cost per call. The dashboard shows the latency and cost each one adds.
Harnesses, not glue code
The parts everyone rebuilds — a PII filter, a retrieval connector, an eval — attach to a deployment instead of living in your application.
Guardrails
PII filter · prompt-injection filter · content safety · topic limits
Tools
Web search · database query · code run · MCP servers
RAG connectors
Google Drive · Notion · S3 · websites · SQL
Evaluators
Hallucination check · groundedness score · regression tests
Harness templates
Prompt, tools, guardrails, and RAG preassembled into one setup
First-party plugins ship before the marketplace opens to other publishers. Tools use MCP rather than a proprietary interface.
Three tiers, metered per unit
Metering is per token for inference, per second for GPU time, per call for plugins, and per GB for RAG storage and embeddings.
BYOK
Connect your own provider key and pay the provider directly. Feldspar charges a flat monthly fee for the software layer.
Managed
Buy prepaid credits. Feldspar supplies model access and meters what you use.
Enterprise
Invoiced billing, custom contract, private deployment.
Rates are not set. We would rather publish nothing than publish a number we intend to change.
What exists, and what does not
Feldspar is being built in the open. This is the whole roadmap, not the parts that sound finished.
- Phase 1Building now
5 to 10 open-source models on serverless GPUs. Closed models through BYOK. The unified API. First-party guardrails and tools. Prepaid credits, a usage dashboard, and encrypted key storage.
- Phase 2Next
Managed RAG as plugins. Shared GPUs for the most-used models. Custom Hugging Face model IDs. Spend caps.
- Phase 3Planned
Open marketplace: plugin SDK, review process, publisher payouts. Harness templates. Fine-tuning presets.
- Phase 4Planned
Invoiced billing. SOC 2. Private deployment. Team roles.