Verified before it sends.

An OpenAI-compatible API for open-weight models inside trusted execution environments (TEEs). The SDK verifies the enclave's remote attestation, then encrypts each request to it. One key also calls frontier models in ZDR and Open, through OpenRouter.

›ai.chat.completions.create(…)

Enclave
Verified
Encryption
HPKE · AES-256-GCM
Thinkr sees
Ciphertext

Your OpenAI code, on private inference.

Swap the client for the Thinkr SDK, and keep the rest of your code.

  • OpenAI-compatible

    The request and response formats of the OpenAI API, streaming included, so existing code moves over with a new client. ZDR and Open take plain JSON from any OpenAI client.

  • Verified before it sends

    In Private mode, the SDK verifies the enclave's remote attestation against its published measurement, and sends nothing if the verification fails.

  • Encrypted to the enclave

    In Private mode, each request is encrypted with Hybrid Public Key Encryption (HPKE) to a key that only the enclave holds, so every server on the way sees ciphertext.

  • Tool calling

    Models call your functions and APIs, so agents and workflows run on private inference too.

  • Vision

    Send images and screenshots to the models that read them.

  • Structured outputs

    Ask for JSON that follows your schema, ready for the next step of your code.

  • OpenAI
  • DeepSeek
  • Moonshot AI
  • Z.ai
  • Google
  • Meta

What protects a request in Private mode.

API
OpenAI-compatible
Encryption
HPKE, RFC 9180
Cipher
AES-256-GCM
CPU
AMD SEV-SNP · Intel TDX
GPU
NVIDIA, confidential computing
Verification
Remote attestation
Verified by
The SDK
Failed verification
Nothing sent
Thinkr sees
Ciphertext

Open-weight models, ready to call.

Every model of the private lane, with its context window and what it can do. GET /v1/models also lists the frontier models of ZDR and Open.

ModelContextCan
GPT-OSS 120B131KThinking
DeepSeek V4.1 Flash1MImages · Thinking
Kimi K3256KImages · Thinking
GLM-5.31MThinking
Gemma 4 31B256KImages · Thinking
Llama 3.3 70B128KText

More for builders.

Build on private inference.

Get an API key