Open Source Models

Open source models on Inference.net are served serverless. Call them through the OpenAI-compatible API with your Inference API key and pay per token. There is nothing to deploy.

Call an open source model

Use the model id as the model parameter, the same as any other serverless call:

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inference.net/v1",
  apiKey: process.env.INFERENCE_API_KEY,
});

const response = await client.chat.completions.create({
  model: "glm-5.2",
  messages: [{ role: "user", content: "Hello, world!" }],
});

console.log(response.choices[0].message.content);

Browse the available models at inference.net/models. See the API quickstart for full examples.

Dedicated deployments

You can also run an open source model on its own dedicated GPU — your own instance, no shared capacity. Open source catalog models with weights available are deployable through the same create-deployment flow you use for trained models: open the Create Deployment picker and select the model from the open source catalog, not just your fine-tuned models.

Bringing your own weights is supported too, via registering a Hugging Face model as a custom model first. Once registered, that model appears in the deployment picker under My Models. See Deploy a Trained Model for the create-deployment flow.