llm-connectorRust LLM Connector

Provider abstraction for OpenAI/Anthropic/Gemini and more — streaming, tools, and multimodal.

Get Started

View on GitHub

Crates.io

Unified Streaming

One streaming model across providers with a consistent response type.

Tools / Function Calling

OpenAI-compatible tools with streaming support.

Multi-modal

Text + images in a single message block.

Provider Matrix

12+ providers with clean Protocol/Provider separation.

Install

bash

cargo add llm-connector

Quick Example

rust

use llm_connector::{LlmClient, types::{ChatRequest, Message, Role}};

let client = LlmClient::openai("sk-...")?;
let request = ChatRequest {
    model: "gpt-4".to_string(),
    messages: vec![Message::text(Role::User, "Hello!")],
    ..Default::default()
};

let response = client.chat(&request).await?;
println!("{}", response.content);