O

    OVHcloud AI Endpoints

    Serverless AI inference platform providing API access to open-source LLMs and image generation models on sovereign European infrastructure.

    FRFrance·Founded 1999
    Headquarters
    🇫🇷France
    Data Hosting
    GermanyFrance
    Structure
    Independent
    Compliance
    ▣GDPR◆EU HQ▦EU Data

    OVHcloud AI Endpoints key facts

    Last updated
    Legal entity
    OVH Groupe SAS
    Headquarters
    France (FR)
    Ownership
    Part of OVHcloud (OVH Groupe SAS)
    Founded
    1999
    Data hosting
    Germany, France, United Kingdom, Poland
    Infrastructure
    Self-hosted (OVHcloud)
    Open source
    No
    US Cloud Act exposure
    Low (no US parent)
    Certifications
    ISO 27001, ISO 27017, ISO 27018, SOC 1 Type II, SOC 2 Type II, PCI DSS, HDS (Health Data Hosting)
    Replaces
    Replicate, Together AI, Groq, Fireworks AI, AWS Bedrock, Google Vertex AI, Azure OpenAI, Hugging Face Inference Endpoints

    About OVHcloud AI Endpoints

    OVHcloud AI Endpoints, part of the OVHcloud Labs experimental suite, provides developers and enterprises with a managed, serverless infrastructure for deploying and querying large language models (LLMs) and diffusion models. It focuses on offering a European-governed alternative to US-based AI providers, ensuring that data processing remains within the EEA. The service emphasizes ease of use, allowing users to generate API endpoints for models like Mistral AI and Meta's Llama in seconds without managing underlying GPU clusters or hardware. The platform is built on OVHcloud's proprietary public cloud ecosystem, utilizing NVIDIA H100 and A100 GPUs. It is designed for production-grade throughput, supporting scaling up to 1,000+ tokens per second. By providing an OpenAI-compatible API, it allows for easy migration from other platforms while maintaining a focus on digital sovereignty and GDPR compliance. It is particularly targeted at B2B customers in regulated sectors who require performance without vendor lock-in or exposure to the US Cloud Act.

    Alternative to

    Hosting & Security

    Infrastructure

    Self-hosted (OVHcloud)

    Certifications
    ISO 27001
    ISO 27017
    ISO 27018
    SOC 1 Type II
    SOC 2 Type II
    PCI DSS
    HDS (Health Data Hosting)

    Key Features

    Serverless AI API endpoints
    Support for open-source models (Mistral, Llama, Gemma)
    Streaming responses for chat completions
    Image generation (Stable Diffusion XL)
    OpenAI-compatible SDK support
    Pay-as-you-go billing per million tokens/image
    No training on user data commitment
    Integrated cost calculator

    Related Articles

    All articles