Educational content, tutorials and insights on the future of AI infrastructure.

Tutorial

How to run Qwen 3 235B on a cloud GPU

Discover how to deploy Qwen 3 235B model with Ollama and OpenWebUI on a cloud GPU and check out our model analysis.

Tutorial

How to run Llama 4 on a cloud GPU with Transformers and vLLM

Learn how to run Meta’s multimodal Llama 4 models with Hugging Face Transformers and vLLM on an Ori cloud GPU, and check our comparison of Llama 4 vs...

Tutorial

How to deploy an interactive chatbot with Ori Inference Endpoints and Gradio

Learn how to deploy chatbots based on LLMs with Ori Inference Endpoints and Gradio

Tutorial

How to run Mistral Small 3 on a cloud GPU with vLLM

Discover how to easily deploy Mistral Small 3 on a cloud GPU with vLLM and our model analysis with verbal, math and coding prompts.

Tutorial

How to run DeepSeek R1 on a cloud GPU with Ollama

Learn how to easily deploy DeepSeek R1 Distill 70B on an H100 GPU with Ollama and OpenWebUI, plus our thoughts about the model and its innovative...

AI

Accelerate Llama 3.1 8B Instruct Inference with TensorRT LLM

An end to end Tutorial using Ori's Virtual Machines, Llama3.1 8B Instruct, and FastAPI for speedy batch inference with TensorRT LLM.

Tutorial

How to run Llama 3.3 70B on a cloud GPU

Learn how to deploy Meta’s new text-generation model Llama 3.3 70B with Ollama and Open WebUI on an Ori cloud GPU.

Tutorial

How to run Genmo Mochi 1 video generation on a cloud GPU

Discover how to deploy Genmo Mochi 1 with ComfyUI on an Ori GPU instance, and read our analysis of this new open source video generation model.

Tutorial

How to run Llama 3.2 11B Vision with Hugging Face Transformers on a cloud GPU

Learn how to deploy Meta’s multimodal Lllama 3.2 11B Vision model with Hugging Face Transformers on an Ori cloud GPU and see how it compares with...

Tutorial

How to run Pixtral 12B on a cloud GPU with vLLM

Discover how to get Mistral’s new multimodal LLM, Pixtral 12B up and running on an Ori cloud GPU.

Tutorial

How to run Flux.1 image generation on Ori cloud GPUs

Learn how to deploy Flux.1 image generation on the Ori GPU cloud. This tutorial will demonstrate how to create images with Flux's open source...

Blog Post

How to Merge Models for Code-Generating LLMs

Generative AI coding is a powerful assistant for software developers. Mergekit offers an easy way to blend pre-trained code LLMs and create your own...