Educational content, tutorials and insights on the future of AI infrastructure.

AI

How to build an AI Agent for Health Advice

Learn how to build an AI agent based on the NHS Health A-Z Data that makes it easy to find answers to health and medical queries.

AI

Unlocking Data Privacy for Enterprise AI - Data Safe Fine-Tuning and Training

Explore how enterprises can leverage sensitive datasets for AI training while ensuring data privacy through techniques like Differential Privacy.

AI

Accelerate Llama 3.1 8B Instruct Inference with TensorRT LLM

An end to end Tutorial using Ori's Virtual Machines, Llama3.1 8B Instruct, and FastAPI for speedy batch inference with TensorRT LLM.

AI

Benchmarking Llama 3.1 8B Instruct on Nvidia H100 and A100 chips with the vLLM Inferencing Engine

Benchmarking llama 3.1 8B Instruct with vLLM using BeFOri to benchmark time to first token (TTFT), inter-token latency, end to end latency, and...

AI

An introduction to AI agents

Agentic AI is the next frontier in AI adoption. Discover more about AI agents in this blog post: what are they, types of agents, benefits, AI agents...

AI

How to Perform a Cost-per-Token Analysis of Self-Hosted LLMs Using BeFOri: DBRX from Databricks

Discover how to use BeFOri to calculate a cost per input and output token for self hosted models and apply this methodology to the DBRX Base model...

AI

How to run Snowflake Arctic Model Inference on NVIDIA H100s

Ready to experience the Snowflake-Arctic-instruct model with Hugging Face? In this blog we are going to walk you through environment setup, model...

AI

Unveiling a New Benchmarking Framework from Ori

Access BeFOri for LLama2 and LLama3 Benchmarks on Nvidia V100s and H100 Chips

Blog Post

How to Merge Models for Code-Generating LLMs

Generative AI coding is a powerful assistant for software developers. Mergekit offers an easy way to blend pre-trained code LLMs and create your own...

AI

Choosing between NVIDIA H100 vs A100 - Performance and Costs Considerations

When should you opt for H100 GPUs over A100s for ML training and inference? Here's a top down view when considering cost, performance and use case.

Blog Post

How to Navigate a Global GPU Shortage & Scale AI Workloads

A global GPU shortage and rogue compute costs can threaten to sink even the best AI project’s go-to-market plans. How can AI teams navigate around...

Blog Post

AI at Scale: Deploy LLMs like Code Llama on Any Cloud

Follow this step-by-step guide to quickly deploy Meta’s Code Llama and other open-source Large Language Models (LLMs), using Python and Hugging Face...