Skip to content
All tags

#openai-compatible

2 posts
ai

Groq Console: The Developer Platform for Running Open-Source Models on LPU Inference

Groq Console is the developer portal for Groq's in-house LPU chip, offering an OpenAI-compatible API, Playground, and free tier credits. Its selling point is running open-source models like Llama, Qwen, and DeepSeek at the fastest tokens/second on the market.

#groq#lpu#inference#llm#openai-compatible#developer-platform
ai guide

The Complete Ollama Guide: Run LLMs Locally with One Command

Ollama wraps llama.cpp in a Docker-style CLI + REST API, letting you run LLMs locally with a single command. This post covers core concepts, installation, API, hardware requirements, Modelfile customization, and what this tool is — and isn't — good for.

#ollama#llm#local-inference#llama-cpp#self-hosted#openai-compatible