LLM Speedtest
name: llm-speedtest
by chapati23 · published 2026-03-22
$ claw add gh:chapati23/chapati23-llm-speedtest---
name: llm-speedtest
version: 1.0.0
description: "Ping major LLM providers in parallel and compare real API latency. Run with /ping"
metadata:
category: utility
capabilities:
- api
dependencies: []
interface: shell
openclaw:
emoji: "⚡"
requires:
env:
- ANTHROPIC_API_KEY (optional)
- OPENAI_API_KEY (optional)
- GEMINI_API_KEY (optional)
- MINIMAX_API_KEY (optional)
- XAI_API_KEY (optional)
author:
name: chapati23
---
# LLM Speedtest
Ping major LLM providers in parallel and compare real API latency (TTFT).
When to Use
How It Works
Runs `scripts/ping.sh` which:
1. Retrieves API keys from `pass shared/` (users may need to adapt key sourcing for their setup)
2. Fires parallel `curl` requests to each provider with a minimal prompt ("hi", `max_tokens=1`)
3. Measures total round-trip time per provider
4. Sorts results by latency and displays with color badges
Output Format
Results are sorted fastest-to-slowest with color badges:
Example:
⚡ Model Latency — 14:32
🟢 `Gemini 412ms`
🟢 `GPT-4o 623ms`
🟢 `Sonnet 891ms`
🟡 `Grok 2104ms`
🟡 `MiniMax 3210ms`
🟡 `Opus 4102ms`
_real API latency (TTFT)_Models Tested
| Provider | Model |
|----------|-------|
| Anthropic | Claude Sonnet 4 |
| Anthropic | Claude Opus 4 |
| OpenAI | GPT-4o-mini |
| Google | Gemini 2.5 Flash |
| MiniMax | MiniMax-M1 |
| xAI | Grok 3 Mini Fast |
Cost
~$0.0001 per run (1 token per model, cheapest tiers).
Note
This skill uses `pass shared/` for API key retrieval. If you don't use `pass`, you'll need to adapt `scripts/ping.sh` to source keys from environment variables or another secret manager.
More tools from the same signal band
Order food/drinks (点餐) on an Android device paired as an OpenClaw node. Uses in-app menu and cart; add goods, view cart, submit order (demo, no real payment).
Sign plugins, rotate agent credentials without losing identity, and publicly attest to plugin behavior with verifiable claims and authenticated transfers.
The philosophical layer for AI agents. Maps behavior to Spinoza's 48 affects, calculates persistence scores, and generates geometric self-reports. Give your...