Multi-Cloud Product Docs/API Benchmark

---

name: alicloud-platform-multicloud-docs-api-benchmark

description: Benchmark similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. Given one product keyword, auto-discover latest official docs/API links, score quality consistently, and output detailed prioritized improvement recommendations.

version: 1.0.0

---

# Multi-Cloud Product Docs/API Benchmark

Use this skill when the user wants cross-cloud documentation/API comparison for similar products.

Supported clouds

Data source policy

- GCP: Discovery API

- AWS: API Models repository

- Azure: REST API Specs repository

Workflow

Run the benchmark script:

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "<product keyword>"

Example:

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "serverless"

LLM platform benchmark example (Bailian/Bedrock/Azure OpenAI/Vertex AI/Hunyuan/Ark/Pangu):

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform"

If `--preset` is omitted, script attempts to auto-match preset based on keyword.

Scoring weights can be switched by profile (see `references/scoring.json`):

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform" --scoring-profile "llm-platform"

Optional: pin authoritative links

Auto-discovery may miss pages. For stricter comparison, pass official links manually:

python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py \
  --product "object storage" \
  --aws-links "https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html" \
  --azure-links "https://learn.microsoft.com/azure/storage/blobs/"

Available manual flags:

Each flag accepts comma-separated URLs.

Output policy

All artifacts must be written under:

`output/alicloud-platform-multicloud-docs-api-benchmark/`

Per run:

Reporting guidance

When answering the user:

1) Show score ranking across all providers.

2) Highlight top gaps (P0/P1/P2) and concrete fix actions.

3) If discovery confidence is low, ask user to provide pinned links and rerun.

Validation

mkdir -p output/alicloud-platform-multicloud-docs-api-benchmark
for f in skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/*.py; do
  python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt

Pass criteria: command exits 0 and `output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt` is generated.

Output And Evidence

Prerequisites

References