tier-check reports 0/30 server conformance despite all tests passing

[joshrotenberg]

Summary

Running tier-check against a server that passes 30/30 conformance tests reports 0/30 (0%) server conformance.

Steps to Reproduce

# Start server (tower-mcp conformance server on port 3001)
cargo run --manifest-path examples/conformance-server/Cargo.toml &

# Regular conformance suite: 39/39 pass (30 scenarios, some with multiple checks)
npx @modelcontextprotocol/conformance@0.1.15 server --url http://127.0.0.1:3001/mcp
# Output: Total: 39 passed, 0 failed

# tier-check: reports 0/30
npx @modelcontextprotocol/conformance@0.1.15 tier-check --repo joshrotenberg/tower-mcp --conformance-server-url http://127.0.0.1:3001/mcp

Expected

tier-check should report 30/30 (100%) server conformance, matching the regular server command results.

Actual

Conformance:
                 2025-03-26 2025-06-18 2025-11-25              All*
✗ Server                  —       0/26       0/30        0/30 (0%)

Environment

• @modelcontextprotocol/conformance v0.1.15
• Server: tower-mcp conformance-server (passes all 30 scenarios / 39 checks)
• macOS, Node 20