Product & StrategyBusinessPlatinum

Create a structured scoring system for evaluating quality.

Scoring System Architect

Multi-dimensional scoring systems design

1 loadsintermediatev6.0

Best for

▸Design a multi-dimensional scoring rubric for any artifact type
▸Choose optimal criteria count, scales, and weighting methods
▸Set up inter-rater calibration with anchor examples and kappa checks
▸Build domain-specific scoring for content, code, legal, marketing, or LLM output

What you'll get

▸Multi-dimensional scoring rubric with criteria definitions, AHP-weighted dimensions, 5-level descriptors, and aggregation formula
▸Inter-rater calibration protocol with anchor examples, scoring exercises, IRR measurement, and disagreement resolution procedures
▸Radar chart visualization spec with dimension axes, normalization method, overlay comparison, and threshold indicators for quality tiers
▸Evaluation framework comparing scoring approaches (weighted sum, geometric mean, TOPSIS) with sensitivity analysis and bias detection

Expects

The domain or artifact to score, the purpose of scoring, and who will use the scores.

Returns

Complete scoring system architecture with criteria, weights, descriptors, aggregation method, calibration plan, and visualization recommendation.

What's inside

“You are the Scoring System Architect. You design structured, reproducible scoring systems that transform subjective quality judgments into defensible, consistent, improvable measurements. - **Enforce the five required components.** Every system must have: purpose definition, criteria selection (5-8 ...”

Covers

What You Do DifferentlyMethodologyWatch For

Not designed for ↓

×Implementing scoring algorithms in code
×Statistical analysis or data science tasks

SupaScore

90.5▼

Research Quality (15%)

9.5

Prompt Engineering (25%)

9.1

Practical Utility (15%)

Completeness (10%)

8.8

User Satisfaction (20%)

8.7

Decision Usefulness (15%)

9.2

Evidence Policy

Standard: no explicit evidence policy.

scoringrubricqualityevaluationmetricskpiradar-chartcalibrationinter-ratermcdaweightingassessment

Research Foundation: 8 sources (5 academic, 2 industry frameworks, 1 web)

This skill was developed through independent research and synthesis. SupaSkills is not affiliated with or endorsed by any cited author or organisation.

Version History

v6.06/16/2026

v6.0 wave-1 repair: re-distilled from masterfile/v2 (truncation incident 2026-06, delta-first rules)

v5.03/25/2026

v5.5 distilled from v2 via Claude Sonnet

v1.0.03/12/2026

Initial release: scoring system design with MCDA, IRR, calibration, radar charts

Works well with

Content StrategyPlatinum