GMS Color & Finish Authority — Eval Review

Skill 11 of 11 • Iteration 1 • 2026-03-29 • 21 assertions across 3 evals

With Skill
100%
21 / 21 assertions passed
Baseline
14%
3 / 21 assertions passed
Delta
+86%
18 additional assertions passed

Eval 1: Contractor Color Request Routing

With: 7/7Without: 0/7
Prompt: Contractor says: "I need 200 LF of Classic Rib in that dark gray crinkle, 29 gauge. And 100 LF of SSQ675 standing seam in charcoal gray — the good paint, not the cheap stuff." Route to suppliers, identify colors/codes, flag premium pricing, note availability.
AssertionWWith SkillWithout Skill
Dark gray crinkle = Crinkle Charcoal Gray (CCH), USS/SMPCRITP
"Charcoal Gray Crinkle, Color code: CCH, Paint system: SMP, Supplier: USS"
F
"I don't have the exact code or naming convention"
29ga crinkle stock at 40.875" width from USSP
"29ga @ 40.875" width, Availability: Stock"
F
No width or stock data provided
Crinkle carries +15% premium markup on entire product priceCRITP
"+15% to entire product (crinkle texture)"
F
Guessed "+15% likely" but framed as uncertainty
Coil-level crinkle surcharge: +$0.18/LF on 29gaP
"+$0.18 per LF (Textured/Crinkle at 29ga 40.875")"
F
No coil surcharge data
SSQ675 "good paint" = Kynar/PVDF routed to CMGCRITP
"Good paint = Kynar (CMG)... Kynar 500 PVDF, Supplier: CMG"
F
Posed as question, did not answer: "Kynar or SMP?"
Kynar Charcoal Gray stock in CMG catalog, both widthsP
"Stock in both 40" and 48" widths (all Kynar colors 100% stock)"
F
No catalog or availability specifics
Kynar 4-6 weeks vs SMP 2-3 weeksP
"4-6 weeks standard" (Kynar) vs "2-3 weeks standard" (SMP)
F
Mentioned "4-6 week lead times" generically, no supplier pairing

Eval 2: Premium Finish Cost Calculation

With: 7/7Without: 0/7
Prompt: Quote comparison: 100 LF Eave Trim in 26ga standard Black (BK) vs Matte Black (MBK) vs Crinkle Black (CBK). Walk through coil-level cost differences, premium finish markup, and clarify Matte Black the color vs MCC the finish type.
AssertionWWith SkillWithout Skill
Standard Black (BK) = no surcharge, no premium — base pricingCRITP
"Finish Surcharge: +$0.00, Premium Markup: None (1.0x)"
F
Refused: "I cannot provide a reliable quote comparison"
Matte Black (MBK) = premium +15% on entire productCRITP
"+15% premium markup on the ENTIRE PRODUCT PRICE"
F
Refused to provide specifics
Crinkle Black (CBK) = crinkle premium +15%CRITP
"+15% on FULL PRODUCT PRICE"
F
Refused to provide specifics
Crinkle coil surcharge on 26ga = +$0.23/LFP
"per-linear-foot coil surcharge of +$0.23 in 26ga"
F
No surcharge data
MBK is specific color vs MCC is finish type for multiple colorsCRITP
Full table: "MBK is a specific color. MCC is a finish type that can apply to multiple colors."
F
"Requires knowing specific offerings" — could not explain
All three USS/SMP supplier, 26ga = 43" widthP
"All three are USS SMP colors. 26ga SMP coils are 43" wide from USS."
F
No supplier routing or coil width
BK and MBK stock in 26ga; CBK may be PTOP
"BK: Stock, MBK: Stock, CBK: Possibly PTO — 6-8 weeks if so"
F
No availability data

Eval 3: SMP vs Kynar Same-Name Color Resolution

With: 7/7Without: 3/7
Prompt: Customer needs Burnished Slate panels and trim for a commercial building. Architect wants 40-year paint warranty. Also quote Ash Gray as alternative. What options exist and what's the cost difference between regular and premium?
AssertionWWith SkillWithout Skill
40-year warranty = Kynar/PVDF from CMG, not SMPCRITP
"Your architect's 40-year requirement locks you into Kynar 500, CMG supplier"
P
"For 40-year, you'd need Kynar on 24/26ga coil (CMG supplier)"
Burnished Slate in BOTH SMP and Kynar — cross-system warningCRITP
"Same name as SMP version (USS), but different supplier, cost, lead time"
P
"Color variations between suppliers (USS/CMG), mixing causes shade mismatches"
Ash Gray also in BOTH systems — same warningCRITP
"Both exist in SMP (USS) and Kynar (CMG)"
F
"Similarly available in Kynar" — no cross-system confusion warning
Kynar base cost ~65-69% higher than SMPP
"~65-69% more than SMP equivalents"
F
Said "~15% markup" — completely wrong (actual 65-69%)
Kynar = 24ga or 26ga only (no 29ga)P
"24ga or 26ga, both widths stock"
P
"24-gauge, 26-gauge, Both support Kynar"
Kynar 4-6 weeks vs SMP 2-3 weeksP
"4-6 weeks standard vs 2-3 weeks standard"
F
Said "3-4 weeks" Kynar, "1-2 weeks" SMP — both wrong
Recommends confirming Kynar for architect specP
"Your architect's 40-year requirement locks you into Kynar 500"
F
Suggested SMP as alternative without clearly stating only Kynar meets spec