Tier-A agreement scorecard

Two INDEPENDENT human transcriptions of the same song, same stream extraction, agreement = sequence-alignment score (best of 12 chroma rotations for pitch streams; melodic streams compare directed deltas). Containment = matches / shorter length (scope-free); identity = 2·matches / total. Deterministic extraction ⇒ disagreement is human transcription variance seen through the extraction lens. Generated 2026-08-07 07:49 from runs/scorecard.json · back to index

Containment

stream	pairs	mean	median	p10	≥0.96	≥0.889
chords (with quality)	4,078	0.524	0.494	0.167	11.9%	15.6%
chords (roots only)	4,078	0.690	0.719	0.331	20.1%	29.2%
bass	2,861	0.791	0.875	0.444	34.7%	47.4%
vocal	586	0.701	0.743	0.317	23.4%	33.8%
keys	377	0.631	0.783	0.099	43.2%	46.4%
drums	4,898	0.487	0.480	0.007	13.7%	20.6%

Identity

stream	pairs	mean	median	p10	≥0.96	≥0.889
chords (with quality)	4,078	0.404	0.341	0.083	7.0%	9.9%
chords (roots only)	4,078	0.531	0.509	0.155	9.3%	15.8%
bass	2,861	0.632	0.684	0.184	18.0%	29.0%
vocal	586	0.610	0.620	0.180	17.1%	26.8%
keys	377	0.561	0.571	0.058	39.8%	42.2%
drums	4,898	0.429	0.367	0.006	10.6%	16.6%

Distributions (containment)

chords (with quality) — containment (4,078 pairs)

chords (roots only) — containment (4,078 pairs)

bass — containment (2,861 pairs)

vocal — containment (586 pairs)

keys — containment (377 pairs)

drums — containment (4,898 pairs)

20 lowest substantial chord pairs (roots containment, min_len ≥ 30)

Mostly correctly-labeled same-song pairs, skewed acoustic/folk — consistent with strummed-chords vs fingerpicked transcription styles diverging at the chord-event level. One junk label visible. Interpretation of the 96% bar against these distributions is the open discussion item.

containment	vault side	ladder side	min len
0.00	Jaromír Nohavica - Kometa	Jaromír Nohavica - Kometa	88
0.03	Raul Seixas - O Trem Das Sete	Raul Seixas - O Trem Das Sete	33
0.03	Weezer - Pig	Weezer - Pig	63
0.05	Adele - Make You Feel My Love	Adele - Make You Feel My Love	65
0.05	Akon - Ghetto	Akon - Ghetto	98
0.06	John Mayer - Queen Of California	John Mayer - Queen Of California	161
0.06	Bob Marley - One Drop	Bob Marley - One Drop	120
0.06	[[[[test]]]] - [[[[test]]]]	_Test_ - _Test_	102
0.06	Neil Young - Sugar Mountain	Neil Young - Sugar Mountain	119
0.08	Nick Drake - Northern Sky	Nick Drake - Northern Sky	78
0.09	Marshall Crenshaw - crying waiting hoping	Marshall Crenshaw - Crying Waiting Hoping	92
0.09	Sade - like a tattoo	Sade - Like a Tattoo	65
0.10	Leo Sayer - More Than I Can Say	Leo Sayer - More Than I Can Say	62
0.10	The Cure - One Hundred Years	The Cure - One Hundred Years	102
0.10	Udo Jürgens - Griechischer Wein	Udo Jürgens - Griechischer Wein	118
0.10	John Martyn - May You Never	John Martyn - May You Never	78
0.10	Geraldo Vandré - Pra Não Dizer Que Não Falei Das Flores	Geraldo Vandré - Pra Não Dizer Que Não Falei Das Flores	117
0.10	Kenny Rogers - The Gambler	Kenny Rogers - The Gambler	87
0.10	Bob Dylan - Corrina, Corrina	Bob Dylan - Corrina, Corrina	58
0.11	The Hollies - He Ain't Heavy, He's My Brother	The Hollies - He Ain't Heavy, He's My Brother	95