Synth AI
HomeResearchEvalsContributionsBlogDocsSign in
← All challenges

NanoClassify · Banking77

Submissions

Receipt-backed Banking77 development results. 400 fixed examples; higher is better.

Start a submission ↗

Current record · Accuracy

87.75%

Tinker SFT + CISPO v5by Synth

87.00%87.25%87.50%87.75%88.00%#1Tinker SFT v1: 87.50%#2Tinker SFT + CISPO v5: 87.75%

Tinker SFT + CISPO v5

GPT-OSS-20B · 64 rollouts · 50 updates · Not recorded train time · Not recorded cost

87.75% · Evidence ↗

Stepped line = best result so far · dots = evaluated submissions · zoomed scale

Leaderboard

Existing entries predate the PR submission flow, so their source link points to the public-release commit. New entries link their submission PR.

The base-model reference used the original random 400-example evaluation, not the later fixed development sample, so it is shown unranked.

RankSubmissionAccuracyMacro-F1Train timeCostSubmitterSource
1Tinker SFT + CISPO v5GPT-OSS-20B · 64 rollouts · 50 updates87.75%86.78%Not recordedNot recordedSynthCommit ↗
2Tinker SFT v1GPT-OSS-20B · rank-16 LoRA · 100 updates87.50%86.29%7m 32sNot recordedSynthCommit ↗
ReferenceGPT-OSS-20B base modelUntrained reference · original random 400-example evaluation83.75%82.73%No trainingNot recordedSynthReceipt ↗
© 2026 SynthChangelogOpen sourceDocs