Fronset Benchmark

Meta Muse Spark 1.2 (archived)

Provider
OpenRouter
Model name
meta/muse-spark-1.2
Last benchmarked
Qualified on
21 / 52 tasks (at the 90% bar)
Best value on
0 tasks

Good enough on 21/52 tasks at the 90% bar. Best value on 0 tasks. Best fit for: Infrastructure & Utility, Relevance, Classification & Matching, Social & Promotional Content, Topic Organization & Clustering.

Cost vs quality across all tasks, as of 5 September 2026

0%25%50%75%100%78910Quality score (7–10)Cost-efficiency vs best value (1.0 = best value)Thematic Topic Discovery — quality 7.85, 10.8x the cost of the best-value good-enough optionAuthoritative Source Selection — quality 8.14, 14.8x the cost of the best-value good-enough optionCommunity Content Promotion Generation — quality 8.07, 10.7x the cost of the best-value good-enough optionBatch Text Translation — quality 8.93, 16.1x the cost of the best-value good-enough optionTopic Cluster Labeling — quality 8.48, 6.0x the cost of the best-value good-enough optionVoice Profile Generation — quality 9.72, 12.2x the cost of the best-value good-enough optionTopic Section Assignment — quality 8.01, 42.6x the cost of the best-value good-enough optionPublication Title Package Generation — quality 8.55, 9.5x the cost of the best-value good-enough optionSocial Post Portfolio Selection — quality 8.52, 88.4x the cost of the best-value good-enough optionStructured Content Summarization — quality 8.98, 26.4x the cost of the best-value good-enough optionFactual Claim Refinement — quality 8.87, 26.0x the cost of the best-value good-enough optionResearch Query Validation — quality 8.31, 21.2x the cost of the best-value good-enough optionPersona Policy Eligibility Check — quality 8.92, 23.8x the cost of the best-value good-enough optionShort Promotional Teaser Generation — quality 8.40, 27.8x the cost of the best-value good-enough optionMulti Perspective Decision Synthesis — quality 8.16, 12.9x the cost of the best-value good-enough optionLanguage Identification — quality 9.80, 27.5x the cost of the best-value good-enough optionProfiled Document Section Analysis — quality 8.61, 12.6x the cost of the best-value good-enough optionEngagement Opportunity Triage — quality 8.65, 20.0x the cost of the best-value good-enough optionTopic Taxonomy Matching — quality 8.33, 11.5x the cost of the best-value good-enough optionProfile Pool Matching — quality 8.48, 15.9x the cost of the best-value good-enough optionPromotional Message Generation — quality 8.28, 12.6x the cost of the best-value good-enough option

within ~1.3× of the best-value model · 1.3–2× · >2× · ★ this model is the best-value pick on that task. Top-right = best quadrant. Only tasks where this model qualifies at the 90% bar are plotted.

Per-task breakdown, as of 5 September 2026

TaskCategoryQuality (% of best)ConfidenceOverpay
Topic Cluster LabelingTopic Organization & Clustering95%HIGH6x
Publication Title Package GenerationContent Summarization & Synthesis93%RANKED9.5x
Community Content Promotion GenerationSocial & Promotional Content93%MEDIUM11x
Thematic Topic DiscoveryTopic Organization & Clustering92%MEDIUM11x
Topic Taxonomy MatchingRelevance, Classification & Matching99%MEDIUM11x
Voice Profile GenerationLong-form Content Generation99%HIGH12x
Promotional Message GenerationSocial & Promotional Content95%HIGH13x
Profiled Document Section AnalysisFinancial Analysis & Trading Decisions94%MEDIUM13x
Multi Perspective Decision SynthesisFinancial Analysis & Trading Decisions92%HIGH13x
Authoritative Source SelectionRelevance, Classification & Matching93%HIGH15x
Profile Pool MatchingRelevance, Classification & Matching96%MEDIUM16x
Batch Text TranslationInfrastructure & Utility95%HIGH16x
Engagement Opportunity TriageRelevance, Classification & Matching98%RANKED20x
Research Query ValidationInfrastructure & Utility95%MEDIUM21x
Persona Policy Eligibility CheckRelevance, Classification & Matching97%HIGH24x
Factual Claim Refinement bestInfrastructure & Utility100%MEDIUM26x
Structured Content SummarizationContent Summarization & Synthesis97%HIGH26x
Language IdentificationRelevance, Classification & Matching97%MEDIUM28x
Short Promotional Teaser GenerationSocial & Promotional Content96%HIGH28x
Topic Section AssignmentTopic Organization & Clustering91%MEDIUM43x
Social Post Portfolio SelectionRelevance, Classification & Matching97%HIGH88x

Overpay — how much more you pay by running this model instead of the best-value model that clears the quality bar on that task (marked ★). "16x" means you overpay 16× — the same output for 16× the best-value good-enough option; ★ means this model is that option (no overpayment). Confidence — how sure we are about the quality score (more judgments + more agreement = higher confidence): RANKED many independent judges scored this model's outputs and their agreement is very high (most confident) — HIGH many judges have scored it and they mostly agree (well-pinned) — MEDIUM enough judges have weighed in to publish, but they disagree more than we'd like (treat with a small grain of salt). LOW-confidence cells are hidden everywhere on the site. See the methodology for the exact thresholds.