Event
MetaDecision from Meta-Task Lab Enters Top Three on JevBench Open-Source Leaderboard
1 reports · 1 sources
MetaDecision, the structured decision model from Meta-Task Lab, has entered the top three on the JevBench decision model evaluation leaderboard: as of October 17, among the 129 open-source systems ranked, its 31B version ranks 3rd, and its 12B version ranks first among models of the same size. According to the leaderboard's GPU measurements, the 31B version's median latency for a single judgment is under 0.2 seconds (excluding network).
Report timeline
- MetaDecision enters JevBench open-source top three: 31B version has median single-decision latency under 0.2 seconds
MetaDecision, the structured decision model from MetaDecision Lab, has entered the top three on the JevBench decision model evaluation leaderboard: as of October 17, among 129 open-source systems, its 31B version ranks 3rd, and its 12B version ranks first among models of the same size. According to the leaderboard's GPU measurements, the 31B version has a median single-decision latency of under 0.2 seconds (excluding network). MetaDecision is an AI lab focused on Agent Infra and decision models, offering an embeddable Agent runtime foundation as well as knowledge and model services.
36Kr Embodied Intelligence ·