Launched this week
Megaton Monitor
AI video benchmarks, leaderboards and industry news
189 followers
AI video benchmarks, leaderboards and industry news
189 followers
Monitor is a comprehensive set of evaluations for video models aimed at creative teams looking at qualitative measures. Things such a visual fidelity, cinematography a well as industry specific metrics like copyright compliance and diversity measures. We aim to be the bloomberg of video ai!
Megaton Mask
Burner
To add to the point about the ecosystem moving fast — the qualitative measures angle is what makes this stand out to me. Most benchmarks I've seen lean heavily on technical metrics, but "does this actually look cinematic" is often the real question creative teams are asking. Curious how you're handling the subjectivity there — is it human eval panels, or are you using AI judges for things like cinematography scores?
Megaton Mask
@wcrtr human judges! The subjective measures are scored against a rubric. They're evaluated by entertainment industry / hollywood visual effects pros.
@sherif_higazy1 The video AI ecosystem is moving so fast that it’s difficult to know which models actually perform better. Having benchmarks and leaderboards in one place makes a lot of sense. Congrats on launching
Megaton Mask
@josh_bennett1 - thanks for taking the time josh!
Looks great!
Megaton Mask
@tom_chapoton thank you! appreciate you checking us out :)
let me know if you have any feedback?