Abstract
FVSCORE is a neuro-symbolic evaluation framework that compiles videos into prompt and implicit constraint propositions, verifies them with perceptual tools and soft temporal logic, and calibrates significant violations to produce interpretable, human-aligned feedback for video generation.
We introduce Faithfulness Video Score (FVSCORE), a neuro-symbolic framework for specification-driven video generation evaluation. Existing evaluators rely on holistic MLLM judgments or vision-language metrics, yet aligning their scores with human judgments and tracing them to specific temporal violations remain open challenges. FVSCORE addresses these limitations by compiling each video into explicit propositions capturing prompt requirements and implicit propositions capturing unstated physical, temporal, and cross-modal constraints. It grounds each proposition using specialized perceptual tools and evaluates the resulting confidence traces with soft temporal operators inspired by Linear Temporal Logic. A Significance-Aware Calibration step then aligns verification with human perception by retaining only perceptually significant violations before producing a timestamp- and evidence-grounded report. We conduct extensive experiments across public and complex multi-event benchmarks with the strongest video models to date, demonstrating that FVSCORE outperforms holistic and agent-based evaluators in human correlation while providing highly accurate and interpretable feedback.
Community
Introducing Faithfulness Video Score (FVScore), a neuro-symbolic framework for human-aligned and interpretable video generation evaluation.
I like that PAC gets its own human-label check. Beyond the reported 85.7% F1 and 90% recall, did you look separately at brief violations of explicit prompt requirements that PAC filtered out?
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- OmniCapBench: A Deep-Structured Evaluation Framework for Fine-Grained Audio-Visual Captioning (2026)
- RoboJudge: Multimodal Language Models as Judges for Embodied Video Generation (2026)
- SyncReward: Human-Aligned Synchronization Reward for Audio-Visual Generation (2026)
- PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos (2026)
- ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark (2026)
- RVG-Bench: A Benchmark for Reasoning-Driven Audio-Visual Temporal Grounding (2026)
- VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.22673 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper