We invite submissions of full-length papers (8 pages excluding the references) for workshop proceedings. The topics covered in the workshop include but are not limited to:

• Challenges in Multimodal AI Evaluation: Current limitations and the need for integrated assessments.

• Designing Multimodal Benchmarks: Strategies for creating realistic and comprehensive tasks.

• Ethical and Fair AI Evaluation: Addressing biases to ensure fairness across different demographic groups.

• Multimodal AI in Real-World Applications: Case studies demonstrating the application of multimodal systems.

• Future Directions in AI Benchmarking: Innovative methods and technologies.

All submissions should follow the CVPR 2025 instructions. The papers will be subject to a double-blind review process, i.e. authors must not identify themselves on the submitted papers. The reviewing process is single-stage without rebuttals.

Online Submission System: CMT
Submission Format: official CVPR template (double column; no more than 8 pages, excluding reference).

The Microsoft CMT service was used for managing the peer-reviewing process for this conference. This service was provided for free by Microsoft and they bore all expenses, including costs for Azure cloud services as well as for software development and support.