MACEval: A Multi-Agent Continual Evaluation Network for Large Models

The introduction of MACEval marks a pivotal advancement in the evaluation of large models, responding to the limitations of existing benchmarks that often suffer from overfitting and data contamination. By utilizing a Multi-Agent Continual Evaluation network, MACEval offers a human-free, scalable solution that can dynamically assess model performance across nine diverse tasks with 23 participating models. This approach not only reduces the data overhead but also integrates seamlessly with existing benchmarks, thereby enhancing the overall credibility and adaptability of model evaluations. The significance of MACEval lies in its potential to keep pace with the rapid advancements in AI, ensuring that evaluations remain relevant and reliable in a field characterized by constant change.