A benchmark is a standard test for AI: the same questions or tasks are given to different models and their scores compared. Examples range from school-style multiple-choice exams to coding challenges and maths contests.
You meet benchmarks in almost every model launch and research paper. They are useful but limited: models can be tuned to a test, and a high score does not always mean a model will do well on real work.