huggingface-evaluation
Use this skill for add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations with vLLM/lighteval. Works with the model-index metadata format.
Pinned to revision 4e4fe02df5f4, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/huggingface-evaluation/SKILL.md
- skills/huggingface-evaluation/agents/openai.yaml
- skills/huggingface-evaluation/examples/.env.example
- skills/huggingface-evaluation/examples/USAGE_EXAMPLES.md
- skills/huggingface-evaluation/examples/artificial_analysis_to_hub.py
- skills/huggingface-evaluation/examples/example_readme_tables.md
- skills/huggingface-evaluation/examples/metric_mapping.json
- skills/huggingface-evaluation/metadata.json
- skills/huggingface-evaluation/requirements.txt
- skills/huggingface-evaluation/scripts/evaluation_manager.py
- skills/huggingface-evaluation/scripts/inspect_eval_uv.py
- skills/huggingface-evaluation/scripts/inspect_vllm_uv.py
- skills/huggingface-evaluation/scripts/lighteval_vllm_uv.py
- skills/huggingface-evaluation/scripts/run_eval_job.py
- skills/huggingface-evaluation/scripts/run_vllm_eval_job.py
- skills/huggingface-evaluation/scripts/test_extraction.py
Every link opens the file at its source, pinned to the revision this page describes.