Real Skill packageSource verifiedGitHub repository

huggingface-community-evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Identity and source

Publisher attributionOpenAIrepository owner unverified by skillvetai
Functional categoryAgent Engineering, Security & Governanceautomatically inferred · 78% rule confidence
Package forminstruction with code7 recorded files
Canonical sourceGitHub repositorygithub:openai/plugins:plugins/hugging-face/skills/community-evals
Open canonical source ↗

Platform declarations

These states come from the source or distribution context. None of the entries below are SkillVetAI compatibility test results.

OpenAI Codexdeclared onlyProvenance: platform official

Independent structural checks

These checks parse the fixed package against dated platform rules. They do not execute the Skill or verify task behavior.

Claude Codepasses structure
Checker 0.1.0 · agent-skills-2026-08-13+claude-code-docs-2026-08-13 · 8/13/2026.claude/skills/huggingface-community-evals

Runtime, accounts, dependencies, permissions, network behavior and task quality remain untested.

OpenAI Codexpasses structure
Checker 0.1.0 · agent-skills-2026-08-13+codex-docs-2026-08-13 · 8/13/2026.agents/skills/huggingface-community-evals

Runtime, accounts, dependencies, permissions, network behavior and task quality remain untested.

OpenClawpasses structure
Checker 0.1.0 · agent-skills-2026-08-13+openclaw-docs-2026-08-13 · 8/13/2026skills/huggingface-community-evals

Runtime, accounts, dependencies, permissions, network behavior and task quality remain untested.

Installation and inspection

This adapter did not publish an authoritative install command. Use the canonical source instructions and do not infer an installation path from the repository layout.

Security evidence

SkillVetAI static result: high signal

This automated, non-executing scan is bound to this release hash. It is not a safety certification and may contain false positives or false negatives.

Status
completed
Coverage
full text content
Files
6 / 7 inspected as text
Checked
8/13/2026, 7:58:57 AM
Scanner
0.1.3
Policy
1.0.3
1 automated finding
highPackage contains a path commonly used for secretsexamples/.env.example · confidence 88%/.env.example
1 High/Critical review queue entry
STATIC_SENSITIVE_FILE_IN_PACKAGEpending
Open human review queue →
2 inferred permission indicators
  • shell execution — automatically inferred
  • credential access — automatically inferred

Recorded files

The catalog stores hashes and an inventory summary for change detection. It does not republish the package contents.

Package content hashsha256:9d67442b1bcb2d6072b1049cfd2f2eda9a2235b30f853ed5f49c7c07aa1871fe
Show up to 7 recorded paths
  • SKILL.md
  • agents/openai.yaml
  • examples/.env.example
  • examples/USAGE_EXAMPLES.md
  • scripts/inspect_eval_uv.py
  • scripts/inspect_vllm_uv.py
  • scripts/lighteval_vllm_uv.py