# SkillEvaluator 1.0: NVIDIA's scanner for agent skills and plugins

> SkillEvaluator 1.0 adds static harness checks to NVIDIA's open-source scanner for AI agent skills and plugins.

- **Severity:** Info: Research, tools, evals or lab claims with no direct exposure. Context, not an alert.
- **Category:** Tool
- **Published by:** NVIDIA
- **Disclosed:** 2026-11-18
- **Affects:** Claude Code, OpenAI Codex, GitHub Copilot CLI, OpenClaw, OpenCode, Hermes
- **Research by:** [NVIDIA Corporation](https://github.com/NVIDIA)
- **Primary source:** https://github.com/NVIDIA/SkillEvaluator/releases/tag/v1.0.1
- **Page:** https://theinjection.dev/items/nvidia-skillevaluator-1-0/

SkillEvaluator 1.0 is NVIDIA's open-source checker for AI agent skills and plugins. The first full 1.0 release adds HarnessCheck, a static test for six coding agents, and runs its security tier without a model key.

## What happened

NVIDIA published SkillEvaluator v1.0.1 on 18 November 2026, which the release notes call the first complete release in the 1.0 series. The project is an Apache-2.0 command-line tool, and also an installable agent skill, that checks AI agent skills and plugins before a team ships them. An earlier v1.0.0 tag from 17 November was superseded because its package and CI bundle were not published.

## How it works

Three tiers do the work. Tier 1 is static and, NVIDIA says, needs no model key: it runs SkillSpector for skill-specific security scanning, Bandit for code risk, Gitleaks for secrets, optional Semgrep scanning and opt-in pip-audit dependency checks, next to schema, license, PII and Unicode checks. Tier 2 uses embeddings to find guidance that repeats or overlaps across skills, and Tier 3 runs an agent with and without the skill in a Docker sandbox to measure the difference. HarnessCheck, new in this release, is a static advisory test of whether a harness will load a skill at all.

## Who is affected

Six agent harnesses have HarnessCheck profiles, listed below. The tool runs on Python 3.12 to 3.14, and NVIDIA lists its support level as experimental and community-supported, with no SLA.

## What to do

Teams that install third-party agent skills can run skillevaluator quality-check or skillevaluator validate --tiers 1 against a skill before it ships, and skillevaluator ci init to add the checks to a GitHub or GitLab pipeline. Upgrading from v0.9.0 needs a review of the author policy, security override and hook gate changes, and NVIDIA says CI workflow files and image pins must be updated separately from the Python package.

## Quick facts

- **Release:** v1.0.1, published 2026-11-18
- **License:** Apache-2.0
- **Install:** pip install skillevaluator, Python 3.12 to 3.14
- **Security scanners:** SkillSpector 2.13.4, Bandit, Gitleaks, optional Semgrep, opt-in pip-audit
- **Harnesses checked:** Claude Code, Codex, Copilot CLI, Hermes, OpenClaw, OpenCode
- **Static rules:** More than 500, by NVIDIA's count
- **Support level:** Experimental, community-supported, no SLA

## Questions

### Does SkillEvaluator 1.0 need an NVIDIA API key?

SkillEvaluator's Tier 1 checks, including the security scanners and the new HarnessCheck, run without a model key, according to NVIDIA's documentation. A full three-tier run is different: Tier 3 live agent evaluation needs an NVIDIA Build API key, Docker, scanner setup and a reviewed dataset. Teams that want only static security and quality scoring can therefore start with no credentials at all.

### Which coding agents does HarnessCheck support?

HarnessCheck ships profiles for six agent harnesses: Claude Code, Codex, Copilot CLI, Hermes, OpenClaw and OpenCode. NVIDIA describes the check as static and advisory, so it flags cases where a harness would miss, reject or truncate a skill rather than reporting a security flaw. Running it takes one command, skillevaluator harness-check, against a skill directory.

### What changes when upgrading SkillEvaluator from v0.9.0?

Upgrading from v0.9.0 requires reviewing changes to the author policy, security overrides and hook gates, which NVIDIA lists in the v1.0.1 changelog. NVIDIA also states that CI workflow files and image pins must be updated separately from the Python package, so a pip upgrade on its own leaves older pipeline configuration in place. The release pins SkillSpector at 2.13.4.

## Sources

1. [Release Notes v1.0.1](https://github.com/NVIDIA/SkillEvaluator/releases/tag/v1.0.1)
2. [GitHub Repository](https://github.com/NVIDIA/SkillEvaluator)
3. [SkillEvaluator Docs](https://docs.nvidia.com/skills/skillevaluator/)
