Registry / ai-ml / nvidia-nat-eval

nvidia-nat-eval

JSON →
library1.7.0pypypiunverified

Subpackage for evaluation in NVIDIA NeMo Agent Toolkit (NeMo Agent). Provides evaluation utilities for conversational AI agents. Current version: 1.7.0, requires Python 3.11-3.13. Release cadence matches NeMo Agent Toolkit (minor releases every few months).

ai-ml
pip install nvidia-nat-eval
INSTALL
IMPORT
SIG · NVIDIA-NAT-EVAL
N
nvidia-nat-eval
ai-mlpythonv1.7.0
harness data pending
Install & Compatibility
Where this runs

No compatibility data collected yet for this library.

Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

EvaluationJobConfig
✓ from nat import EvaluationJobConfig
✗ from nvidia.nat.eval import EvaluationJobConfig

Basic import and instantiation of evaluation job config.

import os from nvidia.nat.eval import EvaluationJobConfig config = EvaluationJobConfig( name="my_eval", eval_type="llm", model_name="gpt2", tasks=["truthfulqa"] ) print(config)
Debug
Known issues
breakingNamespace structure: do not import from `nvidia_nat_eval`; use `nvidia.nat.eval`.
fix
Use `from nvidia.nat.eval import ...`.
affects: >=1.0.0
gotchaThis is a subpackage; ensure `nvidia-nat-core` is installed as it is a dependency but may not be automatically installed if using an older pip.
fix
Run `pip install nvidia-nat-core` if import errors occur.
affects: <1.5.0
deprecated`EvaluationJobConfig` parameters may change across minor versions; always pin version in requirements.
fix
Pin to specific version like `nvidia-nat-eval==1.7.0`.
affects: all
Upgrade
Version history
1.7.0latest on PyPI · released May 21, 2026
Audit
Dependencies
nvidia-nemo-lm-evaloptionalOften required alongside for language model evaluation tasks.
Agent activity
11 hits · last 30 days
node
8
Anthropic
1
Resources

No resource links recorded.

nvidia-nat-eval — pip install nvidia-nat-eval · libregistry