KGI-Bench documentation

KGI-Bench is the benchmark suite accompanying KGpipe. It defines benchmark datasets and evaluation entrypoints for comparing generated knowledge graphs.

Getting started

• Movie benchmark: movie-benchmark.md
• CLI reference: cli.md

CLI

KGI-Bench provides a CLI intended to run evaluation on KGpipe pipeline outputs:

kgibench --help
kgibench evaluate --help

List available metrics:

kgibench list-metrics

Movie preset (evaluates stage_* directories and writes eval_results.json into each stage):

kgibench evaluate --benchmark movie --bench-data /path/to/movie/dataset /path/to/pipeline_output_dir