Framework for Algorithmic Correctness Testing of Operators
InputGen is a Python library to generate inputs for torch operators, given certain specifications. These specifications can be provided by the user, or can be retrieved from a library of specifications such as SpecDB. They provide a complete description of the space of valid inputs to the operator.
Here is an overview of InputGen
SpecDB is a database of specifications covering most of the Core ATen Ops. They have been developed using the ATen CPU kernels as a reference.
The code below is a minimal example to test add.Tensor using FACTO.
import torch
from inputgen.argtuple.gen import ArgumentTupleGenerator
from specdb.db import SpecDictDB
# Retrieve the specification from SpecDB
spec = SpecDictDB["add.Tensor"]
# Initialize generator
generator = ArgumentTupleGenerator(spec)
op = torch.ops.aten.add.Tensor
# Generate input tuples
for posargs, inkwargs, outargs in generator.gen():
# Evaluate op with given inputs
op(*posargs, **inkwargs, **outargs)Calibrator is under development. It is intended to be a tool for calibrating the specifications against the behavior of the reference op implementation.
If you encounter a bug or some other problem with FACTO, please file an issue on https://github.com/pytorch-labs/facto/issues.
FACTO has a BSD 3-Clause License, as found in the LICENSE file.