Benchmark

The MemryX Benchmark tools are command line interface tools that can be used to easily perform inference on the connected MXA and get latency and FPS. The FPS and latency are measured from the host side, which includes the driver and the interface time. After installing the SDK, and runtime libraries, the accelerator CLI tools can be run using mx_bench or acclBench.

Contents:

• Python Benchmark (mx_bench)
• C++ Benchmark (acclBench)

Warning

Benchmark tools will use the number of chips specified while compiling the DFP. Please, make sure to compile your DFP for the number of chips per your requirement.