Skip to content

Update cpp launcher and add other improvements

Created by: AlibekovMurad5202

Changes:

  • add class OutputTensor for storing output results
  • replace dump_output with get_output_tensors, making dump_output a common method
  • updates from clang-format
  • minor change in readme for pytorch cpp launcher
  • change the format for saving validation results (bin file -> .json)
  • add io_adapters to validate some models by tflite cpp
  • change output message if pytorch cpp benchmark failed to read model file
  • fix problem with using folder's path as input parameter for inference_pytorch_cpp.py
  • add latency per token metric in openvino, pytorch and onnxruntime launchers

Merge request reports