Update cpp launcher and add other improvements
Created by: AlibekovMurad5202
Changes:
- add
class OutputTensorfor storing output results - replace
dump_outputwithget_output_tensors, makingdump_outputa common method - updates from clang-format
- minor change in readme for
pytorch cpp launcher - change the format for saving validation results (bin file -> .json)
- add io_adapters to validate some models by tflite cpp
- change output message if pytorch cpp benchmark failed to read model file
- fix problem with using folder's path as input parameter for
inference_pytorch_cpp.py - add latency per token metric in openvino, pytorch and onnxruntime launchers