MAI是一个神经网络推理引擎，以跨平台为目标，开发目标：Linux CPU --> Android CPU --> Android GPU --> Android DSP --> Windows CPU -->...
./bazel-bin/tools/benchmark/mai_benchmark --model_format=TENSORFLOW --model_path=tools/converter/tensorflow/models/mobilenet-v1-1.0.pb --num_runs=1 --warm_up=0
bazel build //test/optest:optest --incompatible_disable_deprecated_attr_params=false
./bazel-bin/test/optest/optest
| Models | ONNX | Tensorflow |
|---|---|---|
| mobilenetv1 | yes | yes |
| squeezenet | yes | no(https://storage.googleapis.com/download.tensorflow.org/models/tflite/model_zoo/upload_20180427/squeezenet_2018_04_27.tgz) |
| shufflenet | yes | no |
| CPU | GPU | CPU | GPU | CPU | GPU | DSP | NPU | |
| Add | yes | yes | ||||||
| BiasAdd | yes | yes | ||||||
| Cast | yes | yes | ||||||
| Concat | yes | yes | ||||||
| Conv2D | yes | yes | ||||||
| DepthwiseConv2d | yes | yes | ||||||
| TransposeConv2D | yes | yes | ||||||
| Dropout | yes | yes | ||||||
| ExpandDims | yes | yes | ||||||
| Exp | yes | yes | ||||||
| Fill | yes | yes | ||||||
| Floor | yes | yes | ||||||
| FusedBatchNorm | yes | yes | ||||||
| Gather | yes | yes | ||||||
| Gemm | yes | yes | ||||||
| Mul | yes | yes | ||||||
| Pad | yes | yes | ||||||
| MaxPool | yes | yes | ||||||
| AveragePool | yes | yes | ||||||
| GlobalAveragePool | yes | yes | ||||||
| Relu | yes | yes | ||||||
| Relu1 | yes | yes | ||||||
| Relu6 | yes | yes | ||||||
| CRelu | yes | yes | ||||||
| LeakyRelu | yes | yes | ||||||
| Reshape | yes | yes | ||||||
| Shape | yes | yes | ||||||
| Sigmoid | yes | yes | ||||||
| Softmax | yes | yes | ||||||
| Split | yes | yes | ||||||
| Squeeze | yes | yes | ||||||
| Tan | yes | yes | ||||||
| Tanh | yes | yes | ||||||
| ATan | yes | yes | ||||||
| ATanh | yes | yes | ||||||
| Sin | yes | yes | ||||||
| Sinh | yes | yes | ||||||
| ASin | yes | yes | ||||||
| ASinh | yes | yes | ||||||
| Cos | yes | yes | ||||||
| Cosh | yes | yes | ||||||
| ACos | yes | yes | ||||||
| ACosh | yes | yes | ||||||
| Transpose | yes | yes | ||||||
| StridedSlice | yes | yes | ||||||
| Identity | yes | yes | ||||||
| Pack | yes | yes | ||||||
| ResizeBilinear | yes | yes | ||||||
| Pow | yes | yes | ||||||
| Neg | yes | yes | ||||||
| ArgMax | yes | yes | ||||||
| ArgMin | yes | yes | ||||||
| Abs | yes | yes | ||||||