Model eXplorer#

At MemryX, we do not maintain a curated model zoo which limits customers choice. Instead, we recommend customers choose/train their own model(s) and use MemryX automated tools to generate executable DFP files (.dfp = “dataflow program”).

Our automated tools do not modify original source models (e.g. no pruning, no distillation, etc.) and do not require any retraining (or any dataset) to maintain high accuracy. Instead, our tools compile models as they were trained, resulting in dataflow programs that execute with high accuracy and high utilization of available hardware.

The list of models below was created using a model explorer that automatically aggregates, compiles, and tests models from various public online sources on MemryX hardware. Anyone can use these publicly available models, access links for detailed model source information, and either recreate or simply download the compiled DFP. None of these models were created by MemryX or belong to MemryX. This model list will evolve over time depending on customer feedback.

Of course, a customer can certainly choose to modify any given model(s) prior to using MemryX tools. For example, if a customer is willing to tradeoff accuracy for performance, one can choose to prune, quantize, and/or distill model(s) and then create an executable for measuring performance & accuracy.

Measurement Information
  • SDK Version: 1.0.0

  • The host used for these measurements is: Intel i7 9700T (1.5GHz), 16 GB RAM

  • The FPS and latency metrics reported here reflect the performance of models running at both Default (14 TFLOPS) and Full (20 TFLOPS) performance modes. Future updates will include benchmarks for configurations up to 40 TFLOPS, providing even more detailed insights into the system’s capabilities.

  • Latency 1: Frame-to-frame latency (used to compute fps)

  • Latency 2: Full system latency (including host) from initial input to final output

Models with Tutorials and Examples

Models featured in tutorials carry the badge, indicating code-specific learning paths, while models used in complete example applications are marked with the / badges. Explore in-depth tutorials at Tutorials and discover end-to-end examples at MemryX eXamples.

Models (Below is a partial list of tested models)

Below is a partial list of AI models that MemryX has downloaded, compiled, and benchmarked from public sources. This is not a model zoo; the models remain unmodified, and MemryX customers are not restricted to using these models. Customers are welcome to compile additional models as needed. For guidance, see the Neural Compiler and Tutorials pages.

Classification (ImageNet)

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

1

CSP-DarkNet50

256×256×3

26.3 M

ONNX

468

662

2.1 ms

1.5 ms

9.9 ms

7.2 ms

OpenMMLab

DFP

2

CSP-ResNet-50

256×256×3

20.6 M

ONNX

869

1128

1.2 ms

0.9 ms

5.4 ms

4.1 ms

OpenMMLab

DFP

3

DLA34

224×224×3

15.0 M

ONNX

603

854

1.7 ms

1.2 ms

4.4 ms

3.3 ms

OpenVINO

DFP

4

DenseNet121

224×224×3

7.7 M

Keras

711

1008

1.4 ms

1.0 ms

11.1 ms

8.0 ms

Keras.Applications

DFP

5

DenseNet169

224×224×3

13.6 M

Keras

521

738

1.9 ms

1.4 ms

19.0 ms

13.6 ms

Keras.Applications

DFP

6

DenseNet201

224×224×3

19.3 M

Keras

334

473

3.0 ms

2.1 ms

32.1 ms

22.9 ms

Keras.Applications

DFP

7

EfficientNet-B0

224×224×3

5.0 M

ONNX

761

1077

1.3 ms

0.9 ms

8.0 ms

5.9 ms

OpenVINO

DFP

8

EfficientNet-B1

240×240×3

7.4 M

ONNX

456

646

2.2 ms

1.5 ms

17.1 ms

12.5 ms

OpenMMLab

DFP

9

EfficientNet-EdgeTpu(L)

300×300×3

10.1 M

TFLite

166

235

6.0 ms

4.3 ms

14.5 ms

10.4 ms

Coral

DFP

10

EfficientNet-EdgeTpu(M)

240×240×3

6.5 M

TFLite

450

637

2.2 ms

1.6 ms

6.5 ms

4.8 ms

Coral

DFP

11

EfficientNet-EdgeTpu(S)

224×224×3

3.9 M

TFLite

488

690

2.0 ms

1.4 ms

4.4 ms

3.3 ms

Coral

DFP

12

EfficientNet-lite0

224×224×3

4.4 M

TFLite

1900

2255

0.5 ms

0.4 ms

2.1 ms

1.6 ms

TFHub

DFP

13

EfficientNet-lite1

240×240×3

5.1 M

TFLite

1890

2176

0.5 ms

0.5 ms

2.5 ms

2.0 ms

TFHub

DFP

14

EfficientNet-lite2

260×260×3

5.8 M

TFLite

1538

1780

0.7 ms

0.6 ms

3.4 ms

2.6 ms

TFHub

DFP

15

EfficientNet-lite3

280×280×3

7.8 M

TFLite

1281

1814

0.8 ms

0.6 ms

4.7 ms

3.5 ms

TFHub

DFP

16

EfficientNet-lite4

300×300×3

12.4 M

TFLite

748

1059

1.3 ms

0.9 ms

8.9 ms

6.4 ms

TFHub

DFP

17

EfficientNet-lite4

224×224×3

12.4 M

ONNX

1391

1969

0.7 ms

0.5 ms

6.0 ms

4.4 ms

ONNX Zoo

DFP

18

EfficientNet-v2-B0

224×224×3

6.8 M

ONNX

1101

1558

0.9 ms

0.6 ms

6.5 ms

4.8 ms

OpenVINO

DFP

19

EfficientNet-v2-B0

224×224×3

6.9 M

Keras

1102

1560

0.9 ms

0.6 ms

6.0 ms

4.5 ms

Keras.Applications

DFP

20

EfficientNet-v2-B1

240×240×3

7.8 M

Keras

1018

1441

1.0 ms

0.7 ms

8.8 ms

6.4 ms

Keras.Applications

DFP

21

EfficientNet-v2-B2

260×260×3

9.7 M

Keras

763

1080

1.3 ms

0.9 ms

13.5 ms

9.7 ms

Keras.Applications

DFP

22

EfficientNet-v2-B3

300×300×3

13.8 M

Keras

524

742

1.9 ms

1.3 ms

25.4 ms

18.1 ms

Keras.Applications

DFP

23

GoogleNet

224×224×3

6.7 M

ONNX

519

734

1.9 ms

1.4 ms

3.9 ms

2.9 ms

ONNX Zoo

DFP

24

HBONet0.25

224×224×3

1.8 M

ONNX

1898

2247

0.5 ms

0.4 ms

1.5 ms

1.3 ms

OpenVINO

DFP

25

HBONet1.0

224×224×3

4.3 M

ONNX

1112

1180

0.9 ms

0.8 ms

3.2 ms

2.6 ms

OpenVINO

DFP

26

Inception

224×224×3

6.7 M

ONNX

537

760

1.9 ms

1.3 ms

3.7 ms

2.8 ms

ONNX Zoo

DFP

27

Inception

224×224×3

6.3 M

TFLite

753

1066

1.3 ms

0.9 ms

3.0 ms

2.3 ms

Coral

DFP

28

Inception(GoogleNet)-v3

299×299×3

22.7 M

ONNX

318

450

3.1 ms

2.2 ms

10.1 ms

7.3 ms

OpenVINO

DFP

29

Inception-ResNet-v2

299×299×3

28.9 M

TensorFlow

168

238

6.0 ms

4.2 ms

36.6 ms

26.0 ms

OpenVINO

DFP

30

Inception-v2

224×224×3

10.7 M

ONNX

752

1064

1.3 ms

0.9 ms

3.8 ms

2.8 ms

ONNX Zoo

DFP

31

Inception-v3

346×346×3

22.7 M

TFLite

275

389

3.6 ms

2.6 ms

11.1 ms

8.0 ms

AI Benchmark

DFP

32

Inception-v3

299×299×3

22.7 M

TFLite

318

450

3.1 ms

2.2 ms

10.1 ms

7.3 ms

Coral

DFP

33

Inception-v3

224×224×3

10.7 M

TFLite

750

1063

1.3 ms

0.9 ms

3.6 ms

2.8 ms

Coral

DFP

34

Inception-v3

299×299×3

22.7 M

Keras

318

450

3.1 ms

2.2 ms

10.1 ms

7.3 ms

Keras.Applications

DFP

35

MobileNet

128×128×3

4.0 M

TFLite

6284

6975

0.2 ms

0.1 ms

1.1 ms

0.9 ms

TFHub

DFP

36

MobileNet

192×192×3

4.0 M

TFLite

3510

3914

0.3 ms

0.3 ms

1.4 ms

1.2 ms

TFHub

DFP

37

MobileNet

224×224×3

4.0 M

ONNX

1894

2245

0.5 ms

0.4 ms

1.7 ms

1.3 ms

OpenCV

DFP

38

MobileNet

160×160×3

4.0 M

TFLite

3949

4435

0.3 ms

0.2 ms

1.3 ms

1.1 ms

TFHub

DFP

39

MobileNet

224×224×3

4.1 M

Keras

1887

2256

0.5 ms

0.4 ms

1.6 ms

1.3 ms

Keras.Applications

DFP

40

MobileNet-EdgeTPU-v2-extra-small

224×224×3

4.2 M

TFLite

1889

2248

0.5 ms

0.4 ms

2.1 ms

1.7 ms

TFHub

DFP

41

MobileNet-v2

224×224×3

3.3 M

ONNX

1903

2251

0.5 ms

0.4 ms

1.5 ms

1.3 ms

ONNX Zoo

DFP

42

MobileNet-v2

224×224×3

3.4 M

Keras

1891

2257

0.5 ms

0.4 ms

1.6 ms

1.4 ms

Keras.Applications

DFP

43

MobileNet-v3

512×512×3

5.2 M

TFLite

454

556

2.2 ms

1.8 ms

9.6 ms

7.3 ms

AI Benchmark

DFP

44

MobileNet-v3

224×224×3

3.9 M

TFLite

1901

2255

0.5 ms

0.4 ms

2.1 ms

1.6 ms

Coral

DFP

45

MobileOne

224×224×3

7.4 M

ONNX

1889

2247

0.5 ms

0.4 ms

2.4 ms

1.9 ms

GitHub/PINTO

DFP

46

NasNet(Mobile)

160×160×3

4.2 M

TFLite

3922

4596

0.3 ms

0.2 ms

1.7 ms

1.3 ms

TFHub

DFP

47

NasNet(Mobile)

192×192×3

4.2 M

TFLite

3525

3952

0.3 ms

0.3 ms

1.7 ms

1.4 ms

TFHub

DFP

48

NasNet(Mobile)

128×128×3

4.2 M

TFLite

4728

6678

0.2 ms

0.1 ms

1.5 ms

1.2 ms

TFHub

DFP

49

NasNet(Mobile)-1.3

224×224×3

5.9 M

TFLite

1885

2253

0.5 ms

0.4 ms

2.4 ms

1.9 ms

TFHub

DFP

50

PP-LCNet-v2

224×224×3

6.3 M

TensorFlow

1877

2247

0.5 ms

0.4 ms

2.7 ms

2.1 ms

GitHub/PINTO

DFP

51

PpResNet-50

224×224×3

24.4 M

ONNX

742

1050

1.3 ms

1.0 ms

6.1 ms

4.5 ms

OpenCV

DFP

52

RepVGG-A0

224×224×3

7.9 M

ONNX

1839

2257

0.5 ms

0.4 ms

2.1 ms

1.6 ms

OpenMMLab

DFP

53

RepVGG-A1

224×224×3

12.2 M

ONNX

1898

2226

0.5 ms

0.4 ms

2.2 ms

1.7 ms

OpenMMLab

DFP

54

RepVGG-A2

224×224×3

24.3 M

ONNX

742

1051

1.3 ms

1.0 ms

4.9 ms

3.6 ms

OpenMMLab

DFP

55

RepVGG-B0

224×224×3

13.7 M

ONNX

1079

1528

0.9 ms

0.7 ms

3.2 ms

2.4 ms

OpenMMLab

DFP

56

ResNet-18

224×224×3

11.2 M

ONNX

1782

2167

0.6 ms

0.5 ms

1.8 ms

1.5 ms

ONNX Zoo

DFP

57

ResNet-18-v2

224×224×3

11.2 M

ONNX

1760

2149

0.6 ms

0.5 ms

1.9 ms

1.5 ms

ONNX Zoo

DFP

58

ResNet-34

224×224×3

20.8 M

ONNX

888

1257

1.1 ms

0.8 ms

4.6 ms

3.4 ms

OpenVINO

DFP

59

ResNet-34-v2

224×224×3

20.8 M

ONNX

967

1369

1.0 ms

0.7 ms

4.5 ms

3.4 ms

ONNX Zoo

DFP

60

ResNet-50

224×224×3

24.4 M

ONNX

825

1169

1.2 ms

0.9 ms

6.3 ms

4.6 ms

ONNX Zoo

DFP

61

ResNet-50

224×224×3

24.4 M

Keras

811

1148

1.2 ms

0.9 ms

5.2 ms

3.9 ms

Keras.Applications

DFP

62

ResNet-50-v2

224×224×3

24.4 M

Keras

820

1162

1.2 ms

0.9 ms

5.7 ms

4.2 ms

Keras.Applications

DFP

63

ShuffleNet

224×224×3

1.4 M

ONNX

1896

2256

0.5 ms

0.4 ms

2.1 ms

1.6 ms

ONNX Zoo

DFP

64

ShuffleNet-v2

224×224×3

2.2 M

ONNX

1885

2228

0.5 ms

0.4 ms

1.8 ms

1.4 ms

OpenVINO

DFP

65

SqueezeNet

224×224×3

1.2 M

TFLite

1034

1464

1.0 ms

0.7 ms

2.4 ms

2.1 ms

TFHub

DFP

66

SqueezeNet1.0

224×224×3

1.2 M

ONNX

1887

2213

0.5 ms

0.5 ms

2.0 ms

1.7 ms

ONNX Zoo

DFP

67

SqueezeNet1.1

224×224×3

1.2 M

ONNX

1274

1287

0.8 ms

0.8 ms

2.4 ms

2.1 ms

ONNX Zoo

DFP

68

Xception

299×299×3

21.8 M

Keras

300

425

3.3 ms

2.4 ms

13.1 ms

9.4 ms

Keras.Applications

DFP

69

YOLO-v8-large-CLS

224×224×3

35.7 M

TFLite

259

366

3.9 ms

2.7 ms

13.4 ms

9.7 ms

Ultralytics

DFP

70

YOLO-v8-large-CLS

224×224×3

35.7 M

ONNX

260

369

3.8 ms

2.7 ms

13.7 ms

9.9 ms

Ultralytics

DFP

71

YOLO-v8-medium-CLS

224×224×3

16.3 M

TFLite

1018

1441

1.0 ms

0.7 ms

4.4 ms

3.3 ms

Ultralytics

DFP

72

YOLO-v8-medium-CLS

224×224×3

16.3 M

ONNX

1019

1442

1.0 ms

0.7 ms

4.2 ms

3.2 ms

Ultralytics

DFP

73

YOLO-v8-nano-CLS

224×224×3

2.6 M

TFLite

1866

2261

0.5 ms

0.4 ms

1.4 ms

1.1 ms

Ultralytics

DFP

74

YOLO-v8-nano-CLS

224×224×3

2.6 M

ONNX

1902

2252

0.5 ms

0.4 ms

1.3 ms

1.1 ms

Ultralytics

DFP

75

YOLO-v8-small-CLS

224×224×3

6.1 M

TFLite

1892

2245

0.5 ms

0.4 ms

1.8 ms

1.5 ms

Ultralytics

DFP

76

YOLO-v8-small-CLS

224×224×3

6.1 M

ONNX

1876

2243

0.5 ms

0.4 ms

1.8 ms

1.4 ms

Ultralytics

DFP

77

ZfNet512

224×224×3

6.2 M

ONNX

283

401

3.5 ms

2.5 ms

4.9 ms

3.6 ms

ONNX Zoo

DFP

Object Detection

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

78

CenterNet(DLA)

512×512×3

17.1 M

ONNX

111

152

9.0 ms

6.6 ms

23.0 ms

17.6 ms

OpenVINO

DFP

79

CenterNet-MobileNet-v2

320×320×3

2.3 M

TensorFlow

599

657

1.7 ms

1.5 ms

5.0 ms

4.2 ms

TF Object Detection Zoo

DFP

80

CenterNet-MobileNet-v2-kpts

320×320×3

2.3 M

ONNX

462

476

2.2 ms

2.1 ms

6.4 ms

5.8 ms

TF Object Detection Zoo

DFP

81

CenterNet-ResNet-fpn

512×512×3

24.2 M

TensorFlow

66

90

15.2 ms

11.1 ms

28.0 ms

21.0 ms

TF Object Detection Zoo

DFP

82

DAMO-YOLO-Nl

416×416×3

5.4 M

ONNX

313

442

3.2 ms

2.3 ms

10.1 ms

7.4 ms

DaMoYolo

DFP

83

DAMO-YOLO-Nm

416×416×3

2.6 M

ONNX

345

488

2.9 ms

2.0 ms

7.3 ms

5.4 ms

DaMoYolo

DFP

84

DAMO-YOLO-Ns

416×416×3

1.3 M

ONNX

609

862

1.6 ms

1.2 ms

4.9 ms

4.0 ms

DaMoYolo

DFP

85

DAMO-YOLO-small

320×320×32

15.5 M

ONNX

135

135

7.4 ms

7.4 ms

21.7 ms

21.7 ms

DaMoYolo

DFP

86

DAMO-YOLO-small

640×640×3

15.5 M

ONNX

141

199

7.1 ms

5.0 ms

18.7 ms

13.7 ms

DaMoYolo

DFP

87

DAMO-YOLO-tiny

640×640×3

8.1 M

ONNX

356

356

2.8 ms

2.8 ms

10.5 ms

10.5 ms

DaMoYolo

DFP

88

DbNet-ResNet-18

736×1344×3

11.6 M

ONNX

17

23

58.8 ms

43.5 ms

75.7 ms

54.8 ms

OpenMMLab

DFP

89

DeepSort

128×64×3

10.6 M

TensorFlow

2015

2852

0.5 ms

0.4 ms

1.8 ms

1.4 ms

GitHub/PINTO

DFP

90

DroNet

608×608×3

67.4 K

TFLite

358

431

2.8 ms

2.3 ms

3.8 ms

3.2 ms

GitHub/PINTO

DFP

91

EfficientDet-Lite1

384×384×3

4.2 M

TFLite

62

62

16.1 ms

16.1 ms

20.9 ms

20.9 ms

Coral

DFP

92

License-plate-Detection-LPD-YuNet

240×320×3

1008.7 K

ONNX

726

913

1.4 ms

1.1 ms

2.5 ms

2.1 ms

OpenCV

DFP

93

MediaPipe-object-Detection-3d-camera

224×224×3

2.4 M

TFLite

1881

2255

0.5 ms

0.4 ms

2.0 ms

1.6 ms

MediaPipe

DFP

94

MediaPipe-object-Detection-3d-sneakers

224×224×3

2.4 M

TFLite

1877

2252

0.5 ms

0.4 ms

2.0 ms

1.6 ms

MediaPipe

DFP

95

MediaPipe-object-Detection-3d-sneakers-1s…

640×480×3

1.4 M

TFLite

406

484

2.5 ms

2.1 ms

5.6 ms

4.5 ms

MediaPipe

DFP

96

Mobile-object-labeler

224×224×3

3.5 M

TFLite

1898

2252

0.5 ms

0.4 ms

1.5 ms

1.2 ms

TFHub

DFP

97

Mobile-object-localizer

192×192×3

1.7 M

TFLite

3360

3480

0.3 ms

0.3 ms

1.4 ms

1.1 ms

GitHub/PINTO

DFP

98

MobileNet-YOLO-v4-syg

416×416×3

10.0 M

TensorFlow

764

913

1.3 ms

1.1 ms

8.4 ms

6.3 ms

OpenVINO

DFP

99

NanoDet

416×416×3

919.8 K

ONNX

770

902

1.3 ms

1.1 ms

4.4 ms

3.7 ms

OpenCV

DFP

100

NanoDetPluswithShuffleNet-v2-1.5x

416×416×3

2.3 M

ONNX

616

765

1.6 ms

1.3 ms

6.6 ms

5.5 ms

OpenVINO

DFP

101

NanoDetwithShuffleNet-v2-1.5x

416×416×3

2.0 M

ONNX

693

884

1.4 ms

1.1 ms

5.2 ms

4.3 ms

OpenVINO

DFP

102

Person-Detection

512×512×3

1.7 M

TFLite

467

544

2.1 ms

1.8 ms

3.9 ms

3.3 ms

GitHub/PINTO

DFP

103

Person-vehicle-bike-Detection-crossroad-0…

1024×1024×3

1.1 M

TFLite

117

149

8.5 ms

6.7 ms

14.1 ms

11.3 ms

GitHub/PINTO

DFP

104

Person-vehicle-bike-Detection-crossroad-1…

512×512×3

2.8 M

TFLite

467

546

2.1 ms

1.8 ms

4.6 ms

3.8 ms

GitHub/PINTO

DFP

105

SSD-FPNMobileNet

640×640×3

29.5 M

TFLite

41

58

24.4 ms

17.2 ms

45.2 ms

34.7 ms

Coral

DFP

106

SSD-MobileNet

300×300×3

6.5 M

TFLite

1136

1352

0.9 ms

0.7 ms

2.2 ms

2.0 ms

Coral

DFP

107

SSD-MobileNet-v2

300×300×3

5.8 M

TFLite

1145

1296

0.9 ms

0.8 ms

2.6 ms

2.1 ms

Coral

DFP

108

SSD-MobileNet-v2-mnasfpn-shared-box-predi…

320×320×3

2.4 M

TFLite

228

232

4.4 ms

4.3 ms

10.5 ms

9.6 ms

GitHub/PINTO

DFP

109

SSD512

512×512×3

34.4 M

ONNX

21

29

47.6 ms

34.5 ms

65.1 ms

47.2 ms

OpenMMLab

DFP

110

SSDLiteMobileDet

320×320×3

3.9 M

TFLite

1138

1303

0.9 ms

0.8 ms

3.3 ms

2.6 ms

Coral

DFP

111

SSDlite-MobileNet-v2

320×320×3

4.0 M

ONNX

874

876

1.1 ms

1.1 ms

3.2 ms

3.0 ms

OpenMMLab

DFP

112

SSDlite-MobileNet-v2

300×300×3

4.3 M

TensorFlow

1154

1308

0.9 ms

0.8 ms

2.6 ms

2.1 ms

GitHub/PINTO

DFP

113

SpaghettiNet-EdgeTPU

320×320×3

3.3 M

TFLite

1137

1289

0.9 ms

0.8 ms

3.9 ms

3.3 ms

GitHub/PINTO

DFP

114

Text-Detection-db

480×640×3

11.6 M

TensorFlow

59

82

16.9 ms

12.2 ms

24.7 ms

17.9 ms

GitHub/PINTO

DFP

115

Text-recognition-CRNN-EN8

32×100×1

5.3 M

ONNX

3304

4674

0.3 ms

0.2 ms

1.4 ms

1.1 ms

OpenCV

DFP

116

Vehicle-license-plate-Detection-barrier-0…

300×300×3

619.4 K

TFLite

1167

1362

0.9 ms

0.7 ms

1.6 ms

1.4 ms

GitHub/PINTO

DFP

117

VehicleLicensePlateDetectionBarrier

256×256×3

561.2 K

TensorFlow

1639

1935

0.6 ms

0.5 ms

2.4 ms

1.9 ms

OpenVINO

DFP

118

YOLO-tiny

416×416×3

15.1 M

TensorFlow

492

697

2.0 ms

1.4 ms

4.1 ms

3.2 ms

GitHub/RedisAI

DFP

119

YOLO-v2-tiny

416×416×3

15.1 M

TFLite

594

840

1.7 ms

1.2 ms

3.4 ms

2.6 ms

OpenVINO

DFP

120

YOLO-v3-MobileNet-v2

320×320×3

3.2 M

ONNX

712

875

1.4 ms

1.1 ms

5.2 ms

4.4 ms

OpenMMLab

DFP

121

YOLO-v3-MobileNet-v2-ms

416×416×3

3.2 M

ONNX

464

484

2.2 ms

2.1 ms

7.0 ms

6.6 ms

OpenMMLab

DFP

122

YOLO-v3-lite

256×256×3

6.4 M

ONNX

1605

1852

0.6 ms

0.5 ms

3.1 ms

2.4 ms

GitHub/PINTO

DFP

123

YOLO-v4-tiny

416×416×3

5.8 M

TFLite

608

675

1.6 ms

1.5 ms

3.8 ms

3.3 ms

AI Benchmark

DFP

124

YOLO-v5-medium-leaky

640×640×3

20.2 M

TensorFlow

124

176

8.1 ms

5.7 ms

21.9 ms

16.7 ms

Ultralytics

DFP

125

YOLO-v5-medium-leaky

416×416×3

20.2 M

TensorFlow

261

358

3.8 ms

2.8 ms

11.5 ms

9.2 ms

Ultralytics

DFP

126

YOLO-v5-medium-v6.1-fast

640×640×3

20.2 M

ONNX

113

160

8.8 ms

6.2 ms

22.5 ms

16.9 ms

OpenMMLab

DFP

127

YOLO-v5-medium-v6.1-fastb64-VOC

512×512×3

20.0 M

ONNX

187

256

5.3 ms

3.9 ms

15.5 ms

11.2 ms

OpenMMLab

DFP

128

YOLO-v5-mu

640×640×3

23.9 M

ONNX

91

129

11.0 ms

7.8 ms

28.3 ms

20.3 ms

Ultralytics

DFP

129

YOLO-v5-n6u

1280×1280×3

4.1 M

ONNX

79

83

12.7 ms

12.0 ms

38.4 ms

36.2 ms

Ultralytics

DFP

130

YOLO-v5-nano-leaky

416×416×3

1.8 M

TensorFlow

439

468

2.3 ms

2.1 ms

6.0 ms

5.6 ms

Ultralytics

DFP

131

YOLO-v5-nano-leaky

320×320×3

1.8 M

TensorFlow

848

918

1.2 ms

1.1 ms

4.0 ms

3.6 ms

Ultralytics

DFP

132

YOLO-v5-nano-leaky

640×640×3

1.8 M

TensorFlow

198

211

5.1 ms

4.7 ms

12.1 ms

11.4 ms

Ultralytics

DFP

133

YOLO-v5-nano-p6-v6.2-fast

1280×1280×3

3.1 M

ONNX

42

45

23.8 ms

22.2 ms

51.7 ms

47.8 ms

OpenMMLab

DFP

134

YOLO-v5-nano-v6.1-fast

640×640×3

1.8 M

ONNX

197

208

5.1 ms

4.8 ms

12.1 ms

11.3 ms

OpenMMLab

DFP

135

YOLO-v5-nano-v6.1-fastb64-VOC

512×512×3

1.7 M

ONNX

465

542

2.2 ms

1.8 ms

5.0 ms

4.3 ms

OpenMMLab

DFP

136

YOLO-v5-nu

640×640×3

2.5 M

ONNX

316

357

3.2 ms

2.8 ms

8.8 ms

7.6 ms

Ultralytics

DFP

137

YOLO-v5-small-leaky

320×320×3

6.9 M

TensorFlow

852

927

1.2 ms

1.1 ms

4.1 ms

3.6 ms

Ultralytics

DFP

138

YOLO-v5-small-leaky

416×416×3

6.9 M

TensorFlow

453

468

2.2 ms

2.1 ms

6.9 ms

5.9 ms

Ultralytics

DFP

139

YOLO-v5-small-leaky

640×640×3

6.9 M

TensorFlow

190

202

5.3 ms

5.0 ms

12.6 ms

11.2 ms

Ultralytics

DFP

140

YOLO-v5-small-p6-v6.2-fast

1280×1280×3

12.0 M

ONNX

38

45

26.3 ms

22.2 ms

63.4 ms

54.0 ms

OpenMMLab

DFP

141

YOLO-v5-small-v6.1-fast

640×640×3

6.9 M

ONNX

203

221

4.9 ms

4.5 ms

12.2 ms

11.2 ms

OpenMMLab

DFP

142

YOLO-v5-small-v6.1-fastb64-VOC

512×512×3

6.7 M

ONNX

465

549

2.2 ms

1.8 ms

6.4 ms

5.4 ms

OpenMMLab

DFP

143

YOLO-v5-su

640×640×3

8.7 M

ONNX

266

358

3.8 ms

2.8 ms

11.0 ms

9.1 ms

Ultralytics

DFP

144

YOLO-v6-medium-fast

640×640×3

32.7 M

ONNX

45

63

22.2 ms

15.9 ms

56.7 ms

40.4 ms

OpenMMLab

DFP

145

YOLO-v6-nano-fast

640×640×3

4.1 M

ONNX

320

371

3.1 ms

2.7 ms

7.4 ms

6.3 ms

OpenMMLab

DFP

146

YOLO-v6-small-fast

640×640×3

16.4 M

ONNX

140

198

7.1 ms

5.1 ms

16.8 ms

12.2 ms

OpenMMLab

DFP

147

YOLO-v6-tiny-fast

640×640×3

9.2 M

ONNX

226

320

4.4 ms

3.1 ms

10.9 ms

8.2 ms

OpenMMLab

DFP

148

YOLO-v7

480×640×3

5.9 M

ONNX

247

265

4.0 ms

3.8 ms

11.2 ms

10.2 ms

GitHub/PINTO

DFP

149

YOLO-v7

256×640×3

35.2 M

ONNX

58

82

17.2 ms

12.2 ms

54.6 ms

38.8 ms

GitHub/PINTO

DFP

150

YOLO-v7-tiny

640×640×3

5.9 M

ONNX

199

212

5.0 ms

4.7 ms

12.8 ms

11.6 ms

GitHub/Official YOLOv7

DFP

151

YOLO-v7-tiny

320×320×3

5.9 M

ONNX

859

909

1.2 ms

1.1 ms

4.2 ms

3.8 ms

GitHub/Official YOLOv7

DFP

152

YOLO-v7-tiny

416×416×3

5.9 M

ONNX

431

449

2.3 ms

2.2 ms

6.5 ms

5.8 ms

GitHub/Official YOLOv7

DFP

153

YOLO-v7-tiny-fast-b

640×640×3

5.9 M

ONNX

197

216

5.1 ms

4.6 ms

13.0 ms

12.0 ms

OpenMMLab

DFP

154

YOLO-v8-medium

640×640×3

24.7 M

TFLite

58

81

17.2 ms

12.3 ms

47.8 ms

34.6 ms

Ultralytics

DFP

155

YOLO-v8-medium

640×640×3

24.7 M

ONNX

48

68

20.8 ms

14.7 ms

41.1 ms

29.5 ms

Ultralytics

DFP

156

YOLO-v8-nano

640×640×3

3.0 M

TFLite

318

350

3.1 ms

2.9 ms

9.6 ms

8.6 ms

Ultralytics

DFP

157

YOLO-v8-nano

640×640×3

3.0 M

ONNX

317

340

3.2 ms

2.9 ms

8.9 ms

8.7 ms

Ultralytics

DFP

158

YOLO-v8-nano-Oriented-Bounding-Boxes

1024×1024×3

2.9 M

ONNX

124

139

8.1 ms

7.2 ms

19.0 ms

17.2 ms

Ultralytics

DFP

159

YOLO-v8-small

640×640×3

10.6 M

TFLite

229

315

4.4 ms

3.2 ms

13.2 ms

10.8 ms

Ultralytics

DFP

160

YOLO-v8-small

640×640×3

10.6 M

ONNX

223

316

4.5 ms

3.2 ms

11.7 ms

9.6 ms

Ultralytics

DFP

161

YOLO-v8-small-Oriented-Bounding-Boxes

1024×1024×3

10.9 M

ONNX

76

103

13.2 ms

9.7 ms

22.7 ms

19.5 ms

Ultralytics

DFP

162

YOLO-v9-medium

640×640×3

19.1 M

ONNX

39

55

25.6 ms

18.2 ms

58.6 ms

41.7 ms

Ultralytics

DFP

163

YOLO-v9-small

640×640×3

6.9 M

ONNX

108

149

9.3 ms

6.7 ms

32.5 ms

23.5 ms

Ultralytics

DFP

164

YOLO-v9-tiny

640×640×3

2.0 M

ONNX

262

353

3.8 ms

2.8 ms

16.6 ms

12.5 ms

Ultralytics

DFP

165

YOLOX

640×640×3

8.5 M

ONNX

262

349

3.8 ms

2.9 ms

10.3 ms

8.3 ms

OpenCV

DFP

166

YOLOX-medium

640×640×3

24.1 M

ONNX

66

93

15.2 ms

10.8 ms

36.0 ms

25.7 ms

GitHub/YOLOX

DFP

167

YOLOX-medium-ti-lite

416×416×3

24.1 M

ONNX

158

224

6.3 ms

4.5 ms

19.6 ms

14.0 ms

Texas Instruments

DFP

168

YOLOX-medium-ti-lite

640×640×3

24.1 M

ONNX

79

113

12.7 ms

8.8 ms

32.3 ms

23.1 ms

Texas Instruments

DFP

169

YOLOX-nano

416×416×3

883.3 K

ONNX

808

808

1.2 ms

1.2 ms

3.8 ms

3.8 ms

GitHub/YOLOX

DFP

170

YOLOX-nano-ti-lite

416×416×3

2.1 M

ONNX

770

899

1.3 ms

1.1 ms

3.8 ms

3.3 ms

Texas Instruments

DFP

171

YOLOX-small-ti-lite

640×640×3

8.5 M

ONNX

236

323

4.2 ms

3.1 ms

10.1 ms

8.3 ms

Texas Instruments

DFP

172

YOLOX-small-ti-lite

416×416×3

8.5 M

ONNX

510

722

2.0 ms

1.4 ms

5.6 ms

4.5 ms

Texas Instruments

DFP

173

YOLOX-tiny

416×416×3

4.8 M

ONNX

643

787

1.6 ms

1.3 ms

5.1 ms

4.4 ms

OpenVINO

DFP

174

YOLOX-tiny-ti-lite

416×416×3

4.8 M

ONNX

761

873

1.3 ms

1.1 ms

4.7 ms

3.9 ms

Texas Instruments

DFP

Segmentation

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

175

Autoseg-EdgeTPU-small

512×512×3

2.4 M

TFLite

47

66

21.3 ms

15.2 ms

38.4 ms

27.5 ms

TFHub

DFP

176

DeepLab-v3 (MobileNet-v2)

513×513×3

672.2 K

TFLite

466

553

2.1 ms

1.8 ms

4.6 ms

3.8 ms

Coral

DFP

177

Deeplab-EdgeTPU-extra-small

512×512×3

3.1 M

TFLite

411

563

2.4 ms

1.8 ms

6.0 ms

4.8 ms

TFHub

DFP

178

Deeplab-EdgeTPU-medium

512×512×3

6.8 M

TFLite

234

331

4.3 ms

3.0 ms

10.3 ms

7.6 ms

TFHub

DFP

179

Deeplab-EdgeTPU-small

512×512×3

4.5 M

TFLite

322

456

3.1 ms

2.2 ms

6.9 ms

5.2 ms

TFHub

DFP

180

Deeplab-v3

257×257×3

672.2 K

TFLite

1408

1970

0.7 ms

0.5 ms

2.8 ms

2.2 ms

TFHub

DFP

181

Deeplab-v3-plus

1024×1024×3

2.1 M

TFLite

23

29

43.5 ms

34.5 ms

63.6 ms

50.4 ms

AI Benchmark

DFP

182

EdgeTPU-DeepLab-slim

513×513×3

2.0 M

TFLite

467

561

2.1 ms

1.8 ms

6.2 ms

5.0 ms

Coral

DFP

183

Edgetpu-segmentation-EdgeTPU

512×512×3

2.2 M

TFLite

47

67

21.3 ms

14.9 ms

37.1 ms

26.6 ms

GitHub/PINTO

DFP

184

Edgetpu-segmentation-EdgeTPU

16×16×320

49.5 K

TFLite

765

771

1.3 ms

1.3 ms

2.3 ms

2.3 ms

GitHub/PINTO

DFP

185

FastSAM-small

640×640×3

11.2 M

ONNX

80

113

12.5 ms

8.8 ms

22.8 ms

17.7 ms

Ultralytics

DFP

186

HRNet

256×192×3

27.2 M

ONNX

108

153

9.3 ms

6.5 ms

46.2 ms

32.8 ms

GitHub/PINTO

DFP

187

Human-segmentation

192×192×3

1.5 M

TFLite

652

746

1.5 ms

1.3 ms

3.4 ms

2.8 ms

GitHub/PINTO

DFP

188

MagicTouch

512×512×4

2.9 M

TFLite

223

300

4.5 ms

3.3 ms

11.1 ms

8.9 ms

GitHub/PINTO

DFP

189

MediaPipe-selfie-segmentation

256×256×3

103.8 K

TFLite

691

934

1.4 ms

1.1 ms

4.4 ms

3.7 ms

MediaPipe

DFP

190

MediaPipe-selfie-segmentation-landscape

144×256×3

103.9 K

TFLite

1413

1999

0.7 ms

0.5 ms

2.9 ms

2.5 ms

MediaPipe

DFP

191

PaNet-ResNet-18-ffm

640×640×3

11.7 M

ONNX

27

39

37.0 ms

25.6 ms

56.9 ms

40.5 ms

OpenMMLab

DFP

192

Selfie-Segmentation

256×256×3

103.9 K

TFLite

766

1070

1.3 ms

0.9 ms

4.6 ms

3.5 ms

GitHub/PINTO

DFP

193

U-NetMobileNet-v2

256×256×3

6.2 M

TFLite

51

71

19.6 ms

14.1 ms

23.4 ms

17.2 ms

Coral

DFP

194

UNet

1024×1024×3

1.9 M

TFLite

27

32

37.0 ms

31.2 ms

43.4 ms

37.0 ms

AI Benchmark

DFP

195

UNet

256×256×1

29.6 M

ONNX

31

44

32.3 ms

22.7 ms

35.5 ms

25.4 ms

Zetane Viewer

DFP

196

Xray-80-whole-f2

256×256×1

29.6 M

Keras

34

48

29.4 ms

20.8 ms

43.5 ms

30.9 ms

Zetane Viewer

DFP

197

YOLO-v8-medium-seg

640×640×3

26.0 M

ONNX

27

38

37.0 ms

26.3 ms

61.1 ms

44.6 ms

Ultralytics

DFP

198

YOLO-v8-nano-seg

640×640×3

3.2 M

ONNX

165

171

6.1 ms

5.8 ms

15.0 ms

14.1 ms

Ultralytics

DFP

199

YuNet

120×160×3

81.1 K

TensorFlow

5310

5816

0.2 ms

0.2 ms

0.6 ms

0.5 ms

GitHub/PINTO

DFP

Pose Estimation

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

200

BodyPix (MobileNet)

480×640×3

1.2 M

TFLite

406

478

2.5 ms

2.1 ms

4.9 ms

4.3 ms

Coral

DFP

201

BodyPix (MobileNet)

512×512×3

1.2 M

TFLite

467

558

2.1 ms

1.8 ms

4.4 ms

3.8 ms

Coral

DFP

202

BodyPix (MobileNet)

768×1024×3

1.2 M

TFLite

167

194

6.0 ms

5.2 ms

10.5 ms

9.1 ms

Coral

DFP

203

BodyPix (MobileNet)

576×768×3

1.2 M

TFLite

293

347

3.4 ms

2.9 ms

6.6 ms

5.7 ms

Coral

DFP

204

BodyPix (MobileNet)

720×1280×3

1.2 M

TFLite

144

167

6.9 ms

6.0 ms

12.0 ms

10.7 ms

Coral

DFP

205

BodyPix (MobileNet)

352×480×3

1.2 M

TFLite

790

928

1.3 ms

1.1 ms

3.2 ms

2.8 ms

Coral

DFP

206

BodyPix (ResNet-50)

496×768×3

22.7 M

TFLite

152

215

6.6 ms

4.7 ms

17.6 ms

12.9 ms

Coral

DFP

207

BodyPix (ResNet-50)

624×864×3

22.7 M

TFLite

112

159

8.9 ms

6.3 ms

20.3 ms

14.8 ms

Coral

DFP

208

BodyPix (ResNet-50)

288×416×3

22.7 M

TFLite

247

348

4.0 ms

2.9 ms

12.4 ms

9.1 ms

Coral

DFP

209

BodyPix (ResNet-50)

480×640×3

22.7 M

TFLite

101

138

9.9 ms

7.2 ms

23.7 ms

17.6 ms

Coral

DFP

210

BodyPix (ResNet-50)

672×928×3

22.7 M

TFLite

53

76

18.9 ms

13.2 ms

35.4 ms

25.8 ms

Coral

DFP

211

HHP-Net

1×5×1, 1×5×1, 1×5×1

36.4 K

TFLite

6494

6494

0.2 ms

0.2 ms

0.3 ms

0.3 ms

GitHub/PINTO

DFP

212

Handpose-estimation-mediapipe

224×224×3

988.0 K

ONNX

1898

2185

0.5 ms

0.5 ms

1.5 ms

1.2 ms

OpenCV

DFP

213

Human-pose-estimation-3d-0001

256×448×3

4.8 M

ONNX

461

652

2.2 ms

1.5 ms

9.2 ms

6.8 ms

OpenVINO

DFP

214

MediaPipe-pose-landk

256×256×3

3.0 M

TFLite

528

644

1.9 ms

1.6 ms

4.9 ms

4.2 ms

MediaPipe

DFP

215

MediaPipe-pose-landk-heavy

256×256×3

13.1 M

TFLite

103

146

9.7 ms

6.8 ms

14.6 ms

10.7 ms

MediaPipe

DFP

216

MediaPipe-pose-landk-lite

256×256×3

1.3 M

TFLite

517

591

1.9 ms

1.7 ms

4.4 ms

3.7 ms

MediaPipe

DFP

217

MoveNet.SinglePose.Lightning

192×192×3

2.2 M

TFLite

1507

1538

0.7 ms

0.7 ms

2.7 ms

2.4 ms

Coral

DFP

218

MoveNet.SinglePose.Thunder

256×256×3

5.9 M

TFLite

903

924

1.1 ms

1.1 ms

5.1 ms

4.4 ms

Coral

DFP

219

P-STMO

3×17, 3×17

0.0 K

ONNX

3721

3721

0.3 ms

0.3 ms

0.3 ms

0.3 ms

GitHub/PINTO

DFP

220

Pose-estimation-mediapipe

258×258×3

1.3 M

ONNX

525

591

1.9 ms

1.7 ms

4.5 ms

3.7 ms

OpenCV

DFP

221

PoseC3D

48×64×64×17

2.0 M

ONNX

29

41

34.5 ms

24.4 ms

41.8 ms

30.4 ms

GitHub/PINTO

DFP

222

PoseC3D

48×56×56×17

2.9 M

ONNX

33

47

30.3 ms

21.3 ms

36.9 ms

26.6 ms

GitHub/PINTO

DFP

223

PoseNet (MobileNet)

353×481×3

1.2 M

TFLite

787

928

1.3 ms

1.1 ms

2.8 ms

2.5 ms

Coral

DFP

224

PoseNet (MobileNet)

481×641×3

1.2 M

TFLite

407

486

2.5 ms

2.1 ms

4.6 ms

4.0 ms

Coral

DFP

225

PoseNet (MobileNet)

721×1281×3

1.2 M

TFLite

145

169

6.9 ms

5.9 ms

11.4 ms

10.0 ms

Coral

DFP

226

PoseNet (ResNet-50)

288×416×3

22.6 M

TFLite

258

365

3.9 ms

2.7 ms

12.2 ms

8.9 ms

Coral

DFP

227

PoseNet (ResNet-50)

496×768×3

22.6 M

TFLite

153

217

6.5 ms

4.6 ms

16.6 ms

12.1 ms

Coral

DFP

228

PoseNet (ResNet-50)

736×960×3

22.6 M

TFLite

83

117

12.0 ms

8.5 ms

24.9 ms

18.1 ms

Coral

DFP

229

PoseNet (ResNet-50)

624×864×3

22.6 M

TFLite

112

159

8.9 ms

6.3 ms

20.4 ms

14.8 ms

Coral

DFP

230

PoseNet (ResNet-50)

480×640×3

22.6 M

TFLite

117

165

8.5 ms

6.1 ms

20.3 ms

14.8 ms

Coral

DFP

231

PoseNet (ResNet-50)

672×928×3

22.6 M

TFLite

53

75

18.9 ms

13.3 ms

35.6 ms

25.8 ms

Coral

DFP

232

RtmDet-nano-person

320×320×3

962.8 K

ONNX

1162

1340

0.9 ms

0.7 ms

3.5 ms

2.6 ms

OpenMMLab

DFP

233

YOLO-v8-medium-pose

640×640×3

25.2 M

ONNX

44

62

22.7 ms

16.1 ms

43.2 ms

30.9 ms

Ultralytics

DFP

234

YOLO-v8-nano-pose

640×640×3

3.1 M

ONNX

317

329

3.2 ms

3.0 ms

10.0 ms

8.7 ms

Ultralytics

DFP

235

YOLO-v8-small-pose

640×640×3

11.1 M

ONNX

228

317

4.4 ms

3.2 ms

12.9 ms

10.6 ms

Ultralytics

DFP

Image Enhancement/Super Resolution

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

236

AOD-Net

720×1280×3

1.7 K

TFLite

17

24

58.8 ms

41.7 ms

62.3 ms

45.3 ms

GitHub/PINTO

DFP

237

AOD-Net

480×640×3

1.7 K

TFLite

52

73

19.2 ms

13.7 ms

21.4 ms

15.7 ms

GitHub/PINTO

DFP

238

Colorization-v2

256×256×1

30.7 M

ONNX

36

51

27.8 ms

19.6 ms

40.4 ms

29.2 ms

OpenVINO

DFP

239

DPED

384×512×48

414.7 K

TFLite

25

25

40.0 ms

40.0 ms

77.8 ms

76.3 ms

AI Benchmark

DFP

240

ESRGAN

128×128×3

1.2 M

TFLite

59

80

16.9 ms

12.5 ms

24.7 ms

18.1 ms

AI Benchmark

DFP

241

Fast-SRGAN

512×512×3

154.9 K

TFLite

4

5

250.0 ms

200.0 ms

272.3 ms

195.8 ms

GitHub/PINTO

DFP

242

Fast-SRGAN

128×128×3

154.9 K

TFLite

59

81

16.9 ms

12.3 ms

18.3 ms

13.6 ms

GitHub/PINTO

DFP

243

IMDN

480×640×3

873.0 K

TFLite

9

12

111.1 ms

83.3 ms

177.0 ms

142.5 ms

GitHub/PINTO

DFP

244

IMDN

360×640×3

873.0 K

TFLite

12

16

83.3 ms

62.5 ms

136.1 ms

108.8 ms

GitHub/PINTO

DFP

245

Imdn

1024×1024×3

149.1 K

TFLite

39

42

25.6 ms

23.8 ms

30.5 ms

28.7 ms

AI Benchmark

DFP

246

MBLLEN

480×640×3

439.6 K

TFLite

11

15

90.9 ms

66.7 ms

99.7 ms

71.0 ms

GitHub/PINTO

DFP

247

MBLLEN

720×1280×3

439.6 K

TFLite

4

5

250.0 ms

200.0 ms

291.4 ms

207.2 ms

GitHub/PINTO

DFP

248

Noise2Noise

256×256×3

1.2 M

TFLite

61

86

16.4 ms

11.6 ms

20.9 ms

15.2 ms

GitHub/PINTO

DFP

249

PMN

416×416×4

7.4 M

ONNX

43

61

23.3 ms

16.4 ms

27.5 ms

19.8 ms

GitHub/PINTO

DFP

250

SCI

288×800×3

0.2 K

ONNX

340

380

2.9 ms

2.6 ms

4.5 ms

4.1 ms

GitHub/PINTO

DFP

251

SCL-LLE

240×320×3

77.6 K

TFLite

104

148

9.6 ms

6.8 ms

13.7 ms

10.8 ms

GitHub/PINTO

DFP

252

SCL-LLE

180×320×3

77.6 K

TFLite

138

195

7.2 ms

5.1 ms

10.5 ms

8.3 ms

GitHub/PINTO

DFP

253

SRCNN-di-v2-k

896×896×3

19.6 K

ONNX

7

10

142.9 ms

100.0 ms

138.8 ms

99.1 ms

OpenMMLab

DFP

254

SRGAN

256×256×3

1.4 M

TFLite

8

11

125.0 ms

90.9 ms

137.3 ms

97.6 ms

AI Benchmark

DFP

255

Semantic-Guided-Low-Light-Image-Enhanceme…

24×54×3

10.3 K

ONNX

6652

6970

0.2 ms

0.1 ms

0.4 ms

0.4 ms

GitHub/PINTO

DFP

256

Super-Resolution

224×224×1

58.3 K

ONNX

160

227

6.2 ms

4.4 ms

7.1 ms

5.3 ms

ONNX Zoo

DFP

257

TBEFN

180×320×3

475.0 K

TFLite

201

233

5.0 ms

4.3 ms

6.3 ms

5.7 ms

GitHub/PINTO

DFP

258

TBEFN

240×320×3

475.0 K

TFLite

158

178

6.3 ms

5.6 ms

7.8 ms

7.1 ms

GitHub/PINTO

DFP

259

VSR

540×960×3

18.6 K

TFLite

11

11

90.9 ms

90.9 ms

163.0 ms

159.1 ms

AI Benchmark

DFP

260

XLSR

360×640×3

21.5 K

TFLite

34

34

29.4 ms

29.4 ms

50.8 ms

46.8 ms

AI Benchmark

DFP

261

Y-Net

480×640×3

190.9 K

TFLite

32

40

31.2 ms

25.0 ms

33.2 ms

27.1 ms

GitHub/PINTO

DFP

262

Y-Net

240×320×3

190.9 K

TFLite

130

161

7.7 ms

6.2 ms

9.0 ms

7.4 ms

GitHub/PINTO

DFP

263

Zero-DCE

360×640×3

77.6 K

TFLite

40

42

25.0 ms

23.8 ms

33.6 ms

32.4 ms

GitHub/PINTO

DFP

264

Zero-DCE

240×320×3

77.6 K

TFLite

121

127

8.3 ms

7.9 ms

11.8 ms

11.4 ms

GitHub/PINTO

DFP

265

Zero-DCE-improved

360×512×3

23.0 K

ONNX

87

101

11.5 ms

9.9 ms

17.1 ms

15.3 ms

GitHub/PINTO

DFP

Face/Head

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

266

ACR-Loss

224×224×3

2.3 M

TFLite

1894

2252

0.5 ms

0.4 ms

1.6 ms

1.3 ms

GitHub/PINTO

DFP

267

BlazeFace

128×128×3

99.0 K

TensorFlow

6021

7147

0.2 ms

0.1 ms

0.6 ms

0.6 ms

GitHub/PINTO

DFP

268

Face-Detection-0100

256×256×3

1.7 M

TFLite

1634

1894

0.6 ms

0.5 ms

1.7 ms

1.4 ms

GitHub/PINTO

DFP

269

Face-Detection-YuNet

640×640×3

51.9 K

ONNX

322

377

3.1 ms

2.7 ms

4.9 ms

4.2 ms

OpenCV

DFP

270

Face-Detection-adas-0001

384×672×3

1.0 M

TFLite

526

626

1.9 ms

1.6 ms

3.7 ms

3.3 ms

GitHub/PINTO

DFP

271

Face-Mask-Detection

300×300×3

2.5 M

TFLite

840

1189

1.2 ms

0.8 ms

2.9 ms

2.3 ms

GitHub/PINTO

DFP

272

Face-landk

160×160×3

611.3 K

ONNX

3998

4722

0.3 ms

0.2 ms

0.8 ms

0.7 ms

GitHub/PINTO

DFP

273

Face-recognition-sface

112×112×3

9.2 M

ONNX

2580

3649

0.4 ms

0.3 ms

1.5 ms

1.1 ms

OpenCV

DFP

274

FaceBoxes

1024×1024×3

982.3 K

ONNX

126

150

7.9 ms

6.7 ms

10.8 ms

9.5 ms

OpenVINO

DFP

275

FaceMesh

192×192×3

590.5 K

TFLite

3526

3945

0.3 ms

0.3 ms

0.9 ms

0.8 ms

GitHub/PINTO

DFP

276

MediaPipe-face-Detection-range

192×192×3

502.1 K

TFLite

2577

3514

0.4 ms

0.3 ms

1.7 ms

1.4 ms

MediaPipe

DFP

277

MediaPipe-face-Detection-short-range

128×128×3

99.1 K

TFLite

6093

7187

0.2 ms

0.1 ms

0.6 ms

0.6 ms

MediaPipe

DFP

278

MediaPipe-face-landk

192×192×3

590.5 K

TFLite

3540

3946

0.3 ms

0.3 ms

0.9 ms

0.7 ms

MediaPipe

DFP

279

MediaPipe-iris-landk

64×64×3

636.0 K

TFLite

8508

8508

0.1 ms

0.1 ms

0.6 ms

0.6 ms

MediaPipe

DFP

280

RetinaFacewithResNet-50

640×640×3

26.0 M

ONNX

45

64

22.2 ms

15.6 ms

34.7 ms

25.0 ms

OpenVINO

DFP

281

SFace

112×112×3

9.2 M

TFLite

2579

3650

0.4 ms

0.3 ms

1.4 ms

1.1 ms

GitHub/PINTO

DFP

282

SSD-MobileNet-v2 (Face)

320×320×3

5.1 M

TFLite

1142

1350

0.9 ms

0.7 ms

2.6 ms

2.1 ms

Coral

DFP

283

SynergyNet

120×120×3

2.2 M

ONNX

4939

6983

0.2 ms

0.1 ms

0.9 ms

0.8 ms

GitHub/PINTO

DFP

284

UltraLightweightFaceDetectionRFB320

240×320×3

274.5 K

ONNX

1625

1870

0.6 ms

0.5 ms

1.4 ms

1.3 ms

OpenVINO

DFP

285

UltraLightweightFaceDetectionslim320

240×320×3

258.5 K

ONNX

1648

1946

0.6 ms

0.5 ms

1.3 ms

1.2 ms

OpenVINO

DFP

286

Ultraface

240×320×3

274.5 K

ONNX

1621

1871

0.6 ms

0.5 ms

1.4 ms

1.3 ms

ONNX Zoo

DFP

287

Ultraface

480×640×3

274.5 K

ONNX

408

486

2.5 ms

2.1 ms

3.8 ms

3.4 ms

ONNX Zoo

DFP

288

Version-RFB

240×320×3

274.5 K

ONNX

1626

1863

0.6 ms

0.5 ms

1.4 ms

1.3 ms

ONNX Zoo

DFP

289

WHENet

224×224×3

4.1 M

TFLite

970

1374

1.0 ms

0.7 ms

6.4 ms

4.8 ms

GitHub/PINTO

DFP

290

YOLO-v5-Face

256×320×3

1.6 M

TensorFlow

1554

1822

0.6 ms

0.5 ms

2.9 ms

2.3 ms

GitHub/PINTO

DFP

291

YuNet-v2

640×640×3

51.9 K

TFLite

324

380

3.1 ms

2.6 ms

4.8 ms

4.2 ms

GitHub/PINTO

DFP

Classification (Other)

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

292

Aiy-vision-classifier-birds

224×224×3

3.3 M

TFLite

1785

2247

0.6 ms

0.4 ms

2.0 ms

1.6 ms

TFHub

DFP

293

Aiy-vision-classifier-food

192×192×3

5.0 M

TFLite

3513

3903

0.3 ms

0.3 ms

1.5 ms

1.2 ms

TFHub

DFP

294

Aiy-vision-classifier-insects

224×224×3

3.4 M

TFLite

1785

2223

0.6 ms

0.4 ms

1.9 ms

1.6 ms

TFHub

DFP

295

Aiy-vision-classifier-plants

224×224×3

4.7 M

TFLite

1785

2239

0.6 ms

0.4 ms

2.0 ms

1.6 ms

TFHub

DFP

296

Anti-spoof-mn3

128×128×3

2.9 M

TFLite

4377

6190

0.2 ms

0.2 ms

1.8 ms

1.4 ms

GitHub/PINTO

DFP

297

Gender-googleNet

224×224×3

5.7 M

ONNX

519

734

1.9 ms

1.4 ms

3.8 ms

2.9 ms

ONNX Zoo

DFP

298

Malaria-Detector

125×125×3

6.7 M

Keras

6504

7524

0.2 ms

0.1 ms

0.6 ms

0.5 ms

xmartlabs

DFP

299

NSFW

224×224×3

5.6 M

TFLite

1793

2165

0.6 ms

0.5 ms

2.3 ms

1.8 ms

GitHub/PINTO

DFP

300

Person-Attributes-recog-crossroad-0230

160×80×3

717.7 K

TFLite

5819

7572

0.2 ms

0.1 ms

0.7 ms

0.5 ms

GitHub/PINTO

DFP

301

Vehicle-Attributes-recog-barrier-0039

72×72×3

611.5 K

TFLite

7148

7862

0.1 ms

0.1 ms

0.6 ms

0.6 ms

GitHub/PINTO

DFP

302

Vehicle-Attributes-recog-barrier-0042

72×72×3

10.7 M

TFLite

5907

7304

0.2 ms

0.1 ms

1.2 ms

1.0 ms

GitHub/PINTO

DFP

ADAS/Driver Monitoring

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

303

Driver-action-recognition-adas-0002-encod…

224×224×3

2.7 M

TFLite

1891

2259

0.5 ms

0.4 ms

1.7 ms

1.4 ms

GitHub/PINTO

DFP

304

Gaze-estimation-adas-0002

60×60×3, 60×60×3, 3

1.8 M

TFLite

3204

3204

0.3 ms

0.3 ms

0.8 ms

0.8 ms

GitHub/PINTO

DFP

305

Open-closed-eye-0001

32×32×3

11.0 K

ONNX

10945

10945

0.1 ms

0.1 ms

0.2 ms

0.2 ms

OpenVINO

DFP

306

Pedestrian-Detection-adas-0002

384×672×3

1.1 M

TFLite

524

608

1.9 ms

1.6 ms

3.9 ms

3.5 ms

GitHub/PINTO

DFP

307

Pedestrian-and-vehicle-Detector-adas-0001

384×672×3

1.6 M

TFLite

522

619

1.9 ms

1.6 ms

4.2 ms

3.6 ms

GitHub/PINTO

DFP

308

Road-segmentation-adas-0001

512×896×3

180.0 K

TFLite

139

174

7.2 ms

5.7 ms

10.6 ms

8.3 ms

GitHub/PINTO

DFP

309

Vehicle-Detection-0200

256×256×3

1.7 M

TFLite

1636

1884

0.6 ms

0.5 ms

1.7 ms

1.4 ms

GitHub/PINTO

DFP

310

YOLOp320

320×320×3

7.6 M

ONNX

380

507

2.6 ms

2.0 ms

7.3 ms

5.5 ms

GitHub/YOLOP

DFP

311

YOLOp640

640×640×3

7.6 M

ONNX

123

159

8.1 ms

6.3 ms

18.4 ms

14.1 ms

GitHub/YOLOP

DFP

Hand/Palm

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

312

Hand-Detection-and-Tracking

256×256×3

1.3 M

TensorFlow

1035

1127

1.0 ms

0.9 ms

4.3 ms

3.4 ms

GitHub/PINTO

DFP

313

Hand-recrop

256×256×3

26.1 K

TFLite

1625

1980

0.6 ms

0.5 ms

1.0 ms

0.9 ms

GitHub/PINTO

DFP

314

MediaPipe-hand-landk

224×224×3

2.6 M

TFLite

1867

2234

0.5 ms

0.4 ms

1.9 ms

1.5 ms

MediaPipe

DFP

315

MediaPipe-hand-landk-lite

224×224×3

988.0 K

TFLite

1893

2174

0.5 ms

0.5 ms

1.4 ms

1.2 ms

MediaPipe

DFP

316

MediaPipe-hand-recrop

256×256×3

26.4 K

TFLite

1621

1980

0.6 ms

0.5 ms

1.1 ms

0.9 ms

MediaPipe

DFP

317

MediaPipe-palm-Detection

192×192×3

1.1 M

TFLite

906

1280

1.1 ms

0.8 ms

2.7 ms

2.1 ms

MediaPipe

DFP

318

MediaPipe-palm-Detection-lite

192×192×3

937.6 K

TFLite

1259

1736

0.8 ms

0.6 ms

2.2 ms

1.8 ms

MediaPipe

DFP

319

Palm-Detection-mediapipe

192×192×3

937.6 K

ONNX

1138

1551

0.9 ms

0.6 ms

2.3 ms

1.9 ms

OpenCV

DFP

Depth Estimation

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

320

Graft-PSMNet

120×160×256

1.2 M

ONNX

92

92

10.9 ms

10.9 ms

22.0 ms

22.0 ms

GitHub/PINTO

DFP

321

Graft-PSMNet

80×120×256

1.2 M

ONNX

184

184

5.4 ms

5.4 ms

10.4 ms

10.4 ms

GitHub/PINTO

DFP

322

HR-Depth

384×1280×3

10.7 M

ONNX

29

29

34.5 ms

34.5 ms

69.9 ms

68.2 ms

GitHub/PINTO

DFP

323

PyDNet

192×320×3

1.9 M

TFLite

354

501

2.8 ms

2.0 ms

5.0 ms

3.8 ms

GitHub/PINTO

DFP

324

PyDNet2

384×1280×3

699.9 K

TFLite

44

63

22.7 ms

15.9 ms

28.8 ms

21.6 ms

GitHub/PINTO

DFP

325

PyDNet2

384×640×3

699.9 K

TFLite

89

126

11.2 ms

7.9 ms

14.8 ms

11.1 ms

GitHub/PINTO

DFP

Style Transfer/GANs

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

326

Arbitrary-stylization-inception-v3

256×256×3

8.6 M

TFLite

566

802

1.8 ms

1.2 ms

4.8 ms

3.5 ms

TFHub

DFP

327

Facial-cartoonizer

512×512×3

2.0 M

ONNX

59

81

16.9 ms

12.3 ms

20.7 ms

15.4 ms

GitHub/Facial Image Cartoonizaiton

DFP

328

Magenta-arbitrary-stylization-256

256×256×3

2.2 M

TFLite

1644

1977

0.6 ms

0.5 ms

1.7 ms

1.4 ms

TFHub

DFP

329

MobileStyleGAN

512

2.0 M

ONNX

13730

13730

0.1 ms

0.1 ms

0.3 ms

0.3 ms

GitHub/PINTO

DFP

Emotion Detection

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

330

Emotion-FERPlus

64×64×1

8.4 M

TFLite

965

1367

1.0 ms

0.7 ms

1.8 ms

1.3 ms

GitHub/PINTO

DFP

331

Emotion-ferplus

64×64×1

8.4 M

ONNX

991

1404

1.0 ms

0.7 ms

1.8 ms

1.3 ms

ONNX Zoo

DFP

332

Facial-expRession-recognition-MobilefaceN…

112×112×3

1.1 M

TFLite

5722

7618

0.2 ms

0.1 ms

0.9 ms

0.8 ms

GitHub/PINTO

DFP

333

Facial-expRession-recognition-MobilefaceN…

112×112×3

1.1 M

ONNX

5722

7617

0.2 ms

0.1 ms

0.9 ms

0.8 ms

OpenCV

DFP

Audio/Speech

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

334

FRILL

96×64×1

9.6 M

TFLite

5465

7725

0.2 ms

0.1 ms

1.3 ms

1.0 ms

GitHub/PINTO

DFP

335

Light-SERNet

184×40×1

449.9 K

TFLite

3213

3369

0.3 ms

0.3 ms

0.7 ms

0.6 ms

GitHub/PINTO

DFP

336

Speech-enhancement

128×128×1

1.9 M

ONNX

967

1370

1.0 ms

0.7 ms

2.1 ms

1.6 ms

GitHub/PINTO

DFP

337

YAMNet

96×64×1

3.6 M

TFLite

7879

7881

0.1 ms

0.1 ms

0.9 ms

0.7 ms

GitHub/PINTO

DFP

Gesture Recognition

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

338

American-sign-language

224×224×3

2.7 M

TFLite

1899

2260

0.5 ms

0.4 ms

1.6 ms

1.3 ms

TFHub

DFP

339

FINNger

96×96×3

3.2 M

TensorFlow

379

537

2.6 ms

1.9 ms

3.8 ms

2.8 ms

GitHub/PINTO

DFP

340

Naruto-handsign-Detection

416×416×3

871.1 K

TFLite

809

809

1.2 ms

1.2 ms

3.5 ms

3.5 ms

GitHub/PINTO

DFP

Tracking

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

341

LiteTrack

127×127×3

1.2 M

TFLite

2447

3464

0.4 ms

0.3 ms

2.7 ms

2.0 ms

GitHub/PINTO

DFP

342

Object-tracking-dasiamrpn

360×480×3

4.8 M

ONNX

93

132

10.8 ms

7.6 ms

12.6 ms

9.2 ms

OpenCV

DFP

343

Object-tracking-dasiamrpn-kernel-r1

24×24×256

11.3 M

ONNX

84

84

11.9 ms

11.9 ms

24.9 ms

24.9 ms

OpenCV

DFP

Point Cloud

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

344

Pointpillars-hv-secfpn-kitti-3d-3class

496×432×64

4.6 M

ONNX

10

15

100.0 ms

66.7 ms

123.0 ms

94.7 ms

OpenMMLab

DFP

345

Pointpillars-hv-secfpn-sbn-all-2x-nus-3d

400×400×64

4.7 M

ONNX

13

18

76.9 ms

55.6 ms

125.8 ms

102.9 ms

OpenMMLab

DFP

346

SFA3D

608×608×3

12.1 M

TensorFlow

90

95

11.1 ms

10.5 ms

20.0 ms

17.2 ms

GitHub/PINTO

DFP

Wireframe/keypoint Detection

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

347

M-LSD

320×320×4

599.8 K

TFLite

804

1054

1.2 ms

0.9 ms

3.1 ms

2.6 ms

GitHub/PINTO

DFP

348

M-LSD

512×512×4

1.5 M

TFLite

31

44

32.3 ms

22.7 ms

37.9 ms

28.0 ms

GitHub/PINTO

DFP

Re-identification

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

349

Person-ReID-youtu

256×128×3

25.5 M

ONNX

736

1042

1.4 ms

1.0 ms

4.1 ms

3.1 ms

OpenCV

DFP

Third-Party Licenses

Each of these models is shared under the original creator’s license. Please check the license at the source page.