Model eXplorer#

At MemryX, we do not maintain a curated model zoo which limits customers choice. Instead, we recommend customers choose/train their own model(s) and use MemryX automated tools to generate executable DFP files (.dfp = “dataflow program”).

Our automated tools do not modify original source models (e.g. no pruning, no distillation, etc.) and do not require any retraining (or any dataset) to maintain high accuracy. Instead, our tools compile models as they were trained, resulting in dataflow programs that execute with high accuracy and high utilization of available hardware.

The list of models below was created using a model explorer that automatically aggregates, compiles, and tests models from various public online sources on MemryX hardware. Anyone can use these publicly available models, access links for detailed model source information, and either recreate or simply download the compiled DFP. Unless explicitly stated, none of these models were developed by or are owned by MemryX. This model list will evolve over time depending on customer feedback.

Of course, a customer can certainly choose to modify any given model(s) prior to using MemryX tools. For example, if a customer is willing to tradeoff accuracy for performance, one can choose to prune, quantize, and/or distill model(s) and then create an executable for measuring performance & accuracy.

Benchmark Details

  • SDK Version: 2.1

  • Compilation: Closed-loop method is used to create DFPs. See Closed Loop Compilation tutorial.

  • Host: Intel i7-9700T (1.5 GHz), 16 GB RAM

  • Metrics: FPS and latency reported for Default (14 TFLOPS) and Full (20 TFLOPS) modes. Benchmarks up to 40 TFLOPS will be added in future releases.

  • Latency 1: Frame-to-frame latency (used to compute FPS)

  • Latency 2: Full system latency (including host) from initial input to final output

Understanding Model Icons
Tutorial code

Models featured in step-by-step coding tutorials. See Tutorials.

Example app (video)

Used in a complete example application that processes video streams. Browse MemryX eXamples.

Example app (image)

Used in a complete example application for still-image workflows. Browse MemryX eXamples.

Example app (audio)

Used in a complete example application for audio/voice pipelines. Browse MemryX eXamples.

Needs Neural Compiler extension

Requires additional extensions to run properly. See Neural Compiler and Neural Compiler Extensions tutorial.

MXA optimized

Optimized/retrained by the MemryX team for better MXA performance while preserving accuracy.

Models (Below is a partial list of tested models)

Below is a partial list of AI models that MemryX has downloaded, compiled, and benchmarked from public sources. This is not a model zoo; the models remain unmodified (unless explicitly mentioned), and MemryX customers are not restricted to using these models. Customers are welcome to compile additional models as needed. For guidance, see the Neural Compiler and Tutorials pages.

Classification (ImageNet)
Classification (ImageNet)
Object Detection
Object Detection
Segmentation
Segmentation
Pose Estimation
Pose Estimation
Image Enhancement/Super Resolution
Image Enhancement/Super Resolution
Face/Head
Face/Head
Classification (Other)
Classification (Other)
ADAS/Driver Monitoring
ADAS/Driver Monitoring
Hand/Palm
Hand/Palm
Depth Estimation
Depth Estimation
Point Cloud
Point Cloud
Audio/Speech
Audio/Speech
Emotion Detection
Emotion Detection
Style Transfer/GANs
Style Transfer/GANs
Gesture Recognition
Gesture Recognition
Tracking
Tracking
Wireframe/keypoint Detection
Wireframe/keypoint Detection
Re-identification
Re-identification
Classification (ImageNet)

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

1

ConvNext-tiny

224×224×3

27.3 M

ONNX

377

529

2.7 ms

1.9 ms

18.3 ms

13.1 ms

HuggingFace

DFP

2

CS3-DarkNet

256×256×3

8.9 M

ONNX

1676

2025

0.6 ms

0.5 ms

2.5 ms

1.9 ms

Timm

DFP

3

CS3-SE-DarkNet

256×256×3

20.9 M

ONNX

110

156

9.1 ms

6.4 ms

31.5 ms

22.4 ms

Timm

DFP

4

CSP-DarkNet-53

256×256×3

26.3 M

ONNX

467

663

2.1 ms

1.5 ms

9.8 ms

7.1 ms

Timm

DFP

5

CSP-ResNet-50

256×256×3

20.6 M

ONNX

868

1127

1.2 ms

0.9 ms

5.3 ms

4.0 ms

OpenMMLab

DFP

6

DarkNet-53

256×256×3

39.7 M

ONNX

82

117

12.2 ms

8.5 ms

27.4 ms

19.5 ms

Timm

DFP

7

DarkNet-AA53

256×256×3

34.3 M

ONNX

224

317

4.5 ms

3.2 ms

14.2 ms

10.2 ms

Timm

DFP

8

DenseNet121

224×224×3

7.8 M

ONNX

737

1035

1.4 ms

1.0 ms

10.6 ms

7.6 ms

ONNX Zoo

DFP

9

DenseNet121

224×224×3

7.7 M

Keras

711

1008

1.4 ms

1.0 ms

11.0 ms

7.9 ms

Keras.Applications

DFP

10

DenseNet169

224×224×3

13.6 M

Keras

521

738

1.9 ms

1.4 ms

18.9 ms

13.5 ms

Keras.Applications

DFP

11

DenseNet201

224×224×3

19.3 M

Keras

333

472

3.0 ms

2.1 ms

32.0 ms

22.8 ms

Keras.Applications

DFP

12

DLA34

224×224×3

15.0 M

ONNX

603

854

1.7 ms

1.2 ms

4.5 ms

3.3 ms

OpenVINO

DFP

13

EfficientNet-B0

224×224×3

5.0 M

ONNX

1013

1433

1.0 ms

0.7 ms

7.4 ms

5.5 ms

OpenVINO

DFP

14

EfficientNet-B1

240×240×3

7.4 M

ONNX

518

735

1.9 ms

1.4 ms

14.6 ms

10.5 ms

OpenMMLab

DFP

15

EfficientNet-EdgeTpu(L)

300×300×3

10.1 M

TFLite

165

234

6.1 ms

4.3 ms

14.4 ms

10.3 ms

Coral

DFP

16

EfficientNet-EdgeTpu(M)

240×240×3

6.5 M

TFLite

449

636

2.2 ms

1.6 ms

6.7 ms

4.9 ms

Coral

DFP

17

EfficientNet-EdgeTpu(S)

224×224×3

3.9 M

TFLite

487

690

2.1 ms

1.4 ms

4.2 ms

3.1 ms

Coral

DFP

18

EfficientNet-lite0

224×224×3

4.4 M

TFLite

1946

2327

0.5 ms

0.4 ms

2.0 ms

1.5 ms

Kaggle

DFP

19

EfficientNet-lite1

240×240×3

5.1 M

TFLite

1944

2318

0.5 ms

0.4 ms

2.4 ms

1.8 ms

Kaggle

DFP

20

EfficientNet-lite2

260×260×3

5.8 M

TFLite

1538

1781

0.7 ms

0.6 ms

3.4 ms

2.6 ms

Kaggle

DFP

21

EfficientNet-lite3

280×280×3

7.8 M

TFLite

1218

1724

0.8 ms

0.6 ms

4.3 ms

3.2 ms

Kaggle

DFP

22

EfficientNet-lite4

300×300×3

12.4 M

TFLite

750

1062

1.3 ms

0.9 ms

8.9 ms

6.4 ms

Kaggle

DFP

23

EfficientNet-lite4

224×224×3

12.4 M

ONNX

1402

1985

0.7 ms

0.5 ms

6.0 ms

4.4 ms

ONNX Zoo

DFP

24

EfficientNet-v2-B0

224×224×3

6.8 M

ONNX

1100

1558

0.9 ms

0.6 ms

6.6 ms

4.8 ms

OpenMMLab

DFP

25

EfficientNet-v2-B0

224×224×3

6.9 M

Keras

1102

1560

0.9 ms

0.6 ms

6.0 ms

4.4 ms

Keras.Applications

DFP

26

EfficientNet-v2-B1

240×240×3

7.7 M

ONNX

1016

1438

1.0 ms

0.7 ms

10.0 ms

7.2 ms

OpenMMLab

DFP

27

EfficientNet-v2-B1

240×240×3

7.8 M

Keras

1019

1442

1.0 ms

0.7 ms

8.6 ms

6.2 ms

Keras.Applications

DFP

28

EfficientNet-v2-B2

260×260×3

9.6 M

ONNX

761

1077

1.3 ms

0.9 ms

14.6 ms

10.4 ms

OpenMMLab

DFP

29

EfficientNet-v2-B2

260×260×3

9.7 M

Keras

762

1080

1.3 ms

0.9 ms

13.4 ms

9.6 ms

Keras.Applications

DFP

30

EfficientNet-v2-B3

300×300×3

13.8 M

Keras

524

742

1.9 ms

1.3 ms

25.2 ms

18.0 ms

Keras.Applications

DFP

31

FastViT

256×256×3

3.8 M

ONNX

1124

1591

0.9 ms

0.6 ms

3.8 ms

2.8 ms

Timm

DFP

32

FBNet-v3

224×224×3

8.2 M

ONNX

1783

2282

0.6 ms

0.4 ms

7.8 ms

5.7 ms

Timm

DFP

33

FBNetC

224×224×3

5.3 M

ONNX

1947

2328

0.5 ms

0.4 ms

2.1 ms

1.6 ms

Timm

DFP

34

GerNet-large

256×256×3

29.6 M

ONNX

488

691

2.0 ms

1.4 ms

9.3 ms

6.8 ms

Timm

DFP

35

GhostNet

224×224×3

4.9 M

ONNX

1628

2302

0.6 ms

0.4 ms

3.8 ms

2.9 ms

Timm

DFP

36

GhostNet-v2

224×224×3

5.8 M

ONNX

1033

1462

1.0 ms

0.7 ms

6.2 ms

4.5 ms

Timm

DFP

37

GoogleNet

224×224×3

6.7 M

ONNX

518

734

1.9 ms

1.4 ms

3.8 ms

2.8 ms

ONNX Zoo

DFP

38

HardCoRe-NAS

224×224×3

4.9 M

ONNX

1943

2319

0.5 ms

0.4 ms

2.5 ms

2.0 ms

Timm

DFP

39

HBONet0.25

224×224×3

1.8 M

ONNX

1941

2329

0.5 ms

0.4 ms

1.5 ms

1.2 ms

OpenVINO

DFP

40

HBONet1.0

224×224×3

4.3 M

ONNX

1112

1178

0.9 ms

0.8 ms

3.2 ms

2.6 ms

OpenVINO

DFP

41

HGNet-tiny

224×224×3

14.0 M

ONNX

372

527

2.7 ms

1.9 ms

9.7 ms

7.0 ms

Timm

DFP

42

HGNet-v2

224×224×3

37.7 M

ONNX

96

136

10.4 ms

7.4 ms

41.1 ms

29.2 ms

Timm

DFP

43

Inception

224×224×3

6.7 M

ONNX

536

760

1.9 ms

1.3 ms

3.7 ms

2.8 ms

ONNX Zoo

DFP

44

Inception

224×224×3

6.3 M

TFLite

751

1064

1.3 ms

0.9 ms

2.8 ms

2.1 ms

Coral

DFP

45

Inception-ResNet-v2

299×299×3

28.9 M

TensorFlow

168

238

6.0 ms

4.2 ms

36.5 ms

25.9 ms

OpenVINO

DFP

46

Inception-v2

224×224×3

10.7 M

ONNX

751

1063

1.3 ms

0.9 ms

3.5 ms

2.7 ms

ONNX Zoo

DFP

47

Inception-v3

299×299×3

22.7 M

TFLite

317

449

3.2 ms

2.2 ms

10.0 ms

7.2 ms

Kaggle

DFP

48

Inception-v3

346×346×3

22.7 M

TFLite

275

390

3.6 ms

2.6 ms

11.9 ms

8.6 ms

AI Benchmark

DFP

49

Inception-v3

299×299×3

22.7 M

TensorFlow

317

449

3.2 ms

2.2 ms

10.1 ms

7.3 ms

OpenVINO

DFP

50

Inception-v3

299×299×3

22.7 M

ONNX

317

449

3.2 ms

2.2 ms

10.0 ms

7.2 ms

OpenMMLab

DFP

51

Inception-v3

224×224×3

10.7 M

TFLite

749

1061

1.3 ms

0.9 ms

3.6 ms

2.7 ms

Coral

DFP

52

Inception-v3

299×299×3

22.7 M

Keras

317

449

3.2 ms

2.2 ms

10.0 ms

7.2 ms

Keras.Applications

DFP

53

MobileNet

128×128×3

4.0 M

TFLite

6820

7945

0.1 ms

0.1 ms

1.0 ms

0.8 ms

Kaggle

DFP

54

MobileNet

224×224×3

4.0 M

TFLite

1951

2329

0.5 ms

0.4 ms

1.5 ms

1.2 ms

Kaggle

DFP

55

MobileNet

192×192×3

4.0 M

TFLite

3584

4240

0.3 ms

0.2 ms

1.3 ms

1.0 ms

Kaggle

DFP

56

MobileNet

224×224×3

4.0 M

ONNX

1952

2332

0.5 ms

0.4 ms

1.5 ms

1.2 ms

OpenCV

DFP

57

MobileNet

160×160×3

4.0 M

TFLite

4231

4866

0.2 ms

0.2 ms

1.2 ms

1.0 ms

Kaggle

DFP

58

MobileNet

224×224×3

4.1 M

Keras

1940

2332

0.5 ms

0.4 ms

1.4 ms

1.2 ms

Keras.Applications

DFP

59

MobileNet-EdgeTPU-v2-extra-small

224×224×3

4.2 M

TFLite

1945

2318

0.5 ms

0.4 ms

1.9 ms

1.5 ms

Kaggle

DFP

60

MobileNet-EdgeTPU-v2-m4

224×224×3

8.0 M

ONNX

564

799

1.8 ms

1.3 ms

4.2 ms

3.1 ms

Timm

DFP

61

MobileNet-v1

224×224×3

4.1 M

TensorFlow

1946

2324

0.5 ms

0.4 ms

1.5 ms

1.2 ms

OpenVINO

DFP

62

MobileNet-v2

224×224×3

3.3 M

ONNX

1951

2327

0.5 ms

0.4 ms

1.5 ms

1.2 ms

ONNX Zoo

DFP

63

MobileNet-v2

224×224×3

3.3 M

TFLite

1953

2328

0.5 ms

0.4 ms

1.5 ms

1.2 ms

Coral

DFP

64

MobileNet-v2

224×224×3

3.4 M

Keras

1941

2334

0.5 ms

0.4 ms

1.5 ms

1.2 ms

Keras.Applications

DFP

65

MobileNet-v2-0.5

224×224×3

1.9 M

ONNX

1955

2334

0.5 ms

0.4 ms

1.1 ms

1.0 ms

Timm

DFP

66

MobileNet-v3

512×512×3

5.2 M

TFLite

453

582

2.2 ms

1.7 ms

9.5 ms

7.2 ms

AI Benchmark

DFP

67

MobileNet-v3

224×224×3

3.9 M

TFLite

1946

2332

0.5 ms

0.4 ms

2.0 ms

1.6 ms

Coral

DFP

68

MobileNet-v4

224×224×3

4.0 M

ONNX

1951

2334

0.5 ms

0.4 ms

1.4 ms

1.2 ms

Timm

DFP

69

MobileNet-v4-conv-small

224×224×3

3.6 M

ONNX

1955

2334

0.5 ms

0.4 ms

1.4 ms

1.1 ms

Timm

DFP

70

MobileOne

224×224×3

7.4 M

ONNX

1943

2325

0.5 ms

0.4 ms

2.4 ms

1.8 ms

GitHub/PINTO

DFP

71

Mobileone-s4

224×224×3

14.3 M

ONNX

818

1158

1.2 ms

0.9 ms

11.1 ms

8.0 ms

Timm

DFP

72

NasNet(Mobile)

224×224×3

4.2 M

TFLite

1949

2328

0.5 ms

0.4 ms

1.8 ms

1.4 ms

Kaggle

DFP

73

NasNet(Mobile)

160×160×3

4.2 M

TFLite

4255

4906

0.2 ms

0.2 ms

1.5 ms

1.2 ms

Kaggle

DFP

74

NasNet(Mobile)

192×192×3

4.2 M

TFLite

3573

4229

0.3 ms

0.2 ms

1.7 ms

1.3 ms

Kaggle

DFP

75

NasNet(Mobile)

224×224×3

4.2 M

ONNX

1940

2327

0.5 ms

0.4 ms

1.8 ms

1.4 ms

Timm

DFP

76

NasNet(Mobile)

128×128×3

4.2 M

TFLite

4732

6688

0.2 ms

0.1 ms

1.4 ms

1.1 ms

Kaggle

DFP

77

NasNet(Mobile)-1.3

224×224×3

5.9 M

TFLite

1943

2324

0.5 ms

0.4 ms

2.2 ms

1.8 ms

Kaggle

DFP

78

NasNet(Mobile)-small

224×224×3

1.9 M

ONNX

1949

2330

0.5 ms

0.4 ms

2.0 ms

1.6 ms

Timm

DFP

79

PP-LCNet-v2

224×224×3

6.3 M

TensorFlow

1938

2327

0.5 ms

0.4 ms

2.2 ms

1.7 ms

GitHub/PINTO

DFP

80

PpResNet-50

224×224×3

24.4 M

ONNX

741

1050

1.3 ms

1.0 ms

6.0 ms

4.4 ms

OpenCV

DFP

81

RegNetX002

224×224×3

2.6 M

ONNX

1937

2317

0.5 ms

0.4 ms

2.1 ms

1.6 ms

Timm

DFP

82

RegNetX002

224×224×3

2.6 M

Keras

1950

2327

0.5 ms

0.4 ms

1.9 ms

1.5 ms

Keras.Applications

DFP

83

RegNetX004

224×224×3

5.0 M

Keras

1871

2288

0.5 ms

0.4 ms

3.4 ms

2.5 ms

Keras.Applications

DFP

84

RegNetX006

224×224×3

5.9 M

Keras

1199

1697

0.8 ms

0.6 ms

3.8 ms

2.8 ms

Keras.Applications

DFP

85

RegNetX008

224×224×3

7.0 M

Keras

1003

1421

1.0 ms

0.7 ms

4.7 ms

3.4 ms

Keras.Applications

DFP

86

RegNetX016

224×224×3

8.8 M

Keras

289

410

3.5 ms

2.4 ms

12.2 ms

8.8 ms

Keras.Applications

DFP

87

RegNetY002

224×224×3

3.0 M

ONNX

1925

2303

0.5 ms

0.4 ms

5.0 ms

3.7 ms

Timm

DFP

88

RegNetY002

224×224×3

3.0 M

Keras

1925

2309

0.5 ms

0.4 ms

3.8 ms

2.8 ms

Keras.Applications

DFP

89

RegNetY004

224×224×3

4.2 M

Keras

773

1094

1.3 ms

0.9 ms

10.2 ms

7.4 ms

Keras.Applications

DFP

90

RegNetY006

224×224×3

5.8 M

Keras

1118

1583

0.9 ms

0.6 ms

9.4 ms

6.8 ms

Keras.Applications

DFP

91

RegNetY008

224×224×3

6.0 M

Keras

1286

1776

0.8 ms

0.6 ms

7.9 ms

5.7 ms

Keras.Applications

DFP

92

RegNetY016

224×224×3

10.7 M

Keras

220

311

4.5 ms

3.2 ms

57.3 ms

40.6 ms

Keras.Applications

DFP

93

RepGhostNet-0.5

224×224×3

2.2 M

ONNX

1953

2325

0.5 ms

0.4 ms

1.8 ms

1.6 ms

Timm

DFP

94

RepVGG-A0

224×224×3

7.9 M

ONNX

1839

2332

0.5 ms

0.4 ms

2.0 ms

1.6 ms

OpenMMLab

DFP

95

RepVGG-A1

224×224×3

12.2 M

ONNX

1946

2322

0.5 ms

0.4 ms

2.1 ms

1.6 ms

OpenMMLab

DFP

96

RepVGG-A2

224×224×3

24.3 M

ONNX

742

1050

1.3 ms

1.0 ms

4.8 ms

3.5 ms

OpenMMLab

DFP

97

RepVGG-B0

224×224×3

13.7 M

ONNX

1079

1527

0.9 ms

0.7 ms

3.1 ms

2.4 ms

OpenMMLab

DFP

98

RepViT

224×224×3

5.2 M

ONNX

1917

2298

0.5 ms

0.4 ms

5.0 ms

3.7 ms

Timm

DFP

99

Res2NeXt50

224×224×3

23.5 M

ONNX

333

473

3.0 ms

2.1 ms

14.1 ms

10.1 ms

Timm

DFP

100

ResNet32-TS

256×256×3

17.1 M

ONNX

852

1207

1.2 ms

0.8 ms

3.7 ms

2.8 ms

Timm

DFP

101

ResNet33-TS

256×256×3

18.7 M

ONNX

804

1139

1.2 ms

0.9 ms

3.8 ms

2.8 ms

Timm

DFP

102

ResNet-18

224×224×3

11.1 M

ONNX

1835

2246

0.5 ms

0.4 ms

1.8 ms

1.4 ms

OpenMMLab

DFP

103

ResNet-18-v2

224×224×3

11.2 M

ONNX

1835

2247

0.5 ms

0.4 ms

1.8 ms

1.4 ms

ONNX Zoo

DFP

104

ResNet-34

224×224×3

20.8 M

ONNX

898

1271

1.1 ms

0.8 ms

4.5 ms

3.3 ms

OpenMMLab

DFP

105

ResNet-34-v2

224×224×3

20.8 M

ONNX

967

1369

1.0 ms

0.7 ms

4.4 ms

3.3 ms

ONNX Zoo

DFP

106

ResNet-50

224×224×3

24.3 M

TFLite

811

1148

1.2 ms

0.9 ms

4.9 ms

3.6 ms

Coral

DFP

107

ResNet-50

224×224×3

24.4 M

ONNX

825

1169

1.2 ms

0.9 ms

6.2 ms

4.5 ms

ONNX Zoo

DFP

108

ResNet-50

224×224×3

24.4 M

Keras

811

1148

1.2 ms

0.9 ms

5.2 ms

3.8 ms

Keras.Applications

DFP

109

ResNet-50

224×224×3

24.4 M

Keras

811

1148

1.2 ms

0.9 ms

5.2 ms

3.8 ms

Keras.Applications

DFP

110

ResNet-50-v2

224×224×3

24.4 M

ONNX

691

979

1.4 ms

1.0 ms

6.6 ms

4.8 ms

ONNX Zoo

DFP

111

ResNet-50-v2

224×224×3

24.4 M

Keras

820

1161

1.2 ms

0.9 ms

5.7 ms

4.2 ms

Keras.Applications

DFP

112

ResNet-B-26

224×224×3

15.2 M

ONNX

1210

1476

0.8 ms

0.7 ms

2.3 ms

1.8 ms

Timm

DFP

113

ResNet-B-50 (Blur)

224×224×3

24.4 M

ONNX

530

751

1.9 ms

1.3 ms

7.7 ms

5.5 ms

Timm

DFP

114

ResNet-Q-51

256×256×3

34.0 M

ONNX

138

196

7.2 ms

5.1 ms

15.8 ms

11.4 ms

Timm

DFP

115

ResNet-v1-d50

224×224×3

24.4 M

ONNX

723

1024

1.4 ms

1.0 ms

6.4 ms

4.7 ms

OpenMMLab

DFP

116

ResNeXt

256×256×3

9.8 M

ONNX

904

976

1.1 ms

1.0 ms

2.9 ms

2.4 ms

Timm

DFP

117

ReXNet

224×224×3

4.6 M

ONNX

1922

2309

0.5 ms

0.4 ms

4.6 ms

3.4 ms

Timm

DFP

118

ReXNetr-200

224×224×3

15.7 M

ONNX

774

1097

1.3 ms

0.9 ms

10.9 ms

7.8 ms

Timm

DFP

119

SelecSLS60

224×224×3

29.2 M

ONNX

322

457

3.1 ms

2.2 ms

7.5 ms

5.5 ms

Timm

DFP

120

SeNasNet(Mobile)

224×224×3

3.7 M

ONNX

1944

2325

0.5 ms

0.4 ms

2.8 ms

2.2 ms

Timm

DFP

121

SeNasNet(Mobile)-0.75

224×224×3

2.8 M

ONNX

1944

2324

0.5 ms

0.4 ms

2.4 ms

1.9 ms

Timm

DFP

122

SeResNet33-TS

256×256×3

18.8 M

ONNX

304

391

3.3 ms

2.6 ms

17.2 ms

12.9 ms

Timm

DFP

123

ShuffleNet

224×224×3

1.8 M

ONNX

1951

2330

0.5 ms

0.4 ms

1.7 ms

1.3 ms

OpenMMLab

DFP

124

ShuffleNet-v2

224×224×3

2.2 M

ONNX

1950

2327

0.5 ms

0.4 ms

1.7 ms

1.3 ms

OpenMMLab

DFP

125

SPNasNet

224×224×3

4.2 M

ONNX

1946

2325

0.5 ms

0.4 ms

2.1 ms

1.6 ms

Timm

DFP

126

SqueezeNet

224×224×3

1.2 M

TFLite

1035

1466

1.0 ms

0.7 ms

1.8 ms

1.4 ms

Kaggle

DFP

127

SqueezeNet1.1

224×224×3

1.2 M

ONNX

1955

2337

0.5 ms

0.4 ms

1.1 ms

0.9 ms

ONNX Zoo

DFP

128

TinyNet-A

192×192×3

5.9 M

ONNX

1339

1895

0.7 ms

0.5 ms

7.2 ms

5.3 ms

Timm

DFP

129

VoVNet-v2

224×224×3

6.2 M

ONNX

1118

1235

0.9 ms

0.8 ms

3.8 ms

3.2 ms

Timm

DFP

130

Xception

299×299×3

25.7 M

ONNX

258

365

3.9 ms

2.7 ms

15.9 ms

11.4 ms

Timm

DFP

131

Xception

299×299×3

21.8 M

Keras

300

425

3.3 ms

2.4 ms

12.9 ms

9.3 ms

Keras.Applications

DFP

132

YOLO-v8-large-CLS

224×224×3

35.7 M

TFLite

258

366

3.9 ms

2.7 ms

13.4 ms

9.6 ms

Ultralytics

DFP

133

YOLO-v8-medium-CLS

224×224×3

16.3 M

TFLite

1018

1441

1.0 ms

0.7 ms

4.3 ms

3.2 ms

Ultralytics

DFP

134

YOLO-v8-nano-CLS

224×224×3

2.6 M

TFLite

1949

2326

0.5 ms

0.4 ms

1.3 ms

1.0 ms

Ultralytics

DFP

135

YOLO-v8-small-CLS

224×224×3

6.1 M

TFLite

1949

2331

0.5 ms

0.4 ms

1.8 ms

1.4 ms

Ultralytics

DFP

136

YOLO-v11-large-CLS

224×224×3

13.4 M

ONNX

477

676

2.1 ms

1.5 ms

9.3 ms

6.7 ms

Ultralytics

DFP

137

YOLO-v11-medium-CLS

224×224×3

11.1 M

ONNX

661

936

1.5 ms

1.1 ms

4.4 ms

3.2 ms

Ultralytics

DFP

138

YOLO-v11-nano-CLS

224×224×3

2.7 M

ONNX

1947

2330

0.5 ms

0.4 ms

1.7 ms

1.3 ms

Ultralytics

DFP

139

YOLO-v11-small-CLS

224×224×3

6.4 M

ONNX

1949

2321

0.5 ms

0.4 ms

2.4 ms

1.9 ms

Ultralytics

DFP

140

YOLO-v11-x-CLS

224×224×3

28.2 M

ONNX

229

324

4.4 ms

3.1 ms

19.3 ms

13.8 ms

Ultralytics

DFP
Object Detection

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

141

CenterNet(DLA)

512×512×3

17.1 M

ONNX

109

155

9.2 ms

6.5 ms

21.1 ms

15.3 ms

OpenVINO

DFP

142

CenterNet-MobileNet-v2

320×320×3

2.3 M

TensorFlow

839

940

1.2 ms

1.1 ms

3.7 ms

3.1 ms

TF Object Detection Zoo

DFP

143

CenterNet-MobileNet-v2-kpts

320×320×3

2.3 M

ONNX

784

811

1.3 ms

1.2 ms

3.8 ms

3.3 ms

TF Object Detection Zoo

DFP

144

CenterNet-ResNet-fpn

512×512×3

24.2 M

TensorFlow

66

94

15.2 ms

10.6 ms

26.8 ms

19.4 ms

TF Object Detection Zoo

DFP

145

DAMO-YOLO-medium

640×640×3

26.9 M

ONNX

35

50

28.6 ms

20.0 ms

48.8 ms

34.4 ms

DaMoYolo

DFP

146

DAMO-YOLO-Nl

416×416×3

5.4 M

ONNX

312

442

3.2 ms

2.3 ms

9.9 ms

7.2 ms

DaMoYolo

DFP

147

DAMO-YOLO-Ns

416×416×3

1.3 M

ONNX

611

865

1.6 ms

1.2 ms

4.5 ms

3.4 ms

DaMoYolo

DFP

148

DAMO-YOLO-small

640×640×3

15.5 M

ONNX

150

212

6.7 ms

4.7 ms

19.2 ms

13.7 ms

DaMoYolo

DFP

149

DAMO-YOLO-tiny

640×640×3

8.1 M

ONNX

386

386

2.6 ms

2.6 ms

10.0 ms

10.0 ms

DaMoYolo

DFP

150

DbNet-ResNet-18

736×1344×3

11.6 M

ONNX

16

23

62.5 ms

43.5 ms

74.1 ms

52.8 ms

OpenMMLab

DFP

151

DroNet

608×608×3

67.4 K

TFLite

364

448

2.7 ms

2.2 ms

3.4 ms

2.9 ms

GitHub/PINTO

DFP

152

EfficientDet-Lite1

384×384×3

4.2 M

TFLite

216

221

4.6 ms

4.5 ms

14.2 ms

11.6 ms

Coral

DFP

153

License-plate-Detection-LPD-YuNet

240×320×3

1008.7 K

ONNX

725

913

1.4 ms

1.1 ms

2.3 ms

2.0 ms

OpenCV

DFP

154

MediaPipe-object-Detection-3d-camera

224×224×3

2.4 M

TFLite

1944

2308

0.5 ms

0.4 ms

1.9 ms

1.5 ms

MediaPipe

DFP

155

MediaPipe-object-Detection-3d-chair

224×224×3

2.4 M

TFLite

1935

2312

0.5 ms

0.4 ms

1.9 ms

1.5 ms

MediaPipe

DFP

156

MediaPipe-object-Detection-3d-chair-1stag…

640×480×3

1.4 M

TFLite

412

506

2.4 ms

2.0 ms

5.2 ms

4.1 ms

MediaPipe

DFP

157

MediaPipe-object-Detection-3d-cup

224×224×3

2.4 M

TFLite

1939

2310

0.5 ms

0.4 ms

1.9 ms

1.5 ms

MediaPipe

DFP

158

Mobile-object-labeler

224×224×3

3.5 M

TFLite

1947

2332

0.5 ms

0.4 ms

1.4 ms

1.2 ms

Kaggle

DFP

159

Mobile-object-localizer

192×192×3

1.7 M

TFLite

3585

4236

0.3 ms

0.2 ms

1.3 ms

1.0 ms

Kaggle

DFP

160

MobileNet-YOLO-v4-syg

416×416×3

10.0 M

TensorFlow

766

964

1.3 ms

1.0 ms

7.9 ms

5.9 ms

OpenVINO

DFP

161

NanoDet

416×416×3

919.8 K

ONNX

786

956

1.3 ms

1.0 ms

3.5 ms

2.9 ms

OpenCV

DFP

162

NanoDet+ (ShuffleNet)-v2-1.5x

416×416×3

2.3 M

ONNX

617

767

1.6 ms

1.3 ms

6.0 ms

4.6 ms

OpenVINO

DFP

163

NanoDetwithShuffleNet-v2-1.5x

416×416×3

2.0 M

ONNX

639

892

1.6 ms

1.1 ms

4.4 ms

3.5 ms

OpenVINO

DFP

164

Person-Detection

512×512×3

1.7 M

TFLite

475

584

2.1 ms

1.7 ms

3.6 ms

3.0 ms

GitHub/PINTO

DFP

165

Person-vehicle-bike-Detection-crossroad-0…

1024×1024×3

1.1 M

TFLite

117

156

8.5 ms

6.4 ms

12.8 ms

9.6 ms

GitHub/PINTO

DFP

166

Person-vehicle-bike-Detection-crossroad-1…

512×512×3

2.8 M

TFLite

475

582

2.1 ms

1.7 ms

4.0 ms

3.3 ms

GitHub/PINTO

DFP

167

PP-YOLOE-Plus

640×640×3

7.6 M

ONNX

73

103

13.7 ms

9.7 ms

29.8 ms

21.5 ms

GitHub/PINTO

DFP

168

RtmDet-small

640×640×3

9.6 M

ONNX

56

79

17.9 ms

12.7 ms

39.0 ms

27.8 ms

OpenMMLab

DFP

169

RtmDet-tiny

640×640×3

5.3 M

ONNX

128

182

7.8 ms

5.5 ms

16.8 ms

12.4 ms

OpenMMLab

DFP

170

RtmDet-tiny-fast

640×640×3

5.3 M

ONNX

126

179

7.9 ms

5.6 ms

17.0 ms

12.5 ms

OpenMMLab

DFP

171

SpaghettiNet-EdgeTPU

320×320×3

3.3 M

TFLite

1188

1428

0.8 ms

0.7 ms

3.2 ms

2.6 ms

GitHub/PINTO

DFP

172

SSD300

300×300×3

32.7 M

ONNX

52

74

19.2 ms

13.5 ms

28.3 ms

20.2 ms

OpenMMLab

DFP

173

SSD512

512×512×3

34.4 M

ONNX

20

29

50.0 ms

34.5 ms

63.9 ms

45.4 ms

OpenMMLab

DFP

174

SSD-FPNMobileNet

640×640×3

29.5 M

TFLite

41

58

24.4 ms

17.2 ms

39.4 ms

28.8 ms

Coral

DFP

175

SSD-MobileNet

300×300×3

6.5 M

TFLite

1198

1448

0.8 ms

0.7 ms

2.0 ms

1.7 ms

Coral

DFP

176

SSD-MobileNet-v2

300×300×3

5.8 M

TFLite

1198

1436

0.8 ms

0.7 ms

2.4 ms

1.9 ms

Coral

DFP

177

SSD-MobileNet-v2 (MNAS-FPN)

320×320×3

2.4 M

TFLite

310

312

3.2 ms

3.2 ms

6.9 ms

6.1 ms

GitHub/PINTO

DFP

178

SSDlite-MobileNet-v2

320×320×3

4.0 M

ONNX

1198

1423

0.8 ms

0.7 ms

2.4 ms

1.9 ms

OpenMMLab

DFP

179

SSDlite-MobileNet-v2

300×300×3

4.3 M

TensorFlow

1197

1435

0.8 ms

0.7 ms

2.3 ms

1.9 ms

GitHub/PINTO

DFP

180

SSDLiteMobileDet

320×320×3

3.9 M

TFLite

1192

1433

0.8 ms

0.7 ms

3.0 ms

2.4 ms

Coral

DFP

181

SSSD-ResNet34

1200×1200×3

19.0 M

ONNX

21

30

47.6 ms

33.3 ms

62.2 ms

44.5 ms

OpenVINO

DFP

182

Text-Detection-db

480×640×3

11.6 M

TensorFlow

59

83

16.9 ms

12.0 ms

22.6 ms

16.8 ms

GitHub/PINTO

DFP

183

Vehicle-license-plate-detection

300×300×3

619.4 K

TFLite

1204

1462

0.8 ms

0.7 ms

1.5 ms

1.3 ms

GitHub/PINTO

DFP

184

Vehicle-license-plate-detection

256×256×3

561.2 K

TensorFlow

1684

2023

0.6 ms

0.5 ms

2.3 ms

1.9 ms

OpenVINO

DFP

185

YOLO-NAS-small

640×640×3

12.3 M

ONNX

106

150

9.4 ms

6.7 ms

20.5 ms

14.7 ms

Ultralytics

DFP

186

YOLO-tiny

416×416×3

15.1 M

TensorFlow

492

697

2.0 ms

1.4 ms

3.9 ms

3.0 ms

GitHub/RedisAI

DFP

187

YOLO-v2-tiny

416×416×3

15.1 M

TFLite

593

841

1.7 ms

1.2 ms

3.3 ms

2.5 ms

OpenVINO

DFP

188

YOLO-v3-lite

256×256×3

6.4 M

ONNX

1669

2013

0.6 ms

0.5 ms

2.7 ms

2.1 ms

GitHub/PINTO

DFP

189

YOLO-v3-MobileNet-v2

320×320×3

3.2 M

ONNX

713

1009

1.4 ms

1.0 ms

4.4 ms

3.5 ms

OpenMMLab

DFP

190

YOLO-v3-MobileNet-v2

416×416×3

3.2 M

ONNX

546

613

1.8 ms

1.6 ms

5.6 ms

4.6 ms

OpenMMLab

DFP

191

YOLO-v4-tiny

416×416×3

5.8 M

TFLite

608

675

1.6 ms

1.5 ms

3.3 ms

2.9 ms

AI Benchmark

DFP

192

YOLO-v5-medium-v6.1-fast

640×640×3

20.2 M

ONNX

106

150

9.4 ms

6.7 ms

19.6 ms

14.1 ms

OpenMMLab

DFP

193

YOLO-v5-medium-v6.1-fastb64-VOC

512×512×3

20.0 M

ONNX

186

256

5.4 ms

3.9 ms

15.2 ms

11.0 ms

OpenMMLab

DFP

194

YOLO-v5-mu

640×640×3

23.9 M

ONNX

96

137

10.4 ms

7.3 ms

26.2 ms

18.7 ms

Ultralytics

DFP

195

YOLO-v5-n6u

1280×1280×3

4.1 M

ONNX

83

98

12.0 ms

10.2 ms

23.4 ms

20.6 ms

Ultralytics

DFP

196

YOLO-v5-nano-p6-v6.2-fast

1280×1280×3

3.1 M

ONNX

66

67

15.2 ms

14.9 ms

29.0 ms

27.1 ms

OpenMMLab

DFP

197

YOLO-v5-nano-v6.1-fast

640×640×3

1.8 M

ONNX

272

272

3.7 ms

3.7 ms

7.5 ms

7.5 ms

OpenMMLab

DFP

198

YOLO-v5-nano-v6.1-fastb64-VOC

512×512×3

1.7 M

ONNX

475

576

2.1 ms

1.7 ms

3.7 ms

3.1 ms

OpenMMLab

DFP

199

YOLO-v5-nu

640×640×3

2.5 M

ONNX

326

391

3.1 ms

2.6 ms

6.3 ms

5.4 ms

Ultralytics

DFP

200

YOLO-v5-s6u

1280×1280×3

14.6 M

ONNX

42

59

23.8 ms

16.9 ms

43.0 ms

30.8 ms

Ultralytics

DFP

201

YOLO-v5-small-p6-v6.2-fast

1280×1280×3

12.0 M

ONNX

46

66

21.7 ms

15.2 ms

40.1 ms

32.8 ms

OpenMMLab

DFP

202

YOLO-v5-small-v6.1-fast

640×640×3

6.9 M

ONNX

269

269

3.7 ms

3.7 ms

8.4 ms

8.4 ms

OpenMMLab

DFP

203

YOLO-v5-small-v6.1-fastb64-VOC

512×512×3

6.7 M

ONNX

474

576

2.1 ms

1.7 ms

5.3 ms

4.1 ms

OpenMMLab

DFP

204

YOLO-v5-su

640×640×3

8.7 M

ONNX

266

376

3.8 ms

2.7 ms

9.5 ms

7.2 ms

Ultralytics

DFP

205

YOLO-v6-medium-fast

640×640×3

32.7 M

ONNX

56

80

17.9 ms

12.5 ms

45.7 ms

32.4 ms

OpenMMLab

DFP

206

YOLO-v6-nano-fast

640×640×3

4.1 M

ONNX

327

395

3.1 ms

2.5 ms

6.4 ms

5.1 ms

OpenMMLab

DFP

207

YOLO-v6-small-fast

640×640×3

16.4 M

ONNX

143

202

7.0 ms

5.0 ms

16.2 ms

11.7 ms

OpenMMLab

DFP

208

YOLO-v6-tiny-fast

640×640×3

9.2 M

ONNX

228

323

4.4 ms

3.1 ms

10.4 ms

7.8 ms

OpenMMLab

DFP

209

YOLO-v7

256×640×3

35.2 M

ONNX

57

81

17.5 ms

12.3 ms

54.1 ms

38.4 ms

GitHub/PINTO

DFP

210

YOLO-v7-13M (MXA-Optimized)

640×640×3

12.4 M

ONNX

85

121

11.8 ms

8.3 ms

27.3 ms

21.0 ms

GitHub/Official YOLOv7

DFP

211

YOLO-v7-22M (MXA-Optimized)

640×640×3

20.4 M

ONNX

59

84

16.9 ms

11.9 ms

40.1 ms

29.0 ms

GitHub/Official YOLOv7

DFP

212

YOLO-v7-27M (MXA-Optimized)

640×640×3

25.5 M

ONNX

48

68

20.8 ms

14.7 ms

50.4 ms

35.9 ms

GitHub/Official YOLOv7

DFP

213

YOLO-v7-large-fast

640×640×3

35.2 M

ONNX

22

31

45.5 ms

32.3 ms

101.5 ms

71.9 ms

OpenMMLab

DFP

214

YOLO-v7-tiny

320×320×3

5.9 M

ONNX

1187

1249

0.8 ms

0.8 ms

3.1 ms

2.6 ms

GitHub/Official YOLOv7

DFP

215

YOLO-v7-tiny

640×640×3

5.9 M

ONNX

269

270

3.7 ms

3.7 ms

8.2 ms

7.5 ms

GitHub/Official YOLOv7

DFP

216

YOLO-v7-tiny

480×640×3

5.9 M

ONNX

388

402

2.6 ms

2.5 ms

6.6 ms

5.8 ms

GitHub/PINTO

DFP

217

YOLO-v7-tiny

416×416×3

5.9 M

ONNX

648

691

1.5 ms

1.4 ms

4.6 ms

3.8 ms

GitHub/Official YOLOv7

DFP

218

YOLO-v7-tiny-fast

640×640×3

5.9 M

ONNX

271

271

3.7 ms

3.7 ms

8.2 ms

8.2 ms

OpenMMLab

DFP

219

YOLO-v8-medium

640×640×3

24.7 M

ONNX

45

64

22.2 ms

15.6 ms

37.9 ms

27.0 ms

Ultralytics

DFP

220

YOLO-v8-nano

640×640×3

3.0 M

ONNX

327

391

3.1 ms

2.6 ms

6.8 ms

5.8 ms

Ultralytics

DFP

221

YOLO-v8-nano-Oriented-Bounding-Boxes

1024×1024×3

2.9 M

ONNX

128

153

7.8 ms

6.5 ms

13.4 ms

11.6 ms

Ultralytics

DFP

222

YOLO-v8-small

640×640×3

10.6 M

ONNX

186

263

5.4 ms

3.8 ms

10.9 ms

8.1 ms

Ultralytics

DFP

223

YOLO-v8-small-Oriented-Bounding-Boxes

1024×1024×3

10.9 M

ONNX

77

107

13.0 ms

9.3 ms

20.1 ms

15.4 ms

Ultralytics

DFP

224

YOLO-v9-medium

640×640×3

19.1 M

ONNX

40

56

25.0 ms

17.9 ms

61.5 ms

43.7 ms

Ultralytics

DFP

225

YOLO-v9-small

640×640×3

6.9 M

ONNX

109

151

9.2 ms

6.6 ms

32.1 ms

23.0 ms

Ultralytics

DFP

226

YOLO-v9-tiny

640×640×3

2.0 M

ONNX

261

369

3.8 ms

2.7 ms

16.2 ms

12.0 ms

Ultralytics

DFP

227

YOLO-v10-medium

320×320×3

14.6 M

ONNX

166

233

6.0 ms

4.3 ms

18.1 ms

12.9 ms

Ultralytics

DFP

228

YOLO-v10-medium

480×480×3

14.6 M

ONNX

43

60

23.3 ms

16.7 ms

38.5 ms

27.4 ms

Ultralytics

DFP

229

YOLO-v10-nano

320×320×3

2.2 M

ONNX

685

955

1.5 ms

1.0 ms

4.5 ms

3.5 ms

Ultralytics

DFP

230

YOLO-v10-nano

480×480×3

2.2 M

ONNX

121

171

8.3 ms

5.8 ms

12.7 ms

9.6 ms

Ultralytics

DFP

231

YOLO-v10-small

480×480×3

6.9 M

ONNX

106

150

9.4 ms

6.7 ms

16.5 ms

12.2 ms

Ultralytics

DFP

232

YOLO-v10-small

320×320×3

6.9 M

ONNX

319

439

3.1 ms

2.3 ms

8.1 ms

6.0 ms

Ultralytics

DFP

233

YOLO-v11-medium

320×320×3

19.2 M

ONNX

200

283

5.0 ms

3.5 ms

20.1 ms

14.3 ms

Ultralytics

DFP

234

YOLO-v11-nano (MXA-Optimized)

640×640×3

3.9 M

ONNX

326

391

3.1 ms

2.6 ms

8.1 ms

6.4 ms

Ultralytics

DFP

235

YOLO-v11-nano (MXA-Optimized)

480×480×3

3.9 M

ONNX

557

668

1.8 ms

1.5 ms

5.5 ms

4.4 ms

Ultralytics

DFP

236

YOLO-v11-nano (MXA-Optimized)

800×800×3

3.9 M

ONNX

211

253

4.7 ms

4.0 ms

11.0 ms

8.9 ms

Ultralytics

DFP

237

YOLO-v11-nano

480×480×3

2.5 M

ONNX

122

173

8.2 ms

5.8 ms

12.9 ms

9.8 ms

Ultralytics

DFP

238

YOLO-v11-nano

320×320×3

2.5 M

ONNX

776

1088

1.3 ms

0.9 ms

4.5 ms

3.5 ms

Ultralytics

DFP

239

YOLO-v11-small (MXA-Optimized)

640×640×3

14.1 M

ONNX

99

140

10.1 ms

7.1 ms

22.4 ms

16.1 ms

Ultralytics

DFP

240

YOLO-v11-small (MXA-Optimized)

480×480×3

14.1 M

ONNX

220

312

4.5 ms

3.2 ms

15.3 ms

11.0 ms

Ultralytics

DFP

241

YOLO-v11-small

480×480×3

9.0 M

ONNX

102

144

9.8 ms

6.9 ms

17.7 ms

12.9 ms

Ultralytics

DFP

242

YOLO-v11-small

320×320×3

9.0 M

ONNX

316

448

3.2 ms

2.2 ms

8.5 ms

6.3 ms

Ultralytics

DFP

243

YOLOX-medium

640×640×3

24.1 M

ONNX

64

92

15.6 ms

10.9 ms

35.9 ms

25.6 ms

GitHub/YOLOX

DFP

244

YOLOX-medium-ti-lite

416×416×3

24.1 M

ONNX

158

224

6.3 ms

4.5 ms

19.3 ms

13.8 ms

GitHub/YOLOX

DFP

245

YOLOX-medium-ti-lite

640×640×3

24.1 M

ONNX

70

100

14.3 ms

10.0 ms

35.1 ms

25.0 ms

GitHub/YOLOX

DFP

246

YOLOX-nano

416×416×3

883.3 K

ONNX

809

846

1.2 ms

1.2 ms

3.2 ms

2.7 ms

GitHub/YOLOX

DFP

247

YOLOX-nano-ti-lite

416×416×3

2.1 M

ONNX

787

958

1.3 ms

1.0 ms

3.1 ms

2.7 ms

GitHub/YOLOX

DFP

248

YOLOX-small

640×640×3

8.5 M

ONNX

262

371

3.8 ms

2.7 ms

9.4 ms

7.2 ms

OpenMMLab

DFP

249

YOLOX-small-ti-lite

416×416×3

8.5 M

ONNX

510

722

2.0 ms

1.4 ms

5.3 ms

4.0 ms

GitHub/YOLOX

DFP

250

YOLOX-small-ti-lite

640×640×3

8.5 M

ONNX

236

321

4.2 ms

3.1 ms

9.4 ms

7.6 ms

GitHub/YOLOX

DFP

251

YOLOX-tiny

416×416×3

4.8 M

ONNX

644

841

1.6 ms

1.2 ms

4.3 ms

3.7 ms

OpenMMLab

DFP

252

YOLOX-tiny-ti-lite

416×416×3

4.8 M

ONNX

785

958

1.3 ms

1.0 ms

4.3 ms

3.4 ms

GitHub/YOLOX

DFP
Segmentation

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

253

Autoseg-EdgeTPU-small

512×512×3

2.4 M

TFLite

46

66

21.7 ms

15.2 ms

39.5 ms

28.1 ms

Kaggle

DFP

254

BiseNet (ResNet-18)

512×512×3

12.7 M

ONNX

155

220

6.5 ms

4.5 ms

13.7 ms

10.4 ms

OpenMMLab

DFP

255

BiseNet (ResNet-18) - CityScapes

512×512×3

12.7 M

ONNX

144

204

6.9 ms

4.9 ms

15.0 ms

10.8 ms

OpenMMLab

DFP

256

BiseNetv2 (FCN) - CityScapes

512×512×3

3.2 M

ONNX

123

174

8.1 ms

5.7 ms

14.8 ms

10.6 ms

OpenMMLab

DFP

257

Deeplab-EdgeTPU-extra-small

512×512×3

3.1 M

TFLite

410

581

2.4 ms

1.7 ms

5.7 ms

4.4 ms

Kaggle

DFP

258

Deeplab-EdgeTPU-small

512×512×3

4.5 M

TFLite

320

453

3.1 ms

2.2 ms

6.7 ms

4.9 ms

Kaggle

DFP

259

Deeplab-v3

257×257×3

672.2 K

TFLite

1408

1992

0.7 ms

0.5 ms

2.7 ms

2.0 ms

Kaggle

DFP

260

DeepLab-v3 (MobileNet-v2)

513×513×3

672.2 K

TFLite

475

584

2.1 ms

1.7 ms

4.0 ms

3.2 ms

Coral

DFP

261

Deeplab-v3-plus

1024×1024×3

2.1 M

TFLite

27

31

37.0 ms

32.3 ms

47.0 ms

40.8 ms

AI Benchmark

DFP

262

EdgeTPU-DeepLab-slim

513×513×3

2.0 M

TFLite

475

583

2.1 ms

1.7 ms

5.8 ms

4.5 ms

Coral

DFP

263

Edgetpu-segmentation-EdgeTPU

512×512×3

2.2 M

TFLite

46

66

21.7 ms

15.2 ms

35.9 ms

25.6 ms

GitHub/PINTO

DFP

264

Edgetpu-segmentation-EdgeTPU

16×320×16

49.5 K

TFLite

2407

2594

0.4 ms

0.4 ms

1.0 ms

1.0 ms

GitHub/PINTO

DFP

265

ErfNet

208×976×3

2.0 M

ONNX

151

214

6.6 ms

4.7 ms

23.1 ms

16.6 ms

OpenVINO

DFP

266

ERFNet

256×512×3

2.0 M

ONNX

222

261

4.5 ms

3.8 ms

16.2 ms

12.8 ms

GitHub/PINTO

DFP

267

Fast-scnnk-CityScapes

512×512×3

1.3 M

ONNX

475

583

2.1 ms

1.7 ms

4.3 ms

3.4 ms

OpenMMLab

DFP

268

FastSAM-small

640×640×3

11.2 M

ONNX

79

113

12.7 ms

8.8 ms

19.2 ms

14.2 ms

Ultralytics

DFP

269

FPN (ResNet-50) - ADE20K

512×512×3

27.2 M

ONNX

18

26

55.6 ms

38.5 ms

70.4 ms

50.3 ms

OpenMMLab

DFP

270

HRNet

256×192×3

27.2 M

ONNX

115

164

8.7 ms

6.1 ms

45.7 ms

32.5 ms

GitHub/PINTO

DFP

271

Human-segmentation

192×192×3

1.5 M

TFLite

627

866

1.6 ms

1.2 ms

3.3 ms

2.5 ms

GitHub/PINTO

DFP

272

MagicTouch

512×512×4

2.9 M

TFLite

244

345

4.1 ms

2.9 ms

10.2 ms

8.1 ms

GitHub/PINTO

DFP

273

MediaPipe-selfie-segmentation

256×256×3

103.8 K

TFLite

691

935

1.4 ms

1.1 ms

3.8 ms

3.1 ms

MediaPipe

DFP

274

MediaPipe-selfie-segmentation-landscape

144×256×3

103.9 K

TFLite

1415

2002

0.7 ms

0.5 ms

2.6 ms

2.1 ms

MediaPipe

DFP

275

PaNet-ResNet-18-ffm

640×640×3

11.7 M

ONNX

27

38

37.0 ms

26.3 ms

57.8 ms

41.1 ms

OpenMMLab

DFP

276

Selfie-Segmentation

256×256×3

103.9 K

TFLite

766

1071

1.3 ms

0.9 ms

4.4 ms

3.4 ms

GitHub/PINTO

DFP

277

STDC1-CityScapes

512×512×3

7.9 M

ONNX

159

226

6.3 ms

4.4 ms

11.9 ms

8.8 ms

OpenMMLab

DFP

278

STDC2-CityScapes

512×512×3

11.7 M

ONNX

157

223

6.4 ms

4.5 ms

16.8 ms

12.1 ms

OpenMMLab

DFP

279

U-NetMobileNet-v2

256×256×3

6.2 M

TFLite

50

71

20.0 ms

14.1 ms

23.0 ms

16.8 ms

Coral

DFP

280

U-NetMobileNet-v2

128×128×3

6.2 M

TFLite

202

286

5.0 ms

3.5 ms

6.6 ms

4.9 ms

Coral

DFP

281

UNet

1024×1024×3

1.9 M

TFLite

27

32

37.0 ms

31.2 ms

40.6 ms

34.1 ms

AI Benchmark

DFP

282

UNet

256×256×1

29.6 M

ONNX

31

44

32.3 ms

22.7 ms

35.4 ms

25.3 ms

Zetane Viewer

DFP

283

YOLO-v8-medium-seg

640×640×3

26.0 M

ONNX

27

38

37.0 ms

26.3 ms

59.5 ms

42.3 ms

Ultralytics

DFP

284

YOLO-v8-nano-seg

640×640×3

3.2 M

ONNX

206

211

4.9 ms

4.7 ms

9.9 ms

8.9 ms

Ultralytics

DFP
Pose Estimation

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

285

BodyPix (MobileNet)

480×640×3

1.2 M

TFLite

414

499

2.4 ms

2.0 ms

3.9 ms

3.3 ms

Coral

DFP

286

BodyPix (MobileNet)

512×512×3

1.2 M

TFLite

475

577

2.1 ms

1.7 ms

3.5 ms

3.0 ms

Coral

DFP

287

BodyPix (MobileNet)

768×1024×3

1.2 M

TFLite

169

205

5.9 ms

4.9 ms

8.6 ms

7.1 ms

Coral

DFP

288

BodyPix (MobileNet)

576×768×3

1.2 M

TFLite

297

359

3.4 ms

2.8 ms

5.3 ms

4.5 ms

Coral

DFP

289

BodyPix (MobileNet)

720×1280×3

1.2 M

TFLite

146

177

6.8 ms

5.6 ms

9.6 ms

8.2 ms

Coral

DFP

290

BodyPix (MobileNet)

352×480×3

1.2 M

TFLite

805

977

1.2 ms

1.0 ms

2.8 ms

2.2 ms

Coral

DFP

291

BodyPix (ResNet-50)

496×768×3

22.7 M

TFLite

152

215

6.6 ms

4.7 ms

17.4 ms

12.6 ms

Coral

DFP

292

BodyPix (ResNet-50)

624×864×3

22.7 M

TFLite

112

159

8.9 ms

6.3 ms

19.7 ms

14.3 ms

Coral

DFP

293

BodyPix (ResNet-50)

288×416×3

22.7 M

TFLite

247

348

4.0 ms

2.9 ms

12.1 ms

8.8 ms

Coral

DFP

294

BodyPix (ResNet-50)

480×640×3

22.7 M

TFLite

99

139

10.1 ms

7.2 ms

23.0 ms

17.0 ms

Coral

DFP

295

BodyPix (ResNet-50)

672×928×3

22.7 M

TFLite

53

75

18.9 ms

13.3 ms

34.0 ms

24.5 ms

Coral

DFP

296

Handpose-estimation-mediapipe

224×224×3

988.0 K

ONNX

1947

2330

0.5 ms

0.4 ms

1.3 ms

1.1 ms

OpenCV

DFP

297

Handpose-estimation-mediapipe8

224×224×3

904.1 K

ONNX

1476

2091

0.7 ms

0.5 ms

2.9 ms

2.2 ms

OpenCV

DFP

298

HHP-Net

1×5×1, 1×5×1, 1×5×1

91.8 K

TFLite

12137

12148

0.1 ms

0.1 ms

0.3 ms

0.2 ms

GitHub/PINTO

DFP

299

Human-pose-estimation-3d-0001

256×448×3

4.8 M

ONNX

460

652

2.2 ms

1.5 ms

8.7 ms

6.3 ms

OpenVINO

DFP

300

MediaPipe-pose-landk

256×256×3

3.0 M

TFLite

743

876

1.3 ms

1.1 ms

4.4 ms

3.6 ms

MediaPipe

DFP

301

MediaPipe-pose-landk-heavy

256×256×3

13.1 M

TFLite

103

145

9.7 ms

6.9 ms

14.6 ms

10.6 ms

MediaPipe

DFP

302

MediaPipe-pose-landk-lite

256×256×3

1.3 M

TFLite

716

903

1.4 ms

1.1 ms

3.8 ms

3.1 ms

MediaPipe

DFP

303

MoveNet.SinglePose.Lightning

192×192×3

2.2 M

TFLite

2585

2667

0.4 ms

0.4 ms

2.0 ms

1.7 ms

Coral

DFP

304

MoveNet.SinglePose.Thunder

256×256×3

5.9 M

TFLite

1422

1448

0.7 ms

0.7 ms

3.5 ms

3.0 ms

Coral

DFP

305

Pose-estimation-mediapipe

258×258×3

1.3 M

ONNX

567

774

1.8 ms

1.3 ms

4.2 ms

3.3 ms

OpenCV

DFP

306

PoseC3D

48×64×64×17

2.0 M

ONNX

29

41

34.5 ms

24.4 ms

40.9 ms

29.3 ms

GitHub/PINTO

DFP

307

PoseC3D

48×56×56×17

2.9 M

ONNX

33

47

30.3 ms

21.3 ms

35.9 ms

25.7 ms

GitHub/PINTO

DFP

308

PoseNet (MobileNet)

353×481×3

1.2 M

TFLite

803

978

1.2 ms

1.0 ms

2.4 ms

2.0 ms

Coral

DFP

309

PoseNet (MobileNet)

481×641×3

1.2 M

TFLite

414

506

2.4 ms

2.0 ms

3.9 ms

3.3 ms

Coral

DFP

310

PoseNet (MobileNet)

721×1281×3

1.2 M

TFLite

146

178

6.8 ms

5.6 ms

9.4 ms

7.9 ms

Coral

DFP

311

PoseNet (ResNet-50)

288×416×3

22.6 M

TFLite

257

365

3.9 ms

2.7 ms

12.0 ms

8.7 ms

Coral

DFP

312

PoseNet (ResNet-50)

496×768×3

22.6 M

TFLite

152

216

6.6 ms

4.6 ms

16.3 ms

11.8 ms

Coral

DFP

313

PoseNet (ResNet-50)

736×960×3

22.6 M

TFLite

82

117

12.2 ms

8.5 ms

24.1 ms

17.5 ms

Coral

DFP

314

PoseNet (ResNet-50)

624×864×3

22.6 M

TFLite

112

158

8.9 ms

6.3 ms

19.8 ms

14.4 ms

Coral

DFP

315

PoseNet (ResNet-50)

480×640×3

22.6 M

TFLite

116

165

8.6 ms

6.1 ms

19.9 ms

14.3 ms

Coral

DFP

316

PoseNet (ResNet-50)

672×928×3

22.6 M

TFLite

53

75

18.9 ms

13.3 ms

34.5 ms

24.6 ms

Coral

DFP

317

RtmDet-nano-person

320×320×3

962.8 K

ONNX

1197

1453

0.8 ms

0.7 ms

3.0 ms

2.4 ms

OpenMMLab

DFP

318

Simcc-MobileNet-v2-wo-onv

256×192×3

2.2 M

ONNX

1944

2322

0.5 ms

0.4 ms

1.6 ms

1.3 ms

OpenMMLab

DFP

319

YOLO-v8-medium-pose

640×640×3

25.2 M

ONNX

43

61

23.3 ms

16.4 ms

38.4 ms

27.4 ms

Ultralytics

DFP

320

YOLO-v8-nano-pose

640×640×3

3.1 M

ONNX

327

392

3.1 ms

2.6 ms

6.7 ms

5.7 ms

Ultralytics

DFP

321

YOLO-v8-small-pose

640×640×3

11.1 M

ONNX

228

323

4.4 ms

3.1 ms

11.1 ms

8.4 ms

Ultralytics

DFP
Image Enhancement/Super Resolution

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

322

AOD-Net

720×1280×3

1.7 K

TFLite

17

24

58.8 ms

41.7 ms

59.9 ms

42.9 ms

GitHub/PINTO

DFP

323

AOD-Net

480×640×3

1.7 K

TFLite

51

73

19.6 ms

13.7 ms

20.4 ms

14.6 ms

GitHub/PINTO

DFP

324

Colorization-v2

256×256×1

30.7 M

ONNX

31

44

32.3 ms

22.7 ms

50.7 ms

36.1 ms

OpenVINO

DFP

325

DPED

384×512×48

414.7 K

TFLite

41

45

24.4 ms

22.2 ms

37.3 ms

34.4 ms

AI Benchmark

DFP

326

ESRGAN

128×128×3

1.2 M

TFLite

61

86

16.4 ms

11.6 ms

23.8 ms

16.9 ms

AI Benchmark

DFP

327

Fast-SRGAN

512×512×3

154.9 K

TFLite

3

5

333.3 ms

200.0 ms

264.4 ms

187.8 ms

GitHub/PINTO

DFP

328

Fast-SRGAN

128×128×3

154.9 K

TFLite

61

87

16.4 ms

11.5 ms

17.3 ms

12.4 ms

GitHub/PINTO

DFP

329

IMDN

480×640×3

873.0 K

TFLite

8

12

125.0 ms

83.3 ms

129.5 ms

94.5 ms

GitHub/PINTO

DFP

330

IMDN

360×640×3

873.0 K

TFLite

11

16

90.9 ms

62.5 ms

99.6 ms

72.5 ms

GitHub/PINTO

DFP

331

IMDN

1024×1024×3

149.1 K

TFLite

39

41

25.6 ms

24.4 ms

27.6 ms

26.2 ms

AI Benchmark

DFP

332

MBLLEN

480×640×3

439.6 K

TFLite

10

15

100.0 ms

66.7 ms

98.9 ms

70.0 ms

GitHub/PINTO

DFP

333

MBLLEN

720×1280×3

439.6 K

TFLite

3

5

333.3 ms

200.0 ms

289.3 ms

204.9 ms

GitHub/PINTO

DFP

334

Noise2Noise

256×256×3

1.2 M

TFLite

60

86

16.7 ms

11.6 ms

20.8 ms

15.0 ms

GitHub/PINTO

DFP

335

PMN

416×416×4

7.4 M

ONNX

43

61

23.3 ms

16.4 ms

26.5 ms

19.0 ms

GitHub/PINTO

DFP

336

Real-Time-Super-Resolution

240×320×3

1.3 M

TFLite

6

9

166.7 ms

111.1 ms

165.6 ms

117.4 ms

GitHub/PINTO

DFP

337

RFDN

160×160×3

423.3 K

ONNX

22

31

45.5 ms

32.3 ms

75.8 ms

53.8 ms

GitHub/PINTO

DFP

338

RFDN

96×96×3

423.3 K

ONNX

12

17

83.3 ms

58.8 ms

79.5 ms

56.3 ms

GitHub/PINTO

DFP

339

SCI

288×800×3

0.2 K

ONNX

426

557

2.3 ms

1.8 ms

3.2 ms

2.7 ms

GitHub/PINTO

DFP

340

SCL-LLE

240×320×3

77.6 K

TFLite

104

147

9.6 ms

6.8 ms

11.3 ms

8.4 ms

GitHub/PINTO

DFP

341

SCL-LLE

180×320×3

77.6 K

TFLite

138

195

7.2 ms

5.1 ms

8.8 ms

6.6 ms

GitHub/PINTO

DFP

342

SG-Low-Light-Image-Enhancement

24×54×3

10.3 K

ONNX

6648

6966

0.2 ms

0.1 ms

0.4 ms

0.4 ms

GitHub/PINTO

DFP

343

SRCNN-di-v2-k

896×896×3

19.6 K

ONNX

7

10

142.9 ms

100.0 ms

136.8 ms

97.0 ms

OpenMMLab

DFP

344

SRGAN

256×256×3

1.4 M

TFLite

7

11

142.9 ms

90.9 ms

135.2 ms

95.8 ms

AI Benchmark

DFP

345

Super-Resolution

224×224×1

58.3 K

ONNX

160

226

6.2 ms

4.4 ms

6.8 ms

4.9 ms

ONNX Zoo

DFP

346

TBEFN

180×320×3

475.0 K

TFLite

195

205

5.1 ms

4.9 ms

6.6 ms

6.1 ms

GitHub/PINTO

DFP

347

TBEFN

240×320×3

475.0 K

TFLite

146

154

6.8 ms

6.5 ms

8.4 ms

7.8 ms

GitHub/PINTO

DFP

348

VSR

540×960×3

18.6 K

TFLite

29

32

34.5 ms

31.2 ms

51.6 ms

48.7 ms

AI Benchmark

DFP

349

XLSR

360×640×3

21.5 K

TFLite

69

98

14.5 ms

10.2 ms

19.8 ms

15.1 ms

AI Benchmark

DFP

350

Y-Net

480×640×3

190.9 K

TFLite

32

39

31.2 ms

25.6 ms

32.2 ms

26.1 ms

GitHub/PINTO

DFP

351

Y-Net

240×320×3

190.9 K

TFLite

130

160

7.7 ms

6.2 ms

8.6 ms

7.1 ms

GitHub/PINTO

DFP

352

Zero-DCE

360×640×3

77.6 K

TFLite

40

42

25.0 ms

23.8 ms

29.2 ms

28.0 ms

GitHub/PINTO

DFP

353

Zero-DCE

240×320×3

77.6 K

TFLite

121

126

8.3 ms

7.9 ms

10.1 ms

9.6 ms

GitHub/PINTO

DFP

354

Zero-DCE-improved

360×512×3

23.0 K

ONNX

87

123

11.5 ms

8.1 ms

15.2 ms

11.3 ms

GitHub/PINTO

DFP
Face/Head

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

355

ACR-Loss

224×224×3

2.3 M

TFLite

1946

2325

0.5 ms

0.4 ms

1.5 ms

1.2 ms

GitHub/PINTO

DFP

356

BlazeFace

128×128×3

99.0 K

TensorFlow

6827

7918

0.1 ms

0.1 ms

0.5 ms

0.4 ms

GitHub/PINTO

DFP

357

BlazeFace-short-range

128×128×3

99.1 K

TFLite

6831

7918

0.1 ms

0.1 ms

0.5 ms

0.5 ms

GitHub/TorinMB

DFP

358

Face-Detection-0100

256×256×3

1.7 M

TFLite

1688

2030

0.6 ms

0.5 ms

1.5 ms

1.3 ms

GitHub/PINTO

DFP

359

Face-Detection-adas-0001

384×672×3

1.0 M

TFLite

532

653

1.9 ms

1.5 ms

3.2 ms

2.7 ms

GitHub/PINTO

DFP

360

Face-Detection-YuNet

640×640×3

51.9 K

ONNX

328

401

3.0 ms

2.5 ms

4.3 ms

3.7 ms

OpenCV

DFP

361

Face-landk

160×160×3

611.3 K

ONNX

4284

4933

0.2 ms

0.2 ms

0.7 ms

0.6 ms

GitHub/PINTO

DFP

362

Face-Mask-Detection

300×300×3

2.5 M

TFLite

840

1188

1.2 ms

0.8 ms

2.7 ms

2.1 ms

GitHub/PINTO

DFP

363

Face-recognition-sface

112×112×3

9.2 M

ONNX

2578

3651

0.4 ms

0.3 ms

1.4 ms

1.1 ms

OpenCV

DFP

364

FaceBoxes

1024×1024×3

982.3 K

ONNX

128

157

7.8 ms

6.4 ms

9.2 ms

7.8 ms

OpenVINO

DFP

365

FaceMesh

192×192×3

590.5 K

TFLite

3596

4251

0.3 ms

0.2 ms

0.8 ms

0.6 ms

GitHub/PINTO

DFP

366

Head-Pose-Estimation

320×320×3

798.8 K

ONNX

1198

1452

0.8 ms

0.7 ms

2.1 ms

1.8 ms

GitHub/YinguoBing

DFP

367

MediaPipe-face-Detection-range

192×192×3

502.1 K

TFLite

3580

4199

0.3 ms

0.2 ms

1.4 ms

1.2 ms

MediaPipe

DFP

368

MediaPipe-face-Detection-short-range

128×128×3

99.1 K

TFLite

6828

7927

0.1 ms

0.1 ms

0.5 ms

0.5 ms

MediaPipe

DFP

369

MediaPipe-iris-landk

64×64×3

636.0 K

TFLite

10588

10594

0.1 ms

0.1 ms

0.6 ms

0.5 ms

MediaPipe

DFP

370

RetinaFacewithResNet-50

640×640×3

26.0 M

ONNX

45

63

22.2 ms

15.9 ms

33.7 ms

24.2 ms

OpenVINO

DFP

371

SFace

112×112×3

9.2 M

TFLite

2580

3654

0.4 ms

0.3 ms

1.4 ms

1.1 ms

GitHub/PINTO

DFP

372

SSD-MobileNet-v2 (Face)

320×320×3

5.1 M

TFLite

1199

1449

0.8 ms

0.7 ms

2.5 ms

2.0 ms

Coral

DFP

373

SynergyNet

120×120×3

2.2 M

ONNX

4945

6987

0.2 ms

0.1 ms

0.9 ms

0.8 ms

GitHub/PINTO

DFP

374

UltraLightweightFaceDetectionRFB320

240×320×3

274.5 K

ONNX

1690

2027

0.6 ms

0.5 ms

1.3 ms

1.1 ms

OpenVINO

DFP

375

Version-RFB

240×320×3

274.5 K

ONNX

1691

2025

0.6 ms

0.5 ms

1.3 ms

1.1 ms

ONNX Zoo

DFP

376

WHENet

224×224×3

4.1 M

TFLite

970

1374

1.0 ms

0.7 ms

6.4 ms

4.8 ms

GitHub/PINTO

DFP

377

YOLO-v5-Face

256×320×3

1.6 M

TensorFlow

1638

2001

0.6 ms

0.5 ms

2.6 ms

2.1 ms

GitHub/PINTO

DFP

378

YuNet

120×160×3

81.1 K

TensorFlow

5949

6905

0.2 ms

0.1 ms

0.5 ms

0.4 ms

GitHub/PINTO

DFP

379

YuNet-v2

640×640×3

51.9 K

TFLite

328

401

3.0 ms

2.5 ms

4.2 ms

3.6 ms

GitHub/PINTO

DFP
Classification (Other)

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

380

Aiy-vision-classifier-birds

224×224×3

3.3 M

TFLite

1785

2322

0.6 ms

0.4 ms

1.9 ms

1.5 ms

Kaggle

DFP

381

Aiy-vision-classifier-food

192×192×3

5.0 M

TFLite

3585

4242

0.3 ms

0.2 ms

1.3 ms

1.1 ms

Kaggle

DFP

382

Aiy-vision-classifier-insects

224×224×3

3.4 M

TFLite

1785

2317

0.6 ms

0.4 ms

1.9 ms

1.5 ms

Kaggle

DFP

383

Aiy-vision-classifier-plants

224×224×3

4.7 M

TFLite

1785

2325

0.6 ms

0.4 ms

2.0 ms

1.5 ms

Kaggle

DFP

384

Anti-spoof-mn3

128×128×3

2.9 M

TFLite

3883

5492

0.3 ms

0.2 ms

1.7 ms

1.3 ms

GitHub/PINTO

DFP

385

CropNet-classifier-cassava-disease

224×224×3

4.0 M

TFLite

1941

2320

0.5 ms

0.4 ms

2.9 ms

2.2 ms

Kaggle

DFP

386

Gender-googleNet

224×224×3

5.7 M

ONNX

518

734

1.9 ms

1.4 ms

3.7 ms

2.8 ms

ONNX Zoo

DFP

387

Malaria-Detector

125×125×3

6.7 M

Keras

6851

8144

0.1 ms

0.1 ms

0.4 ms

0.4 ms

xmartlabs

DFP

388

NSFW

224×224×3

5.6 M

TFLite

1832

2236

0.5 ms

0.4 ms

1.9 ms

1.6 ms

GitHub/PINTO

DFP

389

Ocr-japanese

512×512×1

23.1 M

TensorFlow

14

20

71.4 ms

50.0 ms

94.9 ms

67.2 ms

GitHub/PINTO

DFP

390

Person-Attributes-recog-crossroad-0230

160×80×3

717.7 K

TFLite

5822

8124

0.2 ms

0.1 ms

0.6 ms

0.5 ms

GitHub/PINTO

DFP

391

Vehicle-Attributes-recog-barrier-0039

72×72×3

611.5 K

TFLite

7126

8860

0.1 ms

0.1 ms

0.6 ms

0.5 ms

GitHub/PINTO

DFP

392

Vehicle-Attributes-recog-barrier-0042

72×72×3

10.7 M

TFLite

5904

8353

0.2 ms

0.1 ms

1.2 ms

1.0 ms

GitHub/PINTO

DFP
ADAS/Driver Monitoring

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

393

Driver-action-recognition-adas-0002-encod…

224×224×3

2.7 M

TFLite

1948

2317

0.5 ms

0.4 ms

1.6 ms

1.3 ms

GitHub/PINTO

DFP

394

Gaze-estimation-adas-0002

60×60×3, 60×60×3, 3

1.8 M

TFLite

268

268

3.7 ms

3.7 ms

4.3 ms

4.3 ms

GitHub/PINTO

DFP

395

Head-pose-estimation-adas-0001

60×60×3

1.8 M

TFLite

8388

11727

0.1 ms

0.1 ms

0.7 ms

0.6 ms

GitHub/PINTO

DFP

396

Open-closed-eye-0001

32×32×3

11.0 K

ONNX

19520

19774

0.1 ms

0.1 ms

0.2 ms

0.2 ms

OpenVINO

DFP

397

Pedestrian-and-vehicle-Detector-adas-0001

384×672×3

1.6 M

TFLite

531

649

1.9 ms

1.5 ms

3.6 ms

3.0 ms

GitHub/PINTO

DFP

398

Pedestrian-Detection-adas-0002

384×672×3

1.1 M

TFLite

532

650

1.9 ms

1.5 ms

3.4 ms

2.9 ms

GitHub/PINTO

DFP

399

Road-segmentation-adas-0001

512×896×3

180.0 K

TFLite

145

186

6.9 ms

5.4 ms

9.6 ms

7.2 ms

GitHub/PINTO

DFP

400

Vehicle-Detection-0200

256×256×3

1.7 M

TFLite

1685

2032

0.6 ms

0.5 ms

1.6 ms

1.3 ms

GitHub/PINTO

DFP

401

YOLOp320

320×320×3

7.6 M

ONNX

402

570

2.5 ms

1.8 ms

7.0 ms

5.2 ms

GitHub/YOLOP

DFP

402

YOLOp640

640×640×3

7.6 M

ONNX

134

190

7.5 ms

5.3 ms

17.6 ms

12.7 ms

GitHub/YOLOP

DFP
Hand/Palm

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

403

Hand-Detection-and-Tracking

256×256×3

1.3 M

TensorFlow

1034

1126

1.0 ms

0.9 ms

4.3 ms

3.3 ms

GitHub/PINTO

DFP

404

Hand-recrop

256×256×3

26.1 K

TFLite

1692

2033

0.6 ms

0.5 ms

0.9 ms

0.8 ms

GitHub/PINTO

DFP

405

MediaPipe-hand-landk

224×224×3

2.6 M

TFLite

1950

2314

0.5 ms

0.4 ms

1.9 ms

1.4 ms

MediaPipe

DFP

406

MediaPipe-hand-landk-lite

224×224×3

988.0 K

TFLite

1947

2331

0.5 ms

0.4 ms

1.4 ms

1.1 ms

MediaPipe

DFP

407

MediaPipe-hand-recrop

256×256×3

26.4 K

TFLite

1695

2036

0.6 ms

0.5 ms

0.9 ms

0.8 ms

MediaPipe

DFP

408

MediaPipe-palm-Detection

192×192×3

1.1 M

TFLite

906

1282

1.1 ms

0.8 ms

2.6 ms

2.0 ms

MediaPipe

DFP

409

MediaPipe-palm-Detection-lite

192×192×3

937.6 K

TFLite

1258

1733

0.8 ms

0.6 ms

2.1 ms

1.6 ms

MediaPipe

DFP

410

Palm-Detection-mediapipe

192×192×3

937.6 K

ONNX

1146

1555

0.9 ms

0.6 ms

2.2 ms

1.7 ms

OpenCV

DFP
Depth Estimation

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

411

Graft-PSMNet

256×120×160

1.2 M

ONNX

96

96

10.4 ms

10.4 ms

15.2 ms

15.2 ms

GitHub/PINTO

DFP

412

Graft-PSMNet

256×80×120

1.2 M

ONNX

193

193

5.2 ms

5.2 ms

8.1 ms

8.1 ms

GitHub/PINTO

DFP

413

HR-Depth

384×1280×3

10.7 M

ONNX

53

53

18.9 ms

18.9 ms

25.5 ms

25.3 ms

GitHub/PINTO

DFP

414

MiDaS

256×256×3

15.8 M

TFLite

216

305

4.6 ms

3.3 ms

14.2 ms

10.3 ms

Kaggle

DFP

415

PyDNet

192×320×3

1.9 M

TFLite

354

501

2.8 ms

2.0 ms

5.0 ms

3.7 ms

GitHub/PINTO

DFP

416

PyDNet2

384×1280×3

699.9 K

TFLite

44

63

22.7 ms

15.9 ms

27.2 ms

19.8 ms

GitHub/PINTO

DFP

417

PyDNet2

384×640×3

699.9 K

TFLite

88

125

11.4 ms

8.0 ms

14.0 ms

10.3 ms

GitHub/PINTO

DFP
Point Cloud

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

418

MMDet3d-CenterPoint

800×800×64

4.9 M

ONNX

11

11

90.9 ms

90.9 ms

112.4 ms

112.4 ms

GitHub/Tartisan

DFP

419

MMDet3d-CenterPoint

20×10

0.6 K

ONNX

37780

38129

0.0 ms

0.0 ms

0.2 ms

0.2 ms

GitHub/Tartisan

DFP

420

MMDet3d-PointPillars

468×468×64

4.6 M

ONNX

2

3

500.0 ms

333.3 ms

409.3 ms

295.6 ms

GitHub/Tartisan

DFP

421

MMDet3d-PointPillars

20×10

0.6 K

ONNX

37854

37854

0.0 ms

0.0 ms

0.2 ms

0.2 ms

GitHub/Tartisan

DFP

422

PointPillars (SECFPN) - KITTI 3D

496×432×64

4.6 M

ONNX

10

14

100.0 ms

71.4 ms

110.3 ms

82.7 ms

OpenMMLab

DFP

423

PointPillars (SECFPN-SBN) - NUS 3D

400×400×64

4.7 M

ONNX

13

18

76.9 ms

55.6 ms

94.1 ms

72.1 ms

OpenMMLab

DFP

424

SFA3D

608×608×3

12.1 M

TensorFlow

89

95

11.2 ms

10.5 ms

19.3 ms

16.6 ms

GitHub/PINTO

DFP
Audio/Speech

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

425

Audio-classification (YamNet)

96×64×1

3.6 M

TFLite

11545

12126

0.1 ms

0.1 ms

0.9 ms

0.7 ms

Kaggle

DFP

426

Audio-Denoising (UNet)

128×128×1

1.9 M

Keras

1735

2114

0.6 ms

0.5 ms

1.8 ms

1.3 ms

GitHub/vbelz

DFP

427

FRILL

96×64×1

9.6 M

TFLite

5462

7723

0.2 ms

0.1 ms

1.3 ms

1.0 ms

GitHub/PINTO

DFP

428

Light-SERNet

184×40×1

449.9 K

TFLite

3211

3362

0.3 ms

0.3 ms

0.7 ms

0.6 ms

GitHub/PINTO

DFP

429

Speech-enhancement

128×128×1

1.9 M

ONNX

967

1370

1.0 ms

0.7 ms

2.1 ms

1.6 ms

GitHub/PINTO

DFP

430

YAMNet

96×64×1

3.6 M

TFLite

11550

12103

0.1 ms

0.1 ms

0.8 ms

0.7 ms

GitHub/PINTO

DFP
Emotion Detection

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

431

Emotion-FERPlus

64×64×1

8.4 M

TFLite

965

1367

1.0 ms

0.7 ms

1.7 ms

1.3 ms

GitHub/PINTO

DFP

432

Emotion-ferplus

64×64×1

8.4 M

ONNX

991

1404

1.0 ms

0.7 ms

1.7 ms

1.3 ms

ONNX Zoo

DFP

433

Facial-expRession-recognition-MobilefaceN…

112×112×3

1.1 M

TFLite

5721

7632

0.2 ms

0.1 ms

0.9 ms

0.8 ms

GitHub/PINTO

DFP

434

Facial-expRession-recognition-MobilefaceN…

112×112×3

1.1 M

ONNX

5719

7621

0.2 ms

0.1 ms

0.9 ms

0.8 ms

OpenCV

DFP

435

Facial-expRession-recognition-MobilefaceN…

112×112×3

1.1 M

ONNX

979

1386

1.0 ms

0.7 ms

5.4 ms

3.9 ms

OpenCV

DFP
Style Transfer/GANs

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

436

Arbitrary-stylization

256×256×3

2.2 M

TFLite

1690

2033

0.6 ms

0.5 ms

1.6 ms

1.3 ms

GitHub/PINTO

DFP

437

Arbitrary-stylization-inception-v3

256×256×3

8.6 M

TFLite

566

802

1.8 ms

1.2 ms

4.7 ms

3.5 ms

Kaggle

DFP

438

Facial-cartoonizer

512×512×3

2.0 M

ONNX

61

87

16.4 ms

11.5 ms

19.3 ms

13.9 ms

GitHub/Facial Image Cartoonizaiton

DFP

439

MobileStyleGAN

512

2.0 M

ONNX

37052

37052

0.0 ms

0.0 ms

0.2 ms

0.2 ms

GitHub/PINTO

DFP
Gesture Recognition

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

440

American-sign-language

224×224×3

2.7 M

TFLite

1944

2329

0.5 ms

0.4 ms

1.5 ms

1.2 ms

Kaggle

DFP

441

FINNger

96×96×3

3.2 M

TensorFlow

378

536

2.6 ms

1.9 ms

3.8 ms

2.8 ms

GitHub/PINTO

DFP

442

Naruto-handsign-Detection

416×416×3

871.1 K

TFLite

809

852

1.2 ms

1.2 ms

3.1 ms

2.7 ms

GitHub/PINTO

DFP
Tracking

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

443

LiteTrack

127×127×3

1.2 M

TFLite

2447

3465

0.4 ms

0.3 ms

2.6 ms

2.0 ms

GitHub/PINTO

DFP

444

OpenCV-DaSiamRPN (Feature Extractor)

360×480×3

4.8 M

ONNX

93

132

10.8 ms

7.6 ms

12.4 ms

9.0 ms

OpenCV

DFP

445

OpenCV-DaSiamRPN (Kernel-R1)

256×24×24

11.3 M

ONNX

110

114

9.1 ms

8.8 ms

11.3 ms

10.7 ms

OpenCV

DFP
Wireframe/keypoint Detection

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

446

M-LSD

320×320×4

599.8 K

TFLite

804

1099

1.2 ms

0.9 ms

2.7 ms

2.2 ms

GitHub/PINTO

DFP

447

M-LSD

512×512×4

1.5 M

TFLite

31

44

32.3 ms

22.7 ms

35.9 ms

26.1 ms

GitHub/PINTO

DFP
Re-identification

#

Name

Input Resolution

Params Count

F/W

FPS (14T)

FPS (20T)

Latency 1 (14T)

Latency 1 (20T)

Latency 2 (14T)

Latency 2 (20T)

Source

DFP

448

Person-ReID-YouTube

256×128×3

25.5 M

ONNX

735

1042

1.4 ms

1.0 ms

4.1 ms

3.0 ms

OpenCV

DFP
Third-Party Licenses

Each of these models is shared under the original creator’s license. Please check the license at the source page.