Kneron Hardware Performance
Performance simulation result on NPU KDP520:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 6.177 | 161.9 ms | No |
| Inception v4 | 299x299 | 1.454 | 687.7 ms | No |
| Mobilenet v1 | 224x224 | 56.80 | 17.60 ms | No |
| Mobilenet v2 | 224x224 | 54.18 | 18.46 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 28.48 | 35.11 ms | No |
| Resnet50 v1.5 | 224x224 | 6.925 | 144.4 ms | No |
| OpenPose | 256x256 | 0.637 | 1569 ms | No |
| SRCNN | 384x384 | 11.00 | 90.90 ms | No |
| Tiny YOLOv3 | 416x416 | 21.80 | 45.85 ms | Yes |
| YOLOv3 | 416x416 | 1.443 | 692.7 ms | Yes |
| YOLOv5s | 640x640 | 3.653 | 273.7 ms | Yes |
| Lite-HRNet | 256x192 | 9.233 | 108.2 ms | Yes |
Performance simulation result on NPU KDP720:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 84.99 | 11.76 ms | No |
| Inception v4 | 299x299 | 21.11 | 47.36 ms | No |
| Mobilenet v1 | 224x224 | 432.6 | 2.311 ms | No |
| Mobilenet v2 | 224x224 | 683.1 | 1.463 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 314.9 | 3.175 ms | No |
| Resnet50 v1.5 | 224x224 | 54.89 | 18.21 ms | No |
| OpenPose | 256x256 | 5.111 | 195.6 ms | No |
| SRCNN | 384x384 | 133.9 | 7.469 ms | No |
| Tiny YOLOv3 | 416x416 | 155.2 | 6.441 ms | No |
| YOLOv3 | 416x416 | 10.23 | 97.72 ms | No |
| YOLOv5s | 640x640 | 25.36 | 39.41 ms | No |
| Centernet res101 | 512x512 | 2.877 | 347.6 ms | No |
| Lite-HRNet | 256x192 | 27.40 | 36.49 ms | No |
Performance simulation result on NPU KDP530:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 62.00 | 16.12 ms | No |
| Inception v4 | 299x299 | 14.56 | 68.68 ms | No |
| Mobilenet v1 | 224x224 | 284.7 | 3.51 ms | No |
| Mobilenet v2 | 224x224 | 342.3 | 2.92 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 202.6 | 4.94 ms | No |
| Resnet50 v1.5 | 224x224 | 36.79 | 27.18 ms | No |
| OpenPose | 256x256 | 3.621 | 276.1 ms | No |
| SRCNN | 384x384 | 61.52 | 16.25 ms | No |
| Tiny YOLOv3 | 416x416 | 72.59 | 13.77 ms | No |
| YOLOv3 | 416x416 | 5.983 | 167.1 ms | No |
| YOLOv5s | 640x640 | 17.99 | 55.56 ms | No |
| Centernet res101 | 512x512 | 2.287 | 437.2 ms | No |
| Unet | 384x384 | 0.875 | 1142 ms | No |
| Lite-HRNet | 256x192 | 52.49 | 19.04 ms | No |
| CenterNet | 512x512 | 2.287 | 437.2 ms | No |
Performance simulation result on NPU KDP630:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 47.95 | 20.85 ms | No |
| Inception v4 | 299x299 | 12.47 | 80.16 ms | No |
| Mobilenet v1 | 224x224 | 219.6 | 4.55 ms | No |
| Mobilenet v2 | 224x224 | 218.9 | 4.568 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 130.0 | 7.69 ms | No |
| Resnet50 v1.5 | 224x224 | 22.91 | 43.63 ms | No |
| OpenPose | 256x256 | 4.035 | 247.8 ms | No |
| SRCNN | 384x384 | 62.84 | 15.91 ms | No |
| Tiny YOLOv3 | 416x416 | 100.3 | 9.964 ms | No |
| YOLOv3 | 416x416 | 5.143 | 194.4 ms | No |
| YOLOv5s | 640x640 | 16.82 | 59.43 ms | No |
| Unet | 384x384 | 1.802 | 554.6 ms | No |
| Lite-HRNet | 256x192 | 17.41 | 57.40 ms | No |
Performance simulation result on NPU KDP730:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 127.2 | 7.860 ms | No |
| Inception v4 | 299x299 | 37.85 | 26.42 ms | No |
| Mobilenet v1 | 224x224 | 610.0 | 1.640 ms | No |
| Mobilenet v2 | 224x224 | 812.5 | 1.230 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 392.2 | 2.549 ms | No |
| Resnet50 v1.5 | 224x224 | 79.03 | 12.65 ms | No |
| OpenPose | 256x256 | 10.46 | 95.59 ms | No |
| SRCNN | 384x384 | 163.2 | 6.127 ms | No |
| Tiny YOLOv3 | 416x416 | 201.9 | 4.951 ms | No |
| YOLOv3 | 416x416 | 16.78 | 59.58 ms | No |
| YOLOv5s | 640x640 | 51.82 | 19.30 ms | No |
| Unet | 384x384 | 3.903 | 256.1 ms | No |
| Lite-HRNet | 256x192 | 200.8 | 4.980 ms | No |
| CenterNet | 512x512 | 6.657 | 150.2 ms | No |