Kneron Hardware Performance
Performance simulation result on NPU KDP520:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 6.27 | 160 ms | No |
| Inception v4 | 299x299 | 1.45 | 687 ms | No |
| Mobilenet v1 | 224x224 | 57.3 | 17.4 ms | No |
| Mobilenet v2 | 224x224 | 54.7 | 18.3 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 28.5 | 35.1 ms | No |
| Resnet50 v1.5 | 224x224 | 6.94 | 144 ms | No |
| OpenPose | 256x256 | 0.637 | 1569 ms | No |
| SRCNN | 384x384 | 11.0 | 90.9 ms | No |
| Tiny YOLOv3 | 416x416 | 21.8 | 45.9 ms | Yes |
| YOLOv3 | 416x416 | 1.44 | 693 ms | Yes |
| YOLOv5s | 640x640 | 3.67 | 272 ms | Yes |
| Lite-HRNet | 256x192 | 8.82 | 113 ms | Yes |
Performance simulation result on NPU KDP720:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 86.2 | 11.6 ms | No |
| Inception v4 | 299x299 | 20.4 | 49.0 ms | No |
| Mobilenet v1 | 224x224 | 437 | 2.29 ms | No |
| Mobilenet v2 | 224x224 | 677 | 1.48 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 310 | 3.22 ms | No |
| Resnet50 v1.5 | 224x224 | 55.6 | 18.0 ms | No |
| OpenPose | 256x256 | 5.30 | 187 ms | No |
| SRCNN | 384x384 | 134 | 7.48 ms | No |
| Tiny YOLOv3 | 416x416 | 151 | 6.61 ms | No |
| YOLOv3 | 416x416 | 10.1 | 98.6 ms | No |
| YOLOv5s | 640x640 | 25.7 | 38.9 ms | No |
| Centernet res101 | 512x512 | 2.84 | 352 ms | No |
| Lite-HRNet | 256x192 | 77.6 | 12.9 ms | No |
Performance simulation result on NPU KDP530:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 64.3 | 15.5 ms | No |
| Inception v4 | 299x299 | 16.5 | 60.5 ms | No |
| Mobilenet v1 | 224x224 | 289 | 3.46 ms | No |
| Mobilenet v2 | 224x224 | 340 | 2.94 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 205 | 4.88 ms | No |
| Resnet50 v1.5 | 224x224 | 35.7 | 28.0 ms | No |
| OpenPose | 256x256 | 3.61 | 277 ms | No |
| SRCNN | 384x384 | 54.5 | 18.3 ms | No |
| Tiny YOLOv3 | 416x416 | 72.0 | 13.9 ms | No |
| YOLOv3 | 416x416 | 5.93 | 169 ms | No |
| YOLOv5s | 640x640 | 16.9 | 59.3 ms | No |
| Centernet res101 | 512x512 | 2.19 | 457 ms | No |
| Unet | 384x384 | 0.950 | 1050 ms | No |
| Lite-HRNet | 256x192 | 52.7 | 19.0 ms | No |
Performance simulation result on NPU KDP630:
| Model | Size | FPS (npu only) | Time(npu only) | Has CPU node(s)? |
|---|---|---|---|---|
| Inception v3 | 224x224 | 56.8 | 17.6 ms | No |
| Inception v4 | 299x299 | 16.3 | 61.3 ms | No |
| Mobilenet v1 | 224x224 | 222 | 4.51 ms | No |
| Mobilenet v2 | 224x224 | 215 | 4.66 ms | No |
| Mobilenet v2 ssdlite | 300x300 | 128 | 7.83 ms | No |
| Resnet50 v1.5 | 224x224 | 25.4 | 39.3 ms | No |
| OpenPose | 256x256 | 5.33 | 187 ms | No |
| SRCNN | 384x384 | 70.5 | 14.2 ms | No |
| Tiny YOLOv3 | 416x416 | 117 | 8.53 ms | No |
| YOLOv3 | 416x416 | 5.56 | 180 ms | No |
| YOLOv5s | 640x640 | 19.1 | 52.4 ms | No |
| Unet | 384x384 | 1.82 | 549 ms | No |
| Lite-HRNet | 256x192 | 19.3 | 51.7 ms | No |