In order to run customized models on Kneron AI device, there are four stages are involved:

The diagram below demonstrates the inference flow for every models runnig on Kneron AI device, and how the PLUS, SCPU, and NCPU interact with each other.

Note: Multiple calls of kp_customized_inference_send() without any call of kp_customized_inference_receive() may cause the system stuck.