### Install RKNN Toolkit2 on Android Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_multiple_input_demo/README_CN.md Installs the RKNN Toolkit2 application on an Android device. Pushes the compiled Android application to the device's `/data` directory. ```bash adb push install/rknn_multiple_input_demo_Android /data/ ``` -------------------------------- ### Install RKNN Toolkit2 Linux Demo Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_api_demo/README_CN.md Installs the compiled RKNN Toolkit2 demo application on a Linux device. Uses ADB to push the application to the device's /userdata directory. ```bash adb push install/rknn_api_demo_Linux /userdata/ ``` -------------------------------- ### Android Platform: Update and Start rknn_server Source: https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md Commands to push the rknn_server and librknnrt.so to the device, set permissions, and start the server on Android systems. Includes checks for successful startup. ```shell adb root && adb remount // 64-bit Android system adb push runtime/Android/rknn_server/arm64/rknn_server /vendor/bin/ // 32-bit Android system adb push runtime/Android/rknn_server/arm/rknn_server /vendor/bin/ // 64-bit Android system adb push runtime/Android/librknn_api/arm64-v8a/librknnrt.so /vendor/lib64 // 32-bit Android system adb push runtime/Android/librknn_api/armeabi-v7a/librknnrt.so /vendor/lib adb shell chmod +x /vendor/bin/rknn_server adb shell "killall rknn_server" adb shell "nohup /vendor/bin/rknn_server >/dev/null"& adb shell ps -ef|grep rknn_server ``` ```shell adb shell "killall rknn_server" adb shell "nohup /vendor/bin/rknn_server > /dev/null&" exit ``` -------------------------------- ### Install RKNN Toolkit2 Android Demo Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_api_demo/README_CN.md Installs the compiled RKNN Toolkit2 demo application on an Android device. Uses ADB to push the application to the device's /data directory. ```bash adb push install/rknn_api_demo_Android /data/ ``` -------------------------------- ### Run TensorFlow Inception V3 QAT Example Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknn-toolkit2/examples/tensorflow/inception_v3_qat/README.md This snippet shows how to execute the Python script to run the TensorFlow Inception V3 QAT example. It's the primary command to start the process. ```python python test.py ``` -------------------------------- ### CMake Installation Rules Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/RV1106_RV1103/rknn_yolov5_demo/CMakeLists.txt Defines the installation rules for the project, including installing the executable, the RKNN runtime library, and model-related files (images and text files) to their respective destinations based on the target SOC. ```cmake # install target and libraries set(CMAKE_INSTALL_PREFIX ${CMAKE_SOURCE_DIR}/install/rknn_yolov5_demo_${CMAKE_SYSTEM_NAME}) install(TARGETS rknn_yolov5_demo DESTINATION ./) install(PROGRAMS ${RKNN_RT_LIB} DESTINATION lib) install(DIRECTORY model/${TARGET_SOC} DESTINATION ./model) file(GLOB IMAGE_FILES "model/*.jpg") install(FILES ${IMAGE_FILES} DESTINATION ./model/) file(GLOB TXT_FILES "model/*.txt") install(FILES ${TXT_FILES} DESTINATION ./model/) ``` -------------------------------- ### Run RKNN Toolkit2 Linux Demos Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_api_demo/README_CN.md Executes RKNN Toolkit2 demo applications on a Linux device after installation. Sets the LD_LIBRARY_PATH and runs the create memory and create memory with RGA demos. ```bash adb shell cd /userdata/rknn_api_demo_Linux/ export LD_LIBRARY_PATH=./lib ./rknn_create_mem_demo model//mobilenet_v1.rknn model/dog_224x224.jpg ./rknn_create_mem_with_rga_demo model//mobilenet_v1.rknn model/dog_224x224.jpg ``` -------------------------------- ### RKNN-Toolkit2 Download and Examples Source: https://github.com/airockchip/rknn-toolkit2/blob/master/README.md Information on downloading RKNN-Toolkit2 packages, Docker images, examples, docs, and platform-tools. It also points to the rknn_model_zoo for more examples. ```APIDOC Download: - All packages, Docker image, examples, docs, and platform-tools available from RKNPU2_SDK. - Fetch code: rknn - Link: https://console.zbox.filez.com/l/I00fc3 Examples: - More examples available at: https://github.com/airockchip/rknn_model_zoo ``` -------------------------------- ### Start rknn_server with Detailed Logging (Linux) Source: https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md Commands to create a directory for logs, set the RKNN_SERVER_LOGLEVEL to 5 for detailed logging, and start the rknn_server in the background. It also includes a command to check if the server process is running. ```shell adb shell mkdir -p /userdata adb shell "killall rknn_server" adb shell "export RKNN_SERVER_LOGLEVEL=5 && nohup /oem/usr/bin/rknn_server >/userdata/server.log"& adb shell ps|grep rknn_server ``` -------------------------------- ### Run RKNN Toolkit2 Android Demos Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_api_demo/README_CN.md Executes RKNN Toolkit2 demo applications on an Android device after installation. Sets the LD_LIBRARY_PATH and runs various demos including create memory, create memory with RGA, and MMZ related demos. ```bash adb shell cd /data/rknn_api_demo_Android/ export LD_LIBRARY_PATH=./lib ./rknn_create_mem_demo model//mobilenet_v1.rknn model/dog_224x224.jpg ./rknn_create_mem_with_rga_demo model//mobilenet_v1.rknn model/dog_224x224.jpg ./rknn_with_mmz_demo model//mobilenet_v1.rknn model/dog_224x224.jpg ./rknn_set_internal_mem_from_fd_demo model//mobilenet_v1.rknn model/dog_224x224.jpg ``` -------------------------------- ### Manually Start rknn_server on Device Source: https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md Instructions for manually starting the rknn_server on the device if it fails to start automatically. This involves entering the device shell, setting the log level, and running the server in the background. ```shell export RKNN_SERVER_LOGLEVEL=5 nohup /oem/usr/bin/rknn_server >/userdata/server.log& exit ``` -------------------------------- ### Install Linux Demo via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_common_test/README.md Installs the RKNN Toolkit2 Linux demo to the device's /userdata/ directory using ADB push command. ```bash adb push install/rknn_common_test_Linux /userdata/ ``` -------------------------------- ### Install Android Demo via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_api_demo/README.md Installs the RKNN Toolkit2 demo to an Android device using ADB. Copies the built demo executable and libraries to the /data directory on the target device. ```bash adb push install/rknn_api_demo_Android /data/ ``` -------------------------------- ### Install RKNN Toolkit2 on Android via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_common_test/README_CN.md Installs the compiled RKNN Toolkit2 application on an Android device using ADB. Copies the executable to the /data directory. ```bash adb push install/rknn_common_test_Android /data/ ``` -------------------------------- ### Install Android Demo Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_mobilenet_demo/README.md Installs the rknn_mobilenet_demo_Android to the Android device. Uses 'adb push' to copy the build output to the /data directory. ```bash adb push install/rknn_mobilenet_demo_Android /data/ ``` -------------------------------- ### Install Android RKNN Demo via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_mobilenet_demo/README_CN.md Installs the compiled RKNN MobileNet demo for Android onto an Android device using ADB. The demo is pushed to the '/data' directory. ```shell adb push install/rknn_mobilenet_demo_Android /data/ ``` -------------------------------- ### Install Aarch64 Linux Demo via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_api_demo/README.md Installs the RKNN Toolkit2 demo to a device using ADB. Copies the built demo executable and libraries to the /userdata directory on the target device. ```bash adb push install/rknn_api_demo_Linux /userdata/ ``` -------------------------------- ### Linux Platform (RV1103/06): Update and Start rknn_server Source: https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md Specific commands for updating the rknn_server and librknnmrt.so on RV1103/06 Linux platforms, setting permissions, and starting the server. Includes verification. ```shell adb push runtime/Linux/rknn_server/armhf-uclibc/usr/bin/rknn_server /oem/usr/bin adb push runtime/Linux/librknn_api/armhf-uclibc/librknnmrt.so /oem/usr/lib adb shell chmod +x /oem/usr/bin/rknn_server adb shell "killall rknn_server" adb shell "nohup /oem/usr/bin/rknn_server >/dev/null"& adb shell ps |grep rknn_server ``` ```shell adb shell "killall rknn_server" adb shell "nohup /oem/usr/bin/rknn_server > /dev/null&" exit ``` -------------------------------- ### Install Android Demo via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_common_test/README.md Installs the RKNN Toolkit2 Android demo to the device's /data/ directory using ADB push command. ```bash adb push install/rknn_common_test_Android /data/ ``` -------------------------------- ### Install RKNN Toolkit2 on Aarch64 Linux via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_common_test/README_CN.md Installs the compiled RKNN Toolkit2 application on an Aarch64 Linux device using ADB. Copies the executable to the /userdata directory. ```bash adb push install/rknn_common_test_Linux /userdata/ ``` -------------------------------- ### Linux Platform (Non-RV1103/06): Update and Start rknn_server Source: https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md Commands to update the rknn_server and librknnrt.so on Linux systems (excluding RV1103/06), set permissions, and start the server. Includes verification steps. ```shell // 64-bit Linux system adb push runtime/Linux/rknn_server/aarch64/usr/bin/rknn_server /usr/bin/ // 32-bit Linux system adb push runtime/Linux/rknn_server/armhf/usr/bin/rknn_server /usr/bin/ // 64-bit Linux system adb push runtime/Linux/librknn_api/aarch64/librknnrt.so /usr/lib // 32-bit Linux system adb push runtime/Linux/librknn_api/armhf/librknnrt.so /usr/lib adb shell chmod +x /usr/bin/rknn_server adb shell "killall rknn_server" adb shell "nohup /usr/bin/rknn_server >/dev/null"& adb shell ps -ef|grep rknn_server ``` ```shell adb shell "killall rknn_server" adb shell "nohup /usr/bin/rknn_server > /dev/null&" exit ``` -------------------------------- ### Run Linux Demo Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_common_test/README.md Executes the RKNN Toolkit2 Linux demo. Sets the LD_LIBRARY_PATH and runs the common test executable with the specified RKNN model and input image. ```bash adb shell cd /userdata/rknn_common_test_Linux/ export LD_LIBRARY_PATH=./lib ./rknn_common_test model//mobilenet_v1.rknn model/dog_224x224.jpg ``` -------------------------------- ### Install RKNN Toolkit2 on Aarch64 Linux Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_multiple_input_demo/README_CN.md Installs the RKNN Toolkit2 application on an Aarch64 Linux device. This typically involves pushing the compiled application to the device's storage using ADB. ```bash adb push install/rknn_multiple_input_demo_Linux /userdata/ ``` -------------------------------- ### Run Android Demo Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_common_test/README.md Executes the RKNN Toolkit2 Android demo. Sets the LD_LIBRARY_PATH and runs the common test executable with the specified RKNN model and input image. ```bash adb shell cd /data/rknn_common_test_Android/ export LD_LIBRARY_PATH=./lib ./rknn_common_test model//mobilenet_v1.rknn model/dog_224x224.jpg ``` -------------------------------- ### Install Aarch64 Linux RKNN Demo via ADB Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_mobilenet_demo/README_CN.md Installs the compiled RKNN MobileNet demo for Aarch64 Linux onto a Rockchip EVB board using ADB. The demo and model are pushed to the '/userdata' directory. ```shell adb push install/rknn_mobilenet_demo_Linux /userdata/ ``` -------------------------------- ### Disable SELinux Source: https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md Command to disable the Security-Enhanced Linux (SELinux) security mechanism on Android systems to resolve potential permission issues when starting the rknn_server. ```shell adb shell setenforce 0 ``` -------------------------------- ### RKNN Toolkit2 Python Example Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknn-toolkit2/examples/caffe/vgg-ssd/mbox_priorbox_97.txt This snippet demonstrates a basic usage of the RKNN Toolkit2 in Python, likely for model inference or optimization. It showcases common operations and setup. ```python from rknn.api import RKNN # Initialize RKNN rknn = RKNN() # Load model ret = rknn.load_rknn_model(model='model.rknn') if ret != 0: print('Load model failed') exit() # Init RKNN context ret = rknn.init_runtime() if ret != 0: print('Init runtime failed') exit() # Get input tensor properties input_details = rknn.get_input_details() print(input_details) # Prepare input data input_data = np.random.rand(*input_details[0]['shape']).astype(np.float32) # Inference outputs = rknn.inference(inputs=[input_data]) # Process outputs print(outputs) # Release resources rknn.release() ``` -------------------------------- ### Execute RKNN Demo Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/librknn_api_android_demo/README.md Example command to run the compiled RKNN demo application on the target Android device. It requires pushing the executable and the model file to specific locations on the device. ```shell rknn_create_mem_demo /data/model/RK3566_RK3568/mobilenet_v1.rknn /data/model/dog_224x224.jpg ``` -------------------------------- ### Install rknn_matmul_api_demo on Linux Device Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_matmul_api_demo/README.md Details the process of installing the compiled rknn_matmul_api_demo executable onto a Linux-based device. It covers copying the executable to the `/userdata/` directory using `adb push` for Rockchip EVB boards or SCP for devices with SSH enabled. ```sh adb push install/rknn_matmul_api_demo_Linux /userdata/ ``` -------------------------------- ### Install rknn_matmul_api_demo on Android Device Source: https://github.com/airockchip/rknn-toolkit2/blob/master/rknpu2/examples/rknn_matmul_api_demo/README.md Details the process of installing the compiled rknn_matmul_api_demo executable onto an Android device. It involves connecting the device and using `adb push` to copy the executable to the `/data/` directory. ```sh adb push install/rknn_matmul_api_demo_Android /data/ ```