History

$M\u00e5ns Nilsson$ M\u00e5ns Nilsson 27b95fad0a PR #38345 : TFLu: Add ethos-u55 kernel

Imported from GitHub PR https://github.com/tensorflow/tensorflow/pull/38345

The PR adds the Ethos-U55 TFLu integration code, including a README with initial instructions. This enables a user to use Ethos-U55 in combination with TFLu.
Copybara import of the project:

--
f5db4532b476aa84bf9918c2daa9c4cf79b4cc1b by Måns Nilsson <mans.nilsson@arm.com>:

TFLu: Add ethos-u55 kernel

Change-Id: Id533c4de26671836307d0a61ccc88a0f7060b2d2

--
566100491a3b8395d9f20ccd146bb82059fe2562 by Måns Nilsson <mans.nilsson@arm.com>:

TFLu: Add comment and remove macro for Ethos-U

--
4bbc515e7cd9e9e709e977b22af3a742e474e997 by Måns Nilsson <mans.nilsson@arm.com>:

TFLu: update bazel build with ethosu

--
78ef0e4b5cdeab8d00f641596402a9678d7824c1 by Måns Nilsson <mans.nilsson@arm.com>:

TFLu: rename ethos-u make variables

--
e4b19550589e9458c9ba2d0e6ad2650f34b913e3 by Måns Nilsson <mans.nilsson@arm.com>:

TFLu: update third party downloads with official ethos-u link

Update README.md as well with the new builds instructions.

--
7193ecaf505239876f70c3649fa68e3565e116c1 by Måns Nilsson <mans.nilsson@arm.com>:

TFLu: Change to TF_LITE_KERNEL_LOG macro in ethos-u op
COPYBARA_INTEGRATE_REVIEW=https://github.com/tensorflow/tensorflow/pull/38345 from mansnils:ethosu 7193ecaf505239876f70c3649fa68e3565e116c1
PiperOrigin-RevId: 314972481
Change-Id: Ifcbe4bc5148bc5b20313d2d030358a38b2a8fb03

2020-06-05 12:21:45 -07:00

ethosu.cc

README.md

Info

To use Ethos-U kernel add TAGS="ethos-u" to the make line. A tflite file compiled by ARM's offline tool Vela is required for it to work. Armclang 6.14 is required as compiler as well.

Vela example workflow

     | tensor0
     |
     v
+------------+
| ethos-u    |
| custom op  |
+------------+
     +
     |
     | tensor1
     |
     v
+---------+
| softmax |
|         |
+----|----+
     |
     | tensor2
     |
     v

Note that ethousu_init() need to be called once during startup.

(TODO: Add link to driver readme.) __FPU_PRESENT need to be set in target makefile.

Example 1

Compile a binary with Ethos-U kernel.

make -f tensorflow/lite/micro/tools/make/Makefile network_tester_test TAGS="ethos-u" \
TARGET=<ethos_u_enabled_target> NETWORK_MODEL=<ethos_u_enabled_tflite>