This adds a new experimental flag to the C API interpreter options,
which provides functionality equivalent to the TF Lite C++ API's
tflite::delegates::InterpreterUtils::InvokeWithCPUFallback
from delegates/interpreter_utils.h.
PiperOrigin-RevId: 345757574
Change-Id: I91ee063babfc25a793535f7dd9d4541810e11650
Added serialization_generated.h and serialization_base_generated.h
The file is generated with the following command.
$ flatc -c --scoped-enums -I ./ tensorflow/lite/delegates/gpu/cl/serialization.fbs
$ flatc -c --scoped-enums -I ./ tensorflow/lite/delegates/gpu/common/task/serialization_base.fbs
PiperOrigin-RevId: 341594596
Change-Id: I2e80a1d01d3b48560c502279443107cce608f369
This change is a preliminary work for resolving builtin code shortage problem.
It introduces a new utility build target, schema_utils, which will be used for
getting/setting builtin code operator value in TFLite flatbuffer in order to
have a single place to access actual fields for accessing values.
See also the RFC proposal draft,
https://github.com/tensorflow/community/pull/285
PiperOrigin-RevId: 335513647
Change-Id: I810a33425bbed3489cfe4a4a98a10dc4bd67a6ba
For TFLite iOS, bazel has been the recommended way to build the static framework
and the Makefile based script is not even meeting feature parity with the bazel
build (e.g., no GPU delegate support).
PiperOrigin-RevId: 317587116
Change-Id: Idbdf60687f35e1ef0bdb074668317818eeaa95e5
Currently, the lite/tools/make/build_lib.sh fails with the following error.
tensorflow/lite/tools/make/downloads/ruy/ruy/prepare_packed_matrices.cc:16:41: fatal error: ruy/prepare_packed_matrices.h: No such file or directory
compilation terminated.
PiperOrigin-RevId: 316025435
Change-Id: I2f9909e8865cee0937efe4170114553319eb33e0
- Use of the cpuinfo thirdparty library to perform CPU feature detection, including detection of dot-product instructions on iOS and detection of cache sizes. Combined with the ARM64 build change below, this means that iPhone11/SE devices now use dot-product instructions. We measured 250 Gop/s on 1 Lightning core in iPhone 11 Pro.
- ARM32: @lissyx's fix in google/ruy#69
- ARM64: build the kNeonDotprod path unconditionally (used to be linux-only).
- x86-64: enabling AVX512 instructions in the general opensource build.
PiperOrigin-RevId: 315467315
Change-Id: I0788ddc68da8d0aa2eee71f820fb5d8c188d35b2
- ARM32: @lissyx's fix in google/ruy#69
- ARM64: enabling dotprod instructions outside of Linux.
- x86-64: enabling AVX512 instructions in the general opensource build. A previous version of this CL was rolled back due to lack of support for -march=skylake-avx512 in some toolchains. Hopefully this will fare better thanks to b68dcd8713 .
PiperOrigin-RevId: 314766242
Change-Id: I56027a328248f2d85c9c74d3d8e27328ac25f332
- ARM32: @lissyx's fix in google/ruy#69
- ARM64: enabling dotprod instructions outside of Linux.
- x86-64: enabling AVX512 instructions in the general opensource build. A previous version of this CL was rolled back due to lack of support for -march=skylake-avx512 in some toolchains. Hopefully this will fare better thanks to b68dcd8713 .
PiperOrigin-RevId: 314597853
Change-Id: Ia64d5aa5bb9e47140e084e0896a5685cac247886
Since commit SHA1: d28cf21aa5
Cross compilation of TFLite is failing.
Add an EXTRA_CFLAGS variable to allow cross compilation environment to
define extra CFLAGS when needed.
Signed-off-by: Vincent ABRIOU <vincent.abriou@st.com>
2. Make common delegate-related parameters into a single delegate_provider module.
3. Changed the delegate provider API to clearly show default params and their values.
PiperOrigin-RevId: 305844062
Change-Id: Iebae441348197803d092d7af0fe84c2c04b90d0d
2. Also branch the benchmark/logging.h to the upper level directory.
Note we still keep those in benchmark directory for backward compatibility but by reusing the new definitions here. These utility classes are helpful to and going to be used in other tflite-related tools.
PiperOrigin-RevId: 305834516
Change-Id: Id809398b060698b641cad0c8ac5fe9ca22b9ab40
