From 1acfadfc982ec606f980485e1d01518d2d9101f6 Mon Sep 17 00:00:00 2001 From: Alexandre Lissy Date: Thu, 27 Jun 2019 16:51:19 +0200 Subject: [PATCH] Document TF_FORCE_GPU_ALLOW_GROWTH Fixes #2211 --- README.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/README.md b/README.md index 6719adac..09e4b9fb 100644 --- a/README.md +++ b/README.md @@ -268,6 +268,14 @@ pip3 install 'tensorflow-gpu==1.13.1' Please ensure you have the required [CUDA dependency](#cuda-dependency). +It has been reported for some people failure at training: +``` +tensorflow.python.framework.errors_impl.UnknownError: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. + [[{{node tower_0/conv1d/Conv2D}}]] +``` + +Setting the `TF_FORCE_GPU_ALLOW_GROWTH` environment variable to `true` seems to help in such cases. + ### Common Voice training data The Common Voice corpus consists of voice samples that were donated through Mozilla's [Common Voice](https://voice.mozilla.org/) Initiative.