diff --git a/doc/TRAINING.rst b/doc/TRAINING.rst index 581af569..dc6ad242 100644 --- a/doc/TRAINING.rst +++ b/doc/TRAINING.rst @@ -3,11 +3,14 @@ Training Your Own Model ======================= +.. _cuda-training-deps: + Prerequisites for training a model ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ * `Python 3.6 `_ * Mac or Linux environment +* CUDA 10.0 / CuDNN v7.6 per `Dockerfile `_. Getting the training code ^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -69,7 +72,7 @@ If you have a capable (NVIDIA, at least 8GB of VRAM) GPU, it is highly recommend pip3 uninstall tensorflow pip3 install 'tensorflow-gpu==1.15.4' -Please ensure you have the required :ref:`CUDA dependency `. +Please ensure you have the required `CUDA dependency `_ and/or :ref:`Prerequisites `. It has been reported for some people failure at training: @@ -78,7 +81,7 @@ It has been reported for some people failure at training: tensorflow.python.framework.errors_impl.UnknownError: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[{{node tower_0/conv1d/Conv2D}}]] -Setting the ``TF_FORCE_GPU_ALLOW_GROWTH`` environment variable to ``true`` seems to help in such cases. This could also be due to an incorrect version of libcudnn. Double check your versions with the :ref:`TensorFlow 1.15 documentation `. +Setting the ``TF_FORCE_GPU_ALLOW_GROWTH`` environment variable to ``true`` seems to help in such cases. This could also be due to an incorrect version of libcudnn. Double check your versions with the :ref:`TensorFlow 1.15 documentation `. Basic Dockerfile for training ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ diff --git a/doc/USING.rst b/doc/USING.rst index 0ad93eb4..40cc044f 100644 --- a/doc/USING.rst +++ b/doc/USING.rst @@ -23,10 +23,10 @@ Running ``deepspeech`` might, see below, require some runtime dependencies to be Please refer to your system's documentation on how to install these dependencies. -.. _cuda-deps: +.. _cuda-inference-deps: -CUDA dependency -^^^^^^^^^^^^^^^ +CUDA dependency (inference) +^^^^^^^^^^^^^^^^^^^^^^^^^^^ The GPU capable builds (Python, NodeJS, C++, etc) depend on CUDA 10.1 and CuDNN v7.6. diff --git a/doc/index.rst b/doc/index.rst index 206425d0..40a01670 100644 --- a/doc/index.rst +++ b/doc/index.rst @@ -46,7 +46,7 @@ Quicker inference can be performed using a supported NVIDIA GPU on Linux. See th # Transcribe an audio file. deepspeech --model deepspeech-0.9.1-models.pbmm --scorer deepspeech-0.9.1-models.scorer --audio audio/2830-3980-0043.wav -Please ensure you have the required :ref:`CUDA dependencies `. +Please ensure you have the required :ref:`CUDA dependencies `. See the output of ``deepspeech -h`` for more information on the use of ``deepspeech``. (If you experience problems running ``deepspeech``, please check :ref:`required runtime dependencies `).