experiments/STT-tensorflow
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Store an empty engine in the case that dynamic engine creation fails. The next time the same input shape appears, we will retrieve the empty engine which tells us to not rebuild the same failing engine again.

Browse Source
This commit is contained in:
Trevor Morris 2019-03-11 14:50:02 -07:00
parent df3a9e555f
commit fe020fccbb
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
tensorflow/compiler/tf2tensorrt/kernels/trt_engine_op.cc
View File

@ -633,6 +633,9 @@ EngineContext* TRTEngineOp::GetEngine(
}
LOG(WARNING) << "Engine creation for batch size " << batch_size
<< " failed " << status;
// Store an empty engine here so we don't try to build the same engine
// again.
cache.emplace(engine_input_shapes, empty_context);
return &empty_context;
}
VLOG(1) << "Conversion is done";