Issue:

According to the documentation in order to make use GPU acceleration the first step is to set the global parameter, IFACE_PARAMETER_GLOBAL_GPU_ENABLED, after which a GPU should be specified. Can IFaceSDK only run on one GPU, or more than one at the same time?(For the benchmark against ABSA we have 4 GPUs available.)

Solution:

Unfortunately, one IFace does not support multiple GPU cards. It is exclusively a matter of dependent library. The solution might be to have more instances of IFace, each running on a different GPU. However, you must handle multi-GPU processing by yourself.