Fixed single GPU issue without setting up mp. Added toggles for server request batching parameters

Fixed single GPU issue without setting up mp. Added toggles for server request batching parameters #374