[batch_inference] Support last_in_batch_set parameter
#1032
| Job | Run time |
|---|---|
| 4s | |
| 2s | |
| 2m 31s | |
| 2m 37s |
last_in_batch_set parameter
#1032
| Job | Run time |
|---|---|
| 4s | |
| 2s | |
| 2m 31s | |
| 2m 37s |