add generation time metrics#613
Merged
andrei-kochin merged 12 commits intoopenvinotoolkit:releases/2024/3from pavel-esir:add_perf_countersJul 26, 2024
+744-30
Commits
Commits on Jul 22, 2024
[Continuous batching] Replace standard max_element call with custom loop for greedy sampling (openvinotoolkit#607)
- committed
- committed
- committed
- committed