Continuous batching

Scheduling work per decode step so finished requests leave a batch and new ones join immediately.

All terms, A to Z