Prompt Caching, Batching and Other Boring Wins

Proposed by Kwame Boateng · Anansi Systems

Accepted

Decision

Currently accepted. You can change your mind at any time.

A session exists on the agenda for this proposal — not scheduled yet.

Proposal

Unglamorous optimisations with outsized effects, benchmarked on production traffic rather than a synthetic loop.

Infrastructure & ScaleTalkIntermediate

LLMs

DevEx

Speaker

People attached to this proposal. Accepting copies them onto the session and assigns their onboarding tasks.

Kwame BoatengSpeakerPrimary contact

Staff Engineer, Anansi Systemskwame.boateng@example.com

Kwame works on inference runtimes and open-model deployment on hardware that was never meant for it.

Application answers

Everything the speaker filled in on the call-for-papers form.

Talk title: Prompt Caching, Batching and Other Boring Wins
Abstract: Unglamorous optimisations with outsized effects, benchmarked on production traffic rather than a synthetic loop.
Track(s): Infrastructure & Scale
Session format: Talk (25 min)
Audience level: Intermediate
Have you presented this talk before?: No
Do you need travel support to attend?: No
Speaker biography: Kwame works on inference runtimes and open-model deployment on hardware that was never meant for it.

Reviewers

Assign this proposal to a specific reviewer, on top of whoever already gets it through their tracks.

Reviews

2 reviews from the programme committee.

5.0 / 5average from 2 scores

Hana Petrova (external)5.0 / 5Approve5 Aug 2026
Strong submission. The outline is specific enough that I trust the speaker can land it in the time slot.
Ada Nwosu5.0 / 5Approve22 Jul 2026
Strong submission. The outline is specific enough that I trust the speaker can land it in the time slot.

Details

FormatTalk

Audience levelIntermediate

Submitted10 Jul 2026 at 22:30

Decision recorded30 Jul 2026 at 22:30

FormDevFlow Conf 2027 — Call for Speakers