← Statistics and Research Methods › Prediction Stability

When classifier predictions route cases to specialized queues, a model update changes both accuracy and the work each team receives. Queue Shift chooses the batch assignment that maximizes candidate-model probability subject to budgets on work moved between queues, counted in cases, hours, or money, and on expected negative flips. At the movement and expected flips of any comparison rule, it has at least that rule's expected accuracy under the candidate's probabilities. Simulations show that holding queue totals fixed costs little when an update mostly reorders cases and a great deal when it moves volume between queues, and that learned queue prices nearly match exact assignment in accuracy but miss the movement budget in most batches.

Cite: Gaurav Sood. "Queue Shift: Updating Classifiers Under a Staffing Budget." https://gsood.com/research/queue-shift-updating-classifiers-under-a-staffing-budget/

BibTeX:
@misc{soodqueue,
  author = {Gaurav Sood},
  title = {{Queue Shift: Updating Classifiers Under a Staffing Budget}},
  note = {Working paper},
  url = {https://gsood.com/research/queue-shift-updating-classifiers-under-a-staffing-budget/}
}