# Competing consumers

> Let several workers read from one queue, so each task goes to exactly one of them and throughput grows by adding workers.

Competing consumers are several workers pulling from the same queue, so the work is shared and each task goes to one worker.

## Use it when

- One worker cannot drain the queue, and queue depth keeps climbing.
- Tasks are independent, so any worker can take any task.
- You want to add capacity by adding workers, not by rewriting the producer.

## How it works

The broker hands each task to one ready consumer and waits for an acknowledgement. If a consumer dies before it acks, the broker gives the task to another, which is why delivery is at least once. If one worker handles 20 tasks a second and 100 arrive, five workers keep up.

Prefetch is how many tasks a worker takes ahead of time. A high value hides broker round trips. A low value spreads tasks fairly when they vary in length, and leaves fewer tasks stuck on a worker that crashes.

## What it costs

Order is gone: two tasks for the same user can run at once or out of order. Fix that by partitioning on a key, so one entity always goes to one consumer. Workers that share a database also share its connection limit, so more workers can move the bottleneck, not remove it.

## In Quorum



Both [Workers](https://wiki.playquorum.dev/components/worker.md) link to the same [Queue](https://wiki.playquorum.dev/components/queue.md), which offers each of them what arrives. Prefetch is the setting on a Worker. A crash loses every task a process had taken, and a planned restart hands them back first. A [Connection Pooler](https://wiki.playquorum.dev/components/pooler.md) protects the Database when Workers multiply.

Add copies with an [Autoscaler](https://wiki.playquorum.dev/components/autoscaler.md) on queue depth. Research [Background jobs](https://wiki.playquorum.dev/research/background-jobs.md) and [Message queues](https://wiki.playquorum.dev/research/queues.md). The glossary defines [at-least-once delivery](https://wiki.playquorum.dev/glossary/at-least-once-delivery.md).

Source: https://wiki.playquorum.dev/patterns/competing-consumers