Group :: Desenvolvimento/Ruby
RPM: gem-gitlab-sidekiq-fetcher
Principal Changelog Spec Patches Sources Download Gear Bugs e FR Repocop
A versão atual: 0.8.0-alt1
Data da compilação: 21 abril 2022, 07:46 ( 101.1 weeks ago )
Tamanho:: 18.82 Kb
Home page: https://gitlab.com/gitlab-org/sidekiq-reliable-f…
Licença: LGPL-3.0
Sumário: Redis reliable queue pattern implemented in Sidekiq
Descrição:
Lista dos contribuidores Lista dos rpms provida por esta srpm:
ACL:
Data da compilação: 21 abril 2022, 07:46 ( 101.1 weeks ago )
Tamanho:: 18.82 Kb
Home page: https://gitlab.com/gitlab-org/sidekiq-reliable-f…
Licença: LGPL-3.0
Sumário: Redis reliable queue pattern implemented in Sidekiq
Descrição:
gitlab-sidekiq-fetcher is an extension to Sidekiq that adds support for reliable
fetches from Redis.
It's based on https://github.com/TEA-ebook/sidekiq-reliable-fe….
There are two strategies implemented: Reliable fetch using rpoplpush command and
semi-reliable fetch that uses regular brpop and lpush to pick the job and put it
to working queue. The main benefit of "Reliable" strategy is that rpoplpush is
atomic, eliminating a race condition in which jobs can be lost. However, it
comes at a cost because rpoplpush can't watch multiple lists at the same time so
we need to iterate over the entire queue list which significantly increases
pressure on Redis when there are more than a few queues. The "semi-reliable"
strategy is much more reliable than the default Sidekiq fetcher, though.
Compared to the reliable fetch strategy, it does not increase pressure on Redis
significantly.
Mantenedor currente: Ruby Maintainers Team fetches from Redis.
It's based on https://github.com/TEA-ebook/sidekiq-reliable-fe….
There are two strategies implemented: Reliable fetch using rpoplpush command and
semi-reliable fetch that uses regular brpop and lpush to pick the job and put it
to working queue. The main benefit of "Reliable" strategy is that rpoplpush is
atomic, eliminating a race condition in which jobs can be lost. However, it
comes at a cost because rpoplpush can't watch multiple lists at the same time so
we need to iterate over the entire queue list which significantly increases
pressure on Redis when there are more than a few queues. The "semi-reliable"
strategy is much more reliable than the default Sidekiq fetcher, though.
Compared to the reliable fetch strategy, it does not increase pressure on Redis
significantly.
Lista dos contribuidores Lista dos rpms provida por esta srpm:
- gem-gitlab-sidekiq-fetcher
- gem-gitlab-sidekiq-fetcher-doc
- gem-gitlab-sidekiq-fetcher-devel