163: Job Queues using Oban with Parker Selbert

If you need background jobs or scheduled tasks in your Elixir project, you've probably already heard of Oban. We talk with Parker Selbert, the creator and maintainer of Oban, to learn more about the project and the additional paid features in Oban Web and Oban Pro. Parker explains the origins, why it's architected the way it is, and how the paid extensions work. We also get some insights into companies using Oban and the kind of scale people reach. Spoiler--100's of millions of jobs is a thing.
Show Notes online - http://podcast.thinkingelixir.com/163 (http://podcast.thinkingelixir.com/163)
Elixir Community News
- https://elixirforum.com/t/nerves-supports-erlang-otp-26-and-elixir-1-15-now/57344 (https://elixirforum.com/t/nerves-supports-erlang-otp-26-and-elixir-1-15-now/57344?utm_source=thinkingelixir&utm_medium=shownotes) – Nerves updated to support OTP 26 and Elixir 1.15
- https://twitter.com/germsvel/status/1686350499967123456 (https://twitter.com/germsvel/status/1686350499967123456?utm_source=thinkingelixir&utm_medium=shownotes) – Phoenix LiveView 0.19 had some enhancements that German Valesco highlights in a video
- https://twitter.com/DNAutics/status/1684418487987441665 (https://twitter.com/DNAutics/status/1684418487987441665?utm_source=thinkingelixir&utm_medium=shownotes) – Zigler 0.10.1 was released
- https://github.com/E-xyza/zigler/ (https://github.com/E-xyza/zigler/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://hexdocs.pm/zigler/beam.html (https://hexdocs.pm/zigler/beam.html?utm_source=thinkingelixir&utm_medium=shownotes) – Zigler's BEAM integration docs
- https://twitter.com/wojtekmach/status/1685390898329178114 (https://twitter.com/wojtekmach/status/1685390898329178114?utm_source=thinkingelixir&utm_medium=shownotes) – Private modules in Elixir? Using @moduledoc false
- https://elixirforum.com/t/proposal-private-modules-general-discussion/19374 (https://elixirforum.com/t/proposal-private-modules-general-discussion/19374?utm_source=thinkingelixir&utm_medium=shownotes) – Previous discussion on private modules
- https://dev.to/savonarola/testing-timer-based-logic-in-elixir-with-klotho-library-2c90 (https://dev.to/savonarola/testing-timer-based-logic-in-elixir-with-klotho-library-2c90?utm_source=thinkingelixir&utm_medium=shownotes) – Klotho library may help with timer based testing logic
- https://twitter.com/spawnfest/status/1683788630156877825 (https://twitter.com/spawnfest/status/1683788630156877825?utm_source=thinkingelixir&utm_medium=shownotes) – SpawnFest will be Oct 28 - 29
- https://spawnfest.org/ (https://spawnfest.org/?utm_source=thinkingelixir&utm_medium=shownotes) – SpawnFest is an annual, 48 hour, online software development contest in which teams from around the world get exactly one weekend to create the best BEAM-based app they can.
- https://github.com/meanderingstream/dlfoundationsinelixir/blob/main/ElixirFashionMLChallenge/fashionmnistchallenge.livemd (https://github.com/meanderingstream/dl_foundations_in_elixir/blob/main/ElixirFashionML_Challenge/fashion_mnist_challenge.livemd?utm_source=thinkingelixir&utm_medium=shownotes) – There's an ML challenge
- https://elixirforum.com/t/elixirfashionmlchallenge-general-discussion-questions/57341 (https://elixirforum.com/t/elixirfashionmlchallenge-general-discussion-questions/57341?utm_source=thinkingelixir&utm_medium=shownotes) – ML challenge discussion thread
Do you have some Elixir news to share? Tell us at @ThinkingElixir (https://twitter.com/ThinkingElixir) or email at show@thinkingelixir.com (mailto:show@thinkingelixir.com)
Discussion Resources
- https://getoban.pro/ (https://getoban.pro/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/sorentwo/oban (https://github.com/sorentwo/oban?utm_source=thinkingelixir&utm_medium=shownotes) – OSS Oban project
- https://podcast.thinkingelixir.com/29 (https://podcast.thinkingelixir.com/29?utm_source=thinkingelixir&utm_medium=shownotes) – Previous interview with Parker from January 2021
- https://dscout.com/ (https://dscout.com/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://getoban.pro/oban (https://getoban.pro/oban?utm_source=thinkingelixir&utm_medium=shownotes) – Oban Web demo
- https://github.com/sidekiq/sidekiq (https://github.com/sidekiq/sidekiq?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/sorentwo/kiq (https://github.com/sorentwo/kiq?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/dashbitco/bytepack_archive (https://github.com/dashbitco/bytepack_archive?utm_source=thinkingelixir&utm_medium=shownotes)
Guest Information
- https://twitter.com/sorentwo (https://twitter.com/sorentwo?utm_source=thinkingelixir&utm_medium=shownotes) – on Twitter
- https://github.com/sorentwo (https://github.com/sorentwo?utm_source=thinkingelixir&utm_medium=shownotes) – on Github
- https://sorentwo.com/ (https://sorentwo.com/?utm_source=thinkingelixir&utm_medium=shownotes) – Blog
Find us online
- Message the show - @ThinkingElixir (https://twitter.com/ThinkingElixir)
- Message the show on Fediverse - @ThinkingElixir@genserver.social (https://genserver.social/ThinkingElixir)
- Email the show - show@thinkingelixir.com (mailto:show@thinkingelixir.com)
- Mark Ericksen - @brainlid (https://twitter.com/brainlid)
- Mark Ericksen on Fediverse - @brainlid@genserver.social (https://genserver.social/brainlid)
- David Bernheisel - @bernheisel (https://twitter.com/bernheisel)
- David Bernheisel on Fediverse - @dbern@genserver.social (https://genserver.social/dbern)
- Cade Ward - @cadebward (https://twitter.com/cadebward)
- Cade Ward on Fediverse - @cadebward@genserver.social (https://genserver.social/cadebward)