185: InstructorEx for LLMs

Dive into the world of structured LLM prompting with our latest guest who shares insights on their innovative project, InstructorEx. We'll explore how this tool is pushing the boundaries of large language models to return structured data, particularly JSON, and the benefits it offers when integrated into existing systems. The conversation takes a deep dive into the challenges and solutions of forcing LLMs to output data in desirable formats using Elixir technology, like Ecto schemas, and what it means to treat an LLM like a digital human, even applying it to tasks like spam detection in emails. Discover the intriguing concept of using a local database as a cache for LLM results. If you're curious about the intersection of structured data, Python experience transition to Elixir, and the future of LLM integration, this is an episode not to miss. Tune in for these engaging topics and more!
Show Notes online - http://podcast.thinkingelixir.com/185 (http://podcast.thinkingelixir.com/185)
Elixir Community News
- https://twitter.com/spawnfest/status/1743987039345782978 (https://twitter.com/spawnfest/status/1743987039345782978?utm_source=thinkingelixir&utm_medium=shownotes) – Announcement and prize awarding of the SpawnFest winners.
- https://spawnfest.org/2023.html (https://spawnfest.org/2023.html?utm_source=thinkingelixir&utm_medium=shownotes) – Official SpawnFest 2023 webpage with details on the projects and winners.
- https://github.com/spawnfest/heimdall (https://github.com/spawnfest/heimdall?utm_source=thinkingelixir&utm_medium=shownotes) – 1st Place Overall at SpawnFest, Heimdall is a web app for secure and easy sharing of sensitive data.
- https://github.com/spawnfest/fluffytrain (https://github.com/spawnfest/fluffytrain?utm_source=thinkingelixir&utm_medium=shownotes) – 2nd Place Overall at SpawnFest, Fluffytrain is a web app for generating working Elixir code using OpenAI GPT-4.
- https://github.com/spawnfest/tabtab (https://github.com/spawnfest/tabtab?utm_source=thinkingelixir&utm_medium=shownotes) – 3rd Place Overall at SpawnFest, tabtab is an autocompletion generator plugin for Erlang's rebar3.
- https://github.com/spawnfest/arizona (https://github.com/spawnfest/arizona?utm_source=thinkingelixir&utm_medium=shownotes) – Arizona, an Erlang Web Framework, was one of the highlighted projects at SpawnFest.
- https://github.com/spawnfest/latch (https://github.com/spawnfest/latch?utm_source=thinkingelixir&utm_medium=shownotes) – Latch, a tool for viewing OpenTelemetry data in real-time was a highlighted project at SpawnFest.
- https://github.com/spawnfest/youcan (https://github.com/spawnfest/youcan?utm_source=thinkingelixir&utm_medium=shownotes) – Youcan, an Elixir library for using UCANs in app authorization flows, featured at SpawnFest.
- https://ucan.xyz/ (https://ucan.xyz/?utm_source=thinkingelixir&utm_medium=shownotes) – UCAN.xyz, related to the Youcan Elixir library for user-controlled authorization networks.
- https://github.com/spawnfest/lorax (https://github.com/spawnfest/lorax?utm_source=thinkingelixir&utm_medium=shownotes) – Lorax, a Livebook app implementing LoRA for fine-tuning language models, was highlighted at SpawnFest.
- https://github.com/spawnfest/karel_dreams (https://github.com/spawnfest/karel_dreams?utm_source=thinkingelixir&utm_medium=shownotes) – SpawnFest's highlighted project Karel_dreams, a Livebook app for controlling a robot with AI or script.
- https://twitter.com/josevalim/status/1744395345872683471 (https://twitter.com/josevalim/status/1744395345872683471?utm_source=thinkingelixir&utm_medium=shownotes) – José Valim celebrates Elixir's 13th anniversary and announces Elixir as a gradually typed language.
- https://twitter.com/bcardarella/status/1743370338254139712 (https://twitter.com/bcardarella/status/1743370338254139712?utm_source=thinkingelixir&utm_medium=shownotes) – Announcement of LiveView Native v0.2.0-rc.1 release and upcoming changes.
- https://twitter.com/germsvel/status/1744686958196973787 (https://twitter.com/germsvel/status/1744686958196973787?utm_source=thinkingelixir&utm_medium=shownotes) – German Valesco shares a tip about LiveView helpers for creating pipe-friendly functions in Elixir.
- https://codebeamamerica.com/ (https://codebeamamerica.com/?utm_source=thinkingelixir&utm_medium=shownotes) – CodeBeam America conference information, happening on March 7-8, 2024 in San Francisco and virtually.
- https://twitter.com/sasajuric/status/1744649232793886963 (https://twitter.com/sasajuric/status/1744649232793886963?utm_source=thinkingelixir&utm_medium=shownotes) – Tweet about CodeBeam America conference.
Do you have some Elixir news to share? Tell us at @ThinkingElixir (https://twitter.com/ThinkingElixir) or email at show@thinkingelixir.com (mailto:show@thinkingelixir.com)
Discussion Resources
- https://github.com/thmsmlr/instructor_ex (https://github.com/thmsmlr/instructor_ex?utm_source=thinkingelixir&utm_medium=shownotes)
- https://twitter.com/thmsmlr/status/1736645576324784375 (https://twitter.com/thmsmlr/status/1736645576324784375?utm_source=thinkingelixir&utm_medium=shownotes)
- https://www.stitchfix.com/ (https://www.stitchfix.com/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://docs.pydantic.dev/latest/ (https://docs.pydantic.dev/latest/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/boudra/jaxon (https://github.com/boudra/jaxon?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/ggerganov/llama.cpp (https://github.com/ggerganov/llama.cpp?utm_source=thinkingelixir&utm_medium=shownotes)
- https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/ (https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://hadoop.apache.org/ (https://hadoop.apache.org/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://pig.apache.org/ (https://pig.apache.org/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://www.r-project.org/ (https://www.r-project.org/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://fly.io/blog/rethinking-serverless-with-flame/ (https://fly.io/blog/rethinking-serverless-with-flame/?utm_source=thinkingelixir&utm_medium=shownotes)
- BNF Grammar enforcement for JSON output
- https://www.linkedin.com/company/modal-labs/ (https://www.linkedin.com/company/modal-labs/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://airflow.apache.org/ (https://airflow.apache.org/?utm_source=thinkingelixir&utm_medium=shownotes)
Guest Information
- https://twitter.com/thmsmlr (https://twitter.com/thmsmlr?utm_source=thinkingelixir&utm_medium=shownotes) – on Twitter
- https://github.com/thmsmlr/ (https://github.com/thmsmlr/?utm_source=thinkingelixir&utm_medium=shownotes) – on Github
- https://thmsmlr.com/ (https://thmsmlr.com/?utm_source=thinkingelixir&utm_medium=shownotes) – Blog
Find us online
- Message the show - @ThinkingElixir (https://twitter.com/ThinkingElixir)
- Message the show on Fediverse - @ThinkingElixir@genserver.social (https://genserver.social/ThinkingElixir)
- Email the show - show@thinkingelixir.com (mailto:show@thinkingelixir.com)
- Mark Ericksen - @brainlid (https://twitter.com/brainlid)
- Mark Ericksen on Fediverse - @brainlid@genserver.social (https://genserver.social/brainlid)
- David Bernheisel - @bernheisel (https://twitter.com/bernheisel)
- David Bernheisel on Fediverse - @dbern@genserver.social (https://genserver.social/dbern)
- Cade Ward - @cadebward (https://twitter.com/cadebward)
- Cade Ward on Fediverse - @cadebward@genserver.social (https://genserver.social/cadebward)