#337: Kedro for Maintainable Data Science

Do you find yourself or your team building internal apps frequently for your company? Are you familiar with the term "forms over data"? They are super empowering for your org but they can be pretty repetitive and you might find yourself spending more time than you'd like working on them rather than core products and services. I invited Jimmy Chan from Dropbase to tell us about their service who's tagline is "Build internal web apps with just Python." It's a cool service and a fun conversation. Episode sponsors Mailtrap Talk Python Courses Links from the show Build internal web apps with just Python.: dropbase.io Dropbase on Github: github.com Dropbase @ LinkedIn: linkedin.com Dropbase on Twitter: twitter.com Jimmy Chan: linkedin.com Jimmy on Twitter: twitter.com Dropbase Docs: docs.dropbase.io Dropbase: dropbase.io Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

We all know that tools like ChatGPT have really empowered developers to tackle bigger problems. Are you using TailwindCSS and need a login page? Try asking Chat "What is the HTML for a login page with the login username, password, and button in its own section in the center of the page?" It will literally give you a first pass version of it. But how far can you push this? Fred Tubiermont may have taken it farther than most. He built a functioning SaaS product with paying customers by only using ChatGPT and Python. It's fascinating to hear his story. Episode sponsors Mailtrap Talk Python Courses Links from the show Frederick Tubiermont: linkedin.com The #1 AI Jingle Generator: aijinglemaker.com Fred's YouTube Channel: youtube.com AI Coding Club: aicodingclub.com No Code: saashub.com Prompt Engineering 101 - Crash Course & Tips: youtube.com gpt-engineer: github.com Instant Deployments, Effortless Scale: railway.app Self-hosting with superpowers.: coolify.io The newsletter platform built for growth.: beehiiv.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

What is the state of serverless computing and Python in 2024? What are some of the new tools and best practices? We are lucky to have Tony Sherman who has a lot of practical experience with serverless programming on the show. Episode sponsors Sentry Error Monitoring, Code TALKPYTHON Mailtrap Talk Python Courses Links from the show Tony Sherman on Twitter: twitter.com Tony Sherman: linkedin.com PyCon serverless talk: youtube.com AWS re:Invent talk: youtube.com Powertools for AWS Lambda: docs.powertools.aws.dev Pantsbuild: The ergonomic build system: pantsbuild.org aws-lambda-power-tuning: github.com import-profiler: github.com AWS Fargate: aws.amazon.com Run functions on demand. Scale automatically.: digitalocean.com Vercel: vercel.com Deft: deft.com 37 Signals We stand to save $7m over five years from our cloud exit: world.hey.com The Global Content Delivery Platform That Truly Hops: bunny.net Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

We've spoken previously about security and software supply chains and we are back at it this episode. We're diving in again with Charles Coggins. Charles works at a software supply chain company and is on to give us the insiders and defender's perspective on how to keep our Python apps and infrastructure safe. Episode sponsors Sentry Error Monitoring, Code TALKPYTHON Mailtrap Talk Python Courses Links from the show Series: How Malicious Python Code Gains Execution: blog.phylum.io Pick a Python Lockfile and Improve Security: blog.phylum.io Bad Beat Poetry: blog.phylum.io PEP 665 – A file format to list Python dependencies for reproducibility of an application: peps.python.org PEP 517 – A build-system independent format for source trees: peps.python.org PEP 518 – Specifying Minimum Build System Requirements for Python Projects: peps.python.org Lockfiles should be committed on all projects: classic.yarnpkg.com An Overview of Software Supply Chain Security: tldrsec.com Typosquatting: docs.phylum.io Common Attack Pattern Enumeration and Classification: capec.mitre.org Dependency Confusion: docs.phylum.io Expired Author Domains: docs.phylum.io Unverifiable Dependency: docs.phylum.io Repo Jacking: Hidden Danger in Broken Links: blog.phylum.io Software Libraries Are Terrifying: medium.com phylum 0.43.0: pypi.org linguist: github.com rich-codex ⚡️📖⚡️: ewels.github.io Phylum Community Discord: discord.gg The dream is dead?: mastodon.social When "Everything" Becomes Too Much: The npm Package Chaos of 2024: socket.dev pip-tools: github.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

Do you know what custom GPTs are? They're configurable and shareable chat experiences with a name, logo, custom instructions, conversation starters, access to OpenAI tools, and custom API actions. And, you can build them with Python! Ian Maurer has been doing just that and is here to share his experience building them. Episode sponsors Sentry Error Monitoring, Code TALKPYTHON Neo4j Talk Python Courses Links from the show Ian on Twitter: @imaurer Mobile Navigation: openai.com What is a Custom GPT?: imaurer.com Mobile Navigation: openai.com FuzzTypes: Pydantic library for auto-correcting types: github.com pypi-gpt: github.com marvin: github.com instructor: github.com outlines: github.com llamafile: github.com llama-cpp-python: github.com LLM Dataset: llm.datasette.io Plugin directory: llm.datasette.io Data exploration at your fingertips.: visidata.org hottest new programming language is English: twitter.com OpenAI & other LLM API Pricing Calculator: docsbot.ai Vector DB Comparison: vdbs.superlinked.com bpytop: github.com Source Graph: about.sourcegraph.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

Interested in data science but you're not quite working in it yet? In software, getting that very first job can truly be the hardest one to land. On this episode, we have Avery Smith from Data Career Jumpstart here to share his advice for getting your first data job. Episode sponsors Sentry Error Monitoring, Code TALKPYTHON Posit Talk Python Courses Links from the show Avery Smith: www.linkedin.com Data Career Jumpstart: www.datacareerjumpstart.com Data Nerd Site: datanerd.tech Write C# LINQ queries to query data: learn.microsoft.com A faster way to build and share data apps: streamlit.io Plotly Dash: dash.plotly.com Michael's Keynote: State of Python in 2024: youtube.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

Do you have data that you pull from external sources or is generated and appears at your digital doorstep? I bet that data needs processed, filtered, transformed, distributed, and much more. One of the biggest tools to create these data pipelines with Python is Dagster. And we are fortunate to have Pedram Navid on the show this episode. Pedram is the Head of Data Engineering and DevRel at Dagster Labs. And we're talking data pipelines this week at Talk Python. Episode sponsors Talk Python Courses Posit Links from the show Rock Solid Python with Types Course: training.talkpython.fm Pedram on Twitter: twitter.com Pedram on LinkedIn: linkedin.com Ship data pipelines with extraordinary velocity: dagster.io dagster-open-platform: github.com The Dagster Master Plan: dagster.io data load tool (dlt): dlthub.com DataFrames for the new era: pola.rs Apache Arrow: arrow.apache.org DuckDB is a fast in-process analytical database: duckdb.org Ship trusted data products faster: www.getdbt.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

Have you ever been wait around for pip to do its thing while installing packages or syncing a virtual environment or through some higher level tool such as pip-tools? Then you'll be very excited to hear about the tool just announced from Astral called uv. It's like pip, but 100x faster. Charlie Marsh from Ruff fame and founder of Astral is here to dive in. Let's go. Episode sponsors Neo4j Talk Python Courses Links from the show Charlie Marsh on Twitter: @charliermarsh Charlie Marsh on Mastodon: @charliermarsh Astral: astral.sh uv: github.com Ruff: github.com Ruff Rules: docs.astral.sh When "Everything" Becomes Too Much: The npm Package Chaos of 2024: socket.dev Talk Python's free Audio AI Course: training.talkpython.fm Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

Have you heard of Quart? It's the fully-async version of Flask created by Philip Jones who is working closely with the Flask team on these parallel projects. The TL;DR; version is that if you want to take advantage of async and await and you're using Flask, you want to give Quart a solid look. We've spoken to Philip previously about Quart. This time around here's here to share his top Quart extensions and libraries you can adopt today. Episode sponsors Posit Talk Python Courses Links from the show Pallets Team on ExTwitter: @PalletsTeam Quart Framework: quart.palletsprojects.com Using Quart Extensions: quart.palletsprojects.com Quart Tasks: quart-tasks.readthedocs.io Quart Minify: github.com Quart Db: github.com Hypercorn: github.com Quart-CORS: github.com Quart-Auth: github.com Quart-Rate: github.com Quart-Schma: github.com Flask-Socket: github.com Quart-SqlAlchemy: github.com Flask-Login: github.com greenback: github.com secure: github.com msgspec: jcristharif.com Server-Sent Events: pgjones.gitlab.io Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy

Are you interested in contributing to Django? Then there is an amazing mentorship program that helps Python and Django enthusiasts, because contributes and potentially core developers of Django. It's called Djangonauts and their slogan is "where contributors launch." On this episode, we have Sarah Boyce from the Django team and former Djangonaut and now Djangonaut mentor, Tushar Gupta. Not only is this excellent for the Django community, many of other open source communities would do well to keep an eye on how this creative project is working. Episode sponsors Neo4j Posit Talk Python Courses Links from the show Sarah on Mastodon: @[email protected] Sarah on LinkedIn: linkedin.com Tushar on Twitter: @tushar5526 Djangonaut Space on Mastodon: @[email protected] Djangonaut Space on Twitter: @djangonautspace Djangonaut Space on LinkedIn: linkedin.com Website: djangonaut.space Djangonaut Space Launch Video: youtube.com Sessions: djangonaut.space Djangonaut Space Interest Form: google.com/forms Program: github.com Watch this episode on YouTube: youtube.com Episode transcripts: talkpython.fm --- Stay in touch with us --- Subscribe to us on YouTube: youtube.com Follow Talk Python on Mastodon: talkpython Follow Michael on Mastodon: mkennedy