#293: Tool Selection and the Unhelpfulness of Feature Comparisons

The one rule about the Analytics Power Hour is that we don't talk about specific tools. But that doesn't mean we won't talk about tool SELECTION! Jason Packer recently released the second edition of Google Analytics Alternatives, (also available on Amazon) and his approach in the book is very much not an RFP-like "check which features your tool offers" system. And his rationale for that seems just as applicable (to us, at least!) for any data platform selection, be it a digital/product analytics platform, a BI tool, database or storage infrastructure, or, well, you name it! Ultimately, the challenge is how to go about getting a reasonably strong understanding of the philosophy and historical roots of each platform being considered and then marrying that up with the foundational priorities and needs of the organization. Is that a lot harder than a feature checklist? Yes. But them's the breaks. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

As Kevin McCallister once taught us: just because the house is still standing doesn't mean everything's under control. Everyone's racing to adopt AI, but has anyone actually read the fine print? For this year's International Women's Day episode, we are joined by Aubrey Blanche to unpack the hype, the hidden tradeoffs, and the quiet ways teams are giving up agency in the name of "productivity." We explore how data and tech teams are uniquely prepared and positioned to ask better questions, measure what really matters, and avoid letting the AI teenager run the house. Learn more about "phantom value" and why faster isn't always better… or even cheaper! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

We know what the work of the data practitioner is, right? It's everything from managing data ingestion to data governance to report development to experimental design to basic and advanced analytics. It's writing (or vibe-writing?) SQL or Python or R while also being adept at whatever data stack—no matter how modern—is at hand. Of course, it's a lot more, too! And that's the topic of this episode: the unofficial, often unheralded, but often quite important "shadow work" of the analyst—the myriad tasks required to effectively glue together all the data work that occurs out in broad daylight to enable the data to truly be useful at driving the business forward. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

From a professional development perspective, you should always be learning: listening to podcasts, reading books, connecting with internal colleagues, following useful people on Medium and LinkedIn, and so on. Did we mention listening to podcasts? Well, THIS episode of THIS podcast is not really about that kind of learning. It's more about the sort of organizational learning that experimentation and analytics is supposed to deliver. How does a brand stay ahead of their competitors? One surefire way is to get smarter about their customers at a faster rate than their competitors do. But what does that even mean? Is it a learning to discover that the MVP of a hot new feature…doesn't look to be moving the needle at all? Our guest, Mårten Schultzberg from Spotify, makes a compelling case that it is! And the co-hosts agree. But it's tricky. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

That darn data. It's so complicated and fragmented and gap-filled and noisy that no amount of time is ever enough to truly get to the bottom of all of its complexity. As a result, it's pretty easy to fill all of our time handling as much of that underlying data messiness as possible. At what cost, though? It's easy for the analyst's connection to the business to suffer as they get mired (too) deeply in the data and lose sight of the broader business needs. In this episode, the gang had a chat about business acumen—what it is, how to develop it, and why it's a must-have for any data or analytics role. This episode's Measurement Bite from show sponsor Recast is a brief explanation of identifiability—what it is and how to check for it using simulation—from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

If there's one thing that we absolutely knew would be coming along with the increased interest and use of AI, it would be… more acronyms! And, along with the acronyms, we pretty much could predict that we see a lot of online flexing through casual dropping of said acronyms as though they're deeply understood by everyone who's anyone. We tackled one such acronym on this episode: MCP! That's "model context protocol" for those who like their acronyms written out, and Sam Redfern joined us to help us wrap our heads around the topic. You see, MCP is kinda' like some other more familiar acronyms like API and XML. But, it's also like… fingers? Sam's enthusiasm and explanation certainly had us ready to dive in! This episode's Measurement Bite from show sponsor Recast is an explanation of model robustness from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

It's the most…won…derful…tiiiiime…of the year! And by that, we mean it's the time of the year when we sit back, look at each other, and ask, "Where did all the time go?!" We brought back a very special someone for this episode as we collectively reflected on the year—show highlights (and what about those shows have stuck with us), industry reflections, and a little shameless shilling for Tim's book (are you still short on a few stocking stuffers? Order now…!). This episode's Measurement Bite from show sponsor Recast is a brief explanation of Granger causality (and how it's NOT actually a causal measure!) from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.  

Semantic layers are having something of a moment, but they're not actually new as a concept. Ever since the first database table was designed with cryptic field names that no business user could possibly understand, there's been a need for some form of mapping and translation. Should every company be considering employing a semantic layer? Is the idea of a single, comprehensive semantic layer within an organization a monolithic concept that is doomed to fail? These questions and more get bandied about on this episode, where we were joined by industry legend Cindi Howson, Chief Data & AI Strategy Officer at Thoughtspot. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page. This episode's Measurement Bite from show sponsor Recast is an explanation of multicollinearity from Michael Kaminsky!

Before you listen to this episode, can you quantify how useful you expect it to be? That's a prior! And "priors" is a word that gets used a lot in this discussion with Michael Kaminsky as we try to demystify the world of Bayesian statistics. Luckily, you can just listen to the episode once and then update your expectation—no need to simulate listening to the show a few thousand times or crunch any numbers whatsoever. The most important takeaway is that you'll know you've achieved Bayesian clarity when you come to realize that human beings are naturally Bayesian, and the underlying principles behind Bayesian statistics are inherently intuitive. This episode's Measurement Bite from show sponsor Recast is a brief explanation of statistical significance (and why shorthanding it is problematic…and why confidence intervals are generally more practically useful in business than p-values) from Michael Kaminsky! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

As the world turns, a couple of things happen: 1) we grow and learn, and 2) the world changes. On this episode, inspired by a job interview question, the hosts walked through a range of thoughts and beliefs they had at one time that they no longer have today. Analytics intake forms are good…or bad? Analytics centers of excellence are the sign of a mature organization…or they're just one of many potential options? Privacy concerns are something no one really cares about…or they are something everyone cares deeply about? Voices were raised. Light profanity was employed. Laughter ensued. This episode's Measurement Bite from show sponsor Recast is a brief explanation of statistical significance (and why shorthanding it is problematic…and why confidence intervals are often more practically useful in business than p-values) from Michael Kaminsky. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.