Monday Morning Data Chat

Matt Housley and Joe Reis chat about where data engineering is going, and take audience questions.

The data job market is certainly evolving. Matt, Chris, and Joe have a candid chat and AMA about career advice going into 2024.

Amit Prakash (CTO/Co-Founder of Thoughtspot) joins the show to chat about the future of generative AI in data analytics. Thoughtspot has been a leader in searchable analytics, and it will be interesting to get Amit's take on where the field of analytics is heading next.

Aaron Hunsaker joins Matthew Housley and I to chat about data grifters, dealing with vendors, how data people should converse with "the business", and much more. Aaron doesn't hold back.
Enjoy this very candid in-person chat.

Hala Nelson joins the show to chat writing books, teaching math, and much more. It's not often we get three math nerds, professors, and authors in the same conversation, and this is a lot of fun. Enjoy!

David Yaffe and Johnny Graettinger (both from Estuary) join the show to do a deep dive into streaming data processing. We also cover how to scale change data capture (CDC) and where transformations belong in data pipelines.

Estuary: https://estuary.dev/

Gazette: https://gazette.readthedocs.io/en/latest/

Note - Joe's audio was having issues for this episode. Apologies.

Multiple products, versions, platforms, targets technologies, formats, and locales? How do you make sense of the "multiple of multiples" challenge from a technical perspective? The "language of the business" and data in all its structured, semi-structured, and 'unstructured' forms helps drive this home.
John O'Gorman has world-class expertise in language, semantics, and tying this together for the business. We hope you learn something new from this episode.

Brian Olsen joins us again to chat about why Apache Iceberg won the table format war. We also finish our chat from last time about Data Mesh. #dataengineering #datalake #datamesh

David Langer joins the show to chat about how programming languages for data science, BI teams have a unique advantage in helping introduce data science into their organizations.

Devin Petersohn (Modin, Ponder) knows a thing or two about dataframes, having done his PhD thesis on them, among other related achievements. We'll talk about all things dataframes, both high level and in the weeds. If you've ever wanted to learn about dataframes, this is the discussion for you.

Joe Perez ("Dr. Joe") joins the show to chat about the importance of actionable data to inform decision-making. We also discuss the various ways disparate data are brought together into a cohesive data warehouse, and how there should be a finite, measurable, deployable strategy

Colin Zima joins the show to chat about what data modeling should look like in 2023 and beyond. We'll chat about real ETL, semantic layers, the troubles with BI, and much more. #datamodeling #data #dataengineering #analytics

Saket Saurabh joins the show to chat about taking a data product-centric view to reinventing data management. #data #dataproducts #datamanagement #dataengineering

Santona Tuli discusses the product management aspects as a data scientist - product and stakeholder management, due diligence of requirements gathering, and developing a strategy before implementing DS/ML pipelines. You know, the fun stuff ;)

Artyom Keydunov & Pavel Tiunov (co-founders of Cube.dev) join the show to chat about all things semantic layers. Curious about the future of data apps? Then check out this episode. #data #semanticlayer #dataengineering #analytics

Malcolm Hawker joins the show to chat about data product management, generative AI and its impact on data products and the broader data industry, and much more.

#datamesh #dataengineering #dataproducts #data

Joe Reis and Matt Housley rant about generative AI, Data Council, WASM, data modeling, regulations, and how programming languages and paradigms impact the business.

#data #dataengineering #datamodeling #chatgpt

Larry Burns is a longtime data modeling expert and author on the topic. He joins the show to discuss some of the (often misunderstood) ways data modeling relates to data engineering, logical data modeling, and much more. If you're a data engineer, you can't afford to miss this discussion. #dataengineering #data #datamodeling

Cody Coleman and Will Gaviria Rojas (Co-founders of Coactive.ai) join the show to chat about the rising importance of unstructured data and the role of AI in unlocking the value of unstructured content. Their motto is "Content is King, and AI is the new Queen." Given the rise of unstructured data, this is a must for anyone working in AI.

https://coactive.ai

Felix GV designs HUGE distributed systems as a principal staff engineer at LinkedIn. We talk about the Venice open-source project and the challenges of massively distributed data. 

But Felix is also thinking about something WAY bigger - designing software for a multi-planetary civilization! This is a very interesting discussion that you won't usually come across on this planet, or others (yet).

Rogier Werschkull is keen on detecting BS in the data industry. This is a very opinionated and informative discussion about the state of affairs of hype and reality in the data industry today.

Matt Turck (Firstmark Capital) joins us to chat about what's new in the data landscape, the economic realities impacting the startup ecosystem, all things AI, and much more.  

Matt is easily one of our favorite thinkers in the data and tech space, so this is definitely worth tuning in for.

MAD Landscape 2023: https://mattturck.com/mad2023/

Neelesh Salian (Staff software engineer at dbt labs) joins the show to discuss building data infrastructure, general engineering topics at the staff+ level, and more.  

#dataengineering #softwareengineering #data

Joe and Matt discuss getting Fundamentals of Data Engineering signed with O'Reilly, the writing process, and marketing a best-selling tech book. This is worth a listen if you've ever wanted to write a technical book.  

#dataengineering #data #author #oreilly

Scott Taylor has become our regular for Valentine's Day week. Join us for a grab bag of thoughts and listener questions.  

#data #masterdatamanagement

Venkat Venkataramani (CEO & co-founder at Rockset) joins the show to chat about real-time analytics at massive scale. In a former life, Venkat led Facebook's infrastructure team that handled billions of events per second for all of Facebook's user data services. Venkat is on OG in the real-time analytics space, so you'll learn a lot about this topic.  

#dataengineering #data #realtimedata #analytics

John Kutay (Striim) joins the show to chat about “easy mode” and “hard mode” use cases for streaming data in the enterprise.  

#data #dataengineering

Zhamak Dehghani (CEO & Founder of Next Data) discusses why she started Next Data, and how her company will finally help Data Mesh become a reality.  

Next Data: https://www.nextdata.com/  

Announcement: https://medium.com/@zhamakd/why-we-started-nextdata-dd30b8528fca  

#datamesh #data

Kate Strachnyi (DATAcated) joins the show to chat about her new book, ColorWise (O'Reilly), content creation, running DATAcated, and much more.  

#datacated #data

Chip Huyen (Claypot AI) joins the show to chat about switching from a batch mindset to a streaming mindset, the convergence of data scientist and data engineering roles, and much more.  

Chip is a well-regarded person in the ML/AI space. She's CEO/co-founder of Claypot AI, teaches Machine Learning Systems Design at Stanford, and wrote the phenomenal book, Designing Machine Learning Systems (O'Reilly), among many achievements.  

#datascience #ai #dataengineering

Serge Gershkovich (SqlDBM) joins the show to chat about a variety of topics, like data modeling, writing books, career pivots, and much more.  

Cameo appearance from Chris Tabb!  

#datamodeling #dataengineering #data

Sanjeev Mohan (SanjMo, former Gartner Research VP) joins the show to chat about the current market conditions affecting the data and tec landscape, trends he's seeing, and much more.  

#data #it #tech

Data Mesh has caught the technology and data industry by storm and is easily one of the hottest topics today. Oftentimes, the harder parts of Data Mesh don't get as much attention or coverage.

This was an open session at the Utah Data Engineering Meetup (November 2022) to ask Zhamak about the hard parts of data mesh that have inspired her to start a company to address them head-on.

Jeremiah Lowin (CEO/Co-Founder @ Prefect) joins the show to chat about why he's excited about boring tech, the current VC/startup environment, building trust, meetups, and much more.  

#dataengineering #prefect #data

Data modeling is seeing a massive resurgence of attention lately. How do you cut through the noise and know what's useful for your situation? 

Juan Sequeda (data.world) joins the show to chat about honest, no-BS data modeling, aka data modeling for the real world.  

#datamodel #dataengineering #data

Sonny Rivera (ThoughtSpot) joins the show to chat about software engineering practices on data, data modeling, approaching things from first principles, the future of BI, and much more. 

Note - we had a few hiccups with Streamyard, but the show conversation is very good.

#dataengineering #thoughtspot #softwareengineering #data