Data Lakes with Michael Rys

Data Lakes with Michael Rys

Author: Carl Franklin and Richard Campbell November 3, 2016 Duration: 56:29
Data Lakes are growing up, and you want one! While at Ignite in Atlanta, Carl and Richard sat down with Michael Rys to talk about Azure Data Lakes - a place to store your data "as is" so that you can easily query and organize the data for further analysis. Michael discusses the problems of data warehouses, with their Extract-Transform-Load (ETL) processes that manipulate the data into a particular shape for the warehouse - and make it harder to ask new questions of the data. Leave the data as it is in the data lake and then build mechanism to extract on demand for the various data marts you have. The conversation turns to USQL (U as in Universal) and HDInsights (Hadoop) as different ways to extract data from the Data Lake for analysis. Lots of choices!

Support this podcast at — https://redcircle.com/net-rocks/donations

Hosted by Carl Franklin and Richard Campbell, .NET Rocks! is a long-running conversation with the people building the future of software. This isn't a dry lecture; it's a lively, technical deep dive where two seasoned developers explore the vast ecosystem around Microsoft .NET, Azure, and modern development practices with a diverse roster of expert guests. Each episode feels like you're pulling up a chair in a room full of brilliant minds, listening to unfiltered discussions about real-world coding challenges, architectural patterns, and the tools that shape our daily work. You'll hear practical advice, war stories from the trenches, and forward-looking insights that go far beyond the documentation. Tuning into this podcast means connecting with a community of professionals who are as passionate about the craft as you are, offering perspectives that can transform how you approach your next project. Whether you're deep into C# or just curious about cloud-native development, these conversations provide a valuable blend of knowledge, humor, and genuine enthusiasm for technology.
Author: Language: English Episodes: 1000

.NET Rocks!
Podcast Episodes
Alice and Bob Learn App Security with Tanya Janca [not-audio_url] [/not-audio_url]

Duration: 57:49
How do we learn about application security? Carl and Richard talk to Tanya Janca about her book 'Alice and Bob Learn Application Security.' Tanya talks about bringing positive conversations around security, enabling peop…
Space Geek Out 2022 [not-audio_url] [/not-audio_url]

Duration: 1:34:46
Ready for some space? Richard talks to Carl about all the incredible space-related stories in 2022. Starting with a record launch year - more flights to orbit than any year in history! Then the conversation digs into som…
Energy Geek Out 2022 [not-audio_url] [/not-audio_url]

Duration: 1:37:17
End of the year, time for a geek out on energy! Richard chats with Carl about the usual modern power generation sources, including solar and wind, and a breakthrough in the drilling method for geothermal energy. The conv…
Wolverine .NET Command and Message Bus with Jeremy Miller [not-audio_url] [/not-audio_url]

Duration: 52:27
Jeremy Miller is back with more open-source goodness in the form of the Wolverine .NET Command and Message Bus. Jeremy talks about developing the Marten database and reaching a point with event sourcing that led to Wolve…
Thinking High-Level Design with Billy Hollis [not-audio_url] [/not-audio_url]

Duration: 1:01:04
Why should you have high-level design in your applications? Carl and Richard chat with Billy Hollis about the concepts around high-level design and how it can help make better software. Billy talks about how high-level d…
Securing Existing Applications with Joylynn Kirui [not-audio_url] [/not-audio_url]

Duration: 48:55
How do you secure your existing applications from the security exploits out there today? Carl and Richard talk to Joylynn Kirui about the challenges developers face in making secure applications. Joylynn talks about unde…
.NET Developers Building Power Apps with April Dunnam [not-audio_url] [/not-audio_url]

Duration: 50:12
Why should .NET developers build Power Apps? Carl and Richard talk to April Dunnam about the latest in Microsoft's Power Platform and why .NET developers should get involved. April talks about the fusion development meth…
Hacking APIs with Dana Epp [not-audio_url] [/not-audio_url]

Duration: 58:42
Are your APIs vulnerable to hacking? Carl and Richard talk to Dana Epp about how APIs have become the focus of black hats today. Dana talks about tooling you can use to look at your APIs the same way the hackers do, and…
Making Open Source Work for Everyone with David Whitney [not-audio_url] [/not-audio_url]

Duration: 50:42
How do we make open source work for everyone? While at NDC in Oslo, Carl and Richard talked to David Whitney about his experiences working on open-source projects, and the challenges of making them sustainable. David tal…