Get it on Google Play

Foundation Models for Structured Data

Foundation Models for Structured Data

Author: Software Engineering Daily June 23, 2026 Duration: 44:00
Software Engineering Daily
NewsTechnology

Predictive modeling is a core element in modern systems, and powers capabilities such as fraud detection, loan approvals, and recommendation systems. These systems typically operate on structured, relational data stored in enterprise databases, with rows, columns, and interlinked tables. While computer vision and natural language processing have undergone a neural network revolution, the tabular data layer underpinning predictive modeling still largely relies on manual feature engineering and task-specific models.

Relational deep learning proposes a new approach. It treats databases as graphs and applies transformer-style attention mechanisms directly over structured relational data. Researchers are now building foundation models for tabular data that aim to generalize across predictive tasks without painstaking feature engineering.

Jure Leskovec is a Professor of Computer Science at Stanford University and he previously served as Chief Scientist at Pinterest and was an investigator at the Chan Zuckerberg Biohub. Most recently, he co-founded the machine learning startup, Kumo.AI.

In this episode, Jure joins Sean Falconer to discuss the limitations of traditional predictive modeling, why structured enterprise data requires its own modality-specific neural architectures, how graph transformers generalize attention to relational databases, and more.

The post Foundation Models for Structured Data appeared first on Software Engineering Daily.


Dive into the vast Podcast Archives-Software Engineering Daily, a curated collection of in-depth technical conversations that have defined the landscape of modern software development. This archive goes beyond surface-level news, offering a permanent record of deep-dive discussions with engineers, researchers, and founders who are building the tools and platforms shaping our digital world. Each episode is a focused exploration, unpacking complex topics like distributed systems, machine learning infrastructure, programming language design, and the practical challenges of scaling technology. You'll hear firsthand accounts of architectural decisions, post-mortems on system failures, and thoughtful debates on emerging paradigms. It’s a resource built for the curious professional who values substance over soundbites, providing context and depth that shorter formats simply cannot. Whether you're looking to understand the historical context behind a current technology, reinforce your foundational knowledge, or discover niche specialties, this podcast archive serves as an essential, ever-growing library. The conversations are detailed, technical, and assume a level of familiarity with the field, making it a trusted companion for continuous learning. Listen to this podcast not for fleeting headlines, but for the enduring insights and nuanced expertise that come from thoughtful, long-form dialogue with the people writing the code and designing the systems that run our world.
Author: Language: en-us Episodes: 50

Official website RSS
youtubelinkedinspotifyapple_music
Software Engineering Daily
Podcast Episodes
Autonomous Drone Delivery at Scale [not-audio_url] [/not-audio_url]

Duration: 50:30
Autonomous drone delivery has long been the stuff of science fiction, but ongoing advances have moved the space from experimental to operational. Zipline is one of the leading companies in this space, with drones that ch…
The European Startup Scene [not-audio_url] [/not-audio_url]

Duration: 48:57
Europe’s startup ecosystem is maturing rapidly, with companies like Revolut, Lovable, and Legora demonstrating that world-class technology businesses can be built and scaled on the continent. While the US remains the dom…
React Native at Scale [not-audio_url] [/not-audio_url]

Duration: 45:35
React Native is an open source framework developed by Meta that allows engineers to build mobile applications for both iOS and Android using a single JavaScript codebase. The framework bridges the gap between web develop…
Formal Methods as Agent Guardrails [not-audio_url] [/not-audio_url]

Duration: 48:32
Formal methods are a branch of mathematics and computer science focused on proving the correctness of systems, and they have long promised a more rigorous foundation for software. However, their complexity has kept them…
Open Source Sustainability [not-audio_url] [/not-audio_url]

Duration: 58:43
Open source software underpins nearly every modern application, including frameworks powering the most popular websites, to the libraries securing financial backend systems. However, while open source drives collaboratio…
Vespa AI and Surpassing the Limits of Vector Search [not-audio_url] [/not-audio_url]

Duration: 38:35
Vector search has risen to become a foundational tool in modern search and retrieval systems, including the RAG pipelines that power many AI applications. However, the demands on retrieval systems are growing more sophis…
SmartBear and Multi-Agent QA [not-audio_url] [/not-audio_url]

Duration: 55:15
AI coding tools have dramatically accelerated the pace of development, and the bottleneck in the software development lifecycle has shifted to code validation and testing. However, the conventional tools and workflows th…
The Ethics of Autonomous Weapons Systems [not-audio_url] [/not-audio_url]

Duration: 1:06:40
Artificial intelligence is transforming warfare faster than the legal and ethical frameworks designed to govern it. Militaries around the world are deploying AI-powered decision support systems to identify targets, asses…
Open-Weight AI Models [not-audio_url] [/not-audio_url]

Duration: 50:14
Open-weight models are AI systems whose trained parameters are publicly released, which allows developers to run, fine-tune, and deploy them independently rather than accessing them only through a hosted API. While close…

«12345»