59. Philip Winter - VRVis - Continual Learning

Today I am talking to Philip Winter, researcher at the Medical Imaging group of the VRVis, a research center for virtual realities and visualizations.

Philip will explain the benefits and challenges in continual learning and will present his recent paper "PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks". Where he and his colleagues have developed a system that uses a frozen hierarchical feature extractor to build a memory database out of the labeled training data. During inference the system identified training examples similar to the test data and prediction is performed through a combination of parameter-free correspondence matching and message passing based on the closes training datapoints.

I hope you enjoy this episode and will find it useful.

## AAIP Community

Join our discord server and ask guest directly or discuss related topics with the community.

https://discord.gg/5Pj446VKNU

## TOC

00:00:00 Beginning

00:03:04 Guest Introduction

00:06:50 What is continual learning?

00:15:38 Catastrophic forgetting

00:27:36 Paper: Parmesan

00:40:14 Composing Ensembles

00:46:12 How to build memory over time

00:55:37 Limitations of Parmesan

### References

Philip Winter - https://www.linkedin.com/in/philip-m-winter-msc-b15679129/

VRVIS - https://www.vrvis.at/

PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks - https://arxiv.org/abs/2403.11743

Continual Learning Survey: https://arxiv.org/pdf/1909.08383