Schedule

MINDS SEMINAR

MINDS Seminar Series | Kyongmin Yeo (IBM T.J. Watson Research Center) - Towards Foundation Model for Dynamical Systems

MINDS SEMINAR
period : 2023-11-08 ~ 2023-11-08
time : 14:00:00 ~ 15:30:00
개최 장소 : Math Bldg 404 & Online streaming (Zoom)
Topic : Towards Foundation Model for Dynamical Systems
개요
Date 2023-11-08 ~ 2023-11-08 Time 14:00:00 ~ 15:30:00
Speaker Kyongmin Yeo Affiliation IBM T.J. Watson Research Center
Place Math Bldg 404 & Online streaming (Zoom) Streaming link ID : 688 896 1076 / PW : 54321
Topic Towards Foundation Model for Dynamical Systems
Contents Since the success of large language models, Foundation Model has attracted a great attention. Foundation Model aims to provide a pre-trained model, typically a large deep learning model, that can be easily fine-tuned or re-purposed for a downstream task with a smaller data set. Where there has been much progress in the language and vision domains, Foundation Model for time series data is not relatively well studied. Here, we propose a preliminary Foundation Model targeted to nonlinear dynamical systems. We consider the problem of building a foundation model from a range of dynamical systems and generating a time series data from the foundation model given a short sequence of input data. The foundation model consists of two modules. In the first module, we aim to learn a dictionary of functions. We propose to use a contrastive learning with a hierarchy to build a dictionary of different classes of dynamical systems. Then, we use a denoising diffusion model to generate the time series data from the dictionary. The foundation model can also be used for a forecast of the input sequence.
MinDS MinDS · 2023-10-31 09:16 · Views 355