Welcome to MINDS!

Established in 2020, POSTECH Mathematical Institute for Data Science (MINDS) is the community of researchers in the areas of fundamental data science, machine learning, artificial intelligence, scientific computing, and humanitarian data science. MINDS mission is to provide a platform for collaboration among researchers and to provide various opportunities for students in data science. MINDS also aims to use our data science research to serve our local and global communities pursuing humanitarian data science.

News

Upcoming Events

Schedule

MINDS SEMINAR

Review Seminar: Score-based Generative Modeling Through Stochastic Differential Equations

MINDS SEMINAR
period : 2023-07-26 ~ 2023-07-26
time : 10:00:00 ~ 17:00:00
๊ฐœ์ตœ ์žฅ์†Œ : Math Bldg 104 & Online streaming (Zoom)
Topic : Review Seminar: Score-based Generative Modeling Through Stochastic Differential Equations
๊ฐœ์š”
Date 2023-07-26 ~ 2023-07-26 Time 10:00:00 ~ 17:00:00
Speaker Woojin Choi Affiliation KAIST
Place Math Bldg 104 & Online streaming (Zoom) Streaming link ID : 688 896 1076 / PW : 54321
Topic Review Seminar: Score-based Generative Modeling Through Stochastic Differential Equations
Contents ์„ธ๋ฏธ๋‚˜ 1. ์ƒ์„ฑ๋ชจ๋ธ์„ ํ™•๋ฅ ํ™•์‚ฐ๋ฐฉ์ •์‹์œผ๋กœ ํ†ตํ•ฉ์  ์ด๋ก ์œผ๋กœ ์ „๊ฐœ ํ•˜๋Š”๋ฐ ์ค‘์š”ํ•œ ์ „ ๋‹จ๊ณ„๋กœ NeurIPS 2019์— ๋ฐœํ‘œ ๋œ ๋…ผ๋ฌธ "Generative Modeling by Estimating Gradients of the Data Distribution"์„ ์‹ฌ์ธต๋ถ„์„ํ•ฉ๋‹ˆ๋‹ค. ๋‹ค์ค‘์  ๋ ˆ๋ฒจ์˜ ๋ถ„์‚ฐ๋“ค์„ ๊ฐ–๋Š” ๊ฐ€์šฐ์‹œ์•ˆ ๋…ธ์ด์ฆˆ๋กœ ๋ฐ์ดํ„ฐ๋ฅผ perturbedํ•˜๋Š” ์†Œ์œ„ "Noise Conditional Score Network(NCSN)" ๊ตฌ์„ฑํ•œ ๋‹ค์Œ ์ด๊ฒƒ์„ ์ด์šฉํ•œ Denoising Score Matching Objective๋ฅผ ์ตœ์†Œํ™” ํ•˜์—ฌ NCSN์„ ํ•™์Šตํ•˜๋Š” ๊ณผ์ •์„ ์ƒ์„ธํžˆ ๊ณ ์ฐฐํ•ฉ๋‹ˆ๋‹ค. ๋‹ค์Œ ๋‹จ๊ณ„๋กœ ํ•™์Šต๋œ NCSN์„ ์ด์šฉํ•œ Annealed Langevin Dynamics ์•Œ๊ณ ๋ฆฌ์ฆ˜์œผ๋กœ Samples์„ ์ƒ์„ฑํ•˜๋Š” ์ „๊ณผ์ •์„ ์‹ฌ์ธตํ† ๋ก  ํ•ฉ๋‹ˆ๋‹ค. ์„ธ๋ฏธ๋‚˜ 2. ICLR2021์—์„œ Ermon๊ต์ˆ˜ํŒ€์€ ์ด์ „๊นŒ์ง€ ์—ฐ๊ตฌ๋œ Discrete Times Points ์—์„œ ๊ฐ€์šฐ์‹œ์•ˆ Perturbations์„ Continuous Time Diffusion์œผ๋กœ ํ™•์žฅํ•˜๋Š” ๋ชจ๋ธ๋กœ Ito Diffusion ๋ฐฉ์ •์‹( Stochastic Differential Equation)์œผ๋กœ Data---- Gaussian Noise์œผ๋กœ ๋ฐ”๊พผ ๋‹ค์Œ, Anderson์˜ Reverse-Time SDE๋ชจ๋ธ๋กœ Gaussian Noise------ ๋กœ ์ฃผ์–ด์ง„ ๋ฐ์ดํ„ฐ๋ฅผ ํฌํ•จํ•œ ์ƒˆ๋กœ์šด ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•จ์œผ๋กœ์จ ์ข…์ „์˜ GAN, VAE, DDPM,DDIM๋“ฑ ๊ณผ๋Š” ์ „ํ˜€ ๋‹ค๋ฅธ ์ƒˆ๋กœ์šด ์ƒ์„ฑ๋ชจ๋ธ์„ ์ œ์•ˆ ํ•ฉ๋‹ˆ๋‹ค. ๋”๊ตฌ๋‚˜ ๋งˆ์ง€๋ง‰ ์ƒ์„ฑ ๋‹จ๊ณ„์—์„œ Langevin Dynamics์„ ์ด์šฉํ•œ Predictor-Corrector์•Œ๊ณ ๋ฆฌ์ฆ˜์œผ๋กœ ์ƒ์„ฑ๊ฒฐ๊ณผ์˜ ํ’ˆ์งˆ์„ ํ–ฅ์ƒ์‹œ์ผฐ์Šต๋‹ˆ๋‹ค. ์œ„์˜ ์ „ ๊ณผ์ •์„ ์ƒ์„ธํ•œ Brain-Storm ํ† ๋ก ์œผ๋กœ ์ง„ํ–‰ ๋ฉ๋‹ˆ๋‹ค.
MinDS MinDS ยท 2023-07-17 11:41 ยท Views 834

POSTECH SIAM Student Chapter

๐ŸŒŸ DACON Ranker Special Lecture: Winning Strategies for AI Competitions ๐ŸŒŸ

2023 POSTECH & Peking SIAM Student Chapter Joint Conference

2023 PSSC Summer Camp

2022 PSSC Summer Camp

2022 POSTECH & Peking SIAM Student Chapter Joint Conference

MINDS-MoNET-ISE Workshop

Information, Network & Topological Data Analysis



2021 POSTECH MINDS WORKSHOP

Recent Progress in Data Science and Applications

Fall 2021 Seminar Series

MINDS Seminar Series on Data Science, Machine Learning, and Scientific Computing

Every Tuesdays 05:00 PM

ILJU POSTECH MINDS Workshop on TDA and ML

POSTECH SIAM Student Chapter Launched!