밤에 쓰는 편지 밤에 쓰는 편지

https://arxiv.org/pdf/2101.09258https://github.com/yang-song/score_flowOct 2021 (NeurIPS 2021)Abstract Score-based diffusion models synthesize samples by reversing a stochastic process that diffuses data to noise, and are trained by minimizing a weighted combination of score matching losses. The log-likelihood of score-based diffusion models can be tractably computed through a connection to cont..

https://arxiv.org/pdf/2011.13456https://github.com/yang-song/score_sde(Feb 2021 ICLR 2021)AbstractCreating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting noise, and a corresponding reverse-time SDE that transforms th..

https://arxiv.org/pdf/2006.09011https://github.com/ermongroup/ncsnv2(Oct 2020 NeurIPS 2020)AbstractScore-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32 × 32), and can be unstable under some settings. We provide a new the..

https://arxiv.org/pdf/1907.05600https://github.com/ermongroup/ncsnOct 2020 (NeurIPS 2019)AbstractWe introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching. Because gradients can be ill-defined and hard to estimate when the data resides on low-dimensional manifolds, we perturb the data with different..

https://arxiv.org/pdf/1810.01367https://github.com/rtqichen/ffjord(ICLR 2019)AbstractA promising class of generative models maps points from a simple distribution to a complex distribution through an invertible neural network. Likelihood-based training of these models requires restricting their architectures to allow cheap computation of Jacobian determinants. Alternatively, the Jacobian trace c..

https://arxiv.org/pdf/1806.07366https://github.com/rtqichen/torchdiffeq(Dec 2019 NeurIPS 2018)AbstractWe introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a blackbox differential equation solver. These continuous-de..

https://arxiv.org/pdf/2401.06281나중에 참고하려고 정리 여러 번 line by line으로 도출해봄..2.1. Forward Process: Gaussian Diffusion2.1.1. Linear Gaussian Transitions: q(zt | zs) 2.1.2. Top-down Posterior: q(zs | zt, x)2.1.3. Learning the Noise Schedule2.2. Reverse Process: Discrete-Time Generative Model2.2.1. Generative Transitions: p(zs | zt) Two other notable parameterizations not elaborated upon in this article ..

https://arxiv.org/pdf/2107.00630https://github.com/google-research/vdm(NeurIPS 2021) Jul 2021 ★ ★ ★ ★ 이걸 먼저 봐야 함!!!!! ★ ★ ★ ★ ↓ ↓ ↓ ↓ ↓ ↓ ↓Demystifying Variational Diffusion Models https://arxiv.org/pdf/2401.06281 ↑ ↑ ↑ ↑ ↑ ↑ ↑ ↑ 「 Variational Diffusion Models 」 이 논문에서의 수식이 Classifier-free guidance, distillation, Imagen 등등..에서 계속 이어지는데,(score-based model 계열 논문에서도 수식, 개념이..