Research
-
PromptingResearch/NLP_CMU 2024. 7. 5. 16:05
※ Summaries after taking 「Advanced NLP - Carnegie Mellon University」 coursehttps://www.youtube.com/watch?v=T1YrTbTkUb4&list=PL8PYTP1V4I8DZprnWryM4nR8IZl1ZXDjg&index=7https://phontron.com/class/anlp2024/assets/slides/anlp-07-prompting.pdf Prompting is a new paradigm as of a few years ago with interacting with models. It's now kind of the standard in doing so and basically what we do is we encoura..
-
Generation AlgorithmsResearch/NLP_CMU 2024. 7. 5. 11:43
※ Summaries after taking 「Advanced NLP - Carnegie Mellon University」 coursehttps://www.youtube.com/watch?v=96MMXDA7F74&list=PL8PYTP1V4I8DZprnWryM4nR8IZl1ZXDjg&index=6https://phontron.com/class/anlp2024/assets/slides/anlp-06-generation.pdfA model M gives you a probability distribution over all tokens in its vocabulary to predict what token you would output next. Given some input X and everything ..
-
TransformersResearch/NLP_CMU 2024. 7. 5. 09:42
※ Summaries after taking 「Advanced NLP - Carnegie Mellon University」 coursehttps://www.youtube.com/watch?v=QkGwxtALTLU&list=PL8PYTP1V4I8DZprnWryM4nR8IZl1ZXDjg&index=5https://phontron.com/class/anlp2024/assets/slides/anlp-05-transformers.pdf Residual Connection allows f to learn the "difference" from the input - instead of learning how the input should be mapped into the output, you learn what di..
-
Multimodal Deep Learning - 5. Evaluation / 6. Where to next?Research/NLP_Stanford 2024. 6. 30. 10:54
※ Writing while taking a course 「Stanford CS224N NLP with Deep Learning」 ※ https://www.youtube.com/watch?v=5vfIT5LOkR0&list=PLoROMvodv4rMFqRtEuo6SGjY4XbRIVRd4&index=22Lecture 16 - Multimodal Deep Learninghttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1234/slides/Multimodal-Deep-Learning-CS224n-Kiela.pdfI also have to tell you how you're going to check that the multimodal system is actua..
-
Multimodal Deep Learning - 4. Multimodal foundation modelsResearch/NLP_Stanford 2024. 6. 29. 21:58
※ Writing while taking a course 「Stanford CS224N NLP with Deep Learning」 ※ https://www.youtube.com/watch?v=5vfIT5LOkR0&list=PLoROMvodv4rMFqRtEuo6SGjY4XbRIVRd4&index=22Lecture 16 - Multimodal Deep Learninghttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1234/slides/Multimodal-Deep-Learning-CS224n-Kiela.pdfIf you have a BERT model and you have a bunch of images, how are you going to turn th..
-
Multimodal Deep Learning - 2. Features and fusion / 3. Contrastive modelsResearch/NLP_Stanford 2024. 6. 29. 15:21
※ Writing while taking a course 「Stanford CS224N NLP with Deep Learning」 ※ https://www.youtube.com/watch?v=5vfIT5LOkR0&list=PLoROMvodv4rMFqRtEuo6SGjY4XbRIVRd4&index=22Lecture 16 - Multimodal Deep Learninghttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1234/slides/Multimodal-Deep-Learning-CS224n-Kiela.pdfIf all of this multimodal stuff is cool and useful and doesn't look that difficult, w..
-
Multimodal Deep Learning - 1. Early modelsResearch/NLP_Stanford 2024. 6. 29. 12:50
※ Writing while taking a course 「Stanford CS224N NLP with Deep Learning」 ※ https://www.youtube.com/watch?v=5vfIT5LOkR0&list=PLoROMvodv4rMFqRtEuo6SGjY4XbRIVRd4&index=22Lecture 16 - Multimodal Deep Learninghttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1234/slides/Multimodal-Deep-Learning-CS224n-Kiela.pdfWhy do we care about multimodality?There are a couple of good reasons in general for ..
-
Model Analysis & ExplanationResearch/NLP_Stanford 2024. 6. 29. 08:04
※ Writing while taking a course 「Stanford CS224N NLP with Deep Learning」 ※ https://www.youtube.com/watch?v=f_qmSSBWV_E&list=PLoROMvodv4rMFqRtEuo6SGjY4XbRIVRd4&index=17&t=1sLecture 17 - Model Analysis and Explanationhttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1234/slides/cs224n-2023-lecture18-analysis.pdfIf you get high accuracy on the in-domain test set, you are not guaranteed high a..