전체 글
-
-
-
-
-
-
-
[Project Proposal] Improving the performance of machine-generated text (MGT) detection by identifying the significance of individual tokensResearch/NLP_Paper 2024. 11. 11. 14:49
※ 수정 중..!!※ This is the project proposal for Team 5 in the 2024 NLP class.※ The main idea for this project was provided by D.H. Lee.※ The content of this proposal is based on discussions with our team members: S.J.Kim, D.H.Lee, S.J.Lee, S.Y.Park.※ The final proposal PPT will be created in collaboration with S.J.Lee.※ The paper review presentation will be given by S.J.Kim.※ The proposal & project..
-
Causal Interpretation of Self-Attention in Pre-Trained TransformersResearch/NLP_Paper 2024. 11. 11. 10:38
https://arxiv.org/pdf/2310.20307(Oct 2023, NeurIPS) ※ 2024 NLP class team project's subjectAbstractWe propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation model for a given input sequence of symbols (tokens). The structural equation model can be interpreted, in turn, as a ..