ARCHIVES
Research Article
Beyond Extractive Methods – Navigating the landscape of Abstractive Summarization Methods
Sherilyn Kevin1
Satish Mishra2
Siddhi Sharma3
1Assistant Professor (IT), Department of Information Technology, Thakur College of Science and Commerce, Kandivali Mumbai, India. 23UG Students, Department of Information Technology, Thakur College of Science and Commerce, Kandivali Mumbai, India.
Published Online: January-April 2024
Pages: 55-61
Cite this article
↗ https://www.doi.org/10.59256/indjcst.20240301008References
Certainly, here are 15 references for your research paper:
1. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. In Advances
in neural information processing systems (pp. 5998-6008).
2. Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., ... & Zettlemoyer, L. (2020). BART: Denoising sequence-to-
sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461.
3. Zhang, Y., Chen, K., Tan, Y., Ren, X., & Zhao, R. (2020). PEGASUS: Pre-training with extracted gap-sentences for abstractive
summarization. arXiv preprint arXiv:1912.08777.
4. Lin, C. Y. (2004). ROUGE: A package for automatic evaluation of summaries. Text Summarization Branches Out: Proceedings of the ACL-
04 Workshop, 74-81.
5. Nallapati, R., Zhai, F., & Zhou, B. (2016). Summarunner: A recurrent neural network based sequence model for extractive summarization
of documents. arXiv preprint arXiv:1611.04230.
6. Liu, P. J., Saleh, M., Pot, E., Goodrich, B., Sepassi, R., Kaiser, Ł., & Shazeer, N. (2019). Generating wikipedia by summarizing long
sequences. arXiv preprint arXiv:1801.10198.
7. Dong, L., Mallinson, J., Vig, J., Van Durme, B., & Choi, Y. (2019). Unified language model pre-training for natural language understanding
and generation. arXiv preprint arXiv:1905.03197.
8. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language
understanding. arXiv preprint arXiv:1810.04805.
9. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., ... & Stoyanov, V. (2019). RoBERTa: A robustly optimized BERT pretraining approach.
arXiv preprint arXiv:1907.11692.
10. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., ... & Liu, P. J. (2020). Exploring the limits of transfer learning with a
unified text-to-text transformer. arXiv preprint arXiv:1910.10683.
11. Xu, W., He, J., Xu, X., Liu, K., Shi, Y., Wu, H., & Wu, H. (2019). Predicting molecular activity based on chemical structure: A comparative
study of deep learning and random forest. Information Sciences, 484, 52-63.
12. Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Advances in neural information
processing systems (pp. 3104-3112).
13. Vaswani, A., Bengio, S., Brevdo, E., Chollet, F., Gomez, A. N., Gouws, S., ... & Zaremba, W. (2018). Tensor2tensor for neural machine
translation. arXiv preprint arXiv:1803.07416.
14. Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving language understanding by generative pretraining. URL
https://s3-us-west-2. amazonaws. com/openai-assets/researchcovers/languageunsupervised/language understanding paper. pdf.
15. Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084.
These references encompass a wide range of works in the field of natural language processing, summarization, and deep learning, providing a
comprehensive basis for further exploration and understanding of the topic
1. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. In Advances
in neural information processing systems (pp. 5998-6008).
2. Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., ... & Zettlemoyer, L. (2020). BART: Denoising sequence-to-
sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461.
3. Zhang, Y., Chen, K., Tan, Y., Ren, X., & Zhao, R. (2020). PEGASUS: Pre-training with extracted gap-sentences for abstractive
summarization. arXiv preprint arXiv:1912.08777.
4. Lin, C. Y. (2004). ROUGE: A package for automatic evaluation of summaries. Text Summarization Branches Out: Proceedings of the ACL-
04 Workshop, 74-81.
5. Nallapati, R., Zhai, F., & Zhou, B. (2016). Summarunner: A recurrent neural network based sequence model for extractive summarization
of documents. arXiv preprint arXiv:1611.04230.
6. Liu, P. J., Saleh, M., Pot, E., Goodrich, B., Sepassi, R., Kaiser, Ł., & Shazeer, N. (2019). Generating wikipedia by summarizing long
sequences. arXiv preprint arXiv:1801.10198.
7. Dong, L., Mallinson, J., Vig, J., Van Durme, B., & Choi, Y. (2019). Unified language model pre-training for natural language understanding
and generation. arXiv preprint arXiv:1905.03197.
8. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language
understanding. arXiv preprint arXiv:1810.04805.
9. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., ... & Stoyanov, V. (2019). RoBERTa: A robustly optimized BERT pretraining approach.
arXiv preprint arXiv:1907.11692.
10. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., ... & Liu, P. J. (2020). Exploring the limits of transfer learning with a
unified text-to-text transformer. arXiv preprint arXiv:1910.10683.
11. Xu, W., He, J., Xu, X., Liu, K., Shi, Y., Wu, H., & Wu, H. (2019). Predicting molecular activity based on chemical structure: A comparative
study of deep learning and random forest. Information Sciences, 484, 52-63.
12. Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Advances in neural information
processing systems (pp. 3104-3112).
13. Vaswani, A., Bengio, S., Brevdo, E., Chollet, F., Gomez, A. N., Gouws, S., ... & Zaremba, W. (2018). Tensor2tensor for neural machine
translation. arXiv preprint arXiv:1803.07416.
14. Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving language understanding by generative pretraining. URL
https://s3-us-west-2. amazonaws. com/openai-assets/researchcovers/languageunsupervised/language understanding paper. pdf.
15. Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084.
These references encompass a wide range of works in the field of natural language processing, summarization, and deep learning, providing a
comprehensive basis for further exploration and understanding of the topic
Related Articles
2024
Revolutionizing User Interfaces: Exploring the Latest Trends in Front-End Development
2024
Website Development in Computer Science: Unveiling the Digital World
2024
Review on RSA Cryptography, Steganography and Compression Techniques for Data Security
2024
Stock Price Prediction Using LSTM
2024
Comparative Analysis of Program Execution Time Required by Python, R and Julia Compiler
2024