A Comparative Study of Transformer Based Pretrained AI Models for Content Summarization

Ashika Sameem Abdul Rasheed, Mohammad Mehedy Masud, Mohammed Abduljabbar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this study, we examine different transformer based pretrained Artificial Intelligence (AI) models on their ability to summarize text content from different sources. AI has emerged as a powerful tool in this context, offering the potential to automate and improve the process of content summarization. We mainly focus on the pretrained transformer models, such as Pegasus, T5, Bart, and ProphetNet for key point summarization from textual contents. We aim to assess the effectiveness of these models in summarizing different contents like articles, instructions, conversational dialogues, and compare and analyze their performance across different datasets. We use ROUGE metric to evaluate the quality of the generated summaries. The Facebook's BART model had better performance across different textual datasets. We believe that our findings will offer valuable insights into the capabilities and limitations of Transformer-based AI models in the context of extracting essential points from large articles, making them useful as assistive tools for summarizing course content in educational environments.

Original languageEnglish
Title of host publication2023 15th International Conference on Innovations in Information Technology, IIT 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages79-84
Number of pages6
ISBN (Electronic)9798350382396
DOIs
Publication statusPublished - 2023
Event15th International Conference on Innovations in Information Technology, IIT 2023 - Al Ain, United Arab Emirates
Duration: Nov 14 2023Nov 15 2023

Publication series

Name2023 15th International Conference on Innovations in Information Technology, IIT 2023

Conference

Conference15th International Conference on Innovations in Information Technology, IIT 2023
Country/TerritoryUnited Arab Emirates
CityAl Ain
Period11/14/2311/15/23

Keywords

  • Artificial Intelligence
  • Key Point Summarization
  • Natural Language Processing
  • Pretrained Language Models
  • Transformers

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems

Fingerprint

Dive into the research topics of 'A Comparative Study of Transformer Based Pretrained AI Models for Content Summarization'. Together they form a unique fingerprint.

Cite this