Epilepsy is a prevalent neurological disorder and has been studied through the analysis of Electroencephalogram (EEG) signals. However, the identification and classification of epileptic seizure patterns remains challenging due to the non-stationary nature of EEG signals and the presence of artifacts. In this paper, we investigate the applicability of a transformer-based deep learning model to classify seizure patterns observed in epileptic patients. We employed the self-Attention mechanism inherent in transformers to capture complex temporal relationships in the EEG recordings. By prepossessing the EEG signals into suitable input sequences and adapting the transformer architecture, we achieved 78.11% in distinguishing between different epileptic seizure patterns. Our findings indicate that the transformer model, with its ability to manage long-range dependencies, offers a robust approach to EEG-based seizure pattern classification. This work is important for building advanced automated diagnostic tools for epilepsy and related neurological disorders.