Big data and semantics management system for computer networks

Bassem Mokhtar, Mohamed Eltoweissy

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)

Abstract

We define “Big Networks” as those that generate big data and can benefit from big data management in their operations. Examples of big networks include the current Internet and the emerging Internet of things and social networks. The ever-increasing scale, complexity and heterogeneity of the Internet make it harder to discover emergent and anomalous behavior in the network traffic. We hypothesize that endowing the otherwise semantically-oblivious Internet with “memory” management mimicking the human memory functionalities would help advance the Internet capability to learn, conceptualize and effectively and efficiently store traffic data and behavior, and to more accurately predict future events. Inspired by the functionalities of human memory, we proposed a distributed network memory management system, termed NetMem, to efficiently store Internet data and extract and utilize traffic semantics in matching and prediction processes. In particular, we explore Hidden Markov Models (HMM), Latent Dirichlet Allocation (LDA), and simple statistical analysis-based techniques for semantic reasoning in NetMem. Additionally, we propose a hybrid intelligence technique for semantic reasoning integrating LDA and HMM to extract network semantics based on learning patterns and features with syntax and semantic dependencies. We also utilize locality sensitive hashing for reducing dimensionality. Our simulation study using real network traffic demonstrates the benefits of NetMem and highlights the advantages and limitations of the aforementioned techniques.

Original languageEnglish
Pages (from-to)32-51
Number of pages20
JournalAd Hoc Networks
Volume57
DOIs
Publication statusPublished - Mar 15 2017
Externally publishedYes

Keywords

  • Big data
  • Bio-inspired design
  • Hybrid intelligence
  • Network management
  • Pattern learning
  • Semantics reasoning

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Big data and semantics management system for computer networks'. Together they form a unique fingerprint.

Cite this