A theoritical (sic) exploration of data management and integration in organisation sectors

Chisom E. Offia, Malcolm Crowe

Research output: Contribution to journalArticle

Abstract

Big data development is a disturbing issue that will affect enterprise across various sectors. The increase of data volume, high speed of data generation and increasing rate of different data from heterogeneous sources have led to difficulties in data management. This paper first reviews different aspects of big data management, including data integration and traditional data warehouse, and their associated challenges.

The problems include increase of redundant data, data accessibility, time consumption in data modelling and data movement from heterogeneous sources into a central database, especially in the big data environment. We then propose a logical data management approach using RESTview technology to integrate and analyse data, without fully adopting traditional ETL processes. Data that for governance, corporate, security or other restriction reasons cannot be copied or moved, can easily be accessed, integrated and analysed, without creating a central repository. Data can be kept in its original form and location, eliminating the movement of data, significantly speeding up the process and allowing for live data interrogation. It may not be the practical solution for every situation but, it is a feasible solution that is comparably cost effective.
LanguageEnglish
Pages37-56
Number of pages20
JournalInternational Journal of Database Management Systems
Volume11
Issue number1
DOIs
StatePublished - 28 Feb 2019

Fingerprint

Data integration
Information management
Data warehouses
Data structures
Big data
Costs
Industry

Keywords

  • Big Data
  • Data Integration
  • Data warehouse
  • RESTView

Cite this

@article{173c4d1e5ba841d0adc0f004f112c18d,
title = "A theoritical (sic) exploration of data management and integration in organisation sectors",
abstract = "Big data development is a disturbing issue that will affect enterprise across various sectors. The increase of data volume, high speed of data generation and increasing rate of different data from heterogeneous sources have led to difficulties in data management. This paper first reviews different aspects of big data management, including data integration and traditional data warehouse, and their associated challenges.The problems include increase of redundant data, data accessibility, time consumption in data modelling and data movement from heterogeneous sources into a central database, especially in the big data environment. We then propose a logical data management approach using RESTview technology to integrate and analyse data, without fully adopting traditional ETL processes. Data that for governance, corporate, security or other restriction reasons cannot be copied or moved, can easily be accessed, integrated and analysed, without creating a central repository. Data can be kept in its original form and location, eliminating the movement of data, significantly speeding up the process and allowing for live data interrogation. It may not be the practical solution for every situation but, it is a feasible solution that is comparably cost effective.",
keywords = "Big Data, Data Integration, Data warehouse, RESTView",
author = "Offia, {Chisom E.} and Malcolm Crowe",
year = "2019",
month = "2",
day = "28",
doi = "10.5121/ijdms.2019.11103",
language = "English",
volume = "11",
pages = "37--56",
journal = "International Journal of Database Management Systems",
issn = "0975-5985",
publisher = "AIRCC Publishing Corporation",
number = "1",

}

A theoritical (sic) exploration of data management and integration in organisation sectors. / Offia, Chisom E.; Crowe, Malcolm.

In: International Journal of Database Management Systems, Vol. 11, No. 1, 28.02.2019, p. 37-56.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A theoritical (sic) exploration of data management and integration in organisation sectors

AU - Offia,Chisom E.

AU - Crowe,Malcolm

PY - 2019/2/28

Y1 - 2019/2/28

N2 - Big data development is a disturbing issue that will affect enterprise across various sectors. The increase of data volume, high speed of data generation and increasing rate of different data from heterogeneous sources have led to difficulties in data management. This paper first reviews different aspects of big data management, including data integration and traditional data warehouse, and their associated challenges.The problems include increase of redundant data, data accessibility, time consumption in data modelling and data movement from heterogeneous sources into a central database, especially in the big data environment. We then propose a logical data management approach using RESTview technology to integrate and analyse data, without fully adopting traditional ETL processes. Data that for governance, corporate, security or other restriction reasons cannot be copied or moved, can easily be accessed, integrated and analysed, without creating a central repository. Data can be kept in its original form and location, eliminating the movement of data, significantly speeding up the process and allowing for live data interrogation. It may not be the practical solution for every situation but, it is a feasible solution that is comparably cost effective.

AB - Big data development is a disturbing issue that will affect enterprise across various sectors. The increase of data volume, high speed of data generation and increasing rate of different data from heterogeneous sources have led to difficulties in data management. This paper first reviews different aspects of big data management, including data integration and traditional data warehouse, and their associated challenges.The problems include increase of redundant data, data accessibility, time consumption in data modelling and data movement from heterogeneous sources into a central database, especially in the big data environment. We then propose a logical data management approach using RESTview technology to integrate and analyse data, without fully adopting traditional ETL processes. Data that for governance, corporate, security or other restriction reasons cannot be copied or moved, can easily be accessed, integrated and analysed, without creating a central repository. Data can be kept in its original form and location, eliminating the movement of data, significantly speeding up the process and allowing for live data interrogation. It may not be the practical solution for every situation but, it is a feasible solution that is comparably cost effective.

KW - Big Data

KW - Data Integration

KW - Data warehouse

KW - RESTView

U2 - 10.5121/ijdms.2019.11103

DO - 10.5121/ijdms.2019.11103

M3 - Article

VL - 11

SP - 37

EP - 56

JO - International Journal of Database Management Systems

T2 - International Journal of Database Management Systems

JF - International Journal of Database Management Systems

SN - 0975-5985

IS - 1

ER -