Tag - structured data

11Jan

Data Absorption (Ingestion)

By , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Comments Off
Read more...
08Sep

Transfer structured data from Oracle to Hadoop storage system

Using Apache's sqoop, we can transfer structured data from Relational Database Management System to Hadoop distributed file system (HDFS). Because of distributed storage mechanism in Hadoop Distributed File System (HDFS), we can store any format of data in huge volume in terms of capacity. In RDBMS, data persists in the row and column format (Known as Structured Data). In order to process the huge volume of enterprise data, we can leverage HDFS as a basic data lake. In this...

By Data Engineering, Hadoop Eco System, , , , , , , , , , , , , , , , , , , , , Comments Off
Read more...
05Apr

Basic concept of Data Lake

The left side info graphics represents the basic concept of Data Lake where we can use the approach of ELT (Extraction, loading and then transformation) against traditional ETL (Extraction, Transformation and then loading) process. ETL process implies to traditional data warehousing system where structured data format follows (row and column). By leveraging HDFS (Hadoop Distributed File System), we can develop data lake to store any format data in order to process and analysis. Directly data can be loaded in the Lake...

By Data Engineering, Storage Mechanism, , , , , , , , , , , , , , , , , , , Comments Off
Read more...