Blog

iDropper – The Data Ingestion, Monitoring and Reporting Tool

In today’s complicated world of business, the data, organizations own and how they use it, make them different from others to innovate, to compete better and to stay ahead in the business. That’s the driving factor for the organizations to collect and process as much data as possible, transform it into information with data-driven discoveries, and deliver it to the end user in the right format for smart decision-making. Common Challenges/Concerns Fetching the raw data files from the various data...

Read more...

Coming Along with Chat bots

Chatbot Service Moving your business where users use it most. Providing users access to information at their fingertips by where information is just a question away. Providing a conversation interface to users to query the information they need without having a human intervention. We can help you build Conversation AI driven chatbot which will help you provide a better user experience and expand your each to customers. Benefits of a Chatbot Availability A chatbot is available round the clock ensuring assistance is not...

Read more...

Store Locator Bot

Problem Statement During the Covid-19 pandemic how will one know if stocks are available at a nearby retail store. As we all might have experienced that before or during the lock-down a few individuals purchased a lot of items in bulk and for oneself and family without considering the risk of stocks not being available to the rest. Also, to ensure each of us stay home and not go out every now and then to the stores we purchases groceries...

Read more...
alt test

Hiring During Covid-19

Dear Friends, At a time when there is a noise of layoffs and pay cuts, Irisidea decided to shun the negatives and look at the positives. Amid all the gloom surrounding the job market due to the COVID-19 pandemic, there’s good news. You can upgrade, up-skill and update your learning while getting adjusted to new normal. Not all companies are firing and laying of people. Some companies, including us, are still hiring. Apart from the positions open for senior technical resources,...

Read more...

Error while batch processing of rest data persisted in Basic Hadoop based (HDFS) Data Lake “Permission denied: user=dr.who, access=READ_EXECUTE, inode=”/tmp”:hdadmin:supergroup:drwx……..”

Typically,  persisting unstructured data and subsequent batch processing  can be very costly and is not advisable for small organizations & startups, as cost is prime factor for them. A Hadoop based Data Lake using Map-Reduce, fits perfectly in this scenario which is not only cost effective but also scalable and easy to extend further. Though it may sound a great option to have, we might face issues while setting up the same and one of common issues is, error "Permission...

Read more...

Data Analysis Vs Predictive Analysis Vs Artificial Intelligence

What is Artificisal Intelligence? In simple words, Artificial intelligence, sometimes called machine intelligence, is intelligence demonstrated by machines, to learn from experience, adjust to new inputs and perform human-like tasks. Data Analysis - Predictive Analysis – Artificial Intelligence Data analysis refers to reviewing data from past events for patterns. Predictive analysis is making assumptions and testing based on past data to predict future what/ifs. AI machine learning analyzes data, makes assumptions, learns and provides predictions at a scale and depth of detail...

Read more...

Resolved – ” Incompatible clusterIds in… ” in Multi Node Hadoop Cluster Setup

Currently, there are many startups / small companies and their customers, working on Data Analytics, ML, AI and related solutions. Due to their budget constraints, some of them don't want to leverage Cloud-based storage.  Alternatively, to process ingested data, they create basic Data Lake using HDFS. During this process, they might encounter the exception of "org.apache.hadoop.hdfs.server.common.Storage: java.io.IOException:  Incompatible  clusterIDs in /home/....". while starting the Name Node or Master Node in a  multi-node Hadoop Cluster. This may occur in the following scenarios: ...

Read more...

Network Topology To Create Multi Node Hybrid Cluster For Hadoop Installation

The aim of this article is to provide an outline for creating network topology for Hadoop installation in multi node hybrid cluster with limited available hardware resources.  This cluster would be beneficial for learning Hadoop, with lower volume of unstructured data processing using various engines etc. Before the cluster setup: We installed Hadoop on a single node cluster running on Ubuntu 14.04 on top of Windows 10 using VMware workstation player. Later we have copied the .vmx file into multiple...

Read more...

The Brain and Convolutional Neural Network (CNN)

In the beginning of our life parents/family used to tell us name of the objects we see. We learned by examples given to us. Slowly we started recognizing certain things more often. They became so common that next time we saw them we would instantly know the name of the object and details of that. We label every object based on what we have learnt in the past. This is what we subconsciously do all days, we see, label, make...

Read more...

Data Governance & Security Mechanism in Distributed Data Storage System

We are aware that the traditional data storage mechanism is incapable to hold the massive volume of  data generated with lightning speed for further utilization even if we perform vertical scaling,  and we have anticipated only one fuel, nothing but DATA to accelerate the movement across all the sectors starting from business to natural resources including medical towards rapid growth. But the question is how to persist this massive volume of data for processing? The answer is, storing the data...

Read more...