Author - Kislay Komal

How Kafka Works?

How Kafka Works?

#realtimedata streaming with #kafka is a popular and powerful approach to handle large volumes of data and facilitate communication between different systems and applications. #apachekafka is an open-source distributed event streaming platform that allows you to publish, subscribe, store, and process streams of records. Here's a general overview of how real-time data streaming with Kafka works: Topic and Message Model: Data is organized into topics, which are essentially log-like data streams. Each message within a topic consists of a key, value, and timestamp. Publishers...

Read more...

iDropper – The Data Ingestion, Monitoring and Reporting Tool

In today’s complicated world of business, the data, organizations own and how they use it, make them different from others to innovate, to compete better and to stay ahead in the business. That’s the driving factor for the organizations to collect and process as much data as possible, transform it into information with data-driven discoveries, and deliver it to the end user in the right format for smart decision-making. Common Challenges/Concerns Fetching the raw data files from the various data...

Read more...

Coming Along with Chat bots

Chatbot Service Moving your business where users use it most. Providing users access to information at their fingertips by where information is just a question away. Providing a conversation interface to users to query the information they need without having a human intervention. We can help you build Conversation AI driven chatbot which will help you provide a better user experience and expand your each to customers. Benefits of a Chatbot Availability A chatbot is available round the clock ensuring assistance is not...

Read more...

Store Locator Bot

Problem Statement During the Covid-19 pandemic how will one know if stocks are available at a nearby retail store. As we all might have experienced that before or during the lock-down a few individuals purchased a lot of items in bulk and for oneself and family without considering the risk of stocks not being available to the rest. Also, to ensure each of us stay home and not go out every now and then to the stores we purchases groceries...

Read more...
alt test

Hiring During Covid-19

Dear Friends, At a time when there is a noise of layoffs and pay cuts, Irisidea decided to shun the negatives and look at the positives. Amid all the gloom surrounding the job market due to the COVID-19 pandemic, there’s good news. You can upgrade, up-skill and update your learning while getting adjusted to new normal. Not all companies are firing and laying of people. Some companies, including us, are still hiring. Apart from the positions open for senior technical resources,...

Read more...

Error while batch processing of rest data persisted in Basic Hadoop based (HDFS) Data Lake “Permission denied: user=dr.who, access=READ_EXECUTE, inode=”/tmp”:hdadmin:supergroup:drwx……..”

Typically,  persisting unstructured data and subsequent batch processing  can be very costly and is not advisable for small organizations & startups, as cost is prime factor for them. A Hadoop based Data Lake using Map-Reduce, fits perfectly in this scenario which is not only cost effective but also scalable and easy to extend further. Though it may sound a great option to have, we might face issues while setting up the same and one of common issues is, error "Permission...

Read more...

Data Analysis Vs Predictive Analysis Vs Artificial Intelligence

What is Artificisal Intelligence? In simple words, Artificial intelligence, sometimes called machine intelligence, is intelligence demonstrated by machines, to learn from experience, adjust to new inputs and perform human-like tasks. Data Analysis - Predictive Analysis – Artificial Intelligence Data analysis refers to reviewing data from past events for patterns. Predictive analysis is making assumptions and testing based on past data to predict future what/ifs. AI machine learning analyzes data, makes assumptions, learns and provides predictions at a scale and depth of detail...

Read more...

The Brain and Convolutional Neural Network (CNN)

In the beginning of our life parents/family used to tell us name of the objects we see. We learned by examples given to us. Slowly we started recognizing certain things more often. They became so common that next time we saw them we would instantly know the name of the object and details of that. We label every object based on what we have learnt in the past. This is what we subconsciously do all days, we see, label, make...

Read more...

Processing and Analysis of Big Telecom Data to minimize crime, combat terrorism, unsocial activities etc.

Telecom providers have a treasure trove of captive data - customer data, CDR (call detail records), call center interactions, tower logs etc. and are metaphorically “sitting on a gold mine”. Ideally, each category of the generated data has the following information. ⦁ Customer data consolidates customer id, plan details, demographic, subscribed services and spending patterns ⦁ Service data category consolidates types of customer, customer history, complain category, query resolved etc.       are on ⦁ Usually for the smart mobile phone subscriber,...

Read more...

Deleting Solr log files/folder from Standby NameNode could be the disaster when Primary NameNode is active in the HDP (Hortonworks Data Platform) Hadoop Cluster

Most of us know that we use Apache Ambari for managing, provisioning and monitor different components of a Hortonworks Hadoop cluster. We also know that Apache Ranger can be used as a centralized security administration solution for Hadoop that enables administrators to create and enforce security policies for HDFS and other Hadoop platform components. When ranger hdfs plugin is enabled ,it writes the client interaction activity to Solr if it is configured. The default location of this solr log files...

Read more...