December 9, 2020
You have RDD in your code and now you want to work the data using DataFrames in Spark. Spark provides you with functions to convert RDD to […]
September 20, 2020
Let’s do this! We are going to do 3 things and trust us, it is going to take less than 5 minutes. 1. Login to our […]
July 13, 2020
In this post we will look at how to calculate resource allocation for Spark applications. Figuring out how to allocate resources for a Spark application requires […]
June 15, 2020
NiFi is an open source data flow framework. It is highly automated for flow of data between systems. It works as a data transporter between data […]
March 11, 2019
This is our second installment of our Big Data Interview Questions and Answers webinar. Click for the first one. It’s always fun to host one of these […]
May 4, 2018
We are happy and excited to announce, today we are launching a Slack workspace for Hadoop In Real World community. The purpose of the Slack workspace […]
January 24, 2018
In this post we are going to learn about 2 different types of Hive tables and the significance of each. There are 2 types of tables […]
November 15, 2017
We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews. Couple weeks before the […]
November 1, 2017
We hosted this webinar on Saturday, October 28th 2017. In this webinar we discussed the most common memory related issues with MapReduce jobs and how to […]
October 25, 2017
ZooKeeper is a coordination service for distributed applications. Well, what the heck is that right? Glad you asked. If you are looking to understand what is […]
October 18, 2017
We hosted a webinar Saturday, October 14th 2017 and we answered some great questions that was posted by Hadoop In Real World community and also from […]
October 4, 2017
We hosted a webinar Saturday, September 30th 2017 and the topic that was covered was RCFile vs. ORC. We had over 60 participants in the webinar. […]
September 27, 2017
This is one of the most widely requested post from our community. We have seen over and over again in other courses where they would start […]
September 13, 2017
When you first heard about Spark, you probably did a quick google search to find out that Apache Spark runs programs up to 100 times faster […]
March 2, 2017
Dissecting MapReduce Program (Part 2) In the last post we went over the driver program of a MapReduce program in detail. We will also see InputFormat, OutputFormat […]
February 27, 2017
Dissecting MapReduce Program (Part 1) From the previous post, we now we have a very good idea about the phases involved in MapReduce. We have a […]
February 23, 2017
Dissecting MapReduce Components In the last post we looked at different Phases of MapReduce. In this post we will take a real example and walk through […]
February 20, 2017
Introduction to MapReduce By now you are quite familiar with HDFS, if you are not to back to the beginning of this tutorial and follow links […]
February 16, 2017
Hadoop Starter Kit – Tutorial In this Hadoop Tutorial a.k.a Hadoop Starter Kit you will learn about the core concepts of Hadoop like HDFS, MapReduce and […]
February 13, 2017
With the Working with HDFS post, we now know how to work with HDFS. It is now time to look at the important components and processes […]
