{"id":1402,"date":"2017-11-15T09:49:31","date_gmt":"2017-11-15T15:49:31","guid":{"rendered":"http:\/\/hadoopinrealworld.com\/?p=1402"},"modified":"2023-02-19T07:32:42","modified_gmt":"2023-02-19T13:32:42","slug":"hadoop-or-big-data-interview-questions-and-answers-part-1","status":"publish","type":"post","link":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/","title":{"rendered":"Hadoop or Big Data Interview Questions and Answers (Part 1)"},"content":{"rendered":"<p>We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews. Couple weeks before the webinar we asked our wonderful Hadoop In Real World community to share interesting or challenging questions they were asked in real interviews.\u00a0As a result we got several interesting and challenging questions from the community that were asked in real world interviews.<\/p>\n<p>We had so much fun answering those questions in the webinar. The participants were super engaging and we even answered more questions that was asked live by the participants on the webinar.<\/p>\n<p>We quite often hosts webinars like these, sign up below to get invitations to join one of our webinars.<script src=\"\/\/static.leadpages.net\/leadboxes\/current\/embed.js\" async=\"\" defer=\"defer\"><\/script><button style=\"background: #afbf00; border-color: #afbf00; border-radius: 20px; color: #ffffff; display: inline-block; vertical-align: middle; padding: 16px 32px; min-width: 192px; border: 1px solid #afbf00; font-size: 1rem; font-family: Helvetica, Arial, sans-serif; text-align: center; outline: 0; line-height: 1; cursor: pointer; -webkit-transition: background 0.3s, color 0.3s, border 0.3s; transition: background 0.3s, color 0.3s, border 0.3s; box-shadow: 0px 2px 5px rgba(0, 0, 0, 0.6);\" data-leadbox-popup=\"146ccea73f72a2:103d035da346dc\" data-leadbox-domain=\"ccubecompany.lpusercontent.com\">Click here to subscribe<\/button><\/p>\n<p>&nbsp;<\/p>\n<h2>Interesting &amp; Challenging Questions<\/h2>\n<ol>\n<li>Explain your recent project, roles &amp; responsibilities?<\/li>\n<li>Explain MapReduce flow in detail<\/li>\n<li>Assume a 10 GB dataset, how many mappers and reducers will be created?<\/li>\n<li>How does data get transferred from Mapper to Reducer?<\/li>\n<li>If you have more than one reducer, how does data gets to the correct reducer?<\/li>\n<li>When to use Hive and when to use Spark?<\/li>\n<li>Does Hive support ACID &amp; CRUD?<\/li>\n<li>When to use Partitions &amp; when to use Buckets in Hive?<\/li>\n<li>What is Map Join &amp; SMB Join in Hive?<\/li>\n<li>When to use columnar format and when to use row format?<\/li>\n<li>What is the difference between RDD &amp; DataFrame?<\/li>\n<li>What is Oozie?<\/li>\n<li>What is Flume?<\/li>\n<li>What is Sentry?<\/li>\n<li>What is Kafka?<\/li>\n<li>How do you promote code to production?<\/li>\n<li>Why odd number of nodes &#8211; 1, 3, 5.. ?<\/li>\n<li>Is it possible to make a Mapper multithreaded?<\/li>\n<\/ol>\n<p>We are certainly planning to host another session to cover more interview questions. So, if you have an interesting interview question that you would like us to answer, please email that question(s) to info@hadoopinrealworld.com<\/p>\n<p>Here is the full recording of the webinar. Enjoy!<\/p>\n<p><iframe width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/t0VkFYEmlC8\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews. Couple weeks before the<span class=\"excerpt-hellip\"> [\u2026]<\/span><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12,1,14,13],"tags":[],"class_list":["post-1402","post","type-post","status-publish","format-standard","hentry","category-apache-hive","category-hadoop","category-hadoop-admin","category-spark"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Hadoop or Big Data Interview Questions and Answers (Part 1) - Big Data In Real World<\/title>\n<meta name=\"description\" content=\"Video Post - We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Hadoop or Big Data Interview Questions and Answers (Part 1) - Big Data In Real World\" \/>\n<meta property=\"og:description\" content=\"Video Post - We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\" \/>\n<meta property=\"og:site_name\" content=\"Big Data In Real World\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bigdatainrealworld\" \/>\n<meta property=\"article:published_time\" content=\"2017-11-15T15:49:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-19T13:32:42+00:00\" \/>\n<meta name=\"author\" content=\"Big Data In Real World\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Big Data In Real World\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\"},\"author\":{\"name\":\"Big Data In Real World\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\"},\"headline\":\"Hadoop or Big Data Interview Questions and Answers (Part 1)\",\"datePublished\":\"2017-11-15T15:49:31+00:00\",\"dateModified\":\"2023-02-19T13:32:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\"},\"wordCount\":317,\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"articleSection\":[\"Apache Hive\",\"Hadoop\",\"Hadoop Admin\",\"Spark\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\",\"name\":\"Hadoop or Big Data Interview Questions and Answers (Part 1) - Big Data In Real World\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\"},\"datePublished\":\"2017-11-15T15:49:31+00:00\",\"dateModified\":\"2023-02-19T13:32:42+00:00\",\"description\":\"Video Post - We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.bigdatainrealworld.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Hadoop or Big Data Interview Questions and Answers (Part 1)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"name\":\"Big Data In Real World\",\"description\":\"Learn Big Data from experts!\",\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\",\"name\":\"Big Data In Real World\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"width\":500,\"height\":500,\"caption\":\"Big Data In Real World\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/bigdatainrealworld\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\",\"name\":\"Big Data In Real World\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"caption\":\"Big Data In Real World\"},\"description\":\"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.\",\"sameAs\":[\"https:\/\/www.bigdatainrealworld.com\/\"],\"url\":\"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Hadoop or Big Data Interview Questions and Answers (Part 1) - Big Data In Real World","description":"Video Post - We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/","og_locale":"en_US","og_type":"article","og_title":"Hadoop or Big Data Interview Questions and Answers (Part 1) - Big Data In Real World","og_description":"Video Post - We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews.","og_url":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/","og_site_name":"Big Data In Real World","article_publisher":"https:\/\/www.facebook.com\/bigdatainrealworld","article_published_time":"2017-11-15T15:49:31+00:00","article_modified_time":"2023-02-19T13:32:42+00:00","author":"Big Data In Real World","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Big Data In Real World","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/#article","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/"},"author":{"name":"Big Data In Real World","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67"},"headline":"Hadoop or Big Data Interview Questions and Answers (Part 1)","datePublished":"2017-11-15T15:49:31+00:00","dateModified":"2023-02-19T13:32:42+00:00","mainEntityOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/"},"wordCount":317,"publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"articleSection":["Apache Hive","Hadoop","Hadoop Admin","Spark"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/","url":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/","name":"Hadoop or Big Data Interview Questions and Answers (Part 1) - Big Data In Real World","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/#website"},"datePublished":"2017-11-15T15:49:31+00:00","dateModified":"2023-02-19T13:32:42+00:00","description":"Video Post - We hosted a webinar on November 11th 2017 answering several Hadoop or Big Data interview questions that were asked in real interviews.","breadcrumb":{"@id":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.bigdatainrealworld.com\/hadoop-or-big-data-interview-questions-and-answers-part-1\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.bigdatainrealworld.com\/"},{"@type":"ListItem","position":2,"name":"Hadoop or Big Data Interview Questions and Answers (Part 1)"}]},{"@type":"WebSite","@id":"https:\/\/www.bigdatainrealworld.com\/#website","url":"https:\/\/www.bigdatainrealworld.com\/","name":"Big Data In Real World","description":"Learn Big Data from experts!","publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.bigdatainrealworld.com\/#organization","name":"Big Data In Real World","url":"https:\/\/www.bigdatainrealworld.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","width":500,"height":500,"caption":"Big Data In Real World"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bigdatainrealworld"]},{"@type":"Person","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67","name":"Big Data In Real World","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","caption":"Big Data In Real World"},"description":"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.","sameAs":["https:\/\/www.bigdatainrealworld.com\/"],"url":"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/"}]}},"_links":{"self":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1402"}],"collection":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/comments?post=1402"}],"version-history":[{"count":2,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1402\/revisions"}],"predecessor-version":[{"id":1405,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1402\/revisions\/1405"}],"wp:attachment":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/media?parent=1402"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/categories?post=1402"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/tags?post=1402"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}