{"id":1866,"date":"2021-03-05T06:00:00","date_gmt":"2021-03-05T12:00:00","guid":{"rendered":"https:\/\/www.bigdatainrealworld.com\/?p=1866"},"modified":"2023-02-19T07:31:43","modified_gmt":"2023-02-19T13:31:43","slug":"why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle","status":"publish","type":"post","link":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/","title":{"rendered":"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle?"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Shuffle-and-Replication does not mean a \u201ctrue\u201d shuffle as in records with the same keys are sent to the same partition. Instead the entire partition of the dataset is sent over or replicated to all the partitions for a full cross or nested-loop join.<\/span><br \/>\n<script src=\"https:\/\/embed.lpcontent.net\/leadboxes\/current\/embed.js\" async=\"\" defer=\"defer\"><\/script><\/p>\n<p style=\"border: 1px; border-style: solid; border-color: #005cb9; background-color: #f1f5f9; padding: 1em;\">Do you like us to send you a 47 page Definitive guide on Spark join algorithms? ===&gt; <button style=\"background: #afbf00; border-color: #afbf00; border-radius: 20px; color: #ffffff; display: inline-block; vertical-align: middle; padding: 16px 32px; min-width: 192px; border: 1px solid #afbf00; font-size: 1rem; font-family: Helvetica, Arial, sans-serif; text-align: center; outline: 0; line-height: 1; cursor: pointer; -webkit-transition: background 0.3s, color 0.3s, border 0.3s; transition: background 0.3s, color 0.3s, border 0.3s; box-shadow: 0px 2px 5px rgba(0, 0, 0, 0.6);\" data-leadbox-popup=\"iRwJt3SrgaavPhqQ3dnrtg\" data-leadbox-domain=\"ccubecompany.lpages.co\">Send me the guide<\/button><\/p>\n<p><span style=\"font-weight: 400;\">This is how the execution of a Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join will look like.<\/span><br \/>\n<a href=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\"><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone size-full wp-image-1867\" src=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\" alt=\"Cartesian product join Spark stages\" width=\"431\" height=\"648\" srcset=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png 431w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages-200x300.png 200w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages-97x146.png 97w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages-33x50.png 33w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages-50x75.png 50w\" sizes=\"(max-width:767px) 431px, 431px\" \/><\/a><\/p>\n<h2><span style=\"font-weight: 400;\">Reason<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Internally partitions from one DataFrame are sent over the partitions in the other dataset over the network. This means a lot of partitions are moved over the network as a whole and a shuffle is not involved.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Once partitions from both dataset are available on one side, a nested loop join is performed.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">If there are N records in one dataset and M records in the other dataset a nested loop is performed on N * M records.<a href=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-1868\" src=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1.png\" alt=\"Cartesian product join Stage 1\" width=\"703\" height=\"456\" srcset=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1.png 703w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1-300x195.png 300w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1-225x146.png 225w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1-50x32.png 50w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Stage-1-116x75.png 116w\" sizes=\"(max-width:767px) 480px, 703px\" \/><\/a><\/span><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Shuffle-and-Replication does not mean a \u201ctrue\u201d shuffle as in records with the same keys are sent to the same partition. Instead the entire partition of the<span class=\"excerpt-hellip\"> [\u2026]<\/span><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13],"tags":[],"class_list":["post-1866","post","type-post","status-publish","format-standard","hentry","category-spark"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle? - Big Data In Real World<\/title>\n<meta name=\"description\" content=\"A quick 3 minute read to understand why Cartesian Product join or Shuffle and Replicated Nested Loop join cause a shuffle.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle? - Big Data In Real World\" \/>\n<meta property=\"og:description\" content=\"A quick 3 minute read to understand why Cartesian Product join or Shuffle and Replicated Nested Loop join cause a shuffle.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\" \/>\n<meta property=\"og:site_name\" content=\"Big Data In Real World\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bigdatainrealworld\" \/>\n<meta property=\"article:published_time\" content=\"2021-03-05T12:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-19T13:31:43+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\" \/>\n<meta name=\"author\" content=\"Big Data In Real World\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Big Data In Real World\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\"},\"author\":{\"name\":\"Big Data In Real World\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\"},\"headline\":\"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle?\",\"datePublished\":\"2021-03-05T12:00:00+00:00\",\"dateModified\":\"2023-02-19T13:31:43+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\"},\"wordCount\":175,\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\",\"articleSection\":[\"Spark\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\",\"name\":\"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle? - Big Data In Real World\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\",\"datePublished\":\"2021-03-05T12:00:00+00:00\",\"dateModified\":\"2023-02-19T13:31:43+00:00\",\"description\":\"A quick 3 minute read to understand why Cartesian Product join or Shuffle and Replicated Nested Loop join cause a shuffle.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.bigdatainrealworld.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"name\":\"Big Data In Real World\",\"description\":\"Learn Big Data from experts!\",\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\",\"name\":\"Big Data In Real World\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"width\":500,\"height\":500,\"caption\":\"Big Data In Real World\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/bigdatainrealworld\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\",\"name\":\"Big Data In Real World\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"caption\":\"Big Data In Real World\"},\"description\":\"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.\",\"sameAs\":[\"https:\/\/www.bigdatainrealworld.com\/\"],\"url\":\"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle? - Big Data In Real World","description":"A quick 3 minute read to understand why Cartesian Product join or Shuffle and Replicated Nested Loop join cause a shuffle.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/","og_locale":"en_US","og_type":"article","og_title":"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle? - Big Data In Real World","og_description":"A quick 3 minute read to understand why Cartesian Product join or Shuffle and Replicated Nested Loop join cause a shuffle.","og_url":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/","og_site_name":"Big Data In Real World","article_publisher":"https:\/\/www.facebook.com\/bigdatainrealworld","article_published_time":"2021-03-05T12:00:00+00:00","article_modified_time":"2023-02-19T13:31:43+00:00","og_image":[{"url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png"}],"author":"Big Data In Real World","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Big Data In Real World","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#article","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/"},"author":{"name":"Big Data In Real World","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67"},"headline":"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle?","datePublished":"2021-03-05T12:00:00+00:00","dateModified":"2023-02-19T13:31:43+00:00","mainEntityOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/"},"wordCount":175,"publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage"},"thumbnailUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png","articleSection":["Spark"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/","url":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/","name":"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle? - Big Data In Real World","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage"},"thumbnailUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png","datePublished":"2021-03-05T12:00:00+00:00","dateModified":"2023-02-19T13:31:43+00:00","description":"A quick 3 minute read to understand why Cartesian Product join or Shuffle and Replicated Nested Loop join cause a shuffle.","breadcrumb":{"@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#primaryimage","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Cartesian-product-join-Spark-stages.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.bigdatainrealworld.com\/why-does-cartesian-product-join-aka-shuffle-and-replication-nested-loop-join-does-not-cause-a-shuffle\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.bigdatainrealworld.com\/"},{"@type":"ListItem","position":2,"name":"Why does Cartesian Product Join aka Shuffle-and-Replication Nested Loop Join does not cause a shuffle?"}]},{"@type":"WebSite","@id":"https:\/\/www.bigdatainrealworld.com\/#website","url":"https:\/\/www.bigdatainrealworld.com\/","name":"Big Data In Real World","description":"Learn Big Data from experts!","publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.bigdatainrealworld.com\/#organization","name":"Big Data In Real World","url":"https:\/\/www.bigdatainrealworld.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","width":500,"height":500,"caption":"Big Data In Real World"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bigdatainrealworld"]},{"@type":"Person","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67","name":"Big Data In Real World","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","caption":"Big Data In Real World"},"description":"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.","sameAs":["https:\/\/www.bigdatainrealworld.com\/"],"url":"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/"}]}},"_links":{"self":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1866"}],"collection":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/comments?post=1866"}],"version-history":[{"count":4,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1866\/revisions"}],"predecessor-version":[{"id":2029,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1866\/revisions\/2029"}],"wp:attachment":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/media?parent=1866"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/categories?post=1866"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/tags?post=1866"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}