{"id":1844,"date":"2021-01-08T06:00:18","date_gmt":"2021-01-08T12:00:18","guid":{"rendered":"https:\/\/www.bigdatainrealworld.com\/?p=1844"},"modified":"2023-02-19T07:31:58","modified_gmt":"2023-02-19T13:31:58","slug":"how-does-broadcast-nested-loop-join-work-in-spark","status":"publish","type":"post","link":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/","title":{"rendered":"How does Broadcast Nested Loop Join work in Spark?"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Broadcast Nested Loop join works by broadcasting one of the entire datasets and performing a nested loop to join the data. So essentially every record from dataset 1 is attempted to join with every record from dataset 2.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As you could guess, Broadcast Nested Loop is not preferred and could be quite slow. It works for both equi and non-equi joins and it is picked by default when you have a non-equi join.<\/span><br \/>\n<script src=\"https:\/\/embed.lpcontent.net\/leadboxes\/current\/embed.js\" async=\"\" defer=\"defer\"><\/script><\/p>\n<p style=\"border: 1px; border-style: solid; border-color: #005cb9; background-color: #f1f5f9; padding: 1em;\">Do you like us to send you a 47 page Definitive guide on Spark join algorithms? ===&gt; <button style=\"background: #afbf00; border-color: #afbf00; border-radius: 20px; color: #ffffff; display: inline-block; vertical-align: middle; padding: 16px 32px; min-width: 192px; border: 1px solid #afbf00; font-size: 1rem; font-family: Helvetica, Arial, sans-serif; text-align: center; outline: 0; line-height: 1; cursor: pointer; -webkit-transition: background 0.3s, color 0.3s, border 0.3s; transition: background 0.3s, color 0.3s, border 0.3s; box-shadow: 0px 2px 5px rgba(0, 0, 0, 0.6);\" data-leadbox-popup=\"iRwJt3SrgaavPhqQ3dnrtg\" data-leadbox-domain=\"ccubecompany.lpages.co\">Send me the guide<\/button><\/p>\n<h2><span style=\"font-weight: 400;\">Example<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We don\u2019t change the default values for both <span class=\"lang:default decode:true crayon-inline \">spark.sql.join.preferSortMergeJoin<\/span>\u00a0 and <span class=\"lang:default decode:true crayon-inline \">spark.sql.autoBroadcastJoinThreshold<\/span>\u00a0.<\/span><\/p>\n<pre class=\"lang:default decode:true \">scala&gt; spark.conf.get(\"spark.sql.join.preferSortMergeJoin\")\r\nres0: String = true\r\n\r\nscala&gt; spark.conf.get(\"spark.sql.autoBroadcastJoinThreshold\")\r\nres1: String = 10485760<\/pre>\n<p>&nbsp;<\/p>\n<pre class=\"lang:default decode:true \">scala&gt; val data1 = Seq(10, 20, 20, 30, 40, 10, 40, 20, 20, 20, 20, 50)\r\ndata1: Seq[Int] = List(10, 20, 20, 30, 40, 10, 40, 20, 20, 20, 20, 50)\r\n\r\nscala&gt; val df1 = data1.toDF(\"id1\")\r\ndf1: org.apache.spark.sql.DataFrame = [id1: int]\r\n\r\nscala&gt; val data2 = Seq(30, 20, 40, 50)\r\ndata2: Seq[Int] = List(30, 20, 40, 50)\r\n\r\nscala&gt; val df2 = data2.toDF(\"id2\")\r\ndf2: org.apache.spark.sql.DataFrame = [id2: int]<\/pre>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Note here we are trying to perform a non-equi join operation.<\/span><\/p>\n<pre class=\"lang:default decode:true \">scala&gt; val dfJoined = df1.join(df2, $\"id1\" &gt;= $\"id2\")\r\ndfJoined: org.apache.spark.sql.DataFrame = [id1: int, id2: int]<\/pre>\n<p><span style=\"font-weight: 400;\">When we see the plan that will be executed, we can see that BroadcastNestedLoopJoin is used.<\/span><\/p>\n<pre class=\"lang:default decode:true \">scala&gt; dfJoined.queryExecution.executedPlan\r\n\r\nres2: org.apache.spark.sql.execution.SparkPlan =\r\nBroadcastNestedLoopJoin BuildRight, Inner, (id1#3 &gt;= id2#8)\r\n:- LocalTableScan [id1#3]\r\n+- BroadcastExchange IdentityBroadcastMode\r\n\u00a0\u00a0\u00a0+- LocalTableScan [id2#8]\r\n\r\n\r\nscala&gt; dfJoined.show\r\n\r\n+---+---+\r\n|id1|id2|\r\n+---+---+\r\n| 20| 20|\r\n| 20| 20|\r\n| 30| 30|\r\n| 30| 20|\r\n| 40| 30|\r\n| 40| 20|\r\n| 40| 40|\r\n| 40| 30|\r\n| 40| 20|\r\n| 40| 40|\r\n| 20| 20|\r\n| 20| 20|\r\n| 20| 20|\r\n| 20| 20|\r\n| 50| 30|\r\n| 50| 20|\r\n| 50| 40|\r\n| 50| 50|\r\n+---+---+\r\n<\/pre>\n<p>&nbsp;<\/p>\n<h2><span style=\"font-weight: 400;\">Stages involved in a Broadcast Nested Loop Join<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Broadcast Nested Loop join does not involve a shuffle or a sort. Smallest dataset of the two will be broadcasted to all partitions and a nested loop is performed between the 2 datasets to perform the join. Every record from dataset 1 is attempted to join with every record from dataset 2.<\/span><\/p>\n<p><a href=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\"><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone size-full wp-image-1845\" src=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\" alt=\"Broadcast Nested Loop Join Spark stages\" width=\"271\" height=\"644\" srcset=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png 271w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages-126x300.png 126w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages-61x146.png 61w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages-21x50.png 21w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages-32x75.png 32w\" sizes=\"(max-width:767px) 271px, 271px\" \/><\/a><\/p>\n<h2><span style=\"font-weight: 400;\">Internal workings of Broadcast Nested Loop Join<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are 2 phases in a Broadcast Nested Loop Join.<\/span><\/p>\n<h3><span style=\"font-weight: 400;\">Broadcast phase<\/span><\/h3>\n<ul>\n<li><span style=\"font-weight: 400;\">Smallest dataset is broadcasted to all executors or tasks processing the bigger dataset<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Left side will be broadcasted in a right outer join.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Right side in a left outer, left semi, left anti or existence join will be broadcasted.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Either side can be broadcasted in an inner-like join.<\/span><\/li>\n<\/ul>\n<p><img decoding=\"async\" class=\"alignnone size-full wp-image-1847\" src=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1.png\" alt=\"Broadcast Nested Loop Spark stage 1\" width=\"766\" height=\"451\" srcset=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1.png 766w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-300x177.png 300w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-248x146.png 248w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-50x29.png 50w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-127x75.png 127w\" sizes=\"(max-width:767px) 480px, 766px\" \/><\/p>\n<h3><span style=\"font-weight: 400;\">Nested Loop Join phase<\/span><\/h3>\n<ul>\n<li><span style=\"font-weight: 400;\">Once the dataset is broadcasted, every record from one dataset is attempted to join with every record from another dataset in a nested loop.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Since this join is used for non-equi conditions, the iteration can not stop as soon as a match is encountered like in Sort Merge Join. The iteration will go through the entire dataset.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Note that a sort is not involved in this join.<\/span><\/li>\n<\/ul>\n<p><a href=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2.png\"><img decoding=\"async\" class=\"alignnone size-full wp-image-1846\" src=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2.png\" alt=\"Broadcast Nested Loop Spark stage 1 and 2\" width=\"777\" height=\"438\" srcset=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2.png 777w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2-300x169.png 300w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2-768x433.png 768w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2-260x146.png 260w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2-50x28.png 50w, https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Spark-stage-1-and-2-133x75.png 133w\" sizes=\"(max-width:767px) 480px, (max-width:777px) 100vw, 777px\" \/><\/a><\/p>\n<h2><span style=\"font-weight: 400;\">When does Broadcast Nested Loop Join work?<\/span><\/h2>\n<ul>\n<li><span style=\"font-weight: 400;\">Works for both equi and non-equi joins<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Works for all join types<\/span><\/li>\n<\/ul>\n<h2><span style=\"font-weight: 400;\">When Broadcast Nested Loop Join doesn\u2019t work?<\/span><\/h2>\n<ul>\n<li><span style=\"font-weight: 400;\">This join is slow<\/span><\/li>\n<li><span style=\"font-weight: 400;\">This join will not work when either sides are big enough for broadcasting and you could see Out Of Memory exceptions.<\/span><\/li>\n<\/ul>\n<p>Interested in learning about Shuffle Hash join in Spark? &#8211; <a href=\"https:\/\/www.bigdatainrealworld.com\/how-does-shuffle-hash-join-work-in-spark\/\">Click here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Broadcast Nested Loop join works by broadcasting one of the entire datasets and performing a nested loop to join the data. So essentially every record from<span class=\"excerpt-hellip\"> [\u2026]<\/span><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13],"tags":[],"class_list":["post-1844","post","type-post","status-publish","format-standard","hentry","category-spark"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How does Broadcast Nested Loop Join work in Spark? - Big Data In Real World<\/title>\n<meta name=\"description\" content=\"Short and easy to understand post on all you need to know about Broadcast Nested Loop join in Spark.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How does Broadcast Nested Loop Join work in Spark? - Big Data In Real World\" \/>\n<meta property=\"og:description\" content=\"Short and easy to understand post on all you need to know about Broadcast Nested Loop join in Spark.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\" \/>\n<meta property=\"og:site_name\" content=\"Big Data In Real World\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bigdatainrealworld\" \/>\n<meta property=\"article:published_time\" content=\"2021-01-08T12:00:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-19T13:31:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\" \/>\n<meta name=\"author\" content=\"Big Data In Real World\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Big Data In Real World\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\"},\"author\":{\"name\":\"Big Data In Real World\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\"},\"headline\":\"How does Broadcast Nested Loop Join work in Spark?\",\"datePublished\":\"2021-01-08T12:00:18+00:00\",\"dateModified\":\"2023-02-19T13:31:58+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\"},\"wordCount\":406,\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\",\"articleSection\":[\"Spark\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\",\"name\":\"How does Broadcast Nested Loop Join work in Spark? - Big Data In Real World\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\",\"datePublished\":\"2021-01-08T12:00:18+00:00\",\"dateModified\":\"2023-02-19T13:31:58+00:00\",\"description\":\"Short and easy to understand post on all you need to know about Broadcast Nested Loop join in Spark.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.bigdatainrealworld.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How does Broadcast Nested Loop Join work in Spark?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"name\":\"Big Data In Real World\",\"description\":\"Learn Big Data from experts!\",\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\",\"name\":\"Big Data In Real World\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"width\":500,\"height\":500,\"caption\":\"Big Data In Real World\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/bigdatainrealworld\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\",\"name\":\"Big Data In Real World\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"caption\":\"Big Data In Real World\"},\"description\":\"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.\",\"sameAs\":[\"https:\/\/www.bigdatainrealworld.com\/\"],\"url\":\"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How does Broadcast Nested Loop Join work in Spark? - Big Data In Real World","description":"Short and easy to understand post on all you need to know about Broadcast Nested Loop join in Spark.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/","og_locale":"en_US","og_type":"article","og_title":"How does Broadcast Nested Loop Join work in Spark? - Big Data In Real World","og_description":"Short and easy to understand post on all you need to know about Broadcast Nested Loop join in Spark.","og_url":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/","og_site_name":"Big Data In Real World","article_publisher":"https:\/\/www.facebook.com\/bigdatainrealworld","article_published_time":"2021-01-08T12:00:18+00:00","article_modified_time":"2023-02-19T13:31:58+00:00","og_image":[{"url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png"}],"author":"Big Data In Real World","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Big Data In Real World","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#article","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/"},"author":{"name":"Big Data In Real World","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67"},"headline":"How does Broadcast Nested Loop Join work in Spark?","datePublished":"2021-01-08T12:00:18+00:00","dateModified":"2023-02-19T13:31:58+00:00","mainEntityOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/"},"wordCount":406,"publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage"},"thumbnailUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png","articleSection":["Spark"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/","url":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/","name":"How does Broadcast Nested Loop Join work in Spark? - Big Data In Real World","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage"},"thumbnailUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png","datePublished":"2021-01-08T12:00:18+00:00","dateModified":"2023-02-19T13:31:58+00:00","description":"Short and easy to understand post on all you need to know about Broadcast Nested Loop join in Spark.","breadcrumb":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#primaryimage","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2020\/12\/Broadcast-Nested-Loop-Join-Spark-stages.png"},{"@type":"BreadcrumbList","@id":"https:\/\/www.bigdatainrealworld.com\/how-does-broadcast-nested-loop-join-work-in-spark\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.bigdatainrealworld.com\/"},{"@type":"ListItem","position":2,"name":"How does Broadcast Nested Loop Join work in Spark?"}]},{"@type":"WebSite","@id":"https:\/\/www.bigdatainrealworld.com\/#website","url":"https:\/\/www.bigdatainrealworld.com\/","name":"Big Data In Real World","description":"Learn Big Data from experts!","publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.bigdatainrealworld.com\/#organization","name":"Big Data In Real World","url":"https:\/\/www.bigdatainrealworld.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","width":500,"height":500,"caption":"Big Data In Real World"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bigdatainrealworld"]},{"@type":"Person","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67","name":"Big Data In Real World","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","caption":"Big Data In Real World"},"description":"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.","sameAs":["https:\/\/www.bigdatainrealworld.com\/"],"url":"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/"}]}},"_links":{"self":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1844"}],"collection":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/comments?post=1844"}],"version-history":[{"count":4,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1844\/revisions"}],"predecessor-version":[{"id":1894,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1844\/revisions\/1894"}],"wp:attachment":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/media?parent=1844"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/categories?post=1844"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/tags?post=1844"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}