{"id":1678,"date":"2020-12-25T06:00:15","date_gmt":"2020-12-25T12:00:15","guid":{"rendered":"https:\/\/www.bigdatainrealworld.com\/?p=1678"},"modified":"2023-02-19T07:32:13","modified_gmt":"2023-02-19T13:32:13","slug":"what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands","status":"publish","type":"post","link":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/","title":{"rendered":"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands?"},"content":{"rendered":"

If you are trying to access HDFS, you might have come across the below three types of commands. In this post we will see the difference between the 3 of them.<\/p>\n

    \n
  1. hadoop fs {args}<\/li>\n
  2. hadoop dfs {args}<\/li>\n
  3. hdfs dfs {args}<\/li>\n<\/ol>\n

    hadoop fs {args}<\/span><\/h2>\n

    In the above command, fs refers to a generic file system and can point to your local file system, HDFS and other file systems like S3, SFTP etc.<\/span><\/p>\n

    hadoop dfs {args}<\/span><\/h2>\n

    hadoop dfs commands are used when you are working with HDFS and not with other file systems. Note that this command is deprecated and when you use this command it is delegated to hdfs dfs command.<\/span><\/p>\n

    hdfs dfs {args}<\/span><\/h2>\n

    As the command itself suggests, the command is specific to HDFS and use this when you are working with hdfs.<\/span><\/p>\n

    In summary, hadoop fs is versatile and can work with many file systems including HDFS. hdfs dfs works with HDFS and use it if your only need is to access HDFS.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

    If you are trying to access HDFS, you might have come across the below three types of commands. In this post we will see the difference [\u2026]<\/span><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,28],"tags":[],"class_list":["post-1678","post","type-post","status-publish","format-standard","hentry","category-hadoop","category-hdfs"],"yoast_head":"\nWhat is the difference between hadoop fs, hadoop dfs and hdfs dfs commands? - Big Data In Real World<\/title>\n<meta name=\"description\" content=\"hadoop fs vs. hadoop dfs vs. hdfs dfs - differences and which one to use\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands? - Big Data In Real World\" \/>\n<meta property=\"og:description\" content=\"hadoop fs vs. hadoop dfs vs. hdfs dfs - differences and which one to use\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\" \/>\n<meta property=\"og:site_name\" content=\"Big Data In Real World\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bigdatainrealworld\" \/>\n<meta property=\"article:published_time\" content=\"2020-12-25T12:00:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-19T13:32:13+00:00\" \/>\n<meta name=\"author\" content=\"Big Data In Real World\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Big Data In Real World\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\"},\"author\":{\"name\":\"Big Data In Real World\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\"},\"headline\":\"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands?\",\"datePublished\":\"2020-12-25T12:00:15+00:00\",\"dateModified\":\"2023-02-19T13:32:13+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\"},\"wordCount\":176,\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"articleSection\":[\"Hadoop\",\"HDFS\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\",\"name\":\"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands? - Big Data In Real World\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\"},\"datePublished\":\"2020-12-25T12:00:15+00:00\",\"dateModified\":\"2023-02-19T13:32:13+00:00\",\"description\":\"hadoop fs vs. hadoop dfs vs. hdfs dfs - differences and which one to use\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.bigdatainrealworld.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"name\":\"Big Data In Real World\",\"description\":\"Learn Big Data from experts!\",\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\",\"name\":\"Big Data In Real World\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"width\":500,\"height\":500,\"caption\":\"Big Data In Real World\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/bigdatainrealworld\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\",\"name\":\"Big Data In Real World\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"caption\":\"Big Data In Real World\"},\"description\":\"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.\",\"sameAs\":[\"https:\/\/www.bigdatainrealworld.com\/\"],\"url\":\"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands? - Big Data In Real World","description":"hadoop fs vs. hadoop dfs vs. hdfs dfs - differences and which one to use","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/","og_locale":"en_US","og_type":"article","og_title":"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands? - Big Data In Real World","og_description":"hadoop fs vs. hadoop dfs vs. hdfs dfs - differences and which one to use","og_url":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/","og_site_name":"Big Data In Real World","article_publisher":"https:\/\/www.facebook.com\/bigdatainrealworld","article_published_time":"2020-12-25T12:00:15+00:00","article_modified_time":"2023-02-19T13:32:13+00:00","author":"Big Data In Real World","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Big Data In Real World","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/#article","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/"},"author":{"name":"Big Data In Real World","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67"},"headline":"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands?","datePublished":"2020-12-25T12:00:15+00:00","dateModified":"2023-02-19T13:32:13+00:00","mainEntityOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/"},"wordCount":176,"publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"articleSection":["Hadoop","HDFS"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/","url":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/","name":"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands? - Big Data In Real World","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/#website"},"datePublished":"2020-12-25T12:00:15+00:00","dateModified":"2023-02-19T13:32:13+00:00","description":"hadoop fs vs. hadoop dfs vs. hdfs dfs - differences and which one to use","breadcrumb":{"@id":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.bigdatainrealworld.com\/what-is-the-difference-between-hadoop-fs-hadoop-dfs-and-hdfs-dfs-commands\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.bigdatainrealworld.com\/"},{"@type":"ListItem","position":2,"name":"What is the difference between hadoop fs, hadoop dfs and hdfs dfs commands?"}]},{"@type":"WebSite","@id":"https:\/\/www.bigdatainrealworld.com\/#website","url":"https:\/\/www.bigdatainrealworld.com\/","name":"Big Data In Real World","description":"Learn Big Data from experts!","publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.bigdatainrealworld.com\/#organization","name":"Big Data In Real World","url":"https:\/\/www.bigdatainrealworld.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","width":500,"height":500,"caption":"Big Data In Real World"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bigdatainrealworld"]},{"@type":"Person","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67","name":"Big Data In Real World","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","caption":"Big Data In Real World"},"description":"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.","sameAs":["https:\/\/www.bigdatainrealworld.com\/"],"url":"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/"}]}},"_links":{"self":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1678"}],"collection":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/comments?post=1678"}],"version-history":[{"count":2,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1678\/revisions"}],"predecessor-version":[{"id":1680,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1678\/revisions\/1680"}],"wp:attachment":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/media?parent=1678"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/categories?post=1678"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/tags?post=1678"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}