{"id":1824,"date":"2021-04-12T06:00:00","date_gmt":"2021-04-12T11:00:00","guid":{"rendered":"https:\/\/www.bigdatainrealworld.com\/?p=1824"},"modified":"2023-02-19T07:31:30","modified_gmt":"2023-02-19T13:31:30","slug":"how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli","status":"publish","type":"post","link":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/","title":{"rendered":"How to see the first few lines from a file in S3 using AWS CLI?"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">This is a very common requirement and it has an easy solution.<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Solution<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">aws s3api get-object to get the object and use to &#8211;range option to fetch only the specified number of bytes.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Since we are just previewing the content, instead of writing to a file we can send the output to standard output by specifying \/dev\/stdout and followed by a pipe to head<\/span><\/p>\n<pre class=\"lang:default decode:true\">[osboxes@wk1 ~]$ aws s3api get-object --bucket hirw-bucket-versions \n--key version-test --range bytes=0-1000 \/dev\/stdout | head\n\nHello, this is VERSION TWO\n\n{\n    \"AcceptRanges\": \"bytes\",\n    \"LastModified\": \"2020-11-18T19:40:35+00:00\",\n    \"ContentLength\": 27,\n    \"ETag\": \"\\\"04cf95a672923b5c021568765b336c4f\\\"\",\n    \"VersionId\": \"8LKeiP26.7WS_CUYUmY_BNmpIX0ljIxa\",\n    \"ContentRange\": \"bytes 0-26\/27\",\n    \"ContentType\": \"binary\/octet-stream\",\n    \"Metadata\": {}<\/pre>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is a very common requirement and it has an easy solution. Solution aws s3api get-object to get the object and use to &#8211;range option to<span class=\"excerpt-hellip\"> [\u2026]<\/span><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29],"tags":[],"class_list":["post-1824","post","type-post","status-publish","format-standard","hentry","category-s3"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to see the first few lines from a file in S3 using AWS CLI? - Big Data In Real World<\/title>\n<meta name=\"description\" content=\"Quick and easy solution to see first few lines from a file in S3.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to see the first few lines from a file in S3 using AWS CLI? - Big Data In Real World\" \/>\n<meta property=\"og:description\" content=\"Quick and easy solution to see first few lines from a file in S3.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\" \/>\n<meta property=\"og:site_name\" content=\"Big Data In Real World\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/bigdatainrealworld\" \/>\n<meta property=\"article:published_time\" content=\"2021-04-12T11:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-19T13:31:30+00:00\" \/>\n<meta name=\"author\" content=\"Big Data In Real World\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Big Data In Real World\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\"},\"author\":{\"name\":\"Big Data In Real World\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\"},\"headline\":\"How to see the first few lines from a file in S3 using AWS CLI?\",\"datePublished\":\"2021-04-12T11:00:00+00:00\",\"dateModified\":\"2023-02-19T13:31:30+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\"},\"wordCount\":82,\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"articleSection\":[\"S3\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\",\"name\":\"How to see the first few lines from a file in S3 using AWS CLI? - Big Data In Real World\",\"isPartOf\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\"},\"datePublished\":\"2021-04-12T11:00:00+00:00\",\"dateModified\":\"2023-02-19T13:31:30+00:00\",\"description\":\"Quick and easy solution to see first few lines from a file in S3.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.bigdatainrealworld.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to see the first few lines from a file in S3 using AWS CLI?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#website\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"name\":\"Big Data In Real World\",\"description\":\"Learn Big Data from experts!\",\"publisher\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#organization\",\"name\":\"Big Data In Real World\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"contentUrl\":\"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png\",\"width\":500,\"height\":500,\"caption\":\"Big Data In Real World\"},\"image\":{\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/bigdatainrealworld\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67\",\"name\":\"Big Data In Real World\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g\",\"caption\":\"Big Data In Real World\"},\"description\":\"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.\",\"sameAs\":[\"https:\/\/www.bigdatainrealworld.com\/\"],\"url\":\"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to see the first few lines from a file in S3 using AWS CLI? - Big Data In Real World","description":"Quick and easy solution to see first few lines from a file in S3.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/","og_locale":"en_US","og_type":"article","og_title":"How to see the first few lines from a file in S3 using AWS CLI? - Big Data In Real World","og_description":"Quick and easy solution to see first few lines from a file in S3.","og_url":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/","og_site_name":"Big Data In Real World","article_publisher":"https:\/\/www.facebook.com\/bigdatainrealworld","article_published_time":"2021-04-12T11:00:00+00:00","article_modified_time":"2023-02-19T13:31:30+00:00","author":"Big Data In Real World","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Big Data In Real World","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/#article","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/"},"author":{"name":"Big Data In Real World","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67"},"headline":"How to see the first few lines from a file in S3 using AWS CLI?","datePublished":"2021-04-12T11:00:00+00:00","dateModified":"2023-02-19T13:31:30+00:00","mainEntityOfPage":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/"},"wordCount":82,"publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"articleSection":["S3"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/","url":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/","name":"How to see the first few lines from a file in S3 using AWS CLI? - Big Data In Real World","isPartOf":{"@id":"https:\/\/www.bigdatainrealworld.com\/#website"},"datePublished":"2021-04-12T11:00:00+00:00","dateModified":"2023-02-19T13:31:30+00:00","description":"Quick and easy solution to see first few lines from a file in S3.","breadcrumb":{"@id":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.bigdatainrealworld.com\/how-to-see-the-first-few-lines-from-a-file-in-s3-using-aws-cli\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.bigdatainrealworld.com\/"},{"@type":"ListItem","position":2,"name":"How to see the first few lines from a file in S3 using AWS CLI?"}]},{"@type":"WebSite","@id":"https:\/\/www.bigdatainrealworld.com\/#website","url":"https:\/\/www.bigdatainrealworld.com\/","name":"Big Data In Real World","description":"Learn Big Data from experts!","publisher":{"@id":"https:\/\/www.bigdatainrealworld.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.bigdatainrealworld.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.bigdatainrealworld.com\/#organization","name":"Big Data In Real World","url":"https:\/\/www.bigdatainrealworld.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/","url":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","contentUrl":"https:\/\/www.bigdatainrealworld.com\/wp-content\/uploads\/2023\/02\/black.png","width":500,"height":500,"caption":"Big Data In Real World"},"image":{"@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/bigdatainrealworld"]},{"@type":"Person","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/24cab2292ef49c73053440c86515ef67","name":"Big Data In Real World","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.bigdatainrealworld.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d332bc24fe9b3182f0a22135f163ac4e?s=96&d=retro&r=g","caption":"Big Data In Real World"},"description":"We are a group of Big Data engineers who are passionate about Big Data and related Big Data technologies. We have designed, developed, deployed and maintained Big Data applications ranging from batch to real time streaming big data platforms. We have seen a wide range of real world big data problems, implemented some innovative and complex (or simple, depending on how you look at it) solutions.","sameAs":["https:\/\/www.bigdatainrealworld.com\/"],"url":"https:\/\/www.bigdatainrealworld.com\/author\/bigdatainrealworld\/"}]}},"_links":{"self":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1824"}],"collection":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/comments?post=1824"}],"version-history":[{"count":2,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1824\/revisions"}],"predecessor-version":[{"id":2045,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/posts\/1824\/revisions\/2045"}],"wp:attachment":[{"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/media?parent=1824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/categories?post=1824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bigdatainrealworld.com\/wp-json\/wp\/v2\/tags?post=1824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}