AWS S3

Creator

Creator

Seonglae Cho

Created

Created

2022 Feb 19 13:20

Editor

Editor

Seonglae Cho

Edited

Edited

2026 Sep 28 14:29

Refs

Refs

Substitute

Backblaze B2

Wasabi

Formats

Parquet

Client

s3mini
good-lly • Updated 2026 Sep 21 3:36

s5cmd
peak • Updated 2026 Sep 28 5:18

Signed URL

30 seconds signed url

S3 Files

S3 buckets can be mounted and used like a filesystem.

S3 Files: when you want to access S3 data like regular files.

FSx: when you need a high-performance filesystem for traditional NAS/HPC/GPU clusters.

Launching S3 Files, making S3 buckets accessible as file systems | Amazon Web Services

Amazon S3 Files makes S3 buckets accessible as high-performance file systems on AWS compute resources, eliminating the tradeoff between object storage benefits and interactive file capabilities while enabling seamless data sharing with ~1ms latencies.

https://aws.amazon.com/pt/blogs/aws/launching-s3-files-making-s3-buckets-accessible-as-file-systems/

Launching S3 Files, making S3 buckets accessible as file systems | Amazon Web Services

Applications can now add data to existing objects in S3

Amazon S3 Express One Zone now supports the ability to append data to an object - AWS

Discover more about what's new at AWS with Amazon S3 Express One Zone now supports the ability to append data to an object

https://aws.amazon.com/ko/about-aws/whats-new/2024/11/amazon-s3-express-one-zone-append-data-object/

Amazon S3 Express One Zone now supports the ability to append data to an object - AWS

Conditional writes

Amazon S3 adds new functionality for conditional writes - AWS

Discover more about what's new at AWS with Amazon S3 adds new functionality for conditional writes

https://aws.amazon.com/ko/about-aws/whats-new/2024/11/amazon-s3-functionality-conditional-writes/

Amazon S3 adds new functionality for conditional writes - AWS

S3 Is Showing Its Age

I'm squarely in the trough of disillusionment with S3.

https://materializedview.io/p/s3-is-showing-its-age

S3 Is Showing Its Age

Express One Zone

S3 Express One Zone, not quite what I hoped for — Jack Vanlightly

AWS just announced a new lower-latency S3 storage class and for those of us in the data infrastructure business, this is big news. It’s not a secret that a low-latency object storage primitive has the potential to change how we build cloud data systems forever. So has this new world arrived with S

https://jack-vanlightly.com/blog/2023/11/29/s3-express-one-zone-not-quite-what-i-hoped-for

S3 Express One Zone, not quite what I hoped for — Jack Vanlightly

AWS S3: Why sometimes you should press the $100k button | cyclic.sh

TLDR: Mere mortals implement best practices for S3 read and write performance, create a million billion s3 objects with their high performance system, try to clean up the really really expensive mess and find themselves in a dimension as vast as space and as timeless as infinity.

AWS S3: Why sometimes you should press the $100k button | cyclic.sh

https://www.cyclic.sh/posts/aws-s3-why-sometimes-you-should-press-the-100k-dollar-button

AWS S3: Why sometimes you should press the $100k button | cyclic.sh

S3 is files, but not a filesystem

"Deep" modules, mismatched interfaces - and why SAP is so painful

https://calpaterson.com/s3.html

S3 is files, but not a filesystem

s3 as a log

Building a distributed log using S3 (under 150 lines of Go) - blag

In this third part of the series, I will show how we can implement a durable, distributed, and highly available log using S3

https://avi.im/blag/2024/s3-log/

ScopeDB on top of S3

Introducing ScopeDB: Manage Data in Petabytes for An Observability Platform | ScopeDB

https://www.scopedb.io/blog/manage-observability-data-in-petabytes

security

8 Million Requests Later, We Made The SolarWinds Supply Chain Attack Look Amateur

Surprise surprise, we've done it again. We've demonstrated an ability to compromise significantly sensitive networks, including governments, militaries, space agencies, cyber security companies, supply chains, software development systems and environments, and more. “Ugh, won’t they just stick to creating poor-quality memes?” we hear you moan. Maybe we should, maybe

https://labs.watchtowr.com/8-million-requests-later-we-made-the-solarwinds-supply-chain-attack-look-amateur/

8 Million Requests Later, We Made The SolarWinds Supply Chain Attack Look Amateur

S3 Is the Future, S3 Is the Past

Better building blocks for the cloud: storage infrastructure rebuilt for modern SSDs, fast networks, and AI-era workloads.

https://btrblocks.com/blog/s3_is_the_future_and_the_past/

Backlinks

Cloudflare R2 Cloudflare Data Service Apache Iceberg Object Storage Standard

Recommendations

//////