AWS Storage Services Technologies for Cloud and DevOps Engineers

📝Introduction

In this post, we will cover the main Technologies from AWS Storage Services.

📝AWS S3 Storage Services

• AWS S3 (Amazon Simple Storage) -> It allows you to store objects in the cloud and offers scalability, data availability, security, and performance. In this lesson, we cover what S3 is and the many object storage classes.

  • It is an object storage service for the cloud that is highly available.

  • Objects (or files) are stored in buckets (or directories).

  • Objects can be public or private.

  • Essentially unlimited storage that can hold millions of objects per bucket.

  • You can upload objects via the console, the CLI, or programmatically from within code using SDKs.

  • You can set security at the bucket level or individual object level using access control lists (ACLs), bucket policies, or access point policies.

  • You can enable versioning to create multiple versions of your file to protect against accidental deletion and to use a previous version.

  • You can use S3 access logs to track access to your buckets and objects.

  • S3 is a regional service, but bucket names must be globally unique.

  • Data Accessibility:

    • Durability and availability are 2 very different aspects of data accessibility.

      • Durability -> It is important so your objects are never lost or compromised. Amazon S3 Standard is designed for 99.999999999%

        (11 9’s) of durability.

      • Availability -> It is important so you can access your data quickly when you need it. Amazon S3 Standard is designed for 99.99% availability.

  • S3 Storage Classes -> Amazon S3 offers several storage classes designed for different use cases.

    • S3 Standard

      

    • S3 Intelligent-Tiering

      

    • S3 Standard-Infrequent Access(IA)

      

    • S3 One Zone-Infrequent Access(IA)

      

    • S3 Glacier

      

    • S3 Glacier Deep Archive

      

    • S3 Outposts

      

  • S3 in the Real World Scenarios:

    • Static Websites -> Deploy static websites to S3 and use CloudFront for global distribution.

    • Data Archive -> Archive data using Amazon Glacier as a storage option

      for Amazon S3.

    • Analytics System -> Store data in Amazon S3 for use with analytics services like Redshift and Athena.

    • Mobile Applications -> Mobile application users can upload files to an Amazon S3 bucket.

📝AWS Additional Storage Services

• EC2 Storage -> It supports several storage options for your instances.

  • AWS Elastic Block Storage (EBS) -> It is a storage device (called a volume) that can be attached to (or removed from) your instance.

    • Data persists when the instance is not running

    • Can only be attached to one instance in the same Availability Zone

    • Tied to one Availability Zone

    • Recommended for:

      • Quickly accessible data

      • Running a database on an instance

      • Long-term data storage

• EC2 Instance Store -> It is local storage that is physically attached to the host computer and cannot be removed.

  • Storage on disks physically attached to an instance

  • Storage is temporary since data loss occurs when the EC2 instance is stopped

  • Faster with higher I/O speeds

  • Do not forget instance store volumes are ephemeral or temporary

  • Recommended for:

    • Temporary storage needs

    • Data replicated across multiple instances

• AWS Elastic File System (EFS) -> EFS is a serverless network file system for sharing files.

  • Only supports the Linux file system

  • Accessible across different Availability Zones in the same Region

  • More expensive than EBS

  • Recommended for:

    • Main directories for business-critical apps

    • Lift-and-shift existing enterprise apps

• Storage Gateway -> It is a hybrid storage service.

  • Connect on-premises and cloud data

  • Supports a hybrid model

  • Recommended for:

    • Moving backups to the cloud

    • Reducing costs for hybrid cloud storage

    • Low latency access to data

• AWS Backup -> It helps you manage data backups across multiple AWS services.

  • Integrates with resources like EC2, EBS, EFS, and more

  • Create a backup plan that includes frequency and retention

    

• AWS FSx -> It makes it easy and cost-effective to launch, run, and scale feature-rich, high-performance file systems in the cloud.

  • It supports a wide range of workloads with its reliability, security, scalability, and broad set of capabilities

  • Built on the latest AWS compute, networking, and disk technologies to provide high performance and lower TCO

  • Fully managed service, it handles hardware provisioning, patching, and backups -- freeing you up to focus on your applications, your end users, and your business

  • You can choose between four widely-used file systems: NetApp ONTAP, OpenZFS, Windows File Server, and Lustre

    

• AWS Snowcone -> Deploy ultra-portable data transfer and edge computing devices anywhere.

  • Collect and process data, transfer with AWS DataSync, or ship the device with data to AWS for offline transfer

  • Get the compute, storage, and network accessibility you need in a portable device, deployed virtually anywhere

  • Withstands harsh environments with a storage and computing device designed to meet stringent standards for ruggedization

  • AWS Snowcone is a small, rugged, and secure device offering edge computing, data storage, and data transfer on-the-go, in an austere environment with little or no connectivity

• AWS Snowmobile -> Migrate or transport exabyte-scale datasets into and out of AWS

  • Quickly and securely transfer up to 100 petabytes of data in as little as a few weeks

  • Protect your data in a tamper-resistant, water-resistant, and temperature-controlled container with limited physical access

  • Quickly retrieve data from the cloud whenever you need it

  • AWS Snowmobile moves extremely large amounts of data to AWS. Transfer up to 100 PB per Snowmobile, a 45-foot-long ruggedized shipping container pulled by a semi-trailer truck

• AWS Snowball -> Accelerate moving offline data or remote storage to the cloud.

  • Easily migrate terabytes of data to the cloud without limits in storage capacity or compute power

  • Accelerate application performance in disconnected, austere edge environments and run compute workloads with little or no connectivity

  • Protect your data in transit with Snowball’s ruggedized chassis, integrated logistics, and tamper-evident box, and get data to the right place quickly

  • Migrate petabyte-scale data to AWS with Snowball. For jobs that require multiple devices, track the stage of your device with Snow's Large Data Migration Manager

    

Thank you for reading. I hope you were able to understand and learn something helpful from my blog.

Please follow me on Hashnode and on LinkedIn franciscojblsouza