Module 5 - Storage
Unit notes:
“How AWS Partners Are Utilizing Amazon S3 to Help Customers Solve
for Scale” in the AWS Partner Network (APN) Blog https://aws.amazon.com/blogs/apn/how-aws-partners-are-utilizing-amazon-s3-to-help-customers-solve-for-scale/.
“Creating object key names” in the Amazon Simple Storage Service
User Guide https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-keys.html.
“Blocking public access to your Amazon S3 storage” in the Amazon
Simple Storage Service User Guide https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-control-block-public-access.html.
“Using versioning in S3 buckets” https://docs.aws.amazon.com/AmazonS3/latest/dev/Versioning.html.
“Using S3 Object Lock” https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock.html.
“Amazon S3 pricing” https://aws.amazon.com/s3/pricing/.
“Amazon S3 Glacier storage classes” https://aws.amazon.com/glacier/.
“Amazon S3 Glacier pricing” https://aws.amazon.com/glacier/pricing/.
“Transitioning objects using Amazon S3 Lifecycle” https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-transition-general-considerations.html.
“Protecting data using server-side encryption” in the Amazon
Simple Storage Service User Guide https://docs.aws.amazon.com/AmazonS3/latest/userguide/serv-side-encryption.html.
“How to meet business data resiliency with Amazon S3 cross-Region
replication” in the AWS Public Sector Blog https://aws.amazon.com/blogs/publicsector/how-to-meet-business-data-resiliency-s3-cross-region-replication/.
“Amazon S3 Replication” https://aws.amazon.com/s3/features/replication/.
“Reliable event processing with Amazon S3 event notifications" on
the AWS Storage Blog https://aws.amazon.com/blogs/storage/reliable-event-processing-with-amazon-s3-event-notifications/.
“S3 Transfer Acceleration” https://aws.amazon.com/s3/transfer-acceleration/.
“Uploading and copying objects using multipart upload” in the
Amazon Simple Storage Service User Guide https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html.
“Introducing Amazon S3 Object Lambda – Use Your Code to Process
Data as It Is Being Retrieved from S3” in the AWS Storage Blog https://aws.amazon.com/blogs/aws/introducing-amazon-s3-object-lambda-use-your-code-to-process-data-as-it-is-being-retrieved-from-s3/.
“Amazon S3 pricing” https://aws.amazon.com/s3/pricing/.
“Attach a volume to multiple instances with Amazon EBS
Multi-Attach” in the Amazon Elastic Compute Cloud User Guide for
Linux Instances https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-volumes-multi.html.
“File Systems for Enterprise Applications” https://aws.amazon.com/efs/enterprise-applications/.
“Windows home directories made easy with Amazon FSx” in the AWS
Storage Blog. https://aws.amazon.com/blogs/storage/windows-home-directories-and-file-shares-made-easy-with-amazon-fsx/.
“Mounting from an Amazon Elastic Compute Cloud instance” in the
FSx for Lustre User Guide https://docs.aws.amazon.com/fsx/latest/LustreGuide/mounting-ec2-instance.html.
“What is Amazon FSx for Lustre?” in the FSx for Lustre User Guide
https://docs.aws.amazon.com/fsx/latest/LustreGuide/what-is.html.
“Comparing your on-premises storage patterns with AWS Storage
services” in the AWS Storage Blog https://aws.amazon.com/blogs/storage/comparing-your-on-premises-storage-patterns-with-aws-storage-services/.
“AWS Snowball FAQs” https://aws.amazon.com/snowball/faqs/.
“AWS Snowball Edge Specifications” https://docs.aws.amazon.com/snowball/latest/developer-guide/specifications.html.
“AWS Snowmobile” https://aws.amazon.com/snowmobile/.
“AWS Snow Family” https://aws.amazon.com/snow/.
“Protecting Data On Your Device” in the AWS Snowball User Guide https://docs.aws.amazon.com/snowball/latest/ug/data-protection-device.html.
“Cloud storage in minutes with AWS Storage Gateway (updated)” in
the AWS Storage Blog https://aws.amazon.com/blogs/storage/cloud-storage-in-minutes-with-aws-storage-gateway-updated/.
“AWS Storage Gateway Adds SMB Support to Store and Access Objects
in Amazon S3 Buckets” https://aws.amazon.com/about-aws/whats-new/2018/06/aws-storage-gateway-adds-smb-support-to-store-objects-in-amazon-s3/.
Limits & Quotas
EFS https://docs.aws.amazon.com/efs/latest/ug/limits.html
EFx/Windows https://docs.aws.amazon.com/fsx/latest/WindowsGuide/limits.html
S3 https://docs.aws.amazon.com/general/latest/gr/s3.html
S3 Bucket restrictions & limitations https://docs.aws.amazon.com/AmazonS3/latest/userguide/BucketRestrictions.html
Storage Gateway https://docs.aws.amazon.com/storagegateway/latest/userguide/resource-gateway-limits.html
DataSync https://docs.aws.amazon.com/datasync/latest/userguide/datasync-limits.html
Transfer Family https://docs.aws.amazon.com/general/latest/gr/transfer-service.html
S3 https://aws.amazon.com/s3/
S3 Documentation https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html
Glacier Documentation https://docs.aws.amazon.com/amazonglacier/latest/dev/introduction.html
S3 Storage Classes https://aws.amazon.com/s3/storage-classes/
Creating object key names https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-keys.html
Versioning https://docs.aws.amazon.com/AmazonS3/latest/userguide/Versioning.html
Replicating objects https://docs.aws.amazon.com/AmazonS3/latest/userguide/replication.html
Lifecycles https://docs.aws.amazon.com/AmazonS3/latest/userguide/lifecycle-transition-general-considerations.html
Object Locks https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-lock.html
Setting Bucket and Object Access Permissions https://docs.aws.amazon.com/AmazonS3/latest/user-guide/set-permissions.html
Blocking public access https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-control-block-public-access.html
S3 Glacier storage classes https://aws.amazon.com/s3/storage-classes/glacier/
S3 Transfer Acceleration Speed Test https://s3-accelerate-speedtest.s3-accelerate.amazonaws.com/en/accelerate-speed-comparsion.html
EFS https://aws.amazon.com/efs/
Documentation https://docs.aws.amazon.com/efs/latest/ug/whatisefs.html
Use Cases https://aws.amazon.com/efs/enterprise-applications/
Replication https://docs.aws.amazon.com/efs/latest/ug/efs-replication.html
FSx for Windows https://aws.amazon.com/fsx/windows/?nc=sn&loc=2
Documentation https://docs.aws.amazon.com/fsx/latest/WindowsGuide/what-is.html
Using Microsoft Windows file shares https://docs.aws.amazon.com/fsx/latest/WindowsGuide/using-file-shares.html
FSx for Lustre https://aws.amazon.com/fsx/lustre/?nc=sn&loc=3&refid=gs_card
Documentation https://docs.aws.amazon.com/fsx/latest/LustreGuide/what-is.html
Mounting from EC2 https://docs.aws.amazon.com/fsx/latest/LustreGuide/mounting-ec2-instance.html
Snow Family https://aws.amazon.com/snow/?nc2=h_ql_prod_mt_sno
Snowcone https://aws.amazon.com/snowcone/?nc=sn&loc=3&whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc
Snowcone Documentation https://docs.aws.amazon.com/snowball/latest/snowcone-guide/snowcone-what-is-snowcone.html
FAQs https://aws.amazon.com/snowcone/faqs/
Snowball https://aws.amazon.com/snowball/?nc=sn&loc=4&whats-new-cards.sort-by=item.additionalFields.postDateTime&whats-new-cards.sort-order=desc
Snowball Edge Documentation https://docs.aws.amazon.com/snowball/latest/developer-guide/whatisedge.html
FAQs https://aws.amazon.com/snowball/faqs/
Protecting Data On Your Device https://docs.aws.amazon.com/snowball/latest/ug/data-protection-device.html
Snowmobile https://aws.amazon.com/snowmobile/?nc=sn&loc=5
FAQs https://aws.amazon.com/snowmobile/faqs/
Storage Gateway https://aws.amazon.com/storagegateway/
S3 File Gateway https://docs.aws.amazon.com/filegateway/latest/files3/index.html
FSx File Gateway https://docs.aws.amazon.com/filegateway/latest/filefsxw/index.html
Volume Gateway https://docs.aws.amazon.com/storagegateway/latest/userguide/WhatIsStorageGateway.html#volume-gateway
Tape Gateway https://docs.aws.amazon.com/storagegateway/latest/userguide/WhatIsStorageGateway.html#tape-gateway
Feature https://aws.amazon.com/storagegateway/features/
DataSync https://aws.amazon.com/datasync/
Documentation https://docs.aws.amazon.com/datasync/latest/userguide/index.html
Feature https://aws.amazon.com/datasync/features/
Transfer Family https://aws.amazon.com/aws-transfer-family/
Documentation https://docs.aws.amazon.com/transfer/latest/userguide/index.html
Feature https://aws.amazon.com/aws-transfer-family/features/
Mind Maps:
S3 https://www.awsgeek.com/Amazon-S3/
EFS https://www.awsgeek.com/Amazon-EFS/
FSx for Windows https://www.awsgeek.com/Amazon-FSx-for-Windows-File-Server/
Snow family https://www.awsgeek.com/AWS-Snow-Family/
Storage Gateway https://www.awsgeek.com/AWS-Storage-Gateway/
DataSync https://www.awsgeek.com/AWS-DataSync/
Transfer family https://www.awsgeek.com/AWS-Transfer-Family/
Whitepapers:
Storage Best Practices for Data and Analytics Applications https://docs.aws.amazon.com/whitepapers/latest/building-data-lakes/building-data-lake-aws.html?did=wp_card&trk=wp_card
Best Practices Design Patterns: Optimizing Amazon S3 Performance https://docs.aws.amazon.com/whitepapers/latest/s3-optimizing-performance-best-practices/welcome.html?did=wp_card&trk=wp_card
Simple File Manager for Amazon EFS https://d1.awsstatic.com/architecture-diagrams/ArchitectureDiagrams/simple-file-manager-for-amazon-efs-sol.pdf?did=wp_card&trk=wp_card
Encrypting File Data with Amazon Elastic File System https://docs.aws.amazon.com/whitepapers/latest/efs-encrypted-file-systems/efs-encrypted-file-systems.html
Blogs:
Setting up Cross-Region Replication and replicating existing files
https://aws.amazon.com/blogs/big-data/trigger-cross-region-replication-of-pre-existing-objects-using-amazon-s3-inventory-amazon-emr-and-amazon-athena/
How AWS Partners Are Utilizing Amazon S3 to Help Customers Solve
for Scale https://aws.amazon.com/blogs/apn/how-aws-partners-are-utilizing-amazon-s3-to-help-customers-solve-for-scale/
Reliable event processing with Amazon S3 event notifications https://aws.amazon.com/blogs/storage/reliable-event-processing-with-amazon-s3-event-notifications/
Amazon S3 Block Public Access – Another Layer of Protection for
Your Accounts and Buckets https://aws.amazon.com/blogs/aws/amazon-s3-block-public-access-another-layer-of-protection-for-your-accounts-and-buckets/
Changing your Amazon S3 encryption from S3-Managed to AWS KMS https://aws.amazon.com/blogs/storage/changing-your-amazon-s3-encryption-from-s3-managed-encryption-sse-s3-to-aws-key-management-service-sse-kms/
New – Multi-Attach for Provisioned IOPS (io1) Amazon EBS Volumes https://aws.amazon.com/blogs/aws/new-multi-attach-for-provisioned-iops-io1-amazon-ebs-volumes/
Windows home directories made easy with Amazon FSx https://aws.amazon.com/blogs/storage/windows-home-directories-and-file-shares-made-easy-with-amazon-fsx/
Comparing your on-premises storage patterns with AWS Storage
services https://aws.amazon.com/blogs/storage/comparing-your-on-premises-storage-patterns-with-aws-storage-services/
Cloud storage in minutes with AWS Storage Gateway (updated) https://aws.amazon.com/blogs/storage/cloud-storage-in-minutes-with-aws-storage-gateway-updated/
Storage options and designs for VMware Cloud on AWS https://aws.amazon.com/blogs/storage/storage-options-and-designs-for-vmware-cloud-on-aws/
Get Started Using Amazon FSx File Gateway for Fast, Cached Access
to File Server Data in the Cloud https://aws.amazon.com/blogs/aws/get-started-using-amazon-fsx-file-gateway-for-fast-cached-access-to-file-server-data-in-the-cloud/
New – High-Performance HDD Storage for Amazon FSx for Lustre File
Systems https://aws.amazon.com/blogs/aws/new-high-performance-hdd-storage-for-amazon-fsx-for-lustre-file-systems/
Windows home directories made easy with Amazon FSx https://aws.amazon.com/blogs/storage/windows-home-directories-and-file-shares-made-easy-with-amazon-fsx/
Creating and activating File Gateway on VMware https://aws.amazon.com/blogs/storage/creating-and-activating-aws-file-gateway-on-vmware/
Setting up Cross-Region Replication and replicating existing files
https://aws.amazon.com/blogs/big-data/trigger-cross-region-replication-of-pre-existing-objects-using-amazon-s3-inventory-amazon-emr-and-amazon-athena/
Tutorials:
Create and mount an Amazon EFS file system https://aws.amazon.com/getting-started/hands-on/create-mount-amazon-efs-file-system-on-amazon-ec2-using-launch-wizard/?trk=gs_card
Getting started using Amazon S3 Glacier and S3 Glacier Deep
Archive https://aws.amazon.com/getting-started/hands-on/getting-started-using-amazon-s3-glacier-and-s3-glacier-deep-archive/?trk=gs_card
Videos:
AWS Storage - EBS vs S3 vs EFS https://www.youtube.com/watch?v=6vNC_BCqFmI
Now Is The Time To Move To AWS Storage https://youtu.be/qlAw07o5l00
AWS re:Invent 2019: Best practices for Amazon S3 (including
storage classes) https://youtu.be/N_3IaOVcIO0
Amazon FSx for Windows File Server https://youtu.be/IMDWTIShlyI
AWS on Air 2020: AWS What’s Next ft. S3 Encryption &
Networking with S3 PrivateLink & S3 Bucket Keys https://www.youtube.com/watch?v=qvXEJwnJXRA
What's New with Amazon FSx https://www.youtube.com/watch?v=Fm_aaDdROyk
Trainings:
Storage Learning Plan: Object Storage https://explore.skillbuilder.aws/learn/learning_plan/view/51/storage-learning-plan-object-storage -
9 Courses
Storage Learning Plan: File Storage https://explore.skillbuilder.aws/learn/learning_plan/view/95/storage-learning-plan-file-storage -
5 Courses
Amazon Simple Storage Service (Amazon S3) Storage Classes Deep
Dive https://explore.skillbuilder.aws/learn/course/internal/view/elearning/497/amazon-simple-storage-service-amazon-s3-storage-classes-deep-dive
Deep Dive into Amazon Simple Storage Service (Amazon S3) https://explore.skillbuilder.aws/learn/course/internal/view/elearning/147/deep-dive-into-amazon-simple-storage-service-amazon-s3
AWS Snowball Edge Logistics and Planning https://explore.skillbuilder.aws/learn/course/internal/view/elearning/115/aws-snowball-edge-logistics-and-planning
AWS Snowball Edge: Using Snowball Edge https://explore.skillbuilder.aws/learn/course/internal/view/elearning/114/aws-snowball-edge-using-snowball-edge
Getting Started with AWS Storage https://explore.skillbuilder.aws/learn/course/internal/view/elearning/6233/getting-started-with-aws-storage
Deep Dive into Amazon Elastic File System (EFS) https://explore.skillbuilder.aws/learn/course/internal/view/elearning/144/deep-dive-into-amazon-elastic-file-system-efs
Amazon FSx for Windows File Server Primer https://explore.skillbuilder.aws/learn/course/80/amazon-fsx-for-windows-file-server-primer
Amazon FSx for Lustre Primer https://explore.skillbuilder.aws/learn/course/90/amazon-fsx-for-lustre-primer
AWS Storage Gateway Primer: Tape Gateway https://explore.skillbuilder.aws/learn/course/internal/view/elearning/29/aws-storage-gateway-primer-tape-gateway
AWS Storage Gateway Primer: Volume Gateway https://explore.skillbuilder.aws/learn/course/internal/view/elearning/142/aws-storage-gateway-primer-volume-gateway
AWS Storage Gateway Primer: File Gateway https://explore.skillbuilder.aws/learn/course/internal/view/elearning/98/aws-storage-gateway-primer-file-gateway
Deep Dive into AWS Storage Gateway https://explore.skillbuilder.aws/learn/course/internal/view/elearning/216/deep-dive-into-aws-storage-gateway
AWS DataSync Primer https://explore.skillbuilder.aws/learn/course/102/aws-datasync-primer
Labs:
Introduction to Amazon Simple Storage Service (S3) https://amazon.qwiklabs.com/focuses/24214?catalog_rank=%7B%22rank%22%3A2%2C%22num_filters%22%3A0%2C%22has_search%22%3Atrue%7D&parent=catalog&search_id=15162851 -
Free
Introduction to Amazon Elastic File System (EFS) https://amazon.qwiklabs.com/focuses/20532?catalog_rank=%7B%22rank%22%3A1%2C%22num_filters%22%3A0%2C%22has_search%22%3Atrue%7D&parent=catalog&search_id=15162870 Note: This Qwiklabs lab is not free, but you will use
a student account, so there won't be any AWS charges.
Previous Top
Next