S3
- How to use Object Storage
- What We Are Going To Cover
- Prerequisites
- Creating a new object storage container
- Viewing the container
- Creating a new folder
- Navigating through folders
- Uploading a file
- Deleting files and folders from a container
- Recommended number of files in your object storage containers
- Working with public object storage containers
- What To Do Next
- How to access private object storage using S3cmd or boto3
- Configuration files for s3cmd command
- How to Mount Object Storage Container as a File System in Linux Using s3fs
- S3FS Cache
- How to mount object storage container from Destination Earth as file system on local Windows computer
- Prerequisites
- What We Are Going To Cover
- Software tools used in this article: Rclone, WinFSP, and NSSM
- How to use the Rclone configuration file
- Step 1 Download and install the appropriate software
- Step 2: Enter the connection data
- Step 3: Perform a test mount
- Step 4: Tweak the –dir-cache-time option
- Step 5: Configure automatic mounting of your container
- Removing software responsible for automatic mounting of object storage
- What To Do Next
- How to Delete Large S3 Bucket
- How to install s3cmd on Linux
- How to access object storage using s3cmd
- What We Are Going To Cover
- Prerequisites
- Object storage vs. standard file system
- Terminology: container and bucket
- Configuring s3cmd
- S3 paths in s3cmd
- Listing containers
- Creating a container
- Uploading a file to a container
- Listing files and folders of the root directory of a container
- Listing files and folders not in the root directory of a container
- Removing a file from a container
- Downloading a file from a container
- Checking how much storage is being used on a container
- Removing the entire container
- What To Do Next
- S3 bucket object versioning
- Prerequisites
- Configuring and testing AWS CLI
- Assigning bucket names to shell variables
- Creating a bucket without versioning
- Enabling versioning on a bucket
- Uploading file
- S3 paths
- Uploading another version of a file
- Listing available versions of a file
- Downloading a chosen version of the file
- Deleting objects on version-enabled buckets
- Using lifecycle policy to configure automatic deletion of previous versions of files
- Suspending versioning
- What To Do Next
- Using Cyberduck with S3-compatible object storage on Destination Earth
- Prerequisites
- Connecting to S3 object storage
- Understanding the Cyberduck browser
- Creating and organizing buckets
- Uploading, downloading, and deleting objects
- Working with the Info panel
- Viewing permissions in Cyberduck
- Creating a temporary signed download link
- Synchronizing a local folder with a bucket prefix
- Troubleshooting the connection
- Cyberduck on Linux
- What To Do Next
- Sharing S3 buckets between OpenStack projects using bucket policies on Destination Earth
- S3 data-sharing and backup scenarios
- Choosing the correct workflow
- Prerequisites
- Scenario 1: Share an OpenStack bucket with another project
- Scenario 2: Give temporary access to one private object
- Scenario 3: Copy data from standalone S3 object service to OpenStack Object Storage
- Scenario 4: Copy data from OpenStack Object Storage to Standalone S3 Object Service
- Scenario 5: Collect submissions through upload-only prefixes
- Scenario 6: Create a shared collaboration prefix
- Scenario 7: Maintain a second S3 copy as a backup
- Scenario 8: Recover after an overwrite or deletion
- Verifying a sharing or transfer workflow
- Revoking access and cleaning up
- What To Do Next
- Protecting S3 objects with Object Lock
- Prerequisites
- Understanding Object Lock
- Configure and test AWS CLI
- Create an Object Lock-enabled bucket
- Configure default retention
- Upload and inspect a protected object
- Test deletion protection
- Apply retention to an individual object version
- Apply and remove a legal hold
- Bypass Governance retention
- Remove the default retention rule
- Delete objects and the bucket after retention expires
- Sharing locked objects with another project
- Troubleshooting
- What To Do Next