Limitations in S3 interface for MSDP
S3 interface for MSDP has the following limitations:
1000 buckets in one S3 server.
Recommend 500~800 concurrent requests based on your MSDP server performance.
Small file must be less than 1 MB. A tar compress file of small files must be less than 5 GB. The number of small files in small files tar compress file should be less than 10000.
One object size must be less than 5 TB.
Multipart upload limitation. See Amazon S3 multipart upload limits
The S3 interface for MSDP does not support Amazon S3 Glacier, Deep Archive, and Microsoft Azure Archive.
When you configure S3 server, the client's name in the OST plug-in should avoid #s3storage.
Before you change the back-end WORM mode, ensure that all the multipart uploads are completed.
Objects cannot be copied across different storage servers.
Objects greater than 5 GB cannot be copied.
UploadPartCopy API is not supported. If you copy the objects that are uploaded by UploadPart, the created objects will be single objects without any parts.
The S3 interface for MSDP does not support AWS Command Line Interface version 2.23.0 or later as these versions use chunked uploads with trailers for PUT actions such as PutObject and UploadPart.