javamaster/s3pt repository overview

S3 Performance Test Tool

⁠Build:

(requires Java 8 or higher)

docker run -it javamaster/s3pt

⁠Usage by example:

⁠UPLOAD of n randomly generated files (key = UUID), each 2kB size

docker run -it javamaster/s3pt --accessKey <accessKey> --secretKey <secretKey> --bucketName <bucketName> -n <number of files to upload> -s 2048

⁠RANDOM_READ with 4 parallel threads, each 10.000 reads = 40.000 requests

docker run -it javamaster/s3pt--accessKey <accessKey> --secretKey <secretKey> --bucketName <bucketName> --operation=RANDOM_READ -n 10000 -t 4

UPLOAD --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=UPLOAD -n 10 --size 8192

CREATE_BUCKET --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=CREATE_BUCKET -n 10

CLEAR_BUCKET --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=CLEAR_BUCKET -n 10

DELETE_BUCKET --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=DELETE_BUCKET -n 10

CREATE_KEY_FILE --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=CREATE_KEY_FILE -n 10 --keyFileName s3pt_key_file

RANDOM_READ --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=RANDOM_READ -n 10

RANDOM_WRITE --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=RANDOM_WRITE -n 10 --keyFileName s3pt_key_file

RANDOM_READ_METADATA --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=RANDOM_READ_METADATA -n 10 --keyFileName s3pt_key_file

UPLOAD_AND_READ --accessKey AKIAI6T7MIUG4MJ6IA3Q --secretKey 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 --bucketName patrick-realestate-llc --operation=UPLOAD_AND_READ -n 10 --size 8192

⁠General usage:

docker run -it javamaster/s3pt [options...]
 --accessKey VAL      : access key ID; also possible to set AWS_ACCESS_KEY int
                        environment
 --bucketName VAL     : name of bucket
 --endpointUrl VAL    : endpoint url (default: s3.amazonaws.com)
 --gzip               : use gzip (default: false)
 --http               : use http instead of https (default: false)
 --keepAlive          : use TCP keep alive (default: false)
 --keyFileName VAL    : name of file with object keys
 --operation VAL      : operation (default: UPLOAD)
 --secretKey VAL      : secret access key; also possible to set AWS_SECRET_KEY
                        in environment
 --signerOverride VAL : override the S3 signer (e.g. 'S3Signer' or
                        'AWSS3V4Signer')
 --size N             : file size (e.g. for UPLOAD); supported units: B, K, M
                        (default: 131072)
 --usePathStyleAccess : use path-style access (instead of DNS-style) (default:
                        false)
 -n (--number) N      : number of operations
 -t (--threads) N     : number of threads (default: 1)

To print the usage information execute docker run -it javamaster/s3pt on the command line.