mohanar/push_data_to_s3 repository overview

This image contains a python code which copied files matching a pattern in a session level resource into an S3 bucket.

USAGE:

push_data_to_s3.py --xnat_session_label MR_SESSION_LABEL --bucket BUCKET_NAME --aws_access_key AWS_ACCESS_KEY --aws_secret_access_key AWS_SECRET_ACCESS_KEY --resource RESOURCE_NAME --fileglob "**/a1_2*.txt"

OR

push_data_to_s3.py --xnat_session_label MR_SESSION_LABEL --bucket BUCKET_NAME --aws_access_key AWS_ACCESS_KEY --aws_secret_access_key AWS_SECRET_ACCESS_KEY --resource RESOURCE_NAME --fileglob "**/a1_2*.txt" --flatten

NOTES:

a) --fileglob "**/a1_2*.txt" enables looking into subdirectory b) The default behaviour is to create relative sub-paths into the S3 Bucket. You can override this by using the --flatten flag.