Sign inSign up

vemonet/data2services-download

By vemonet

•Updated almost 7 years ago

Shell scripts to download datasets for the Data2Services project.

Image
1

1.4K

vemonet/data2services-download repository overview

⁠Get started

A project to automate the download of datasets for the data2services-pipeline⁠ using Shell scripts run in a Ubuntu Docker image⁠.

⁠Build or pull

docker pull vemonet/data2services-download
docker build -t vemonet/data2services-download .

⁠Run

This command will download files in /data/data2services.

docker run -it --rm -v /data/data2services:/data vemonet/data2services-download \
	--download-datasets aeolus,pharmgkb,ctd \
	--username my_login --password my_password \
	--clean # to delete all files in /data/data2services

More datasets can be found in ./datasets

⁠Add a new dataset

Shell scripts are executed to download each dataset. Add your own.

  • Copy and rename the TEMPLATE directory, then change the download.sh accordingly, you will find a lot of simple operations to download files already covered.
  • Use the name of the directory to pass it as a dataset to download.
  • Use $USERNAME and $PASSWORD variables if you need one.

See the Wiki⁠ for more details on common Shell download operations.

⁠Example of datasets bundles

Check in /datasets⁠.

# XML
docker run -it --rm -v /data/data2services:/data vemonet/data2services-download --download-datasets clinicaltrials,pubmed,interpro,bioproject,clinvar,dailymed,dbsnp,flybase,orphanet,pdb

# TSV
docker run -it --rm -v /data/data2services:/data vemonet/data2services-download --download-datasets stitch,pharmgkb,drugcentral,bindingdb,ncbigene,ndc,stitch,genage,ncbigene,irefindex

# NCATS Translator program
docker run -it --rm -v /data/data2services:/data vemonet/data2services-download --download-datasets gote,disgenet,pathwaycommons,biogrid,wikipathways,preppi,clinicaltrials,pubmed,kegg

Tag summary

Content type

Image

Digest

Size

62.9 MB

Last updated

almost 7 years ago

docker pull vemonet/data2services-download