Sign inSign up

mbartoli/patentprocessing

By mbartoli

Updated about 11 years ago

Process and run Pagerank on USPTO patent data

Image
0

912

mbartoli/patentprocessing repository overview

patentprocessing

Process and analyze data from http://www.google.com/googlebooks/uspto-patents-applications-text.html

PageRank

Compile

sbt package

Submit to the cluster

spark-submit -v --driver-library-path /usr/lib/hadoop/lib/native \
                --class "PageRank" \
                --master yarn-cluster \
                --deploy-mode cluster \
                --executor-memory 8G \
                --num-executors 10 \
                target/scala-2.10/patentpagerank_2.10-1.0.jar

Misc

For use on DARPA's Memex cluster

Tag summary

Content type

Image

Digest

sha256:1cbedd5e9

Size

397.6 MB

Last updated

about 11 years ago

docker pull mbartoli/patentprocessing