Sign inSign up

korap/conllu-spacy

By korap

•Updated 4 months ago

spaCy Docker Image with CoNLL-U Support

Image
0

10K+

korap/conllu-spacy repository overview

⁠spaCy Docker Image with CoNLL-U Support

Docker image for spaCy POS tagging, lemmatization and dependency parsing with support for input and output in CoNLL-U format⁠.

This is a slim, focused implementation extracted from sota-pos-lemmatizers⁠, originally developed by José Angel Daza⁠, following the same pattern as conllu-treetagger-docker⁠.

⁠Usage

⁠Basic usage
# Default: German model with dependency parsing and GermaLemma
docker run --rm -i korap/conllu-spacy < input.conllu > output.conllu
⁠Without dependency parsing
# Disable dependency parsing for faster processing
docker run --rm -i korap/conllu-spacy -d < input.conllu > output.conllu
⁠Using different language models
# Use a smaller German model
docker run --rm -i korap/conllu-spacy -m de_core_news_sm < input.conllu > output.conllu

# Use French model
docker run --rm -i korap/conllu-spacy -m fr_core_news_lg < input.conllu > output.conllu

# Use English model (disable GermaLemma for non-German)
docker run --rm -i korap/conllu-spacy -m en_core_web_lg -g < input.conllu > output.conllu
⁠Persisting Models

To avoid downloading the language model on every run, mount a local directory to /local/models:

chmod 777 /path/to/local/models
docker run --rm -i -v /path/to/local/models:/local/models korap/conllu-spacy < input.conllu > output.conllu
⁠Running with korapxmltool

korapxmltool, which includes korapxml2conllu as a shortcut, can be downloaded from https://github.com/KorAP/korapxmltool⁠.

korapxml2conllu goe.zip | docker run --rm -i korap/conllu-spacy
⁠Generate a spaCy-tagged KorAP XML zip directly
korapxmltool -A "docker run --rm -i korap/conllu-spacy" -t zip goe.zip
`

Tag summary

Content type

Image

Digest

sha256:566e8119e…

Size

204 MB

Last updated

4 months ago

docker pull korap/conllu-spacy