selmaproject/text-segmentation repository overview

⁠Running the Docker Container

To run the Docker container, use the following command:

docker run --rm -v /path/to/your/input:/app/input -v /path/to/your/output:/app/output selmaproject/text-segmentation:latest

The will process the text files and generate the output in the specified output directory.

⁠Input Directory

Place your .jsonl or .txt files in a directory (e.g., /path/to/your/input).

• JSON Lines (.jsonl): Each line should be a JSON object with a key sourceItemMainText. Example:

  {"sourceItemMainText": "This is the first sentence. This is the second sentence."}
  {"sourceItemMainText": "Here is another text to be segmented into sentences."}
  

  Copy

• Plain Text (.txt): Simple text files with sentences. Example:

  This is the first sentence. This is the second sentence.
  Here is another text to be segmented into sentences.
  

  Copy