Back to directory

GermanWordEmbeddings

A toolkit for training and evaluating German-language word embeddings, covering obtaining and preprocessing German text corpora, training models with gensim's word2vec, and evaluating them against generated test sets.

GermanWordEmbeddings

GermanWordEmbeddings applies deep learning via gensim's word2vec implementation to German corpora, since the authors note that most existing word embedding research and tooling focuses on English text. A bundled shell script automates downloading the toolkit and its corpus files and running training and evaluation end to end, though the README warns this can take a very long time.

Documented corpus sources include German Wikipedia dumps and shuffled German news text from a statistical machine translation dataset spanning 2007 to 2013; the project's own pretrained models were built from German Wikipedia and 2013 news data. A WikipediaExtractor script and shell commands strip the raw Wikipedia XML dump down to plain text before training, and Jupyter notebooks in the repository show example script output for users who want to inspect how each step works without running the full pipeline themselves.

More in Models

See all 405
  • mini-AGI

    github.com

    A continual learning language model that trains from scratch on a single 8 GB VRAM GPU, assembling its own architecture and adapting its size to the hardware and data available rather than shipping as a fixed pretrained model.

  • An open-source contrastive-embedding pipeline that maps technical CVE vulnerability descriptions to formal cybersecurity compliance controls in NIST SP 800-53 and CMMC, published with its model generation, fine-tuning and evaluation code.

  • peekaboolean

    github.com

    A small vision-language model, fine-tuned with LoRA on a 500-million-parameter backbone, that answers typed multiple-choice, ordinal-score and yes/no questions about an image with calibrated probabilities, in about 400 milliseconds on a laptop.