Knesset-dictabert: A Hebrew Language Model For Parliamentary Proceedings
Gili Goldin, Shuly Wintner . No Venue 2024
[Paper]
We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is based on the DictaBERT architecture and demonstrates significant improvements in understanding parliamentary language according to the MLM task. We provide a detailed evaluation of the model’s performance, showing improvements in perplexity and accuracy over the baseline DictaBERT model.
📬 Stay current on LLM research:
Subscribe to the Weekly Digest
— a quick summary of new papers, tools, and micro-trends.