Add Slovenian language support (#653)
--------- Co-authored-by: sspanak <doftor.livain@gmail.com>
This commit is contained in:
parent
04231b7707
commit
ffae563b95
4 changed files with 1052665 additions and 0 deletions
13
app/languages/definitions/Slovenian.yml
Normal file
13
app/languages/definitions/Slovenian.yml
Normal file
|
|
@ -0,0 +1,13 @@
|
|||
locale: sl-SI
|
||||
dictionaryFile: sl-utf8.csv
|
||||
layout:
|
||||
- [SPECIAL] # 0
|
||||
- [PUNCTUATION] # 1
|
||||
- [a, b, c, č, ć] # 2
|
||||
- [d, e, f, đ] # 3
|
||||
- [g, h, i] # 4
|
||||
- [j, k, l] # 5
|
||||
- [m, n, o] # 6
|
||||
- [p, q, r, s, š] # 7
|
||||
- [t, u, v] # 8
|
||||
- [w, x, y, z, ž] # 9
|
||||
1052630
app/languages/dictionaries/sl-utf8.csv
Normal file
1052630
app/languages/dictionaries/sl-utf8.csv
Normal file
File diff suppressed because it is too large
Load diff
22
docs/dictionaries/slWordlistReadme.txt
Normal file
22
docs/dictionaries/slWordlistReadme.txt
Normal file
|
|
@ -0,0 +1,22 @@
|
|||
Slovenian wordlist 1 by: Fran Ramovš Institute of Slovenian Language - ZRC SAZU
|
||||
Version: ZIP exported on 2025-02-25
|
||||
Source: http://bos.zrc-sazu.si/besede_en.html
|
||||
License: Public domain source from ZRC SAZU, zrc@zrc-sazu.si
|
||||
|
||||
Slovenian wordlist 2 by: Aleksander Simonic and Uros Lotric
|
||||
Version: 2012-11-30
|
||||
Source: https://www.winedt.org/dict.html
|
||||
License: https://www.winedt.org/dict/Slovenian.html
|
||||
|
||||
Frequencies obtained from LatinIME dictionaries:
|
||||
Source: https://android.googlesource.com/platform/packages/inputmethods/LatinIME
|
||||
Version: 66093bf509ea92fa31d796326d5f30a8d9582ffe (2023-12-21)
|
||||
License: https://android.googlesource.com/platform/packages/inputmethods/LatinIME/+/refs/heads/main/NOTICE
|
||||
|
||||
Slovenian word list 3 by: CC-100;
|
||||
Version: 2020
|
||||
Source: https://data.statmt.org/cc-100/
|
||||
References (PDF links are available in the source URL):
|
||||
- Unsupervised Cross-lingual Representation Learning at Scale, Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), p. 8440-8451, July 2020.
|
||||
- CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data, Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Joulin, Edouard Grave, Proceedings of the 12th Language Resources and Evaluation Conference (LREC), p. 4003-4012, May 2020.
|
||||
Remark: Only the words that appear at least 4 times were used.
|
||||
BIN
downloads/sl-utf8.zip
Normal file
BIN
downloads/sl-utf8.zip
Normal file
Binary file not shown.
Loading…
Add table
Add a link
Reference in a new issue