Talk:WiktionaryDumps to words: Difference between revisions
→Download 800MB to spell check a document??!!
(spelling checks) |
|||
| (12 intermediate revisions by 3 users not shown) | |||
Line 11:
:::: I would need that explaining to me. How does it quit after 1 or 2 megas and how does it tell wget|bzcat| to quit? --[[User:Petelomax|Pete Lomax]] ([[User talk:Petelomax|talk]]) 09:57, 10 December 2020 (UTC)
::::: On Linux I just use '''Ctrl C''' to terminate all the commands (all the piped programs are terminated at the same time). On Windows, under Cygwin, I just do the same. I think this is the same too on MacOS. - [[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]]) 12:50, 10 December 2020 (UTC)
::: Also you don't really have to download 800 megabytes on your hard drive, you can just read it from a stream. [[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]]) 13:15, 10 December 2020 (UTC)
::: I too have some questions.
::# What does wiktionary have to do with the task? Would any XML encoded word list do? If so, why does the task name include wiktionary?
:::: Because I found it interesting to do something with the wiktionary, as I explained on the [https://rosettacode.org/wiki/Rosetta_Code:Village_Pump/WiktionaryDumps Village Pump page]. - [[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]]) 09:18, 10 December 2020 (UTC)
::::: Also a word list is available for French with [http://manpages.ubuntu.com/manpages/bionic/man5/french.5.html "/usr/share/dict/french"], but I don't think that it's available for every languages, and the Wiktionary could be a good source for generating these files. If I understood correctly these words files are useful for
::# Is the task supposed to show how to download and extract a large file in your particular language? The reference implementation just shells out and uses other tools.
Line 23 ⟶ 24:
::: --[[User:Thundergnat|Thundergnat]] ([[User talk:Thundergnat|talk]]) 21:57, 9 December 2020 (UTC)
:::: Because we can not use the DOM method to parse 800MB of XML, we need to use the SAX method then. Most languages provide 2 different API for SAX and DOM XML parsing, but maybe not all. [[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]]) 09:18, 10 December 2020 (UTC)
==A common task==
You can see on this post that some people are wondering how to do this task:<br>
https://unix.stackexchange.com/questions/48939/add-new-language-to-usr-share-dict-words<br>
The '''wordlist''' package in Debian don't seem to provide that many languages:<br>
https://packages.debian.org/en/sid/wordlist<br>
If we modify the ocaml script replacing "==French==" by "==Indonesian==" we can produce the word list for the Indonesian language quite easily.<br>
-- [[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]]) 13:10, 10 December 2020 (UTC)
== Edit? ==
Hi, it's already 10 days no-one discusses anymore. <br>
Can we allow adding new languages now? <br>
[[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]]) 18:04, 20 December 2020 (UTC)
:That is more a reason to remove the "dumped" task altogrther as the original author doesn't seem to want to address these comments. --[[User:Paddy3118|Paddy3118]] ([[User talk:Paddy3118|talk]]) 00:59, 21 December 2020 (UTC)
::Hi Paddy, Sorry English is not my born language, so I'm not sure what you mean by [the "dumped" task].
::Do you mean that this task is too simple because it's only about the act of dumping selected content from the input?
::(I checked https://en.wiktionary.org/wiki/dump and try to see which definition would match the best, hopping that it's not definition 1, 7 or 8 which are quite pejorative.)
::I do want to address the comments, but I already answered it all, and the discussion stopped after that. In French we say [https://en.wiktionary.org/wiki/qui_ne_dit_mot_consent "qui ne dit mot consent"] (silence is consent) so I thought that they now agree. Isn't it the case?
:: [[User:Blue Prawn|Blue Prawn]] ([[User talk:Blue Prawn|talk]])
== Download 800MB to spell check a document??!! ==
Maybe you can key Ctrl-C, maybe you only got half the language, and what if it's right at the end of the file? --[[User:Petelomax|Pete Lomax]] ([[User talk:Petelomax|talk]]) 00:35, 16 February 2021 (UTC)
:Managed to get 5 words out of the first 240K, and then terminate download/unpack cleanly without having to key Ctrl-C. --[[User:Petelomax|Pete Lomax]] ([[User talk:Petelomax|talk]]) 23:52, 13 April 2021 (UTC)
| |||