Random sentence from book: Difference between revisions

Content added Content deleted

Inline

@@ Line 505: / Line 505: @@
                      utf32_to_utf8({#2014})},   -- hyphen
          asciis = {"'","-"},
-         aleph = tagset('Z','A')&tagset('z','a')&tagset('9','0')&",.?! \n",
+         aleph = tagset('Z','A')&tagset('z','a')&tagset('9','0')&",.?! ",
          follow = new_dict(),   -- {word}      -> {words,counts}
          follow2 = new_dict()   -- {word,word} -> {words,counts}