Esperanto tokenizer for Deno
This is a fork from https://github.com/maroun-baydoun/new-hope
Esperanto?
Esperanto is a constructed language created by L. L. Zamenhof in 1887. Find out more here and check out the great Duolingo Esperanto Course.
Usage
import { split, tokenize } from 'https://deno.land/x/new_hope/mod.ts';
const words = split("Mi parolas Esperanton.");
const tokens = tokenize(words);