Esperanto tokenizer for Deno

This is a fork from https://github.com/maroun-baydoun/new-hope

Esperanto?

Esperanto is a constructed language created by L. L. Zamenhof in 1887. Find out more here and check out the great Duolingo Esperanto Course.

Usage

import { split, tokenize } from 'https://deno.land/x/new_hope/mod.ts';

const words = split("Mi parolas Esperanton.");
const tokens = tokenize(words);