Doesn't work with diacritics

[0xAli]

If a word contains diacritics (Tashkeel) it won't be handled properly.

PS: This gem is a life saver.

[sinantaifour]

Thanks @0xAli! I'd be happy to accept a pull request for this.

[mkdynamic]

Awesome gem, thanks!

Excuse my ignorance, but a couple questions on this issue:

• How feasible would it be to support diacritics in this gem?
• Without this, will the resulting string by illegible/wrong, or just sub-optimal/harder to read?

[0xAli]

Hello!

1. I plan to figure it out later i will (hopefully some day) pull it off, but my guess it's a matter of figuring out the values on a byte level and adding them in "charinfos"

2. Without that support it will split the word https://i.imgur.com/fhdBuPH.png

I discovered this by accident while working on a project that had only one word with diacritics.