Failed to search files encoded with utf-16

[ocitrev]

UTF-16 LE with BOM encoding is used on Windows, especially for resources files in Visual Studio projects.

I created 4 files with the same text content, test pt\r\n, using different encodings:
test-utf16be-bom.txt
test-utf16le-bom.txt
test-utf8.txt
test-utf8-bom.txt

Only UTF-8 files display a result.

$ pt test .
.\test-utf8-bom.txt
1:test pt

.\test-utf8.txt
1:test pt

I would like for pt to search utf-16 encoded files

As a work-around, I use PowerShell's Select-String command to search within those files, but it is much slower than pt.

$ Select-String test -Path .\*
test-utf16be-bom.txt:1:test pt
test-utf16le-bom.txt:1:test pt
test-utf8-bom.txt:1:test pt
test-utf8.txt:1:test pt

[ocitrev]

I've created the PR #204 to resolve this issue.