Skip to content

Read chunks from a file by delimiter and do some work async

License

Notifications You must be signed in to change notification settings

dimonnwc3/chunk-reader

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Chunk Reader

Read chunks from AsyncIterator by delimiter and do some work async.

This module uses async generators. Currently this feature available in Node.js >= v10.

Install

npm install --save chunk-reader
or
yarn add chunk-reader

Usage

const createReader = require("chunk-reader")
const fsPromses = require("fs").promises
const fs = require("fs")

async function main() {
  const filePath = "./pathToFile"
  const delimiter = "\n"
  const { size: bytesTotal } = await fsPromses.stat(filePath)

  const stream = fs.createReadStream(filePath)

  const reader = createReader(stream, { delimiter })

  for await (const chunk of reader) {
    // do here some async stuff with cnunks
    console.log(
      `Progress: ${(stream.bytesRead / bytesTotal * 100).toFixed(2)}%`,
    )
  }
}

main()

createReader(asyncIterator, [opts]) ⇒ AsyncIterator

Create a new ChunkReader instance.

Param Type Description
[asyncIterator] AsyncIterator
[options] Object
[options.delimiter] String Chunk delimiter (optional). EOL by default;

About

Read chunks from a file by delimiter and do some work async

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published