concurrent workers in golang

Repository to support the blog golang-concurrent-worker-pool

example to create a worker pool using channels and goroutines to provide maximum throughput.

the code consists of 2 examples a_sequential where the work happens in sequence and b_concurrent where the work gets distributed among several workers. The users can run the examples themselves and see the difference.

• avg time 10 sequential runs := 17.25387443 Seconds
• avg time 10 concurrent runs := 1.494497171 Seconds

There are several log lines which are commented in the code base. Users can uncomment them to see the actual output on the stdout.

Benchmarks for concurrent runs

The benchmark would be different on different machines. To run benchmark on your machine, run below commands

cd b_concurrent
go test -bench=.

Change the number of workers in main_test.go to see the benchmark differences for different worker counts.

benchmark with 1 worker

goos: linux
goarch: amd64
pkg: github.com/PrakharSrivastav/workers/b_concurrent
BenchmarkConcurrent-8                  1        4349083504 ns/op
BenchmarkNonconcurrent-8               1        4276954083 ns/op
PASS
ok      github.com/PrakharSrivastav/workers/b_concurrent     8.630s

benchmark with 2 workers

prakhar@tardis (master)✗ % go test -bench=.
goos: linux
goarch: amd64
pkg: github.com/PrakharSrivastav/workers/b_concurrent
BenchmarkConcurrent-8                  1        2341316053 ns/op
BenchmarkNonconcurrent-8               1        2076455734 ns/op
PASS
ok      github.com/PrakharSrivastav/workers/b_concurrent     4.422s

benchmark with 4 workers

prakhar@tardis (master)✗ % go test -bench=.
goos: linux
goarch: amd64
pkg: github.com/PrakharSrivastav/workers/b_concurrent
BenchmarkConcurrent-8                  1        1318867706 ns/op
BenchmarkNonconcurrent-8               1        1076381168 ns/op
PASS
ok      github.com/PrakharSrivastav/workers/b_concurrent     2.399s

benchmark with 8 workers

prakhar@tardis (master)✗ % go test -bench=.
goos: linux
goarch: amd64
pkg: github.com/PrakharSrivastav/workers/b_concurrent
BenchmarkConcurrent-8                  2         561313450 ns/op
BenchmarkNonconcurrent-8               2         544786952 ns/op
PASS
ok      github.com/PrakharSrivastav/workers/b_concurrent     3.554s

benchmark with 16 workers

prakhar@tardis (master)✗ % go test -bench=.
goos: linux
goarch: amd64
pkg: github.com/PrakharSrivastav/workers/b_concurrent
BenchmarkConcurrent-8                  3         397863120 ns/op
BenchmarkNonconcurrent-8               3         367798299 ns/op
PASS
ok      github.com/PrakharSrivastav/workers/b_concurrent     4.747s