Skip to content

Go协程并发复用,降低CPU和内存负载

License

Notifications You must be signed in to change notification settings

ding1dingx/nightfall

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

54 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

nightfall

Go协程并发复用,降低CPU和内存负载

特点

  1. 实现简单
  2. 性能优异
  3. 采用「生产-消费」模式
  4. 任务支持context
  5. 任务队列支持缓冲大小设置
  6. 非阻塞模式下,任务缓存到全局链表
  7. 配套设施:errgroup 和 timewheel

安装

go get -u github.com/shenghui0779/nightfall

流程图

flowchart.jpg

效果

goos: darwin
goarch: amd64
cpu: Intel(R) Core(TM) i5-1038NG7 CPU @ 2.00GHz

场景-1

👉 nightfall

func main() {
    ctx := context.Background()
    
    pool := woker.NewPool(5000)
    for i := 0; i < 100000000; i++ {
        i := i
        pool.Go(ctx, func(ctx context.Context) {
            time.Sleep(time.Second)
            fmt.Println("Index:", i)
        })
    }
    
    <-ctx.Done()
}
cpu

nightfall_cpu_1.png

mem

nightfall_mem_1.png

👉 ants

func main() {
    ctx := context.Background()
    
    pool, _ := ants.NewPool(5000)
    for i := 0; i < 100000000; i++ {
        i := i
        pool.Submit(func() {
            time.Sleep(time.Second)
            fmt.Println("Index:", i)
        })
    }
    
    <-ctx.Done()
}
cpu

ants_cpu_1.png

mem

ants_mem_1.png

场景-2

👉 nightfall

func main() {
    ctx := context.Background()
    
    pool := woker.NewPool(5000)
    for i := 0; i < 100; i++ {
        i := i
        pool.Go(ctx, func(ctx context.Context) {
            for j := 0; j < 1000000; j++ {
                j := j
                pool.Go(ctx, func(ctx context.Context) {
                    time.Sleep(time.Second)
                    fmt.Println("Index:", i, "-", j)
                })
            }
        })
    }
    
    <-ctx.Done()
}
cpu

nightfall_cpu_2.png

mem

nightfall_mem_2.png

👉 ants

func main() {
    ctx := context.Background()
    
    pool, _ := ants.NewPool(5000)
    for i := 0; i < 100; i++ {
        i := i
        pool.Submit(func() {
            for j := 0; j < 1000000; j++ {
                j := j
                pool.Submit(func() {
                    time.Sleep(time.Second)
                    fmt.Println("Index:", i, "-", j)
                })
            }
        })
    }
    
    <-ctx.Done()
}
cpu

ants_cpu_2.png

mem

ants_mem_2.png

About

Go协程并发复用,降低CPU和内存负载

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 100.0%