Skip to content

Systems Experiment: General purpose Async Priority Queue and Async Read-Write Queue

License

Notifications You must be signed in to change notification settings

themichaelusa/AsyncPQ

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AsyncPQ

A little exercise in concurrency. Super intuitive way to schedule asynchronous tasks with little overhead.

This library was originally being built for the Trinitum Trading Architecture to communicate with a RethinkDB Instance and update the user's capital information every tick. But I think the idea is general enough to warrant a library of it's own.

Installation

pip3 install AsyncPQ

Documentation

Example:

import asyncio
from AsyncPQ import AsyncPriorityQueue, AsyncReadWriteQueue

class TestClass(object):
	
	def __init__(self): pass

	async def testFunc(self, arg): 
		await asyncio.sleep(0)
		print(arg)

async def testFunc2(arg): 
	await asyncio.sleep(0)
	print(arg)

classDict = {'test': TestClass()}

aspq = AsyncPriorityQueue(classDict)
aspq.addTask(15, testFunc2, 15)
aspq.addTask(15, testFunc2, 15)
aspq.addTask(27, testFunc2, 27)
aspq.addTask(27, testFunc2, 27)
aspq.addTask(89, testFunc2, 89)
aspq.addTask(91, testFunc2, 91)
aspq.addClassTask(96, 'test', 'testFunc', 96)
aspq.addClassTask(99, 'test', 'testFunc', 99)
aspq.processTasks()
print()

asrwq = AsyncReadWriteQueue(classDict)
asrwq.read(testFunc2, 15)
asrwq.write(testFunc2, 15)
asrwq.read(testFunc2, 27)
asrwq.read(testFunc2, 27)
asrwq.write(testFunc2, 89)
asrwq.write(testFunc2, 91)
asrwq.cdRead('test', 'testFunc', 94)
asrwq.cdWrite('test', 'testFunc', 97)
asrwq.processTasks()

...

Terminal Outputs:

99
96
91
89
27
27
15
15

97
91
89
15
94
27
27
15

Use Cases

TBD

TODO

  • PyPI support (pip install...)
  • Better Documentation!

About

Systems Experiment: General purpose Async Priority Queue and Async Read-Write Queue

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages