Skip to content

Releases: cluebotng/bot

v1.0.27

14 Dec 16:50
25c580d
Compare
Choose a tag to compare
composer - bump wikipedia

v1.0.26

13 Dec 14:05
78a28d3
Compare
Choose a tag to compare
Merge pull request #20 from cluebotng/feature/php8-work

Initial php 8 compatibility

v1.0.24

12 Dec 14:45
a0db747
Compare
Choose a tag to compare
Merge pull request #17 from cluebotng/feature/more-work

Production tuning

v1.0.23

12 Dec 14:05
df6dd83
Compare
Choose a tag to compare
mysql_functions - Correct user_distinct_pages query

v1.0.22

12 Dec 14:04
df6dd83
Compare
Choose a tag to compare
mysql_functions - Correct user_distinct_pages query

v1.0.21

12 Dec 13:38
bf4b159
Compare
Choose a tag to compare
Drop db cluster discovery

Production setup is all contained within 1 pod, so everything is on
localhost (same network namespace).

v1.0.20

12 Dec 12:31
b02ec47
Compare
Choose a tag to compare
mysql - limit statements to 10s

Some of these queries can take 2min+, during which time the connection
is consumed.

Fail quickly to allow more overall throughput, at the cost of a loss of
correctness in the edge cases (edits will be skipped).

Note: The queries are usually slow on accounts with lots of edits e.g.
bots, which likely are not going to be reverted anyway.

Sample timings (from botng, which uses the same queries):
name					P95(duration_ms)	AVG(duration_ms)
loader.LoadDistinctPagesCount		18,179.03402		3,005.03574
loader.LoadUserWarnsCount		572.02909		127.03932
loader.LoadPageRecentRevertCount	253.82347		66.91965
loader.LoadPageRevision			163.07911		106.22102
loader.LoadPageMetadata			104.4249		179.18445
loader.LoadUserEditCount		84.84196		11.34932
loader.LoadPageRecentEditCount		9.95227			6.23804

Example edits (also from botng, but shows the challenge)
UUID					duration_ms	Related username
6f9b2f64-bced-4a2f-af1e-5f02bc3b4218	174,505.79937	InternetArchiveBot
94141464-459e-48cf-9901-9a9161fae17c	168,008.14787	AnomieBOT
05e3e528-3f36-493f-91d6-fb7e9aaaaa93	47,951.95634	EmausBot
89f2ef9c-1ec3-425e-b667-a92476a358cf	13,345.4171	Plantdrew
68733457-aafe-426f-b91c-cd85e4c733a6	5,618.97978	Dimadick

v1.0.19

10 Dec 23:58
7c76d0a
Compare
Choose a tag to compare
getCbData - use 14 days again

v1.0.18

10 Dec 12:31
ccddd88
Compare
Choose a tag to compare
mysql_functions - cleanup whitespace style

v1.0.17

04 Apr 22:59
77f9984
Compare
Choose a tag to compare
getCbData - rework mysql connection handling