-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DM-37973: Display Czar monitoring parameters on the Qserv Web Dashboard #809
Commits on Sep 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 3b97352 - Browse repository at this point
Copy the full SHA 3b97352View commit details
Commits on Sep 21, 2023
-
Relaxed syntax requirements for the connections strings
The new implementation allows not to provide database names in the connection strings. The connection string parser was extended with an additional parameter allowing to privide the default database name if the one is found missing in the input connection string.
Configuration menu - View commit details
-
Copy full SHA for 2575532 - Browse repository at this point
Copy the full SHA 2575532View commit details -
Added configuration parameter (url) for the MySQL proxy
The change was made to the Configuraton servive of the Replication/Ingest system.
Configuration menu - View commit details
-
Copy full SHA for b898453 - Browse repository at this point
Copy the full SHA b898453View commit details -
Move class replica::AsyncTimer into the utility module
Refactored dependencies accordingly. The move allows re-using the class by other Qserv modules w/o adding a direct depedency onto the module 'replica' which was the original location of the class. Fixed a bug in the implementation of the timer to allow subsequent restarts. Unblocking implementation of the callback calling mechanism. Extended a model of the callbacks to allow ordering automatic restarts of the timer via the return value (boolean type) of the callbacks. Minor refactpring of the implementation.
Configuration menu - View commit details
-
Copy full SHA for af7a427 - Browse repository at this point
Copy the full SHA af7a427View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6522e9a - Browse repository at this point
Copy the full SHA 6522e9aView commit details -
Improved and extended implementation of the Czar monitoring
Extend the Histogram class to report the histogram label (id). Added a histogram to capture the performance of the result file reads at Czar. Added counters for the number of on-going result file reads (file-based result delivery protocol only) and merges. Fixed database merge histogram load. Added integral counters for metrics reset at the start up time of Czar. Added the timestamp (milliseconds) attribute to the JSON object that returns a state of the monitoring parameters. The timestamps are going to be used for the performance monitoring of Qserv.
Configuration menu - View commit details
-
Copy full SHA for ff22018 - Browse repository at this point
Copy the full SHA ff22018View commit details -
Instrumented Qserv Czar to capture query progess history
The history is recorded in the transient monitoring store (class qserv::CzarStats) from where it could be sampled at run time via the Qserv mysql-proxy service.
Configuration menu - View commit details
-
Copy full SHA for 102aecf - Browse repository at this point
Copy the full SHA 102aecfView commit details -
Processing Czar monitoring requests via MySQL proxy
The requests are made by calling a special stored procedure that is recognized by Qserv. The procedure allows a single parameter (a command) that is interpreted by Czar and processed accordingly.
Configuration menu - View commit details
-
Copy full SHA for d3a821f - Browse repository at this point
Copy the full SHA d3a821fView commit details -
Temporary fix to the connection management of the query manager
The fix was introduced after discovering that the shared connection usage approach in the original design of this and related classes is highly unreliable. A connection shared by the queries seems to be sensitive to the service startup ordering and occasional disconnects. As a result of that the shared connection could just stop working or it could not be alive from the very start of Czar. It's also possible that the shared connection object is not properly synchronized to allow using it in the multi-threaded environment (which would be a bug). The last theory will be further investigated later.
Configuration menu - View commit details
-
Copy full SHA for e49651d - Browse repository at this point
Copy the full SHA e49651dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 54ce44d - Browse repository at this point
Copy the full SHA 54ce44dView commit details -
Split the service reporting info on both ongoing and past queries
The service was replaced with two separate services. The first one reports info on the ongoing queries. The second service is used for searching and displaying info on the past queries.
Configuration menu - View commit details
-
Copy full SHA for 6e0d7fc - Browse repository at this point
Copy the full SHA 6e0d7fcView commit details -
Web Dashboard: minor refactoring in the page update mechanism
The improvement aimed at reducing code duplication as well as the total amounbt of code in the application.
Configuration menu - View commit details
-
Copy full SHA for 1cb1eee - Browse repository at this point
Copy the full SHA 1cb1eeeView commit details -
Web Dashboard: split the page displaying info on user queries
Separated the query into into two pages - the active queries and the past queries. Also rearranges sub-tabs under the 'Status' tab for more intuitive navigation.
Configuration menu - View commit details
-
Copy full SHA for 25e8a97 - Browse repository at this point
Copy the full SHA 25e8a97View commit details -
Configuration menu - View commit details
-
Copy full SHA for 37198d9 - Browse repository at this point
Copy the full SHA 37198d9View commit details -
Web Dashboard: added a page for displaying query progress at Czar
Added a link (an additional column on the active queries table) to the newely added Query progression plot. Fixed minor layout bugs on the active and past query tables. Loading the Highcharts.js library on demand.
Configuration menu - View commit details
-
Copy full SHA for dc3b3b3 - Browse repository at this point
Copy the full SHA dc3b3b3View commit details