- Medium changes
- Clean up descriptors written to the
out/directory by deleting files that are older than seven weeks. - Correctly index files that are moved away and back.
- Include microdescriptors, certs, and OnionPerf analysis files when syncing from another CollecTor instance.
- Update to metrics-lib 2.15.0.
- Medium changes
- Update to metrics-lib 2.14.0.
- Medium changes
- Retain ipv6- lines in bridge extra-info descriptors.
- Medium changes
- Update to metrics-lib 2.13.0.
- Medium changes
- Update to metrics-lib 2.12.2.
-
Medium changes
- Update to metrics-lib 2.12.1.
- Download OnionPerf analysis .json files in addition to .tpf files.
-
Minor changes
- Simplify logging configuration.
- Set default locale
USand default time zoneUTCat the beginning of the execution. - Download missing server and extra-info descriptors that have been published up to 30 hours ago: 24 hours for the maximum age of descriptors to be referenced plus 6 hours for the time between generating votes and processing a consensus.
- Medium changes
- Stay alive after scheduling (daemon) threads for modules. This was broken by taking out the periodic check for configuration file updates.
-
Medium changes
- Give up on periodically checking the configuration file for updates and reloading it in case of changes.
- Avoid reprocessing webstats files.
- Remember processed files between module runs for archived Snowflake statistics, bridge pool assignments, and BridgeDB metrics.
-
Minor changes
- Remove dependency on metrics-lib's internal package.
- Update to metrics-lib 2.10.0.
- Minor changes
- Update to metrics-lib 2.9.1.
- Medium changes
- Extend index.json by including descriptor types, first and last
publication timestamp, and SHA-256 file digest. Requires making
configuration changes in collector.properties:
- IndexedPath is a new directory with subdirectories for archived and recent descriptors,
- ArchivePath and IndexPath are hard-wired to be subdirectories of IndexedPath,
- RecentPath must be set to be a subdirectory of IndexedPath,
- ContribPath has disappeared, and
- HtdocsPath is a new directory with files served by the web server.
- Tweak BridgeDB metrics file names.
- Update to metrics-lib 2.9.0.
- Extend index.json by including descriptor types, first and last
publication timestamp, and SHA-256 file digest. Requires making
configuration changes in collector.properties:
- Medium changes
- Require Mockito 1.10.19 as dependency for running tests.
- Archive BridgeDB statistics.
- Update to metrics-lib 2.8.0.
- Minor changes
- Update create-tarballs.sh to also produce bridge pool assignments tarballs.
- Fix synchronization part of newly re-added bridge pool assignments module.
- Medium changes
- Archive bridge pool assignments again.
- Medium changes
- Changed local import of bandwidth files to include the parent directory name as @source annotation and to the filename.
- Use Ivy for resolving external dependencies rather than relying
on files found in Debian stable packages. Requires installing Ivy
(using
apt-get install ivy,brew install ivy, or similar) and runningant resolve(orant -lib /usr/share/java resolve). Retrieved files are then copied to thelib/directory, except for dependencies on other metrics libraries that still need to be copied to thelib/directory manually. Current dependency versions resolved by Ivy are the same as in Debian stretch with few exceptions. - Remove Cobertura from the build process.
- Archive snowflake statistics.
- Update to metrics-lib 2.7.0.
- Medium changes
- Fix synchronizing bandwidth files from other CollecTors.
- Update to metrics-lib 2.6.2.
- Medium changes
- Stop signing jar files.
- Archive bandwidth files in relaydescs module.
- Update to metrics-lib 2.6.1.
-
Medium changes
- Properly clean up sanitized web server logs in the recent/ directory when they turn older than three days.
-
Minor changes
- Once more, fix the bug in the tarball-creation script where tarballs are not compressed in a run following an aborted run.
- Improve logging to find possible issue with missing server descriptors.
- Update directory authority IP addresses in default properties file.
-
Medium changes
- Recognize new bridge authority Serge.
-
Minor changes
- Rename root package org.torproject.collector to org.torproject.metrics.collector and ..index to ..indexer.
- Fix a bug in the tarball-creation script where tarballs might not have been compressed in a run following an aborted run.
- Prevent weird values when calculating the cut-off date for storing bridge sanitizer secrets using inf as the default value of BridgeDescriptorMappingsLimit.
- Medium changes
- Update and adapt to metrics-lib 2.4.0.
- Replace Gson with Jackson.
-
Medium changes
- Add the correct number of lines to sanitized webstats files.
-
Minor changes
- Add bastet to default list of directory authority fingerprints to download votes for.
-
Major changes
- Update to metrics-lib 2.2.0.
- Add new module for processing and sanitizing Tor web server logs.
-
Minor changes
- Exclude lastModifiedMillis in index.json.
- Medium changes
- Handle bridge descriptors with an unusual order of "published" and "fingerprint" lines.
- Retain "bridge-distribution-request" lines when sanitizing descriptors.
-
Major changes
- Rename "Onionperf*" configuration options in collector.properties to "OnionPerf*" (with capital P).
- Add "Sync" as OnionPerfSource to synchronize .tpf files from other CollecTor instances.
-
Medium changes
- Add new optional "build_revision" field to index.json with the Git revision of the CollecTor instance's software used to create this file, which will be omitted if unknown.
-
Minor changes
- Remove all styling resources (fonts, CSS, etc.) from directory listings.
-
Major changes
- Update to metrics-lib 2.1.0 and to Java 8.
-
Medium changes
- When synchronizing descriptors from another CollecTor instance, keep annotations provided by the descriptor and only add the default annotation, when there was none.
- Medium changes
- Fix a bug while sanitizing bridge network statuses without entries.
-
Major changes
- Download .tpf files from OnionPerf hosts.
- Stop downloading and merging .data and .extradata files from Torperf hosts.
- Update to metrics-lib 2.0.0.
- Update to Debian stretch libraries.
-
Medium changes
- Clean up files in recent/exit-lists/ again.
- Retain padding-counts lines in sanitized extra-info descriptors.
- Either include or retain "fingerprint" line in bridge network statuses with @type bridge-network-status 1.2.
- Set read timeouts for downloads from directory authorities and the exit list server.
-
Minor changes
- Only consider recent relay descriptors in reference checker.
- Medium changes
- Unify the build process by adding git-submodule metrics-base in src/build and removing all centralized parts of the build process.
- Use the correct type annotation "@type tordnsel 1.0" for exit lists, rather than "@type torperf 1.0".
-
Medium changes
- Handle corrupt internal file used for checking references between descriptors by deleting and regenerating instead of escalating.
- Retain hidserv-* lines in sanitized extra-info descriptors.
- Sign .jar files again, and ensure they get signed in the build process.
-
Minor changes
- Add instructions and sample configuration for using nginx as HTTP server rather than Apache.
-
Major changes
- Provide a facility to synchronize descriptors from other CollecTor instances. If configured, the synchronization run collects recent descriptors from one or more remote CollecTor instances, verifies descriptors, and sorts them into the local descriptor store. Synchronization is implemented for relay descriptors (except microdescriptors), sanitized bridge descriptors, and exit lists.
-
Medium changes
- Replace four properties for configuring where to write descriptors by a single 'OutPath' property.
- Introduce *Sources and *Origins properties to simplify data source definition.
- Remove six properties for specifying what relay descriptors to download and replace them with hard-coded 'true' values.
-
Minor changes
- Add enum for descriptor type annotations.
- Add modular file persistence to write descriptors to the out/ and recent/ subdirectories..
- Exclude temporary files from index.json* files.
- Expand the operator's guide in INSTALL.md.
-
Medium changes
- Add support for Bifroest's bridge descriptor tarballs.
- Use a shutdown hook that gives currently running modules up to 10 minutes to finish properly, rather than killing them immediately.
- Replace TCP ports with hashes in @type bridge-network-status 1.1 and @type bridge-server-descriptor 1.2.
- Split up bridge descriptor tarballs into one tarball per month and descriptor type: bridge-statuses-YYYY-MM.tar.xz, bridge-server-descriptors-YYYY-MM.tar.xz and bridge-extra-infos-YYYY-MM.tar.xz.
- Keep "proto" lines in bridge server descriptors as introduced in proposal 264.
- Add tests for the bridgedescs module.
- Validate bridge tarballs from the bridge authority more rigorously.
-
Minor changes
- Remove quotes around base URL in index.json.
- Change default log thresholds from TRACE to INFO.
- Extend checkstyle to also check test sources.
- Medium changes
- Avoid running out of memory when executing the relaydescs module repeatedly from the internal scheduler rather than using the system's cron daemon.
- Major changes
- This is the initial release after over six and a half years of development.