v1.0.0

1.0.0 (2024-09-26)

Features

• add argilla docker-compose.yml (250d78c)
• add ovh1 reverse proxy hosts in git (b1cfcdb)
• add stunnel config for off-query (504c3b4)
• added mysqld exporter on matomo (7641c70)
• adding nginx prometheus exporters (7ed6d0a)
• alert on certbot.service failure on off2 reverse proxy (b89ed9d)
• apache logs scripts from prod (#161) (696b675)
• backup off1 data on off2 (e5cbbac)
• Create 502-unplanned.html (#350) (6167d59)
• enable proxy caching in off2 nginx proxy (#347) (14a1d16)
• expose redis with stunnel (1d28198)
• general 502 is unplanned (e52fa1c)
• Images rate limit on ovh3 (#255) (d2d39ad)
• install proxy on off1 and serve OFF images (#354) (54e39d0)
• ks1 setup (6f1efaa)
• log anonymizer (#303) (69a7bc3)
• migrate off images to ZFS dataset on off2 (#226) (11aa0bd)
• monitor nfs on ovh3 (b1232ed)
• multiple matomo archiver (305c018)
• new sftp configuration (#275) (ec3c1be)
• nginx and apache exporter for prod (0c375a2)
• off-redis install (7c9ddbf)
• off1 munin configuration (9b8739b)
• ovh3 pull off1 data + better sanoid_check (b44240f)
• proxy mogo exporter (f7dab7b)
• pull backups from off2 on ovh3 (1b38ff5)
• put contents.openfoodfacts.org behind basic auth (6188441)
• remove basic auth for graphql for WP (3d472f8)
• remove basic auth for graphql for WP (f80c476)
• remove push backup from ovh3 (2bd26b6)
• remove vzdump for sync data on ovh3 (a722879)
• Revamp Slack Onboarding Page with Enhanced Visuals and Content (#389) (6ae9630), closes #388
• sanoid install on off1 (8ac4fd4)
• sanoid install on off1, follow-up (7275ad2)
• sanoid install on off1, follow-up (0912fd1)
• sanoid policy for moji backups (d17f717)
• save cron.sh from off2 /root (e9a7823)
• separate hdds for dockers-stagging VMs (#324) (554e09f)
• set group write mask for sftp (6959125)
• setting up stunnel client at free (ec0f6e6)
• Setup ElasticSearch for Zammad (#96) (1985106)
• several mongodb settings (353585b)
• some more matomo tuning (32c01fe)
• some off2 reverse proxy configurations (6f0705d)
• stunnel config for off2 reverse proxy (d797e7c)
• stunnel on ovh1 reverse proxy (proxy1) (0864392)
• stunnel-client specific container (522ce0e)
• taxonomy editor on ovh reverse proxy (1879d74)
• test setup for folksonomy on OPF (fce1109)
• using multiple queues for matomo tracking (6408954)

Bug Fixes

• #141 - Add ll alias (#142) (aadfe65)
• add .md extension (19e7b75)
• add missing configuration for stunnel (7bda869)
• branch name (30ea712)
• call mail failure correctly for matomo service (ac65c9a)
• clean lock in matomo tracking (52a016d)
• clones udpate script (f633c1c)
• disabled stunnel client config on ovh proxy (e7916b4)
• distinct backups datasets for off and proxmox (2c46787)
• fix burst on rate limiting (f115013)
• fix ct_postinstall (6ebd2a1)
• fix ct_postinstall (abd5a0a)
• fix matomo cron services logs (c31fe14)
• fix matomo redis mail failure (9c849cb)
• fix on sanoid service alert (6b196d2)
• fix proxmox link (42c8250)
• fix redis overide in matomo (4a1485c)
• fix remote source for static.off (a99f90c)
• fix rsync script (#181) (73e9811), closes #180
• fix sanoid / syncoid on off2 (5fa4da9)
• fix sanoid_post_remove_vzdump.sh (d55266a)
• fix typo for zfs-hdd/opf (#355) (801ed61)
• fix typo in sanoid_check (f6661b8)
• fix user for matomo timers tasks (e8a9da9)
• fixing lost sync of off products on ovh3 (#230) (d243360)
• general 502 is unplanned (198f6ad)
• group mariadb conf in a specific file (3604d81)
• ignore some drive for sanoid_checks on off1 (005f1fb)
• improved email alerts on off2 proxy (db6cf37)
• link for /srv/off-pro/html/images on off1 (#274) (7d8a65c)
• maj clones update (e1bc4ab)
• make a link to GitHub (503c662)
• matomo - more mariadb perfs (1a5ba6b)
• matomo queue 0 handling + patching (#311) (c81f358)
• meeting is monthly, point to right document (#234) (a34309f)
• monthly meeting meet link (#235) (377ea5b)
• more worker connections for nginx (55bc027)
• move syncoid.service to right place (144f599)
• off query internal url (#352) (6d2ccf4)
• off1 distinct backups datasets for off and proxmox (a8210a6)
• off1: off2 backups follow-up (fix) (5f89bb4)
• off2 distinct backups datasets for off and proxmox (1ea7e6a)
• off2: add zfs-nvme/pve to sanoid (f264324)
• one more typo in sanoid_check (e39a041)
• prefix proxy_cache_key with obf/off (fef8b75)
• redis config for off (29fd80d)
• remove opff from snapshot-purge on ovh3 (e43684d)
• remove opff gen_opff_leaderboard in off1 crontab (ea7c6b1)
• remove typo in syncoid.conf (ce309b3)
• remove unwanted config files (5007519)
• remove wrong -%l in OnFailure specifier (86954f0)
• report on zammad down (ad16f8f)
• report on zammad down (f325363)
• sanoid email notifications (#240) (95c1091)
• sanoid unit on ovh3 (bdfd862)
• services configuration for proxy on off1 (nginx, prometheus etc.) (#356) (f0d317b)
• small fixes on ct_postinstall (cbefe09)
• some more fixes on matomo (7ac243f)
• sto-products-sync.sh - removal condition (d846e54)
• stunnel server (d70cd1f)
• try to lower alerts on matomo-archive (a948f82)
• try to reduce stunell log level (afa87aa)
• typo in explain-server-config-in-git.md (14d265c)
• Update bug_report.md (f0a885c)
• Update src URL for 502.jpg to root folder (#343) (b994e7a)
• upgrade matomo configuration for performance (cd6506c)
• use a different cache for obf and off (4dd0417)

Technical

• (wip) odoo setup for pro platform (d3c556e)
• [WIP] Moving off and off-pro to off2 (#243) (54435e7)
• 2023-10-14-mongodb-down.md added robotoff investigation (5a8e584)
• add an example of VM fs resize without swap (#290) (e726f11)
• add backup section (b5f75c2)
• add CICD / Observability / Onboarding docs (df59042)
• add clues for no auto-completion or color in shell (a27b733)
• add cron script removal of opff (c07dc26)
• add deployment workflow for metrics stack (f6dc603)
• add documentation about product opener infrastructure (#295) (5f1ddf5)
• add location of prod mongoDB (3c6f38c)
• add overview doc (e84ff50)
• add report about Moji post-installation steps (8ed8a7d)
• add report about moji server installation (ae5ecf8)
• add robotoff backup report (#228) (f35b432)
• add sanoid configuration for moji server (610939b)
• add script to sync images and OCR to AWS S3 (#222) (352fe26)
• add scripts used in prod (#194) (fee257a)
• add second patch to matomo (#385) (d1089ce)
• add stunnel configuration for moji stunnel client CT (35de44a)
• Add stunnel configuration for moji stunnel-server CT (1ae5dd8)
• add systemd override.conf for moji stunnel (client & server) (fe01b1f)
• add systemd timer and service for robotoff backup (e7516d1)
• add warning to matomo update (79ec6ef)
• added some more detail on discourse install (426a987)
• adding disk space on a VM (#171) (f5f854a)
• advertise the monitoring repository (#102) (fb7d68a)
• bot account for github (7e5837a)
• certbot failures on off2 reverse proxy (#297) (d75c00c), closes #293
• certbot for multiple domain (22afd0f)
• certificate problem on openpetfoodfacts.org (#267) (98605d0)
• chatwoot google translation activation (#310) (32cda4d)
• cleaning of docker VM on ovh2 (#250) (13da707)
• cleanup of products snapshots on off2 (#305) (5546894)
• copy of old logs from off1 (#289) (e0181e8)
• deps: bump actions/checkout from 2 to 3 (#165) (18932ad)
• deps: bump actions/checkout from 3 to 4 (8ea0847)
• deps: bump actions/labeler from 4 to 5 (520207c)
• deps: bump actions/setup-python from 2 to 5 (994b550)
• deps: bump actions/setup-python from 3 to 4.1.0 (fe1fc4f)
• deps: bump actions/setup-python from 4.1.0 to 4.3.0 (#145) (a214a77)
• deps: bump amannn/action-semantic-pull-request from 4 to 5 (e5ab8ec)
• deps: bump certifi in /scripts/readme-writer (af4bd2b)
• deps: bump certifi in /scripts/readme-writer (72e5d01)
• deps: bump idna from 3.2 to 3.7 in /scripts/readme-writer (539259e)
• deps: bump JamesIves/github-pages-deploy-action (675e2d1)
• deps: bump JamesIves/github-pages-deploy-action (b39b44c)
• deps: bump JamesIves/github-pages-deploy-action (790fd76)
• deps: bump JamesIves/github-pages-deploy-action (e40e762)
• deps: bump JamesIves/github-pages-deploy-action (fa7f7e0)
• deps: bump JamesIves/github-pages-deploy-action (18970cf)
• deps: bump JamesIves/github-pages-deploy-action (5254d0a)
• deps: bump JamesIves/github-pages-deploy-action (#239) (7f5580b)
• deps: bump pyjwt from 2.1.0 to 2.4.0 in /scripts/readme-writer (#119) (e3e5e58)
• deps: bump requests in /scripts/readme-writer (a8f3bec)
• deps: bump stefanzweifel/git-auto-commit-action from 4 to 5 (eb7cdd8)
• deps: bump toshimaru/auto-author-assign from 1.4.0 to 1.5.0 (f4b6fc0)
• deps: bump toshimaru/auto-author-assign from 1.5.0 to 1.5.1 (d9a4310)
• deps: bump toshimaru/auto-author-assign from 1.5.1 to 1.6.0 (856413c)
• deps: bump toshimaru/auto-author-assign from 1.6.0 to 1.6.1 (74c6346)
• deps: bump toshimaru/auto-author-assign from 1.6.1 to 1.6.2 (41bdba6)
• deps: bump toshimaru/auto-author-assign from 1.6.2 to 2.0.0 (7225f43)
• deps: bump toshimaru/auto-author-assign from 2.0.0 to 2.0.1 (87220d2)
• deps: bump toshimaru/auto-author-assign from 2.0.1 to 2.1.0 (8e8163c)
• deps: bump toshimaru/auto-author-assign from 2.1.0 to 2.1.1 (09056a8)
• deps: bump urllib3 in /scripts/readme-writer (7543e17)
• deps: bump urllib3 in /scripts/readme-writer (eb44323)
• deps: bump urllib3 in /scripts/readme-writer (#260) (037af13)
• discourse install docs (#107) (382d948)
• disk failure on ovh3 (66e84a6)
• document 07-11 infra workshop (96141ed)
• document off2 upgrade (#189) (fac22b1)
• document producer sftp and various scripts (#136) (7faa538)
• documenting sanoid (#229) (be197f4)
• explain how to git push configs (#392) (94c4760)
• explain how to unlock VM in proxmox (5ca4b19)
• explain how we us git to track server configs (1c4d7b2)
• explain how we us git to track server configs (more) (8a055d3)
• external cheat-sheet for zfs (183ce88)
• finishing off search staging deploy (41079f4)
• Fix a small typo (#242) (721e92e)
• fix images (#193) (b13e4c1)
• fix some warnings (#353) (4de1005)
• fix typo in nginx-reverse-proxy.md (f147009)
• folksonomy and nginx reverse proxy (#163) (cbbd8d5)
• free exporters (#316) (da9dd6a)
• fresh wordpress install for OFF contents (#377) (b5b77f7)
• gmail dkim setup (314df6e), closes #339
• google drive backup (#284) (a42e099)
• harmonize email-failures service (c4f0659)
• how to diagnose blackbox errors (#393) (56dfc39)
• how to resync backups (#390) (6513fb2)
• how-to mitigate crawlers with ip filtering (#210) (737c3b7)
• improve argilla docker-compose.yml (93b4924)
• improve documentation about stunnel and redis (#317) (2f2cb0e)
• incident logs by server (#232) (a9d52b8)
• Incident report - 2023-09-27-expired-ssl-certificate-for-images-on-off2.md (#259) (cf51e97)
• incident reporting (361ddaf)
• kibana status problem report (#131) (c0fdecc)
• make dependabot semantic (3a3f513)
• matomo better mariadb config and systemd services (0018356)
• matomo for performance (#285) (fdbc76f)
• matomo is behind a reverse proxy (#117) (62e8266)
• matomo multi archive (9ddef94)
• matomo perf tunning again (#300) (ddf4070)
• Matomo setup on forum (#211) (bef72c2)
• Monitoring move (#164) (1e84e9c)
• more info on logs index lyfecycle management (69568f2)
• more post opff install things (8997781)
• move off-query (ct 115 on off1) docker volume from hdd to nvme (#357) (2f2b5e0)
• move off-query to moji (+ipv6 on off2) (#401) (7776b76)
• Move old Product Opener folders to backup (#299) (3bc2735)
• moved off query to new location (168ec70)
• moving logs of obf,opf,opff (aedc135)
• moving off-query to off1 (53eceb9)
• nginx logrotate on ovh3 (850b716)
• obf and opf install on off2 (#233) (62400f9)
• odoo: improve doc on how to install modules (8f9d5f2)
• off-query deployment (#358) (04b7fb4)
• off1 exim panic log (#253) (99518ce)
• off1 hardware upgrade (#278) (6a96478)
• off2 opff install (#205) (af7b1f2)
• opiniated use of github secrets (4240e4b)
• overview - more than two data centers (c75b110)
• ovh3 broken disks (#302) (53bd458)
• page on mongodb and logrotate (#208) (4ec9abc)
• PM on lost ip on ovh reverse proxy (#378) (6d10066)
• Post mortem on ovh1 disk space (#325) (3827c7d)
• post mortem on rpool full on off1 (#245) (e6f6cca)
• postfix prometheus exporter (#391) (9c75150)
• Postmortem of the incident of 202-05-19 (#224) (6ab227f)
• prod achitecture overview (#191) (work in progress) (3245907)
• pull snapshots from moji to ovh3 server (61b97d3)
• put ovh proxy confs in same directory (382563e)
• redis install (#307) (4d30762)
• removed sync_s3_images.py (e155d40)
• report ARP problem on off2 (08f3e93)
• report of removing containers on proxmox (f938e71)
• report on monitoring disk space fix (#286) (e449761)
• Report on moving off-query to off, (142be7f)
• report on openfoodfacts-search deploy (#149) (f3101f2)
• report on ovh3 disk replace (#241) (de09598)
• report sunday incident to off3 logs (8ef489b)
• restructure backups (#323) (0db2508)
• run matomo cli command (674c542)
• section about the Monthly meetings (#172) (889d65b)
• set editor for alex (3adc748)
• setup to test folksonomy on Open Products Facts (#405) (fed78e4)
• site setup in matomo (#112) (505c154)
• slack invitation documentation (5251a59)
• small updates to readme (ff6fcac)
• some docs about nesting needed for containers (#283) (f5066d2)
• some hints about prometheus (#282) (09c777e)
• some more cleaning (bd68738)
• some more docs (9b51d45)
• some more info on DKIM / SPF (#371) (72586ab)
• some temporary fixes on obf.com test site (e931f0a)
• some zfs commands (4b1b4e0)
• split VM disks - take 2 (8ae2c54)
• switch redis config to 7.2.4 (ddf5ea4)
• try to fix formating in mail.md (e40cace)
• Update 2023-07-16-ovh3-sdc-broken.md (0a12984)
• update odoo module install (#157) (2cf5af2)
• update overview (#408) (223b132)
• Update README.md by adding status page (#379) (7b87f14)
• update robotoff nginx config (dd02fd4)
• update sto-product-sync as is on off1 (#256) (1476c8e)
• update stunnel configuration for OVH1 (proxy) server (5c77a29)
• updating docker docs (#147) (448f9e2)
• use env name in docker compose project name (6980f8d)
• utils to set author name (6f8ce0d)
• zfs docs improvements (#277) (2459ba1)