Mail version 1.4

[DavidePrincipi]

Milestone goal is implementing advanced relay settings:

• Enforce sender/login match Implement Postfix relay and smarthost management ns8-mail#95
• Relay rules (host with auth) based on sender address Implement Postfix relay and smarthost management ns8-mail#95
• Relay rules (host with auth) based on recipient address (or @Domain wildcard) Implement Postfix relay and smarthost management ns8-mail#95
• Default transport (smarthost) Implement Postfix relay and smarthost management ns8-mail#95
• Configurable queue lifetime Change Mail Queue max lifetime from UI #6886
• API for relay rules Add actions for relay rule management ns8-mail#99
• API for mynetworks table
• UI for open relay from certains IP/networks -- mynetworks table Add UI for Relay page and Relay Settings view ns8-mail#103
• UI for relay rules Add UI for Relay page and Relay Settings view ns8-mail#103
• Migration of NS7 smarthosts DB
  • Migration from Esmith smarthosts to sqlite relayrules ns8-mail#102
  • Add smarthosts.json to the mail migration script nethserver-ns8-migration#65
• SMTPS client encryption for port like 465
  • Relayrules SMTP TLS wrappermode ns8-mail#105
  • Set TLS connection type: smtps/starttls ns8-mail#104
• Integrate Settings > Email notifications with Mail module instances:
  • Configure a Mail instance as Email notifications gateway ns8-core#623
  • Integrate Email notifications UI with Mail app instances ns8-core#624
• Mail archive for individual message restoration
  • Upgrade piler to 1.4.4 ns8-piler#6
  • Update mail server configuration and random TCP port ns8-piler#7
  • Refactor destroy-module action in imageroot to remove relay from mail server and set always_bcc if necessary ns8-piler#8
  • Refactor password handling and UI updates ns8-piler#10
  • Update CAPTCHA_FAILED_LOGIN_COUNT to 0 in config-site.php ns8-piler#11
  • Allow the bulk and selective email restoration by smtp ns8-piler#12
  • Add option to wait between email importation ns8-piler#13
  • Add timestamp options for importing emails ns8-piler#14
  • Remove import-email-to-piler service and script ns8-piler#15
  • Update retention days in piler.conf template ns8-piler#16
  • Add queuedir configuration for purging emails cron job ns8-piler#17
  • Add inline notifications for one-time installation and mail server configuration status ns8-piler#18
  • Add set-always-bcc and get-always-bcc actions ns8-mail#109
• Migration of Enforce sender/login match flag -- Add import-module script for POSTFIX_RESTRICTED_SENDER and network table ns8-mail#108
• Migration of open relay host list
  • Add networks.json to the mail migration script nethserver-ns8-migration#66
  • Add import-module script for POSTFIX_RESTRICTED_SENDER and network table ns8-mail#108
• Add Admin's manual section for Relay rules and new Settings section Fix Mail page for release 1.4 ns8-docs#89
• Piler Admin's manual section Add Piler module section ns8-docs#93
• Migration docs Add Mail app information for migration ns8-docs#95
• Add to ns8-repomd Add Piler application ns8-repomd#37

See also

• other "mail" cards in the project
• NS8 stable announcement

[nethbot]

in 7.9.2009/testing:

• nethserver-ns8-migration-1.0.9-1.2.g287b28e.ns7.x86_64.rpm x86_64

[DavidePrincipi]

Initial testing releases (still missing migration procedures)

• core 2.8.0-dev.1
• mail 1.4.0-dev.1

[DavidePrincipi]

New feature of Core:

• The Settings > Email notifications page can now switch between manual / Mail configuration

New features of Mail:

• The Relay page (add/edit/remove a relay rule), the default/wildcard relay host (aka "smarthost") rule
• Added support to relay hosts with SMTPS (e.g. TLS-wrap on port 465)
• The Settings > Relay card (IP-based relay authorization, enforce sender/login match switch)

Test case 1A

1. Install a new cluster with Core from testing
2. In the Cluster Status page, the "Email notifications" card is present: click the link to reach the settings card
3. As alternative, the usual way: Settings > Email notifications
4. The "Email notifications" settings card allows to manually configure a SMTP server as mail gateway for apps, as usually. Check there are no regressions here.
5. If Mail mode is selected, a message is displayed: proceed to case 2.

Test case 1B

Continue from case 1A,

1. Install a User Domain and configure Mail
2. Check mail1 can be selected from Email notifications settings card
3. Check the new Mail features work as expected: the behavior must be the same of NS7
   • relay rules with/without authentication
   • relay rule with TLS-wrap relay host
   • relay rule with STARTTLS relay host
   • default rule (smarthost)
   • IP-based authorization allow list: save/check/remove items
   • sender/login match policy
   • disabled and deleted rules are not enforced any more

Note: check both English and Italian translations.

Test case 2

Install a new cluster with Core 2.7.0 and Mail 1.3.6. Test the upgrade path.

Test case 3

Migration from NS7 including new features: still on development see it in next comments.

Test case 4

Piler mail archive module. See comment below.

[krejcar25]

Initial testing releases (still missing migration procedures)

• core 2.8.0-dev.1
• mail 1.4.0-dev.1

Hi, is there a way to manually apply the migrations at this point? I am seeing errors like below in mail app log.

2024-04-18T13:59:07+02:00 [1:mail1:postfix/trivial-rewrite] fatal: dict_sqlite_lookup: /etc/postfix/relaydest.cf: SQL prepare failed: no such table: relayrules?

Sent mail is being rejected due to sender/login mismatch while [email protected] is used as sender, logging in as user.

[DavidePrincipi]

Thanks for pointing it out. To manually create the missing table run this command.

runagent -m mail1 podman exec -i postfix sqlite3 -echo /srv/pcdb.sqlite '.read /etc/postfix/pcdb-relayrules.sql'

[krejcar25]

Thank you so much, that worked perfectly. I can now send mail again.

[DavidePrincipi]

In Mail 1.4.0-dev.2

• The upgrade procedure should be fixed NethServer/ns8-mail@8849999
• Fixed the Enforce sender/login switch default position NethServer/ns8-mail@e64b987

[DavidePrincipi]

Test case 4

• Case2 is VERIFIED BUT...
  The Piler service is not restarted after pressing the "Save" button. The UI remains in reload state indefinitely. In logs:

  Termination signal seems not handled by the container:

   time="2024-05-10T16:17:58Z" level=warning msg="StopSignal SIGTERM failed to stop container piler-app in 10 seconds, resorting to SIGKILL"
  

  MariaDB wants to access a file without SELinux permissions

   May 10 16:18:01 rl30.dp.nethserver.net mariadb-app[680728]: 2024-05-10 16:18:01+00:00 [Warn] [Entrypoint]: /sys/fs/cgroup///memory.pressure not writable, functionality unavailable to MariaDB
  

  Don't know how to workaround this on MariaDB side, the container startup fails and the module enters an infinite crashloop.

   ausearch -a 182497 | audit2why                                                                          
   type=AVC msg=audit(1715358840.083:182497): avc:  denied  { write } for  pid=686389 comm="docker-entrypoi" name="memory.pressure" dev="cgroup2" ino=80378 scontext=system_u:system_r:container_t:s0:c119,c654 tcontext=unconfined_u:object_r:cgroup_t:s0 tclass=file permissive=0 ...
  

  On the SELinux side, this fixes the crashloop (well, maybe...):

   # setsebool -P container_manage_cgroup 1                                                                  
  

  ---

  ⚠️ The validation error text is hidden by the drop-down selector when it receives focus in response to the backend validation error.

  

[DavidePrincipi]

I also failed to save a retention rule. When I press the Apply button of route /index.php?route=policy/retention:

a bug to upstream is done : jsuto/piler#43

[lucagasparini]

Installed:

• core 2.8.0-dev.8
• mail 1.4.0-dev.5

Test case 1A + 1B: VERIFIED

Installed and update:

• core 2.7.0 > update 2.8.0-dev.8
• mail 1.3.6 > update 1.4.0-dev.5

Test case 2: VERIFIED

[nrauso]

test case 3: VERIFIED

migration worked as expected in all the considered scenarios.

[DavidePrincipi]

Released Mail https://github.com/NethServer/ns8-mail/releases/tag/1.4.0
Released Core https://github.com/NethServer/ns8-core/releases/tag/2.8.0

Piler is still not released, but it does not block other components.

[nethbot]

in 7.9.2009/updates:

• nethserver-ns8-migration-1.0.10-1.ns7.x86_64.rpm x86_64

[stephdl]

new version to test of piler 1.0.0.-dev.5

#6895 (comment)

[DavidePrincipi]

Test case 4: VERIFIED

Install, clone, backup, restore of Piler 1.0.0

• Manual page https://docs.nethserver.org/projects/ns8/en/latest/piler.html
• Release https://github.com/NethServer/ns8-piler/releases/tag/1.0.0