How backup nominatim-docker for an offline host

[fakhamatia]

I have an offline machine and it's not connected to the internet at all.
I want to create a container in an online machine and create a clone of it and restore it to the offline machine.

docker run --rm -it -e PBF_URL=https://download.geofabrik.de/asia/iran-latest.osm.pbf -e REPLICATION_URL=https://download.geofabrik.de/asia/iran-updates/ -v nominatim:/var/lib/postgresql/12/main -p 82:8080 --name nominatim-offline mediagis/nominatim:3.7

Log

docker run --rm -it -e PBF_URL=https://download.geofabrik.de/asia/iran-latest.osm.pbf -e REPLICATION_URL=https://download.geofabrik.de/asia/iran-updates/ -v nominatim:/var/lib/postgresql/12/main -p 82:8080 --name nominatim-offline mediagis/nominatim:3.7
Unable to find image 'mediagis/nominatim:3.7' locally
3.7: Pulling from mediagis/nominatim
e1546fde4b38: Pull complete 
d736f0b88956: Pull complete 
Digest: sha256:ace3a05d48b27811c6a92932b0cc60d9994463e7232a9bd02a3e58f60f365d24
Status: Downloaded newer image for mediagis/nominatim:3.7
+ trap stopServices TERM
+ /app/config.sh
+ id nominatim
+ useradd -m -p qaIACxO6wMR3 nominatim
+ IMPORT_FINISHED=/var/lib/postgresql/12/main/import-finished
+ '[' '!' -f /var/lib/postgresql/12/main/import-finished ']'
+ /app/init.sh
+ OSMFILE=/nominatim/data.osm.pbf
+ '[' '' = true ']'
+ echo 'Skipping optional Wikipedia importance import'
Skipping optional Wikipedia importance import
+ '[' '' = true ']'
+ echo 'Skipping optional GB postcode import'
Skipping optional GB postcode import
+ '[' '' = true ']'
+ echo 'Skipping optional US postcode import'
Skipping optional US postcode import
+ echo Downloading OSM extract from https://download.geofabrik.de/asia/iran-latest.osm.pbf
Downloading OSM extract from https://download.geofabrik.de/asia/iran-latest.osm.pbf
+ curl -L https://download.geofabrik.de/asia/iran-latest.osm.pbf --create-dirs -o /nominatim/data.osm.pbf
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  162M  100  162M    0     0  1253k      0  0:02:12  0:02:12 --:--:-- 1210k
+ '[' '!' -f /var/lib/postgresql/12/main/PG_VERSION ']'
+ sudo service postgresql start
 * Starting PostgreSQL 12 database server                                                                                                                                                                   [ OK ] 
+ sudo -u postgres psql postgres -tAc 'SELECT 1 FROM pg_roles WHERE rolname='\''nominatim'\'''
+ grep -q 1
+ sudo -u postgres createuser -s nominatim
+ grep -q 1
+ sudo -u postgres psql postgres -tAc 'SELECT 1 FROM pg_roles WHERE rolname='\''www-data'\'''
+ sudo -u postgres createuser -SDR www-data
+ sudo -u postgres psql postgres -tAc 'ALTER USER nominatim WITH ENCRYPTED PASSWORD '\''qaIACxO6wMR3'\'''
ALTER ROLE
+ sudo -u postgres psql postgres -tAc 'ALTER USER "www-data" WITH ENCRYPTED PASSWORD '\''qaIACxO6wMR3'\'''
ALTER ROLE
+ sudo -u postgres psql postgres -c 'DROP DATABASE IF EXISTS nominatim'
NOTICE:  database "nominatim" does not exist, skipping
DROP DATABASE
+ chown -R nominatim:nominatim /nominatim
+ cd /nominatim
+ sudo -E -u nominatim nominatim import --osm-file /nominatim/data.osm.pbf --threads 16
2021-06-12 20:27:18: Using project directory: /nominatim
2021-06-12 20:27:18: Creating database
2021-06-12 20:27:19: Setting up database
2021-06-12 20:27:19: Loading basic data
2021-06-12 20:27:21: Installing database module
2021-06-12 20:27:21: Importing OSM data file
2021-06-12 20:27:21  osm2pgsql version 1.4.1
2021-06-12 20:27:21  Database version: 12.7 (Ubuntu 12.7-0ubuntu0.20.04.1)
2021-06-12 20:27:21  PostGIS version: 3.0
2021-06-12 20:27:21  Node-cache: cache=326MB, maxblocks=5216*65536, allocation method=11
2021-06-12 20:27:21  Parsing gazetteer style file '/usr/local/etc/nominatim/import-full.style'.
NOTICE:  table "place" does not exist, skipping
2021-06-12 20:29:23  Reading input files done in 122s (2m 2s).                )
2021-06-12 20:29:23    Processed 20908758 nodes in 39s - 536k/s
2021-06-12 20:29:23    Processed 2544139 ways in 74s (1m 14s) - 34k/s
2021-06-12 20:29:23    Processed 83523 relations in 9s - 9k/s
2021-06-12 20:29:23  node cache: stored: 20908758(100.00%), storage efficiency: 50.38% (dense blocks: 123, sparse nodes: 20248256), hit rate: 100.00%
2021-06-12 20:29:23  osm2pgsql took 122s (2m 2s) overall.
2021-06-12 20:29:25: Create functions (1st pass)
2021-06-12 20:29:26: Create tables
2021-06-12 20:29:26: Create functions (2nd pass)
2021-06-12 20:29:27: Create table triggers
2021-06-12 20:29:27: Create partition tables
2021-06-12 20:29:29: Create functions (3rd pass)
2021-06-12 20:29:30: Importing wikipedia importance data
2021-06-12 20:29:30: Wikipedia importance dump file not found. Will be using default importances.
2021-06-12 20:29:30: Initialise tables
2021-06-12 20:29:30: Load data into placex table
 count  
--------
 423592
(1 row)

 count 
-------
  1755
(1 row)

.....................................................................................................................................

2021-06-12 20:34:27: Calculate postcodes
2021-06-12 20:34:33 == Calculate Postcodes
2021-06-12 20:34:33 == WARNING: optional external GB postcode table file (/nominatim/gb_postcode_data.sql.gz) not found. Skipping.
2021-06-12 20:34:33 == WARNING: optional external US postcode table file (/nominatim/us_postcode_data.sql.gz) not found. Skipping.
Summary of warnings:

  * optional external GB postcode table file (/nominatim/gb_postcode_data.sql.gz) not found. Skipping.
  * optional external US postcode table file (/nominatim/us_postcode_data.sql.gz) not found. Skipping.

2021-06-12 20:34:34 == Setup finished.
2021-06-12 20:34:34: Indexing places
2021-06-12 20:34:34: Starting indexing rank (0 to 4) using 16 threads
2021-06-12 20:34:34: Starting rank 1 (using batch size 1)
.
.
.
.
2021-06-12 21:19:10: Done 1258/1258 in 0 @ 1531.621 per second - FINISHED postcodes (location_postcode)

2021-06-12 21:21:21: Post-process tables
2021-06-12 21:25:10: Create search index for default country names.
2021-06-12 21:25:12: Setup website at /nominatim/website
+ sudo -u nominatim nominatim admin --check-database
2021-06-12 21:25:16: Using project directory: /nominatim
2021-06-12 21:25:16: Checking database
Checking database connection ... OK
Checking for placex table ... OK
Checking for placex content ... OK
Checking that nominatim.so module is installed ... OK
Checking indexing status ... OK
Checking that database indexes are complete ... OK
Checking that all database indexes are valid ... OK
Checking TIGER external data table. ... not applicable
+ sudo -E -u nominatim nominatim replication --init
2021-06-12 21:25:17: Using project directory: /nominatim
2021-06-12 21:25:17: Initialising replication updates
2021-06-12 21:25:22: Updates intialised at sequence 2998 (2021-06-11 16:21:37+00:00)
2021-06-12 21:25:22: Create functions
+ sudo service postgresql stop
 * Stopping PostgreSQL 12 database server                                                                                                                                                                   [ OK ] 
+ rm /etc/postgresql/12/main/conf.d/postgres-import.conf
+ echo 'Deleting downloaded dumps in /nominatim'
Deleting downloaded dumps in /nominatim
+ rm -f '/nominatim/*sql.gz' /nominatim/data.osm.pbf
+ touch /var/lib/postgresql/12/main/import-finished
+ cd /nominatim
+ nominatim refresh --website
2021-06-12 21:25:29: Using project directory: /nominatim
2021-06-12 21:25:29: Setting up website directory at /nominatim/website
+ service postgresql start
 * Starting PostgreSQL 12 database server                                                                                                                                                                   [ OK ] 
+ service apache2 start
 * Starting Apache httpd web server apache2                                                                                                                                                                        AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 192.168.0.1. Set the 'ServerName' directive globally to suppress this message
 * 
+ wait
+ tail -f /var/log/postgresql/postgresql-12-main.log
2021-06-12 21:25:24.522 UTC [48] LOG:  aborting any active transactions
2021-06-12 21:25:24.634 UTC [48] LOG:  background worker "logical replication launcher" (PID 55) exited with exit code 1
2021-06-12 21:25:24.690 UTC [50] LOG:  shutting down
2021-06-12 21:25:26.235 UTC [48] LOG:  database system is shut down
2021-06-12 21:25:31.457 UTC [833] LOG:  starting PostgreSQL 12.7 (Ubuntu 12.7-0ubuntu0.20.04.1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0, 64-bit
2021-06-12 21:25:31.457 UTC [833] LOG:  listening on IPv4 address "0.0.0.0", port 5432
2021-06-12 21:25:31.458 UTC [833] LOG:  listening on IPv6 address "::", port 5432
2021-06-12 21:25:31.659 UTC [833] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2021-06-12 21:25:31.899 UTC [834] LOG:  database system was shut down at 2021-06-12 21:25:24 UTC
2021-06-12 21:25:31.977 UTC [833] LOG:  database system is ready to accept connections

I use this command to build a container in the online machine, readme said to use this command to persistent container data.
I have a few questions:

• The --rm remove what? should not remove it?
• variables PBF_URL and REPLICATION_URL want a web URL, the offline machine does not connect to the internet how download pbf file? Or how to give a local path of file?
• I use this commands to backup image and this commands to backup files and database, I used this on different OSM docker project and its work well, can I use it on this project?
• After I create tar backup from image and files and database, in the offline machine what command I enter to run the image to run always?
• Because of not connecting to the internet are there commands or parameters to add or remove for better performance and tuning?

[leonardehrenfried]

If I understand the question correctly you want to move the entire container to another host. For this I would use docker import/export.

https://bobcares.com/blog/docker-export-and-import-containers/

[fakhamatia]

Yes, but another offline host
I want to create a container in one online system and make the backup from container and data. and restore it on the offline system.
variables PBF_URL and REPLICATION_URL get URL, I want to use it in an offline host.
How can I use the local path for files??

[leonardehrenfried]

I don't think I understand what your trying to do but can't you do a docker import, leave the config as it is and let the replication fail?

[fakhamatia]

I update the first post to better explan.
Sorry for bad English.

[leonardehrenfried]

Yes, don't use --rm when you do the import.

After the import is finished you can.use docker import/export to move the data to the offline host.

[Bartizan]

I think the issue is off topic.
@fakhamatia, leonardehrenfried has already pointed in the right direction.
So pay attention that docker images and docker containers are different resources. Don't use '--rm' argument as it removes a container and you will not be able to export it.
I am not sure how Nominatim will behave if internet is off, I guess it handles... otherwise, it is possible to direct to your local web server.