History cache not generated for few projects

[kee98]

For few of my projects, I noticed that history cache are not getting generated when we add multiple projects together to opengrok and sync starts for all of them in parallel. I see following log for the indexer (Please note last few lines where it says list of repository is empty):

2022-12-14 03:43:00.748+0000 FINE t1 Executor.registerErrorHandler: Installing default uncaught exception handler
2022-12-14 03:43:02.580+0000 INFO t1 Configuration.read: Reading configuration from /tmp/tmpg9zctrnx
2022-12-14 03:43:02.789+0000 INFO t1 Indexer.parseOptions: Indexer options: [-R, /tmp/tmpg9zctrnx, --renamedHistory, off, -r, dirbased, -G, -m, 4096, -c, /usr/local/bin/ctags, -U, http://localhost:8080/, -o, /opengrok/etc/ctags.config, -H, perforce-project]
2022-12-14 03:43:02.819+0000 FINE t1 HostUtil.isReachable: URI http://localhost:8080/ is reachable via localhost/127.0.0.1
2022-12-14 03:43:03.298+0000 INFO t1 Indexer.main: Indexer version 1.7.41 (c53c7ab0c2a245118f5fc53532392c76d0a89295) running on Java 11.0.17
2022-12-14 03:43:03.305+0000 FINE t1 Executor.exec: Executing command [/usr/local/bin/ctags --version] in directory /usr/local/tomcat
2022-12-14 03:43:03.386+0000 FINE t1 Statistics.logIt: Finished command [/usr/local/bin/ctags --version] in directory /usr/local/tomcat with exit code 0 (took 75 ms)
2022-12-14 03:43:03.386+0000 FINE t1 Executor.exec: Finished command [/usr/local/bin/ctags --version] in directory /usr/local/tomcat with exit code 0
2022-12-14 03:43:03.392+0000 INFO t1 CtagsUtil.validate: Using ctags: Universal Ctags 5.9.0(441e4a75), Copyright (C) 2015-2022 Universal Ctags Team
Universal Ctags is derived from Exuberant Ctags.
Exuberant Ctags 5.8, Copyright (C) 1996-2009 Darren Hiebert
  Compiled: Dec  8 2022, 10:48:50
  URL: https://ctags.io/
  Optional compiled features: +wildcards, +regex, +iconv, +option-directory, +packcc, +optscript
2022-12-14 03:43:03.393+0000 FINE t1 Executor.exec: Executing command [/usr/local/bin/ctags --list-languages] in directory /usr/local/tomcat
2022-12-14 03:43:03.449+0000 FINE t1 Statistics.logIt: Finished command [/usr/local/bin/ctags --list-languages] in directory /usr/local/tomcat with exit code 0 (took 54 ms)
2022-12-14 03:43:03.450+0000 FINE t1 Executor.exec: Finished command [/usr/local/bin/ctags --list-languages] in directory /usr/local/tomcat with exit code 0
2022-12-14 03:43:03.455+0000 INFO t1 Indexer.prepareIndexer: Generating history cache for all repositories ...
2022-12-14 03:43:03.457+0000 WARNING t1 HistoryGuru.createHistoryCacheReal: History cache is enabled however the list of repositories is empty. Either specify the repositories in configuration or let the indexer scan them.
2022-12-14 03:43:03.458+0000 INFO t1 Indexer.prepareIndexer: Done generating history cache
2022-12-14 03:43:03.463+0000 INFO t1 Indexer.doIndexerExecution: Starting indexing
2022-12-14 03:43:03.785+0000 INFO t1 Indexer.doIndexerExecution: Waiting for the executors to finish

However, when I delete the project from /src (and index, log etc) and add it again it works and creates the cache and I see the log saying invalidation happening :

2022-12-14 03:43:00.778+0000 FINE t1 Executor.registerErrorHandler: Installing default uncaught exception handler
2022-12-14 03:43:02.631+0000 INFO t1 Configuration.read: Reading configuration from /tmp/tmpo4gii2p3
2022-12-14 03:43:02.837+0000 INFO t1 Indexer.parseOptions: Indexer options: [-R, /tmp/tmpo4gii2p3, --renamedHistory, off, -r, dirbased, -G, -m, 4096, -c, /usr/local/bin/ctags, -U, http://localhost:8080/, -o, /opengrok/etc/ctags.config, -H, perforce-project]
2022-12-14 03:43:02.868+0000 FINE t1 HostUtil.isReachable: URI http://localhost:8080/ is reachable via localhost/127.0.0.1
2022-12-14 03:43:03.188+0000 FINE t1 HistoryGuru.invalidateRepositories: invalidating 1 repositories
2022-12-14 03:43:03.230+0000 FINE t21 Executor.exec: Executing command [accurev info] in directory /usr/local/tomcat

So, it seems during the first run, HistoryGuru.invalidateRepositories not happening (?) .

Can someone please have a quick look if that might be an issue... I will try to provide more info if I hit this for more projects...

[vladak]

The warning message History cache is enabled however the list of repositories is empty. says it all - without knowledge of the repository, the history cache cannot be generated. This is also why there is no repository invalidation in the first indexer run - because there are no repositories to invalidate.

According to the indexer options, it seems you are using per project workflow. For that, the configuration passed in via the -R option has to contain the repository information because there is no -S used to scan for the repositories. So for the first indexer run, the repository info was not present for some reason.

How do you add the projects exactly ?

[kee98]

According to the indexer options, it seems you are using per project workflow.

I have not done any customization and using the docker image mostly as it is. But I am not sure if that uses per project workflow.

How do you add the projects exactly ?

I have deployed latest opengrok docker image on k8s cluster and following nfs are mounted on the image:

/opengrok/src
/opengrok/data
/opengrok/etc
/opengrok/log

following ENV variables are passed to container:

        - env:
            - name: SYNC_PERIOD_MINUTES
              value: "60"
            - name: NOMIRROR
              value: "true"
            - name: OPENGROK_SCAN_REPOS
              value: "on"
            - name: OPENGROK_SCAN_DEPTH
              value: "5"
            - name: OPENGROK_GENERATE_HISTORY
              value: "on"
            - name: P4CONFIG
              value: ".p4config"
            - name: P4USER
              value: "username"
            - name: P4TICKETS
              value: "/opengrok/data/secrets/.p4tickets"

To add a new project, we go to /opengrok/src folder and for git project we do git clone and for perforce project:

a. create perforce_project directory
b. create .p4config file with below details:

   P4PORT=perforce.example.com:1666
   P4CLIENT=client1-perforce.example.com.1666
   P4USER=username
   P4TICKETS=/opengrok/data/secrets/.p4tickets

c. p4 login
d. p4 client (do edit the path) and
e. p4 sync

Above steps are automated but exactly done as above. For most of the projects everything works well but for few of them, it doesn't generate history and fails with above error (mentioned in 1st comment). When I delete the src/project, xref/project and data/index/project and add it again, it works well (most of the time).