949 GitHub url check

[ewan-escience]

Better GitHub repo URL checks

Changes proposed in this pull request:

• The scrapers now only attempt to scrape a GitHub repo if the URL points to the root of a single repository, reducing the amount of error logs generated.
• Add a warning to the maintainer page if a GitHub repo URL seems not to be valid.

How to test :

• docker compose down --volumes && docker compose build --parallel && docker compose up --scale data-generation=0
• Create a software page, publish it, and enter https://github.com/research-software-directory/RSD-as-a-service/issues as repo URL. This should generate a warning in orange text but should succeed.
• Run the varous Git scrapers (or wait for them to run):
  • docker compose exec scrapers java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.git.MainProgrammingLanguages
  • docker compose exec scrapers java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.git.MainContributors
  • docker compose exec scrapers java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.git.MainBasicData
  • docker compose exec scrapers java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.git.MainCommits
• Login as admin and check that no error logs exist.
• Check that the errors at http://localhost/api/v1/repository_url make sense and that the scraped_at fields were set.
• Change the repo URL again to something else invalid, for example https://github.com/research-software-directory/RSD-as-a-service/tree/949-github-url-check and https://github.com/research-software-directory should behave the same as above.
• Now change the repo URL to be valid: https://github.com/research-software-directory/RSD-as-a-service.
• Run the scrapers again, now they should run succesfully (check the software page and http://localhost/api/v1/repository_url for the results).

Closes #949

PR Checklist:

• Increase version numbers in docker-compose.yml
• Link to a GitHub issue
• Update documentation
• Tests

[dmijatovic]

Nice work!

[sonarcloud]

[scrapers] SonarCloud Quality Gate failed.   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
14 Code Smells

23.2% Coverage
0.0% Duplication

Catch issues before they fail your Quality Gate with our IDE extension SonarLint

[sonarcloud]

[rsd-frontend] SonarCloud Quality Gate failed.   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
1 Code Smell

88.9% Coverage
3.4% Duplication

Catch issues before they fail your Quality Gate with our IDE extension SonarLint