Skip to content

Add JUnit 5 ScorerExtension for AI model evaluation and associated library #1556

Add JUnit 5 ScorerExtension for AI model evaluation and associated library

Add JUnit 5 ScorerExtension for AI model evaluation and associated library #1556

Triggered via pull request December 18, 2024 09:42
Status Success
Total duration 17m 11s
Artifacts 67

build-pull-request.yml

on: pull_request
Matrix: in-process-embedding-model-tests
Matrix: jvm-tests
Matrix: native-tests
Build report
16s
Build report
Fit to window
Zoom out
Zoom in

Annotations

67 warnings
Quick Build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - model-auth-providers - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - testing - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - memory-stores - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - docs - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - codestarts - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - quarkus-integrations - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - testing-internal - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - tools - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - samples - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - codestarts - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - rag - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - docs - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - core - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - model-auth-providers - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-bge-small-en
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-bge-small-en-v15
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-bge-small-en-q
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-bge-small-en-v15-q
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-all-minilm-l6-v2
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-e5-small-v2
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - quarkus-integrations - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-all-minilm-l6-v2-q
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - memory-stores - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - testing-internal - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - tools - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - testing - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - samples - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - rag - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
In process embedding model tests - embed-e5-small-v2-q
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - core - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - docs - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - embedding-stores - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - quarkus-integrations - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - integration-tests - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - model-auth-providers - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - memory-stores - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - testing - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - testing-internal - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - devui
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - tools - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - model-providers - Java 17
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - codestarts - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - samples - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - easy-rag
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - embedding-stores - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - core - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - multiple-providers
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - rag - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - integration-tests - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - model-providers - Java 21
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - anthropic
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - hugging-face
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - azure-openai
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - embedding-stores - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - devui-multiple-embedding-models
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - mistralai
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - integration-tests - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - ollama
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - rag
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - rag-pgvector-flyway
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - simple-ollama
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - openai
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - rag-pgvector
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JVM tests - model-providers - Java 23
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Native tests - tools
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build report
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Artifacts

Produced during runtime
Name Size
build-reports-1-In process embedding model tests - embed-all-minilm-l6-v2 Expired
10.1 KB
build-reports-1-In process embedding model tests - embed-all-minilm-l6-v2-q Expired
10.1 KB
build-reports-1-In process embedding model tests - embed-bge-small-en Expired
10.2 KB
build-reports-1-In process embedding model tests - embed-bge-small-en-q Expired
10.2 KB
build-reports-1-In process embedding model tests - embed-bge-small-en-v15 Expired
10.2 KB
build-reports-1-In process embedding model tests - embed-bge-small-en-v15-q Expired
10.2 KB
build-reports-1-In process embedding model tests - embed-e5-small-v2 Expired
10.2 KB
build-reports-1-In process embedding model tests - embed-e5-small-v2-q Expired
10.2 KB
build-reports-1-JVM tests - codestarts - Java 17 Expired
4.06 KB
build-reports-1-JVM tests - codestarts - Java 21 Expired
4.35 KB
build-reports-1-JVM tests - codestarts - Java 23 Expired
4.37 KB
build-reports-1-JVM tests - core - Java 17 Expired
345 KB
build-reports-1-JVM tests - core - Java 21 Expired
352 KB
build-reports-1-JVM tests - core - Java 23 Expired
340 KB
build-reports-1-JVM tests - docs - Java 17 Expired
20.5 KB
build-reports-1-JVM tests - docs - Java 21 Expired
20.7 KB
build-reports-1-JVM tests - docs - Java 23 Expired
20.9 KB
build-reports-1-JVM tests - embedding-stores - Java 17 Expired
126 KB
build-reports-1-JVM tests - embedding-stores - Java 21 Expired
119 KB
build-reports-1-JVM tests - embedding-stores - Java 23 Expired
123 KB
build-reports-1-JVM tests - integration-tests - Java 17 Expired
225 KB
build-reports-1-JVM tests - integration-tests - Java 21 Expired
222 KB
build-reports-1-JVM tests - integration-tests - Java 23 Expired
229 KB
build-reports-1-JVM tests - memory-stores - Java 17 Expired
13.1 KB
build-reports-1-JVM tests - memory-stores - Java 21 Expired
13.4 KB
build-reports-1-JVM tests - memory-stores - Java 23 Expired
13.4 KB
build-reports-1-JVM tests - model-auth-providers - Java 17 Expired
4.06 KB
build-reports-1-JVM tests - model-auth-providers - Java 21 Expired
4.35 KB
build-reports-1-JVM tests - model-auth-providers - Java 23 Expired
4.38 KB
build-reports-1-JVM tests - model-providers - Java 17 Expired
616 KB
build-reports-1-JVM tests - model-providers - Java 21 Expired
626 KB
build-reports-1-JVM tests - model-providers - Java 23 Expired
630 KB
build-reports-1-JVM tests - quarkus-integrations - Java 17 Expired
4.64 KB
build-reports-1-JVM tests - quarkus-integrations - Java 21 Expired
4.92 KB
build-reports-1-JVM tests - quarkus-integrations - Java 23 Expired
4.93 KB
build-reports-1-JVM tests - rag - Java 17 Expired
80.5 KB
build-reports-1-JVM tests - rag - Java 21 Expired
79.3 KB
build-reports-1-JVM tests - rag - Java 23 Expired
85.7 KB
build-reports-1-JVM tests - samples - Java 17 Expired
4.06 KB
build-reports-1-JVM tests - samples - Java 21 Expired
4.36 KB
build-reports-1-JVM tests - samples - Java 23 Expired
4.37 KB
build-reports-1-JVM tests - testing - Java 17 Expired
28.9 KB
build-reports-1-JVM tests - testing - Java 21 Expired
29.7 KB
build-reports-1-JVM tests - testing - Java 23 Expired
29.1 KB
build-reports-1-JVM tests - testing-internal - Java 17 Expired
4.06 KB
build-reports-1-JVM tests - testing-internal - Java 21 Expired
4.36 KB
build-reports-1-JVM tests - testing-internal - Java 23 Expired
4.37 KB
build-reports-1-JVM tests - tools - Java 17 Expired
19.8 KB
build-reports-1-JVM tests - tools - Java 21 Expired
20.1 KB
build-reports-1-JVM tests - tools - Java 23 Expired
20.2 KB
build-reports-1-Native tests - anthropic Expired
4.06 KB
build-reports-1-Native tests - azure-openai Expired
4.06 KB
build-reports-1-Native tests - devui Expired
11.5 KB
build-reports-1-Native tests - devui-multiple-embedding-models Expired
12 KB
build-reports-1-Native tests - easy-rag Expired
4.06 KB
build-reports-1-Native tests - hugging-face Expired
4.06 KB
build-reports-1-Native tests - mistralai Expired
4.06 KB
build-reports-1-Native tests - multiple-providers Expired
31.5 KB
build-reports-1-Native tests - ollama Expired
4.06 KB
build-reports-1-Native tests - openai Expired
16.5 KB
build-reports-1-Native tests - rag Expired
4.06 KB
build-reports-1-Native tests - rag-pgvector Expired
4.06 KB
build-reports-1-Native tests - rag-pgvector-flyway Expired
4.06 KB
build-reports-1-Native tests - simple-ollama Expired
4.06 KB
build-reports-1-Native tests - tools Expired
4.06 KB
build-reports-1-Quick Build Expired
6.59 KB
maven-repo Expired
944 MB