Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TASK-6708 - Port Patch 2.12.7 -> 3.2.1 (Xetabase 1.10.7 -> 2.2.1) #2499

Merged
merged 33 commits into from
Sep 6, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
51e8a5d
Merge branch 'TASK-6345' into TASK-6345-2.12.6
pfurio Jun 21, 2024
d2d02ba
Merge branch 'TASK-6345' into TASK-6345-2.12.6
pfurio Jun 27, 2024
d4eeb13
Merge branch 'release-2.12.x' into TASK-6345-2.12.6
pfurio Jun 27, 2024
8785c7a
Merge branch 'release-2.12.x' into TASK-6345-2.12.6
pfurio Jul 3, 2024
fb2df63
Prepare next release 2.12.7-SNAPSHOT
juanfeSanahuja Jul 5, 2024
393170e
Merge branch 'release-2.12.x' into TASK-6345-2.12.6
pfurio Jul 8, 2024
6485ab4
pom: Added github packages to manage snapshots #TASK-6345
juanfeSanahuja Jul 8, 2024
3552634
pom: Added sonatype also manage snapshots #TASK-6345
juanfeSanahuja Jul 8, 2024
941c98b
pom: Comment sonatype to manage snapshots #TASK-6345
juanfeSanahuja Jul 8, 2024
59fb8de
pom: Comment repositories section #TASK-6345
juanfeSanahuja Jul 8, 2024
166300c
pom: Restore repositories section #TASK-6345
juanfeSanahuja Jul 8, 2024
008a3bb
Merge branch 'TASK-6345' into TASK-6345-2.12.6
pfurio Jul 8, 2024
e3de2b8
storage-core pom: Exclusion distlib #TASK-6345
juanfeSanahuja Jul 8, 2024
437c164
Merge branch 'TASK-6345-2.12.6' of github.com:opencb/opencga into TAS…
juanfeSanahuja Jul 8, 2024
9e480fc
Merge branch 'TASK-6345' into TASK-6345-2.12.6
pfurio Jul 9, 2024
5d07f87
Merge branch 'TASK-6345' into TASK-6345-2.12.6
pfurio Jul 10, 2024
ceca043
Merge pull request #2473 from opencb/TASK-6345-2.12.6
pfurio Jul 11, 2024
f7e8ccb
storage: Do not use CIEND on INSERTIONS to build HBase RowKey. #TASK-…
j-coll Jul 16, 2024
f601da6
storage: Remove uneeded assumptions in tests. #TASK-6558
j-coll Jul 17, 2024
a1f19fe
Merge pull request #2484 from opencb/TASK-6558
j-coll Aug 6, 2024
86512aa
analysis: Fix ClinicalInterpretationAnalysisTest tests. #TASK-6703
j-coll Jul 11, 2024
d84e860
storage: Fix VariantLocalConflictResolverTest tests. #TASK-6703
j-coll Aug 7, 2024
fab3cab
analysis: Fix test VariantOperationsTest#testCellbaseConfigure #TASK-…
j-coll Jul 12, 2024
ed3efc8
storage: Fix tests VariantQueryExecutorTest. #TASK-6703
j-coll Aug 7, 2024
90c4fe8
Merge pull request #2493 from opencb/TASK-6703
j-coll Aug 8, 2024
0c6551b
storage: Ensure SearchIndexVariantQueryExecutor is used with skip>500…
j-coll Aug 30, 2024
1b764f1
Merge pull request #2498 from opencb/TASK-6789
j-coll Aug 30, 2024
11ecea3
Prepare release 2.12.7
juanfeSanahuja Sep 2, 2024
3412c6b
preparing Port Patch 1.10.7 -> 2.2.1
juanfeSanahuja Sep 3, 2024
58db895
Merge branch 'release-3.2.x' into TASK-6708
juanfeSanahuja Sep 3, 2024
b664fb1
storage: Fix junit tests. #TASK-6708
j-coll Sep 6, 2024
b190236
app: Fix migration test. Missing projectMetadata #TASK-6708
j-coll Sep 6, 2024
f0b62af
anaysis: Fix OpenCGATestExternalResource creating analysis/exomiser. …
j-coll Sep 6, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -81,6 +81,7 @@ public void singleExomiserAnalysis() throws IOException, CatalogException, ToolE
// String resourceVersion = "2109";
String exomiserVersion = "14.0";
String resourceVersion = "2402";
assertTrue(opencga.getOpencgaHome().resolve("analysis").resolve("exomiser").resolve(exomiserVersion).toFile().exists());
assumeTrue(Paths.get("/opt/opencga/analysis/resources/exomiser/READY-" + resourceVersion).toFile().exists());

prepareExomiserData();
Expand Down Expand Up @@ -131,6 +132,7 @@ public void familyExomiserAnalysis() throws IOException, CatalogException, ToolE
// String resourceVersion = "2109";
String exomiserVersion = "14.0";
String resourceVersion = "2402";
assertTrue(opencga.getOpencgaHome().resolve("analysis").resolve("exomiser").resolve(exomiserVersion).toFile().exists());
assumeTrue(Paths.get("/opt/opencga/analysis/resources/exomiser/READY-" + resourceVersion).toFile().exists());

prepareExomiserData();
Expand Down Expand Up @@ -180,6 +182,7 @@ public void trioSingleExomiserAnalysis() throws IOException, CatalogException, T
// String resourceVersion = "2109";
String exomiserVersion = "14.0";
String resourceVersion = "2402";
assertTrue(opencga.getOpencgaHome().resolve("analysis").resolve("exomiser").resolve(exomiserVersion).toFile().exists());
assumeTrue(Paths.get("/opt/opencga/analysis/resources/exomiser/READY-" + resourceVersion).toFile().exists());

prepareExomiserData();
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@
import org.opencb.commons.datastore.mongodb.MongoDataStore;
import org.opencb.commons.datastore.mongodb.MongoDataStoreManager;
import org.opencb.opencga.analysis.StorageManager;
import org.opencb.opencga.analysis.clinical.exomiser.ExomiserInterpretationAnalysisTest;
import org.opencb.opencga.analysis.tools.ToolRunner;
import org.opencb.opencga.analysis.variant.manager.VariantStorageManager;
import org.opencb.opencga.catalog.db.mongodb.MongoBackupUtils;
Expand Down Expand Up @@ -220,9 +219,9 @@ public Path isolateOpenCGA() throws IOException {

catalogManagerExternalResource.getConfiguration().serialize(
new FileOutputStream(conf.resolve("configuration.yml").toFile()));
InputStream inputStream = StorageManager.class.getClassLoader().getResourceAsStream("storage-configuration.yml");

storageConfiguration = StorageConfiguration.load(inputStream, "yml");
try (InputStream inputStream = StorageManager.class.getClassLoader().getResourceAsStream("storage-configuration.yml")) {
storageConfiguration = StorageConfiguration.load(inputStream, "yml");
}

storageConfiguration.getVariant().setDefaultEngine(storageEngine);
if (storageEngine.equals(HadoopVariantStorageEngine.STORAGE_ENGINE_ID)) {
Expand Down Expand Up @@ -259,20 +258,22 @@ public Path isolateOpenCGA() throws IOException {

// Mutational signatue analysis
Path analysisPath = Files.createDirectories(opencgaHome.resolve("analysis/mutational-signature")).toAbsolutePath();
inputStream = new FileInputStream("../opencga-app/app/analysis/mutational-signature/sv_clustering.R");
Files.copy(inputStream, analysisPath.resolve("sv_clustering.R"), StandardCopyOption.REPLACE_EXISTING);
try (FileInputStream inputStream = new FileInputStream("../opencga-app/app/analysis/mutational-signature/sv_clustering.R")) {
Files.copy(inputStream, analysisPath.resolve("sv_clustering.R"), StandardCopyOption.REPLACE_EXISTING);
}

// Pedigree graph analysis
analysisPath = Files.createDirectories(opencgaHome.resolve("analysis/pedigree-graph")).toAbsolutePath();
inputStream = new FileInputStream("../opencga-app/app/analysis/pedigree-graph/ped.R");
Files.copy(inputStream, analysisPath.resolve("ped.R"), StandardCopyOption.REPLACE_EXISTING);
try (FileInputStream inputStream = new FileInputStream("../opencga-app/app/analysis/pedigree-graph/ped.R")) {
Files.copy(inputStream, analysisPath.resolve("ped.R"), StandardCopyOption.REPLACE_EXISTING);
}

// Exomiser analysis files
List<String> exomiserVersions = Arrays.asList("13.1", "14.0");
List<String> exomiserFiles = Arrays.asList("application.properties", "exomiser-analysis.yml", "output.yml");
for (String exomiserVersion : exomiserVersions) {
analysisPath = Files.createDirectories(opencgaHome.resolve("analysis/exomiser").resolve(exomiserVersion).toAbsolutePath());
Path exomiserPath = Paths.get(ExomiserInterpretationAnalysisTest.class.getClassLoader().getResource("exomiser").getPath());
Path exomiserPath = Paths.get("../opencga-app/app/analysis/exomiser");
for (String exomiserFile : exomiserFiles) {
String resource = exomiserVersion + "/" + exomiserFile;
Files.copy(exomiserPath.resolve(resource).toAbsolutePath(), analysisPath.resolve(exomiserFile), StandardCopyOption.REPLACE_EXISTING);
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@
import org.opencb.opencga.core.models.sample.Sample;
import org.opencb.opencga.core.models.study.Study;
import org.opencb.opencga.core.testclassification.duration.MediumTests;
import org.opencb.opencga.storage.core.variant.VariantStorageEngine;
import org.opencb.opencga.storage.core.variant.VariantStorageOptions;

import java.nio.file.Files;
Expand All @@ -46,7 +47,6 @@
import static org.hamcrest.CoreMatchers.anyOf;
import static org.hamcrest.CoreMatchers.is;
import static org.junit.Assert.*;
import static org.opencb.opencga.storage.core.variant.VariantStorageBaseTest.getResourceUri;

/**
* Created on 10/07/17.
Expand Down Expand Up @@ -140,7 +140,7 @@ public void testLoadAndRemoveDifferentChromosomes() throws Exception {
List<File> files = new ArrayList<>();
files.add(create("1k.chr1.phase3_shapeit2_mvncall_integrated_v5.20130502.genotypes.vcf.gz"));
files.add(create("10k.chr22.phase3_shapeit2_mvncall_integrated_v5.20130502.genotypes.vcf.gz"));
indexFiles(files, new QueryOptions(), outputId);
indexFiles(files, new QueryOptions(VariantStorageOptions.LOAD_SPLIT_DATA.key(), VariantStorageEngine.SplitData.CHROMOSOME), outputId);

removeFile(files.get(0), new QueryOptions());
}
Expand Down

This file was deleted.

This file was deleted.

13 changes: 0 additions & 13 deletions opencga-analysis/src/test/resources/exomiser/13.1/output.yml

This file was deleted.

This file was deleted.

This file was deleted.

11 changes: 0 additions & 11 deletions opencga-analysis/src/test/resources/exomiser/14.0/output.yml

This file was deleted.

Loading
Loading