Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve pipeline level snapshots #1379

Merged
merged 53 commits into from
Oct 2, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
53 commits
Select commit Hold shift + click to select a range
eada63d
make snapshot versions pretty
maxulysse Sep 13, 2024
e567889
update CHANGELOG
maxulysse Sep 13, 2024
c652e79
update all snapshots
maxulysse Sep 13, 2024
f1d624e
Merge branch 'dev' into better_snapshots
maxulysse Sep 13, 2024
d145a1b
update half of all snaps
maxulysse Sep 13, 2024
6096641
Merge branch 'dev' into better_snapshots
maxulysse Sep 13, 2024
29af996
more snapshots
maxulysse Sep 13, 2024
caa80e6
update snapshots
maxulysse Sep 13, 2024
03b6501
update snapshots
maxulysse Sep 13, 2024
4dc9fb8
Update CHANGELOG.md
maxulysse Sep 14, 2024
2be93d8
update snapshots
maxulysse Sep 14, 2024
6904250
do not sort output
maxulysse Sep 17, 2024
0ae5f13
Merge branch 'dev' into better_snapshots
maxulysse Sep 17, 2024
96c415d
sort output by PATH
maxulysse Sep 17, 2024
ca3a646
update snapshots
maxulysse Sep 17, 2024
fb6c429
Merge branch 'dev' into better_snapshots
maxulysse Sep 17, 2024
17054a4
snapshot more files
maxulysse Sep 17, 2024
5b41e56
snapshot more files
maxulysse Sep 17, 2024
6aee372
feature counts snapshots
maxulysse Sep 18, 2024
4d143b5
typo
maxulysse Sep 18, 2024
a3e0328
more snapshots
maxulysse Sep 18, 2024
4811e91
more snapshots
maxulysse Sep 18, 2024
30d629b
update snapshots
maxulysse Sep 18, 2024
c26abe5
better regex
maxulysse Sep 18, 2024
7906611
fix regex
maxulysse Sep 18, 2024
c561922
better regex
maxulysse Sep 18, 2024
77e9cc1
update snapshot
maxulysse Sep 19, 2024
d979788
code polish
maxulysse Sep 19, 2024
742bfa1
rescue some snaps
maxulysse Sep 19, 2024
c9e8d0f
Apply suggestions from code review
maxulysse Sep 19, 2024
26f3993
tiny refactor part I
maxulysse Sep 19, 2024
e44a03c
tiny refactor part II - IT IS GROOVY WE CAN SUBSTRACT :facepalm:
maxulysse Sep 19, 2024
ed2cf1f
update regexes
maxulysse Sep 19, 2024
9234922
move pipeline regexes in UTILS_PIPELINE
maxulysse Sep 19, 2024
26737a7
simplify regexes
maxulysse Sep 19, 2024
3172eaa
fix regexes
maxulysse Sep 19, 2024
a6a3107
snapshots all filenames
maxulysse Sep 19, 2024
dc788b4
Merge branch 'dev' into better_snapshots
maxulysse Sep 20, 2024
8550e6d
code polish
maxulysse Sep 20, 2024
5a62a0f
typo
maxulysse Sep 20, 2024
712342a
no snpashots of tasks size for workflow for remove_ribo_rna
maxulysse Sep 20, 2024
134fe31
Merge branch 'dev' into better_snapshots
maxulysse Sep 20, 2024
5bd3d87
snapshot number of sucessful tasks
maxulysse Sep 23, 2024
0df0995
typo
maxulysse Sep 23, 2024
b21e93c
Update tests/featurecounts_group_type.nf.test
maxulysse Sep 23, 2024
8dc2d34
why was this not commited?
maxulysse Sep 23, 2024
5d79bdc
use nft-utils
maxulysse Oct 1, 2024
07ba1b9
update nftignore
maxulysse Oct 1, 2024
00a87fc
Merge branch 'dev' into better_snapshots
maxulysse Oct 1, 2024
a83ce56
update pipeline versions in snapshot
maxulysse Oct 1, 2024
7d14c74
update nftignore
maxulysse Oct 1, 2024
2b856b7
update nftignore
maxulysse Oct 1, 2024
1d35e2a
use nft-utils 0.0.2 to get relative path in snapshots
maxulysse Oct 2, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Enhancements & fixes

- [PR #1374](https://github.com/nf-core/rnaseq/pull/1374) - Bump pipeline version to 3.16.0dev
- [PR #1379](https://github.com/nf-core/rnaseq/pull/1379) - Enhance pipeline level test snapshots
maxulysse marked this conversation as resolved.
Show resolved Hide resolved
- [PR #1380](https://github.com/nf-core/rnaseq/pull/1380) - Fix issues with R modules changing sample names
- [PR #1381](https://github.com/nf-core/rnaseq/pull/1381) - Update all modules following massive conda usage update in nf-core modules
- [PR #1382](https://github.com/nf-core/rnaseq/pull/1381) - Slight fixes for rnaseq preprocessing
Expand Down
1 change: 1 addition & 0 deletions nf-test.config
Original file line number Diff line number Diff line change
Expand Up @@ -13,5 +13,6 @@ config {
// load the necessary plugins
plugins {
load "[email protected]"
load "[email protected]"
}
}
125 changes: 125 additions & 0 deletions tests/.nftignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,125 @@
**/*DupRate_plot.{pdf,r}
**/*Log.out
**/*Log.{final,progress}.out
**/*_fastqc.{html,zip}
**/*_raw.{html,zip}
**/*_{duprateExpBoxplot,duprateExpDens,expressionHist}.{pdf,png,svg}
**/*bam_stat.txt
**/*coverage.gtf
**/*fastq.gz_trimming_report.txt
**/*featureCounts.txt.summary
**/*gene.abundance.txt
**/*hisat2.summary
**/*inner_distance*
**/*junction*
**/*markdup.sorted.MarkDuplicates.metrics.txt
**/*markdup.sorted.{bam,bam.bai}
**/*read_distribution.txt
**/*sorted.bam.{flagstat,idxstats,stats}
**/*sortmerna.log
**/*splice_{events,junction}.{pdf,png,svg}
**/*transcripts.gtf
**/*{cnt,model,theta}
**/*{css,gif,js}
**/*{forward,reverse}.bigWig
**/*{genes,isoforms}.results
**/*{pos,seq}.DupRate.xls
**/*{salmon,star_salmon,star_rsem}_deseq2_clustering-plot*{pdf,png,txt}
**/Junction*.png
**/Reads*.png
**/abundance.{h5,tsv}
**/cutadapt_filtered_reads_plot-{cnt,pct}.{pdf,svg}
**/cutadapt_trimmed_sequences_*{pdf,svg}
**/deseq2*
**/dupradar-section-plot.{pdf,svg}
**/fail_mapped_samples_table*
**/fail_strand_check_table*
**/fastqc-status-check-*{pdf,svg}
**/fastqc_adapter_content_plot.{pdf,png,svg}
**/fastqc_overrepresented_sequences_plot*{pdf,svg}
**/fastqc_per_base_*_plot*{pdf,png,svg}
**/fastqc_per_sequence_*{pdf,svg}
**/fastqc_sequence_length_distribution_plot.{pdf,png,svg}
**/fastqc_sequence_{counts,duplication_levels}_plot*{pdf,svg}
**/fastqc_top_overrepresented_sequences_table*{pdf,png,svg,txt}
**/featurecounts_biotype_plot-{cnt,pct}.{pdf,svg}
**/fld.gz
**/flenDist.txt
**/general_stats_table.{pdf,png,svg}
**/hisat2_pe_plot.txt
**/hisat2_se_plot*{png,svg}
**/hisat2_{pe,se}_plot-{cnt,pct}.{pdf,png,svg}
**/junction_saturation_known.txt
**/junction_saturation_novel.txt
**/kallisto_alignment*{pdf,png,svg}
**/kallisto_alignment.txt
**/kallisto_quant.log
**/meta_info.json
**/multiqc_data.json
**/multiqc_dupradar-section-plot.txt
**/multiqc_fail_strand_check_table.txt
**/multiqc_general_stats.txt
**/multiqc_hisat2.txt
**/multiqc_kallisto.txt
**/multiqc_picard_dups.txt
**/multiqc_plots
**/multiqc_report.html
**/multiqc_rsem.txt
**/multiqc_rseqc_bam_stat.txt
**/multiqc_rseqc_infer_experiment.txt
**/multiqc_rseqc_junction_annotation.txt
**/multiqc_rseqc_read_distribution.txt
**/multiqc_salmon.txt
**/multiqc_samtools_flagstat.txt
**/multiqc_samtools_stats.txt
**/multiqc_software_versions.txt
**/multiqc_sortmerna.txt
**/multiqc_sources.txt
**/multiqc_star.txt
**/multiqc_{salmon,star_salmon}_deseq2_pca-plot*txt
**/picard_deduplication-{cnt,pct}.{pdf,png,svg}
**/picard_deduplication.txt
**/qualimapReport.html
**/qualimap_gene_coverage_profile_Counts.{pdf,svg}
**/qualimap_gene_coverage_profile_Normalised.{pdf,svg}
**/qualimap_genomic_origin-{cnt,pct}.{pdf,png,svg}
**/qualimap_genomic_origin.txt
**/qualimap_rnaseq_genome_results.txt
**/quant.genes.sf
**/quant.sf
**/rnaseq_qc_results.txt
**/rsem_assignment_plot-{cnt,pct}.{pdf,png,svg}
**/rsem_assignment_plot.txt
**/rsem_multimapping_rates.{pdf,svg,txt}
**/rseqc_bam_stat.{pdf,png,svg,txt}
**/rseqc_infer_experiment_plot.{pdf,svg}
**/rseqc_inner_*
**/rseqc_junction_*
**/rseqc_read_distribution_*
**/rseqc_read_dups.txt
**/rseqc_read_dups_plot.txt
**/rseqc_read_dups_plot.{pdf,svg}
**/run_info.json
**/salmon_plot.{pdf,png,svg,txt}
**/salmon_quant.log
**/samtools-flagstat*
**/samtools-idxstats-mapped-reads-plot_Normalised_Counts-log.{pdf,svg}
**/samtools-idxstats-mapped-reads-plot_Normalised_Counts-{cnt,pct}.{pdf,svg}
**/samtools-idxstats-mapped-reads-plot_Observed_over_Expected_Counts-log.{pdf,svg}
**/samtools-idxstats-mapped-reads-plot_Observed_over_Expected_Counts-{cnt,pct}.{pdf,svg}
**/samtools-idxstats-mapped-reads-plot_Raw_Counts-log.{pdf,svg}
**/samtools-idxstats-mapped-reads-plot_Raw_Counts-{cnt,pct}.{pdf,svg}
**/samtools-stats-dp.{pdf,png,svg,txt}
**/sortmerna-detailed-plot-{cnt,pct}.{pdf,svg}
**/sortmerna-detailed-plot.txt
**/star_summary_table.{pdf,png,svg,txt}
**/t_data.ctab
**/{kallisto,salmon}.merged*
**/{salmon,star_rsem}_deseq2_{clustering,pca}-plot.{pdf,png,svg}
**/{salmon,star_rsem}_deseq2_{pca,pca}-plot.{pdf,png,svg}
**/{samtools,star}_alignment_plot*
**/{star_rsem,star_salmon}_deseq2_{clustering,pca}-plot*{pdf,png,svg}
bbsplit/*.stats.txt
pipeline_info/*.{html,json,txt,yml}
**/deseq2_qc/size_factors/*.txt
star_rsem/log/*.log
Loading
Loading