-
Notifications
You must be signed in to change notification settings - Fork 83
Dsl2 new test configs #1121
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Dsl2 new test configs #1121
Changes from 22 commits
Commits
Show all changes
67 commits
Select commit
Hold shift + click to select a range
f8b0d2b
adding modern test
jbv2 e44842f
adding microbial genome test, but missing samplesheet dsl2 to test
jbv2 24cc109
adding short dna, still need the ncbi dir to be set
jbv2 ead8ada
adding test_humanpopgen
jbv2 66aafdf
adding test default
jbv2 2689873
minor updates
jbv2 981cd92
finnished v1 test configs
jbv2 3597d6f
finnished but error with mapDamage --rescale. Mixing different refere…
jbv2 67bde36
removing old profiles
jbv2 56a3ab5
replacing test.config
jbv2 ff452d9
replacing nothing to minimal
jbv2 dd12a5b
adding genotyping source
jbv2 2c0bb13
update nextflow.config
jbv2 e10099b
Merge branch 'dev' into dsl2-new_test_configs
jfy133 57809e5
Update conf/test.config
jfy133 636e5d5
Update conf/test.config
jfy133 b08e6ac
Move kraken2 to humanpopgen
jfy133 ccf180c
removing fastp
jbv2 b1bba76
adding fastp and changing input and fasta
jbv2 52df92b
excluding fasta
jbv2 22433a9
Deactivate rescaling, fix freebayes problem
jfy133 030e28d
Merge branch 'dsl2-new_test_configs' of https://github.com/jbv2/eager…
jfy133 040ceea
Merge branch 'dev' into dsl2-new_test_configs
jfy133 89262a2
Update conf/modules.config
jbv2 04c75a1
Update conf/modules.config
jbv2 23c110f
Merge branch 'dev' into dsl2-new_test_configs
jbv2 13bc21a
Update conf/modules.config
jbv2 396fd25
And for haplotypecaller
jfy133 d73f2e9
Merge branch 'dsl2-new_test_configs' of https://github.com/jbv2/eager…
jfy133 2051309
Use correct GATK UG ploidy flag and remove duplicate
jfy133 8a471e3
Use new test configs in ci test
jfy133 f8a388f
Fix parameter for GATK HC too
jfy133 9f1c719
Replace minimal test data with mammoth mt data to run faster
jfy133 f48cfeb
Fix HC caller command as they renamed the parameter
jfy133 da8718c
Limit MALT memory
jfy133 f42015f
removing double test profiles
jbv2 f5e2a54
adding missing rescale step
jbv2 9184a90
not rescaling
jbv2 7c60084
add test_long.config
jbv2 dfc7ec8
final rev
jbv2 5f5c10a
changing mapping tool
jbv2 59228bb
getting manipulate damage from eager/dev
jbv2 fb3be94
getting manipulate damage from eager/dev
jbv2 834c55b
increasing time for test long
jbv2 b88568f
Merge branch 'dev' into dsl2-new_test_configs
jbv2 a04858f
fixing problem with merging mapad
jbv2 d5387aa
updating short_dna to run map AD
jbv2 b134e95
removing params from CI
jbv2 24bfdaa
latest_everything
jbv2 4ca1cfe
changing input to run mapad
jbv2 4258406
adding rescaled as source for genotyping
jbv2 ed59eb4
swap to fastp
TCLamnidis 2e96488
add adapterlist
TCLamnidis a243300
specifying elongation factor
jbv2 4a30622
fix typo
TCLamnidis f124ab8
add mapdamage downsampling
TCLamnidis ddc97b7
Merge branch 'dsl2-new_test_configs' of https://github.com/jbv2/eager…
jbv2 187ee0a
Merge branch 'dsl2-new_test_configs' of https://github.com/jbv2/eager…
jbv2 52a940f
fix profile names in commented commands
TCLamnidis 9810e80
Update .github/workflows/ci.yml
jfy133 fdd005d
Revert "swap to fastp"
TCLamnidis 85e4a94
swap to adapterremoval
TCLamnidis eb2b330
add snpcapturebed
TCLamnidis b72c6bd
move java opts to beforescript
TCLamnidis 0318736
Merge branch 'dev' into dsl2-new_test_configs
TCLamnidis 737b4ed
re-add latest-everything
TCLamnidis 3f9145b
Update subworkflows/local/genotype.nf
TCLamnidis File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,70 @@ | ||
/* | ||
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||
Nextflow config file for running minimal tests | ||
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||
Defines input files and everything required to run a fast and simple pipeline test. | ||
|
||
Use as follows: | ||
nextflow run nf-core/eager -profile test_humanpopgen,<docker/singularity> --outdir <OUTDIR> | ||
|
||
---------------------------------------------------------------------------------------- | ||
*/ | ||
|
||
process { | ||
resourceLimits = [ | ||
cpus: 4, | ||
memory: '15.GB', | ||
time: '1.h', | ||
] | ||
|
||
// To avoid pipeline failure due to not having X reads and to not have overcrowded datasets in the test | ||
withName: ANGSD_CONTAMINATION { | ||
errorStrategy = { task.exitStatus in [134] ? 'ignore' : 'finish' } | ||
} | ||
} | ||
|
||
params { | ||
config_profile_name = 'Test human popgen profile' | ||
config_profile_description = 'Minimal test dataset to check pipeline function' | ||
|
||
// Input data | ||
input = params.pipelines_testdata_base_path + 'eager/testdata/Human/human_design_bam_eager3.tsv' | ||
|
||
// Genome references | ||
fasta = params.pipelines_testdata_base_path + 'eager/reference/Human/hs37d5_chr21-MT.fa.gz' | ||
|
||
// Mapping | ||
mapping_tool = 'bowtie2' | ||
convert_inputbam = true | ||
|
||
// BAM filtering | ||
run_bamfiltering = true | ||
bamfiltering_minreadlength = 30 | ||
bamfiltering_mappingquality = 37 | ||
|
||
// Damage | ||
damagecalculation_tool = 'mapdamage' | ||
run_trim_bam = true | ||
|
||
// Contamination | ||
run_mtnucratio = true | ||
run_contamination_estimation_angsd = true | ||
|
||
// Genotyping | ||
genotyping_tool = 'pileupcaller' | ||
run_genotyping = true | ||
genotyping_source = 'trimmed' | ||
genotyping_pileupcaller_bedfile = params.pipelines_testdata_base_path + 'eager/reference/Human/1240K.pos.list_hs37d5.0based.bed.gz' | ||
genotyping_pileupcaller_snpfile = params.pipelines_testdata_base_path + 'eager/reference/Human/1240K_covered_in_JK2067_downsampled_s0.1.numeric_chromosomes.snp' | ||
|
||
//Sex Determination | ||
run_sexdeterrmine = true | ||
sexdeterrmine_bedfile = params.pipelines_testdata_base_path + 'eager/reference/Human/1240K.pos.list_hs37d5.0based.bed.gz' | ||
|
||
// Metagenomics | ||
run_metagenomics = true | ||
metagenomics_complexity_tool = 'prinseq' | ||
metagenomics_profiling_tool = 'kraken2' | ||
metagenomics_profiling_database = params.pipelines_testdata_base_path + 'eager/databases/kraken/eager_test.tar.gz' | ||
metagenomics_run_postprocessing = true | ||
} |
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,61 @@ | ||
/* | ||
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||
Nextflow config file for running minimal tests | ||
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | ||
Defines input files and everything required to run a fast and simple pipeline test. | ||
|
||
Use as follows: | ||
nextflow run nf-core/eager -profile test_microbial,<docker/singularity> --outdir <OUTDIR> | ||
|
||
---------------------------------------------------------------------------------------- | ||
*/ | ||
|
||
process { | ||
resourceLimits = [ | ||
cpus: 4, | ||
memory: '15.GB', | ||
time: '1.h', | ||
] | ||
} | ||
|
||
params { | ||
config_profile_name = 'Test microbial profile' | ||
config_profile_description = 'Minimal test dataset to check pipeline function' | ||
|
||
// Input data | ||
input = params.pipelines_testdata_base_path + 'eager/testdata/Mammoth/samplesheet_PE_only_v3.tsv' | ||
|
||
// Genome references | ||
fasta_sheet = params.pipelines_testdata_base_path + 'eager/reference/reference_sheet_multiref.csv' | ||
|
||
// Host Removal | ||
run_host_removal = true | ||
|
||
// Preprocessing | ||
sequencing_qc_tool = 'falco' | ||
preprocessing_tool = 'fastp' | ||
preprocessing_excludeunmerged = true | ||
|
||
// Mapping | ||
mapping_tool = 'circularmapper' | ||
|
||
// BAM filtering | ||
deduplication_tool = "dedup" | ||
run_bamfiltering = true | ||
bamfiltering_minreadlength = 30 | ||
bamfiltering_mappingquality = 37 | ||
|
||
// Metagenomics | ||
run_metagenomics = true | ||
metagenomics_profiling_tool = 'krakenuniq' | ||
metagenomics_profiling_database = params.pipelines_testdata_base_path + 'eager/databases/krakenuniq/testdb-krakenuniq.tar.gz' | ||
run_host_removal = true | ||
|
||
// Bedtools coverage | ||
run_bedtools_coverage = true | ||
|
||
// Genotyping | ||
run_genotyping = true | ||
genotyping_source = 'raw' | ||
genotyping_tool = 'freebayes' | ||
} |
File renamed without changes.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.