[1.2.0 - Ancient Destiny] Chunk fasta reads for better parallelization for revio pacbio data

[DLBPointon]

Description of feature

The size of the revio data is huge, this needs to be split into n = (reads / 10million) files. Mapping and then merge the output.

[yumisims]

if fasta size > 10G, then split the fasta.gz into N chunks, N= round( size_of_fasta/10)
pyfasta split -n N {sample}.fasta.gz

[mcshane]

@yumisims @DLBPointon. Maybe use https://nf-co.re/modules/seqkit_split2 ?

[yumisims]

or just zcat {sample}.fasta.gz | awk '/^>/{n++} { print > ("chunk_" int(n/N) ".fasta") }'
let's see

[mcshane]

seqkit split2 is multithreaded and will output gzipped chunks