This application pattern covers a mixed genomics service: routine short-read germline processing, occasional cohort operations and long-read assembly. It deliberately separates throughput scheduling from memory-heavy jobs and treats workflow provenance as part of the deliverable.
Reference architecture
Use AxiKeystone for method development and memory-heavy single-node work; AxiLattice for the production Slurm queue; and AxiForge for validated GPU-accelerated or imaging/protein stages. Protected NAS holds raw reads, references and approved outputs. Per-job NVMe holds sorting, temporary BAM/CRAM and assembler scratch.
Workflow stages
- Validate sample sheet, checksums and metadata.
- Run read QC and contamination/identity checks.
- Align, sort and mark/process reads in immutable containers.
- Call per-sample variants, then joint genotype where required.
- Apply approved filters and annotation.
- For long reads, reserve a high-memory node for assembly/polishing.
- Publish results with a run manifest and QC report.
Scheduler profile
Create resource labels for standard CPU, high-memory and GPU stages. Let Nextflow request the correct Slurm partition and memory, rather than embedding hostnames. Cap concurrency for metadata-heavy stages and pre-stage reference bundles to node-local storage. Use retry only for clearly transient failures; scientific tool errors need review.
Acceptance evidence
Run recognised truth or internal reference samples and compare sensitivity/precision, genotype concordance, coverage, contamination and structural metrics. Record wall time, samples/day, peak RAM and scratch. Validate restore, interrupted-run resume and reference/version rollback.
Operational controls
Encrypt governed storage, audit access and restrict exports. Do not include identifiers in generic monitoring labels. Separate research findings from clinically reportable outputs. Revalidate when changing caller, reference, container, major driver/runtime or workflow logic.
Primary technical references
- Nextflow executor reference
- Broad Institute GATK germline short-variant discovery workflow
- Slurm Quick Start Administrator Guide
- NVIDIA Container Toolkit overview
References are provided for software architecture and implementation planning. Validate the versions, licences, support matrix and regulated-use requirements applicable to the final deployment.