Header

UZH-Logo

Maintenance Infos

HPC-CLUST: distributed hierarchical clustering for large sets of nucleotide sequences


Matias Rodrigues, João F; von Mering, Christian (2014). HPC-CLUST: distributed hierarchical clustering for large sets of nucleotide sequences. Bioinformatics, 30(2):287-288.

Abstract

MOTIVATION: Nucleotide sequence data are being produced at an ever increasing rate. Clustering such sequences by similarity is often an essential first step in their analysis-intended to reduce redundancy, define gene families or suggest taxonomic units. Exact clustering algorithms, such as hierarchical clustering, scale relatively poorly in terms of run time and memory usage, yet they are desirable because heuristic shortcuts taken during clustering might have unintended consequences in later analysis steps.
RESULTS: Here we present HPC-CLUST, a highly optimized software pipeline that can cluster large numbers of pre-aligned DNA sequences by running on distributed computing hardware. It allocates both memory and computing resources efficiently, and can process more than a million sequences in a few hours on a small cluster. Availability and implementation: Source code and binaries are freely available at http://meringlab.org/software/hpc-clust/; the pipeline is implemented in C++ and uses the Message Passing Interface (MPI) standard for distributed computing.
CONTACT: mering@imls.uzh.ch
SUPPLEMENTARY INFORMATION:  Supplementary data are available at Bioinformatics online.

Abstract

MOTIVATION: Nucleotide sequence data are being produced at an ever increasing rate. Clustering such sequences by similarity is often an essential first step in their analysis-intended to reduce redundancy, define gene families or suggest taxonomic units. Exact clustering algorithms, such as hierarchical clustering, scale relatively poorly in terms of run time and memory usage, yet they are desirable because heuristic shortcuts taken during clustering might have unintended consequences in later analysis steps.
RESULTS: Here we present HPC-CLUST, a highly optimized software pipeline that can cluster large numbers of pre-aligned DNA sequences by running on distributed computing hardware. It allocates both memory and computing resources efficiently, and can process more than a million sequences in a few hours on a small cluster. Availability and implementation: Source code and binaries are freely available at http://meringlab.org/software/hpc-clust/; the pipeline is implemented in C++ and uses the Message Passing Interface (MPI) standard for distributed computing.
CONTACT: mering@imls.uzh.ch
SUPPLEMENTARY INFORMATION:  Supplementary data are available at Bioinformatics online.

Statistics

Citations

8 citations in Web of Science®
11 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

26 downloads since deposited on 18 Mar 2014
8 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:07 Faculty of Science > Institute of Molecular Life Sciences
08 University Research Priority Programs > Systems Biology / Functional Genomics
08 University Research Priority Programs > Evolution in Action: From Genomes to Ecosystems
Dewey Decimal Classification:570 Life sciences; biology
Language:English
Date:2014
Deposited On:18 Mar 2014 16:23
Last Modified:05 Aug 2017 08:50
Publisher:Oxford University Press
ISSN:1367-4803
Free access at:PubMed ID. An embargo period may apply.
Publisher DOI:https://doi.org/10.1093/bioinformatics/btt657
PubMed ID:24215029

Download

Download PDF  'HPC-CLUST: distributed hierarchical clustering for large sets of nucleotide sequences'.
Preview
Content: Published Version
Filetype: PDF
Size: 237kB
View at publisher