Protein annotation leaderboard

HH-suite (hhsearch)

Two profiles against each other.

Will it work for you?

  1. Is the closest same-family domain in the relative you will search at least 40% identical, for most of your proteins? If yes, Fmax here is 40–60% 0.248 (n = 563), 60–100% 0.283 (n = 1,289). If no, 20–30% 0.321 (n = 93), 30–40% 0.190 (n = 165). (Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, setting single-protein profiles; subsets with at least 30 true instances.)
  2. Are the features you care about longer than 60 residues? If yes, Fmax here is 61–120 aa 0.230 (n = 963), 121–250 aa 0.298 (n = 504), 251 aa or more 0.417 (n = 277). If no, 16–30 aa 0.066 (n = 271), 31–60 aa 0.085 (n = 420). (Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, setting single-protein profiles.)
  3. Can you spend about 24.8 core-hours per 1,000 proteins for each relative you search? That is the measured mean per relative; see "Cost per 1,000 queries" below.

Best Fmax and cost

Under the Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, its best setting is single-protein profiles (single_seq): Fmax 0.313 over 2,435 true instances. Searching costs about $1.11 per 1,000 queries (24.8 core-hours), for each relative searched.

Where it is strong and weak

Each line compares this setting with the best setting of any other tool on the same subset of the proteins, so the other tool's setting can change from line to line. Only subsets with at least 30 true instances are compared.

Where it is closest to, or furthest ahead of, the best other tool:

Where it is furthest behind the best other tool:

Swiss-Prot features, raw calls, zebrafish, setting single-protein profiles: best feature type domain, Fmax 0.294 (n = 1,107); worst short motif, Fmax 0.003 (n = 190).

Figure 2. Where HH-suite (hhsearch) is ahead and behind: its Fmax on each subset of the proteins, against the best other tool on that subset (Pfam truth set, raw calls, zebrafish as the relative; its best setting, single-protein profiles). Left out, under 30 true instances: 0–20%.
HH-suite (hhsearch) best other tool on that subset, named at the right
% identity to the closest same-family domain20–30%best other tool: phmmer, default options, Fmax 0.359phmmerHH-suite (hhsearch): Fmax 0.321, n = 9330–40%best other tool: MMseqs2, three rounds, sensitivity 7, 3 rounds, Fmax 0.209MMseqs2, three roundsHH-suite (hhsearch): Fmax 0.190, n = 16540–60%best other tool: phmmer, default options, Fmax 0.252phmmerHH-suite (hhsearch): Fmax 0.248, n = 56360–100%best other tool: phmmer, default options, Fmax 0.308phmmerHH-suite (hhsearch): Fmax 0.283, n = 1,289none in relativebest other tool: Foldseek, shape letters + amino acids, Fmax 0.027FoldseekHH-suite (hhsearch): Fmax 0.032, n = 321length of the annotated region16–30 aabest other tool: kmerseek, wwmj5, k = 11, Fmax 0.330kmerseekHH-suite (hhsearch): Fmax 0.066, n = 27131–60 aabest other tool: kmerseek, gbmr4, k = 21, Fmax 0.232kmerseekHH-suite (hhsearch): Fmax 0.085, n = 42061–120 aabest other tool: phmmer, default options, Fmax 0.250phmmerHH-suite (hhsearch): Fmax 0.230, n = 963121–250 aabest other tool: jackhmmer, 3 rounds, Fmax 0.333jackhmmerHH-suite (hhsearch): Fmax 0.298, n = 504251 aa or morebest other tool: phmmer, default options, Fmax 0.477phmmerHH-suite (hhsearch): Fmax 0.417, n = 27700.10.20.30.40.5Fmax (higher is better)

What it compares

Two profiles against each other. Here each profile was built from a single protein, not from a family alignment, because no UniRef30 database was given.

What it needs

Reference searched

Single-protein profiles of the relative's proteome (Quest for Orthologs reference proteomes, release 2020_04), as an HH-suite database.

How to read its score

Bit score from hhsearch: higher ranks first.

Known failure modes

Cost per 1,000 queries

Setting single_seq, searching one relative (mean over the 15 relatives it searched): 24.8 core-hours reserved per 1,000 queries (16 cores for the task's wall time), measured on Sherlock. Peak memory 23.4 GB. That is about $1.11 at $0.044625 per CPU-hour. Building its databases took 30.9 core-hours over 7 databases. A database is built once and reused, so this is not in the per-query cost. This covers the 7 database builds the task records hold; the search used 15 relatives.

The per-query cost counts the search only. The run recorded cost per tool and setting, summed over all relatives, so the cost for one relative is the mean.

Licence

Settings in the table

Version, container, command

ffindex_apply \
    human-38fdd87d_hhdb/db_a3m.ffdata human-38fdd87d_hhdb/db_a3m.ffindex \
    -d results.ffdata -i results.ffindex \
    -- hhsearch -i stdin -d zebrafish_hhdb/db -blasttab /dev/stdout -cpu 16 -v 0

One hhsearch per query protein, run through ffindex_apply.

Tool id hhblits. Numbers from seanome/2024-kmerseek-analysis commit 4a4b1171.

All tool cards · this card as Markdown · as JSON