Protein annotation leaderboard

hmmscan with Pfam

Each query protein against the curated profile models of every Pfam family, without searching any relative.

Will it work for you?

  1. Is every family you expect to find already in Pfam? If no, this tool cannot find it: it only reports families that have a Pfam model.
  2. Are the features you care about longer than 60 residues? If yes, Fmax here is 61–120 aa 0.785 (n = 963), 121–250 aa 0.802 (n = 504), 251 aa or more 0.871 (n = 277). If no, 16–30 aa 0.580 (n = 271), 31–60 aa 0.573 (n = 420). (Pfam truth set, raw calls, no relative searched, setting Pfam models.)
  3. Can you spend about 0.389 core-hours per 1,000 proteins? That is the measured cost of scanning them against Pfam's models.

Best Fmax and cost

Under the Pfam truth set, raw calls, no relative (hmmscan searches the Pfam models), its best setting is Pfam models (direct): Fmax 0.886 over 2,435 true instances. Searching costs about $0.0173 per 1,000 queries (0.389 core-hours), for scanning Pfam's models.

Where it is strong and weak

Each line compares this setting with the best setting of any other tool on the same subset of the proteins, so the other tool's setting can change from line to line. Only subsets with at least 30 true instances are compared.

No other tool was scored on the same subsets, so no comparison: not run.

Swiss-Prot feature types: not run.

Figure 2. Where hmmscan with Pfam is ahead and behind: its Fmax on each subset of the proteins, against the best other tool on that subset (Pfam truth set, raw calls, no relative; its best setting, Pfam models).
hmmscan with Pfam best other tool on that subset, named at the right
length of the annotated region16–30 aahmmscan with Pfam: Fmax 0.580, n = 27131–60 aahmmscan with Pfam: Fmax 0.573, n = 42061–120 aahmmscan with Pfam: Fmax 0.785, n = 963121–250 aahmmscan with Pfam: Fmax 0.802, n = 504251 aa or morehmmscan with Pfam: Fmax 0.871, n = 27700.20.40.60.8Fmax (higher is better)

What it compares

Each query protein against the curated profile models of every Pfam family, without searching any relative.

What it needs

Reference searched

Pfam-A 38.2 family models (30,134 models).

How to read its score

Domain bit score: higher ranks first. E-value cutoffs 10 (sequence and domain).

Known failure modes

Cost per 1,000 queries

Setting direct, scanning Pfam's models: 0.389 core-hours reserved per 1,000 queries (4 cores for the task's wall time), measured on Sherlock. Peak memory 0.5 GB. That is about $0.0173 at $0.044625 per CPU-hour. Building its databases for setting direct: not measured (no task record holds a database build for this tool and setting).

The per-query cost counts the search only. The run recorded cost per tool and setting, summed over all relatives, so the cost for one relative is the mean.

Licence

Settings in the table

Version, container, command

hmmscan \
    --domtblout /dev/stdout \
    -o /dev/null \
    --noali \
    -E 10.0 --domE 10.0 \
    --cpu 4 \
    Pfam-A.hmm UP000005640_9606.fasta

Query: the same 998 human proteins.

Tool id hmmscan. Numbers from seanome/2024-kmerseek-analysis commit 4a4b1171.

All tool cards · this card as Markdown · as JSON