{
 "page": "tools/hmmscan.html",
 "title": "hmmscan with Pfam card",
 "source": {
  "repo": "seanome/2024-kmerseek-analysis",
  "commit": "4a4b11714ddb740f8a7e324058b26bee8fb35af4",
  "commit_date": "2026-10-15T13:12:56Z",
  "path": "results/leaderboard",
  "copied_at": "2026-10-15T13:44:05Z",
  "sha256": {
   "results.parquet": "0c0cf94b5fc40587cab2ffbf7aaf84df9b5475037cc0d818ad2f452a9c73a837",
   "compute.parquet": "8a47ba2123c60cbb41b4833c9f96661934369137b72c5d81ef0808c98247e435",
   "coverage.md": "c10b26730d8dc44b16120bd2f6ee87eb8ed0db3efa40398b339ddac0b0cb7781",
   "provenance.json": "22e54f206354e42208f8a78c4f4827f980ac1db2ce13153f2b077274552e4141",
   "inventory.md": "8dc7040a38cf06af126bd08211edf1f6055c69fe9ac2b4088c6ba8f7f90e6c71",
   "pileup/regions.parquet": "e97701d2fcb601babe25c7d5c6c82760ea19e460e9bc1d555fe5f8f69cb4d6d8",
   "pileup/calls.parquet": "41bc1f6db7bf54f00370b11db2ffed61031d90a42895aa1697be26fc449ea958",
   "pileup/provenance.json": "5ed6e70dd9e82b5200f089b9da3afc62d0a10cc6a51da86715f5f26d3aac9b9e"
  },
  "pileup_commit": "39d81ec90815cacbf3744199d1fa8e99ab28c6f4"
 },
 "text": [
  {
   "tag": "h1",
   "text": "hmmscan with Pfam"
  },
  {
   "tag": "p",
   "text": "Each query protein against the curated profile models of every Pfam family, without searching any relative."
  },
  {
   "tag": "h2",
   "text": "Will it work for you?"
  },
  {
   "tag": "li",
   "text": "Is every family you expect to find already in Pfam? If no, this tool cannot find it: it only reports families that have a Pfam model."
  },
  {
   "tag": "li",
   "text": "Are the features you care about longer than 60 residues? If yes, Fmax here is 61–120 aa 0.785 (n = 963), 121–250 aa 0.802 (n = 504), 251 aa or more 0.871 (n = 277). If no, 16–30 aa 0.580 (n = 271), 31–60 aa 0.573 (n = 420). (Pfam truth set, raw calls, no relative searched, setting Pfam models.)"
  },
  {
   "tag": "li",
   "text": "Can you spend about 0.389 core-hours per 1,000 proteins? That is the measured cost of scanning them against Pfam's models."
  },
  {
   "tag": "h2",
   "text": "Best Fmax and cost"
  },
  {
   "tag": "p",
   "text": "Under the Pfam truth set, raw calls, no relative (hmmscan searches the Pfam models), its best setting is Pfam models (direct): Fmax 0.886 over 2,435 true instances. Searching costs about $0.0173 per 1,000 queries (0.389 core-hours), for scanning Pfam's models."
  },
  {
   "tag": "h2",
   "text": "Where it is strong and weak"
  },
  {
   "tag": "p",
   "text": "Each line compares this setting with the best setting of any other tool on the same subset of the proteins, so the other tool's setting can change from line to line. Only subsets with at least 30 true instances are compared."
  },
  {
   "tag": "p",
   "text": "No other tool was scored on the same subsets, so no comparison: not run."
  },
  {
   "tag": "p",
   "text": "Swiss-Prot feature types: not run."
  },
  {
   "tag": "figcaption",
   "text": "Figure 2. Where hmmscan with Pfam is ahead and behind: its Fmax on each subset of the proteins, against the best other tool on that subset (Pfam truth set, raw calls, no relative; its best setting, Pfam models)."
  },
  {
   "tag": "h2",
   "text": "What it compares"
  },
  {
   "tag": "p",
   "text": "Each query protein against the curated profile models of every Pfam family, without searching any relative."
  },
  {
   "tag": "h2",
   "text": "What it needs"
  },
  {
   "tag": "li",
   "text": "sequence only: yes"
  },
  {
   "tag": "li",
   "text": "3D structure prediction: no"
  },
  {
   "tag": "li",
   "text": "GPU: no"
  },
  {
   "tag": "h2",
   "text": "Reference searched"
  },
  {
   "tag": "p",
   "text": "Pfam-A 38.2 family models (30,134 models)."
  },
  {
   "tag": "h2",
   "text": "How to read its score"
  },
  {
   "tag": "p",
   "text": "Domain bit score: higher ranks first. E-value cutoffs 10 (sequence and domain)."
  },
  {
   "tag": "h2",
   "text": "Known failure modes"
  },
  {
   "tag": "li",
   "text": "Pfam domains are defined by these same models, so scoring hmmscan against the Pfam truth set grades the models against their own output. Read its Pfam row as the best a search could do, not as a competitor."
  },
  {
   "tag": "li",
   "text": "It was scored against the Pfam truth set only. Swiss-Prot features and Pfam-N: not run."
  },
  {
   "tag": "h2",
   "text": "Cost per 1,000 queries"
  },
  {
   "tag": "p",
   "text": "Setting direct, scanning Pfam's models: 0.389 core-hours reserved per 1,000 queries (4 cores for the task's wall time), measured on Sherlock. Peak memory 0.5 GB. That is about $0.0173 at $0.044625 per CPU-hour. Building its databases for setting direct: not measured (no task record holds a database build for this tool and setting)."
  },
  {
   "tag": "p",
   "text": "The per-query cost counts the search only. The run recorded cost per tool and setting, summed over all relatives, so the cost for one relative is the mean."
  },
  {
   "tag": "h2",
   "text": "Licence"
  },
  {
   "tag": "li",
   "text": "Licence: BSD 3-clause (HMMER); CC0 1.0 (Pfam-A models, per the Pfam 38.2 release notes) (source)"
  },
  {
   "tag": "li",
   "text": "Commercial use allowed: Yes."
  },
  {
   "tag": "h2",
   "text": "Settings in the table"
  },
  {
   "tag": "li",
   "text": "Pfam models (direct): scans Pfam's models; no relative searched"
  },
  {
   "tag": "h2",
   "text": "Version, container, command"
  },
  {
   "tag": "li",
   "text": "Version: HMMER 3.4"
  },
  {
   "tag": "li",
   "text": "Container: quay.io/biocontainers/hmmer:3.4--hb6cb901_4 (sha256:7a2b317b8d2fd3650b4924a8482cddeb940d4a0746c6a1501ff03ac1b7439e0c)"
  },
  {
   "tag": "pre",
   "text": "hmmscan \\ --domtblout /dev/stdout \\ -o /dev/null \\ --noali \\ -E 10.0 --domE 10.0 \\ --cpu 4 \\ Pfam-A.hmm UP000005640_9606.fasta"
  },
  {
   "tag": "p",
   "text": "Query: the same 998 human proteins."
  },
  {
   "tag": "p",
   "text": "Tool id hmmscan. Numbers from seanome/2024-kmerseek-analysis commit 4a4b1171."
  },
  {
   "tag": "p",
   "text": "All tool cards · this card as Markdown · as JSON"
  }
 ],
 "data": {
  "tool": "hmmscan",
  "name": "hmmscan with Pfam",
  "kind": "scans curated Pfam family models",
  "compares": "Each query protein against the curated profile models of every Pfam family, without searching any relative.",
  "needs": {
   "sequence only": true,
   "3D structure prediction": false,
   "GPU": false
  },
  "reference": "Pfam-A 38.2 family models (30,134 models).",
  "score": "Domain bit score: higher ranks first. E-value cutoffs 10 (sequence and domain).",
  "failure_modes": [
   "Pfam domains are defined by these same models, so scoring hmmscan against the Pfam truth set grades the models against their own output. Read its Pfam row as the best a search could do, not as a competitor.",
   "It was scored against the Pfam truth set only. Swiss-Prot features and Pfam-N: not run."
  ],
  "version": "HMMER 3.4",
  "licence": "BSD 3-clause (HMMER); CC0 1.0 (Pfam-A models, per the Pfam 38.2 release notes)",
  "commercial_use": "Yes.",
  "licence_url": "https://github.com/EddyRivasLab/hmmer/blob/master/LICENSE",
  "container": "quay.io/biocontainers/hmmer:3.4--hb6cb901_4 (sha256:7a2b317b8d2fd3650b4924a8482cddeb940d4a0746c6a1501ff03ac1b7439e0c)",
  "command": "hmmscan \\\n    --domtblout /dev/stdout \\\n    -o /dev/null \\\n    --noali \\\n    -E 10.0 --domE 10.0 \\\n    --cpu 4 \\\n    Pfam-A.hmm UP000005640_9606.fasta",
  "numbers_from": {
   "repo": "seanome/2024-kmerseek-analysis",
   "commit": "4a4b11714ddb740f8a7e324058b26bee8fb35af4",
   "filters": "pfam, raw, all"
  },
  "best_setting": "direct",
  "strong": [],
  "weak": [],
  "cost_per_1000_queries": {
   "core_h_reserved_per_relative": 0.38855488755288353,
   "n_relatives": 1,
   "database_build_core_h": null,
   "database_build_gpu_h": null,
   "peak_rss_gb": 0.46298828125,
   "hardware": "Stanford Sherlock, SLURM partition hns"
  },
  "questions": [
   "Is every family you expect to find already in Pfam? If no, this tool cannot find it: it only reports families that have a Pfam model.",
   "Are the features you care about longer than 60 residues? If yes, Fmax here is 61–120 aa 0.785 (n = 963), 121–250 aa 0.802 (n = 504), 251 aa or more 0.871 (n = 277). If no, 16–30 aa 0.580 (n = 271), 31–60 aa 0.573 (n = 420). (Pfam truth set, raw calls, no relative searched, setting Pfam models.)",
   "Can you spend about 0.389 core-hours per 1,000 proteins? That is the measured cost of scanning them against Pfam's models."
  ],
  "markdown": "hmmscan.md"
 }
}