{
 "page": "tools/hmmer3_jackhmmer.html",
 "title": "jackhmmer card",
 "source": {
  "repo": "seanome/2024-kmerseek-analysis",
  "commit": "4a4b11714ddb740f8a7e324058b26bee8fb35af4",
  "commit_date": "2026-10-15T13:12:56Z",
  "path": "results/leaderboard",
  "copied_at": "2026-10-15T13:44:05Z",
  "sha256": {
   "results.parquet": "0c0cf94b5fc40587cab2ffbf7aaf84df9b5475037cc0d818ad2f452a9c73a837",
   "compute.parquet": "8a47ba2123c60cbb41b4833c9f96661934369137b72c5d81ef0808c98247e435",
   "coverage.md": "c10b26730d8dc44b16120bd2f6ee87eb8ed0db3efa40398b339ddac0b0cb7781",
   "provenance.json": "22e54f206354e42208f8a78c4f4827f980ac1db2ce13153f2b077274552e4141",
   "inventory.md": "8dc7040a38cf06af126bd08211edf1f6055c69fe9ac2b4088c6ba8f7f90e6c71",
   "pileup/regions.parquet": "e97701d2fcb601babe25c7d5c6c82760ea19e460e9bc1d555fe5f8f69cb4d6d8",
   "pileup/calls.parquet": "41bc1f6db7bf54f00370b11db2ffed61031d90a42895aa1697be26fc449ea958",
   "pileup/provenance.json": "5ed6e70dd9e82b5200f089b9da3afc62d0a10cc6a51da86715f5f26d3aac9b9e"
  },
  "pileup_commit": "39d81ec90815cacbf3744199d1fa8e99ab28c6f4"
 },
 "text": [
  {
   "tag": "h1",
   "text": "jackhmmer"
  },
  {
   "tag": "p",
   "text": "A profile of a protein family: it searches with one protein, builds a profile from the hits, and searches again with that profile, three rounds in all."
  },
  {
   "tag": "h2",
   "text": "Will it work for you?"
  },
  {
   "tag": "li",
   "text": "Is the closest same-family domain in the relative you will search at least 40% identical, for most of your proteins? If yes, Fmax here is 40–60% 0.217 (n = 563), 60–100% 0.264 (n = 1,289). If no, 20–30% 0.327 (n = 93), 30–40% 0.175 (n = 165). (Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, setting 3 rounds; subsets with at least 30 true instances.)"
  },
  {
   "tag": "li",
   "text": "Are the features you care about longer than 60 residues? If yes, Fmax here is 61–120 aa 0.210 (n = 963), 121–250 aa 0.333 (n = 504), 251 aa or more 0.427 (n = 277). If no, 16–30 aa 0.029 (n = 271), 31–60 aa 0.066 (n = 420). (Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, setting 3 rounds.)"
  },
  {
   "tag": "li",
   "text": "Can you spend about 2.45 core-hours per 1,000 proteins for each relative you search? That is the measured mean per relative; see \"Cost per 1,000 queries\" below."
  },
  {
   "tag": "h2",
   "text": "Best Fmax and cost"
  },
  {
   "tag": "p",
   "text": "Under the Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, its best setting is 3 rounds (n3): Fmax 0.290 over 2,435 true instances. Searching costs about $0.109 per 1,000 queries (2.45 core-hours), for each relative searched."
  },
  {
   "tag": "h2",
   "text": "Where it is strong and weak"
  },
  {
   "tag": "p",
   "text": "Each line compares this setting with the best setting of any other tool on the same subset of the proteins, so the other tool's setting can change from line to line. Only subsets with at least 30 true instances are compared."
  },
  {
   "tag": "p",
   "text": "Where it is closest to, or furthest ahead of, the best other tool:"
  },
  {
   "tag": "li",
   "text": "regions 121–250 aa long: Fmax 0.333 (n = 504); best other: phmmer, default options, 0.329."
  },
  {
   "tag": "li",
   "text": "no same-family domain in the relative: Fmax 0.023 (n = 321); best other: HH-suite (hhsearch), single-protein profiles, 0.032."
  },
  {
   "tag": "p",
   "text": "Where it is furthest behind the best other tool:"
  },
  {
   "tag": "li",
   "text": "regions 16–30 aa long: Fmax 0.029 (n = 271); best other: kmerseek, wwmj5, k = 11, 0.330."
  },
  {
   "tag": "li",
   "text": "regions 31–60 aa long: Fmax 0.066 (n = 420); best other: kmerseek, gbmr4, k = 21, 0.232."
  },
  {
   "tag": "p",
   "text": "Swiss-Prot features, raw calls, zebrafish, setting 3 rounds: best feature type active site, Fmax 0.287 (n = 176); worst short motif, Fmax 0.002 (n = 190)."
  },
  {
   "tag": "figcaption",
   "text": "Figure 2. Where jackhmmer is ahead and behind: its Fmax on each subset of the proteins, against the best other tool on that subset (Pfam truth set, raw calls, zebrafish as the relative; its best setting, 3 rounds). Left out, under 30 true instances: 0–20%."
  },
  {
   "tag": "h2",
   "text": "What it compares"
  },
  {
   "tag": "p",
   "text": "A profile of a protein family: it searches with one protein, builds a profile from the hits, and searches again with that profile, three rounds in all."
  },
  {
   "tag": "h2",
   "text": "What it needs"
  },
  {
   "tag": "li",
   "text": "sequence only: yes"
  },
  {
   "tag": "li",
   "text": "3D structure prediction: no"
  },
  {
   "tag": "li",
   "text": "GPU: no"
  },
  {
   "tag": "h2",
   "text": "Reference searched"
  },
  {
   "tag": "p",
   "text": "The relative's proteome (Quest for Orthologs reference proteomes, release 2020_04), as a FASTA file."
  },
  {
   "tag": "h2",
   "text": "How to read its score"
  },
  {
   "tag": "p",
   "text": "Domain bit score: higher ranks first. The E-value cutoff was 10."
  },
  {
   "tag": "h2",
   "text": "Known failure modes"
  },
  {
   "tag": "li",
   "text": "Each round can pull in proteins from a different family, which then pull in more. How often that happened here: not measured."
  },
  {
   "tag": "h2",
   "text": "Cost per 1,000 queries"
  },
  {
   "tag": "p",
   "text": "Setting n3, searching one relative (mean over the 15 relatives it searched): 2.45 core-hours reserved per 1,000 queries (8 cores for the task's wall time), measured on Sherlock. Peak memory 5.2 GB. That is about $0.109 at $0.044625 per CPU-hour. Building its databases for setting n3: not measured (no task record holds a database build for this tool and setting)."
  },
  {
   "tag": "p",
   "text": "The per-query cost counts the search only. The run recorded cost per tool and setting, summed over all relatives, so the cost for one relative is the mean."
  },
  {
   "tag": "h2",
   "text": "Licence"
  },
  {
   "tag": "li",
   "text": "Licence: BSD 3-clause (HMMER) (source)"
  },
  {
   "tag": "li",
   "text": "Commercial use allowed: Yes."
  },
  {
   "tag": "h2",
   "text": "Settings in the table"
  },
  {
   "tag": "li",
   "text": "3 rounds (n3): three rounds of search (-N 3)"
  },
  {
   "tag": "h2",
   "text": "Version, container, command"
  },
  {
   "tag": "li",
   "text": "Version: HMMER 3.4"
  },
  {
   "tag": "li",
   "text": "Container: quay.io/biocontainers/hmmer:3.4--hb6cb901_4 (sha256:7a2b317b8d2fd3650b4924a8482cddeb940d4a0746c6a1501ff03ac1b7439e0c)"
  },
  {
   "tag": "pre",
   "text": "jackhmmer \\ -N 3 \\ --domtblout /dev/stdout \\ --tblout /dev/null \\ -o /dev/stderr \\ --noali \\ -E 10.0 \\ --cpu 8 \\ UP000005640_9606.fasta UP000000437_7955.fasta"
  },
  {
   "tag": "p",
   "text": "Query: 998 human proteins. Target: the zebrafish proteome."
  },
  {
   "tag": "p",
   "text": "Tool id hmmer3_jackhmmer. Numbers from seanome/2024-kmerseek-analysis commit 4a4b1171."
  },
  {
   "tag": "p",
   "text": "All tool cards · this card as Markdown · as JSON"
  }
 ],
 "data": {
  "tool": "hmmer3_jackhmmer",
  "name": "jackhmmer",
  "kind": "builds a profile of a protein family",
  "compares": "A profile of a protein family: it searches with one protein, builds a profile from the hits, and searches again with that profile, three rounds in all.",
  "needs": {
   "sequence only": true,
   "3D structure prediction": false,
   "GPU": false
  },
  "reference": "The relative's proteome (Quest for Orthologs reference proteomes, release 2020_04), as a FASTA file.",
  "score": "Domain bit score: higher ranks first. The E-value cutoff was 10.",
  "failure_modes": [
   "Each round can pull in proteins from a different family, which then pull in more. How often that happened here: not measured."
  ],
  "version": "HMMER 3.4",
  "licence": "BSD 3-clause (HMMER)",
  "commercial_use": "Yes.",
  "licence_url": "https://github.com/EddyRivasLab/hmmer/blob/master/LICENSE",
  "container": "quay.io/biocontainers/hmmer:3.4--hb6cb901_4 (sha256:7a2b317b8d2fd3650b4924a8482cddeb940d4a0746c6a1501ff03ac1b7439e0c)",
  "command": "jackhmmer \\\n    -N 3 \\\n    --domtblout /dev/stdout \\\n    --tblout /dev/null \\\n    -o /dev/stderr \\\n    --noali \\\n    -E 10.0 \\\n    --cpu 8 \\\n    UP000005640_9606.fasta UP000000437_7955.fasta",
  "numbers_from": {
   "repo": "seanome/2024-kmerseek-analysis",
   "commit": "4a4b11714ddb740f8a7e324058b26bee8fb35af4",
   "filters": "pfam, raw, zebrafish"
  },
  "best_setting": "n3",
  "strong": [
   {
    "axis": "feature_length_bin",
    "stratum": "121-250",
    "fmax": 0.3329766444504547,
    "n": 504,
    "other_tool": "hmmer3_phmmer",
    "other_setting": "default",
    "other_fmax": 0.329341857962297,
    "margin": 0.0036347864881577374
   },
   {
    "axis": "identity",
    "stratum": "no_homolog",
    "fmax": 0.022590530497941866,
    "n": 321,
    "other_tool": "hhblits",
    "other_setting": "single_seq",
    "other_fmax": 0.03236195478661682,
    "margin": -0.009771424288674953
   }
  ],
  "weak": [
   {
    "axis": "feature_length_bin",
    "stratum": "16-30",
    "fmax": 0.02851890266845075,
    "n": 271,
    "other_tool": "kmerseek",
    "other_setting": "wwmj5_k11_lcFalse",
    "other_fmax": 0.3297506857792661,
    "margin": -0.30123178311081533
   },
   {
    "axis": "feature_length_bin",
    "stratum": "31-60",
    "fmax": 0.0659647996799396,
    "n": 420,
    "other_tool": "kmerseek",
    "other_setting": "gbmr4_k21_lcFalse",
    "other_fmax": 0.23209537155652643,
    "margin": -0.16613057187658684
   }
  ],
  "cost_per_1000_queries": {
   "core_h_reserved_per_relative": 2.4450382245973428,
   "n_relatives": 15,
   "database_build_core_h": null,
   "database_build_gpu_h": null,
   "peak_rss_gb": 5.2,
   "hardware": "Stanford Sherlock, SLURM partition hns"
  },
  "questions": [
   "Is the closest same-family domain in the relative you will search at least 40% identical, for most of your proteins? If yes, Fmax here is 40–60% 0.217 (n = 563), 60–100% 0.264 (n = 1,289). If no, 20–30% 0.327 (n = 93), 30–40% 0.175 (n = 165). (Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, setting 3 rounds; subsets with at least 30 true instances.)",
   "Are the features you care about longer than 60 residues? If yes, Fmax here is 61–120 aa 0.210 (n = 963), 121–250 aa 0.333 (n = 504), 251 aa or more 0.427 (n = 277). If no, 16–30 aa 0.029 (n = 271), 31–60 aa 0.066 (n = 420). (Pfam truth set, raw calls, zebrafish (430 Mya) as the relative searched, setting 3 rounds.)",
   "Can you spend about 2.45 core-hours per 1,000 proteins for each relative you search? That is the measured mean per relative; see \"Cost per 1,000 queries\" below."
  ],
  "markdown": "hmmer3_jackhmmer.md"
 }
}