{
 "nb": 45,
 "na": 22,
 "seeds": 50,
 "nt": 39,
 "nd": 6,
 "nt_rows": 39,
 "nruns": 49500,
 "steps": 1615662363.0,
 "corehours": 5465.204711388888,
 "bmin": "5,300",
 "bmax": "150,000",
 "date": "2026-11-04",
 "camp": "main",
 "repo": "https://github.com/JiaaoWANG-ut/nep89-global-opt-benchmark",
 "algs": [
  {
   "key": "gofee",
   "rank": 1,
   "name": "GOFEE (Gaussian-process surrogate search)",
   "short": "GOFEE",
   "type": "baseline",
   "score_t": 82.7449285930887,
   "ci_lo": 81.31260048396376,
   "ci_hi": 84.17725670221364,
   "p_best": 1.0,
   "gmre": 0.30363222200591994,
   "avg_rank": 6.230769230769231,
   "solved": 39,
   "pooled_sr": 0.7702564102564102,
   "speedup": 5.44190428285708,
   "score_all": 83.85057481947817,
   "score_dev": 91.03727529100993,
   "score_wall": 41.300286160367136,
   "overhead": 165.18642286929332,
   "desc": [
    "GOFEE trains a Gaussian-process surrogate (double-Gaussian kernel on a radial + angular distribution fingerprint, repulsive prior) on every NEP energy obtained so far. Each iteration it generates 30 candidates from a population of 10 low-energy structures (random structures, rattle, cut-and-splice, permutation), relaxes them for free in the surrogate's lower confidence bound mu - 2 sigma, and spends real ionic steps only on the most promising one (one single point plus one force-driven 'dual point'). This is the standard published method (Bisbo & Hammer); the only additions are an occasional short true NEP relaxation of the best unrelaxed population member, needed because a hit requires an energy within 0.02 eV of a true NEP minimum, and caps on the training set and surrogate steps to bound the wall time.",
    "GOFEE \u7528\u8fc4\u4eca\u5f97\u5230\u7684\u6240\u6709 NEP \u80fd\u91cf\u8bad\u7ec3\u4e00\u4e2a\u9ad8\u65af\u8fc7\u7a0b\u4ee3\u7406\u6a21\u578b\uff08\u57fa\u4e8e\u5f84\u5411+\u89d2\u5ea6\u5206\u5e03\u6307\u7eb9\u7684\u53cc\u9ad8\u65af\u6838\uff0c\u5e76\u5e26\u6392\u65a5\u5148\u9a8c\uff09\u3002\u6bcf\u6b21\u8fed\u4ee3\u4ece 10 \u4e2a\u4f4e\u80fd\u7ed3\u6784\u7ec4\u6210\u7684\u79cd\u7fa4\u4e2d\u751f\u6210 30 \u4e2a\u5019\u9009\u7ed3\u6784\uff08\u968f\u673a\u7ed3\u6784\u3001\u6270\u52a8\u3001\u5207\u5272\u62fc\u63a5\u3001\u5143\u7d20\u7f6e\u6362\uff09\uff0c\u5728\u4ee3\u7406\u6a21\u578b\u7684\u7f6e\u4fe1\u4e0b\u754c mu - 2 sigma \u4e0a\u514d\u8d39\u5f1b\u8c6b\uff0c\u53ea\u5bf9\u6700\u6709\u5e0c\u671b\u7684\u4e00\u4e2a\u7ed3\u6784\u82b1\u8d39\u771f\u5b9e\u79bb\u5b50\u6b65\uff08\u4e00\u6b21\u5355\u70b9\u8ba1\u7b97\u52a0\u4e00\u4e2a\u6cbf\u53d7\u529b\u65b9\u5411\u7684\u201c\u5bf9\u5076\u70b9\u201d\uff09\u3002\u8fd9\u662f Bisbo \u4e0e Hammer \u53d1\u8868\u7684\u6807\u51c6\u65b9\u6cd5\uff1b\u552f\u4e00\u7684\u8865\u5145\u662f\u5076\u5c14\u5bf9\u79cd\u7fa4\u4e2d\u80fd\u91cf\u6700\u4f4e\u4e14\u5c1a\u672a\u5f1b\u8c6b\u7684\u7ed3\u6784\u505a\u4e00\u6b21\u7b80\u77ed\u7684\u771f\u5b9e NEP \u5f1b\u8c6b\uff08\u56e0\u4e3a\u547d\u4e2d\u8981\u6c42\u80fd\u91cf\u5728\u771f\u5b9e NEP \u6781\u5c0f\u503c 0.02 eV \u4ee5\u5185\uff09\uff0c\u4ee5\u53ca\u4e3a\u63a7\u5236\u5899\u949f\u65f6\u95f4\u800c\u5bf9\u8bad\u7ec3\u96c6\u5927\u5c0f\u548c\u4ee3\u7406\u5f1b\u8c6b\u6b65\u6570\u8bbe\u7684\u4e0a\u9650\u3002"
   ],
   "ref": "M. K. Bisbo and B. Hammer, Phys. Rev. Lett. 124, 086102 (2020); M. K. Bisbo and B. Hammer, Phys. Rev. B 105, 245404 (2022)"
  },
  {
   "key": "surr",
   "rank": 2,
   "name": "Online-surrogate pre-relaxation BH",
   "short": "SurrBH",
   "type": "innovative",
   "score_t": 78.4560152645885,
   "ci_lo": 77.73081587139352,
   "ci_hi": 79.18121465778349,
   "p_best": 0.0,
   "gmre": 0.22577739502978972,
   "avg_rank": 4.128205128205129,
   "solved": 39,
   "pooled_sr": 0.9271794871794872,
   "speedup": 4.048993275690765,
   "score_all": 79.14032736177806,
   "score_dev": 83.5883559935104,
   "score_wall": 58.34711190225982,
   "overhead": 14.716320784419436,
   "desc": [
    "Basin hopping in which a cheap surrogate potential (a linear moment-tensor/MEAM-like model of per-atom energies, frozen host atoms included as neighbours) is refitted on the fly by ridge regression to the energies, forces and virials of every NEP step of the run itself - no pretrained data. Each cycle relaxes a batch of candidate moves (perturbations, relocations, crossover, swaps, random structures) on the surrogate for free, discards those that fall back into already visited basins (fingerprints) or into model holes, and spends NEP steps only on the lowest predicted new minimum. New: the NEP relaxation itself is surrogate-Newton - every ionic step jumps to the trust-region minimum of the surrogate corrected to the current NEP energy and forces (cell included for bulk), so a minimum costs a few ionic steps instead of tens; the screening step size is tuned to the surrogate basin-escape rate, and the method falls back to unscreened moves when the online-measured surrogate error is large or a wall-time governor triggers.",
    "\u5728\u57fa\u8df3(basin hopping)\u6846\u67b6\u4e2d\u5728\u7ebf\u62df\u5408\u4e00\u4e2a\u5ec9\u4ef7\u7684\u4ee3\u7406\u52bf(\u7ebf\u6027\u77e9\u5f20\u91cf/\u7c7bMEAM\u7684\u539f\u5b50\u80fd\u91cf\u6a21\u578b\uff0c\u51bb\u7ed3\u7684\u57fa\u5e95\u539f\u5b50\u4f5c\u4e3a\u8fd1\u90bb\u53c2\u4e0e\u63cf\u8ff0)\uff0c\u7528\u5cad\u56de\u5f52\u62df\u5408\u672c\u6b21\u8fd0\u884c\u4e2d\u6bcf\u4e00\u4e2aNEP\u79bb\u5b50\u6b65\u7684\u80fd\u91cf\u3001\u529b\u548c\u7ef4\u91cc\uff0c\u4e0d\u4f7f\u7528\u4efb\u4f55\u9884\u8bad\u7ec3\u6570\u636e\u3002\u6bcf\u4e2a\u5faa\u73af\u5148\u5728\u4ee3\u7406\u52bf\u4e0a\u514d\u8d39\u5f1b\u8c6b\u4e00\u6279\u5019\u9009\u7ed3\u6784(\u6270\u52a8\u3001\u539f\u5b50\u91cd\u5b9a\u4f4d\u3001\u4ea4\u53c9\u3001\u5143\u7d20\u4e92\u6362\u3001\u968f\u673a\u7ed3\u6784)\uff0c\u7528\u6307\u7eb9\u5254\u9664\u843d\u56de\u5df2\u8bbf\u95ee\u80fd\u8c37\u7684\u5019\u9009\u4ee5\u53ca\u843d\u5165\u6a21\u578b\u201c\u7a7a\u6d1e\u201d\u7684\u5019\u9009\uff0c\u53ea\u628a\u9884\u6d4b\u80fd\u91cf\u6700\u4f4e\u7684\u65b0\u6781\u5c0f\u503c\u4ea4\u7ed9NEP\u5f1b\u8c6b\u3002\u521b\u65b0\u70b9\uff1aNEP\u5f1b\u8c6b\u672c\u8eab\u91c7\u7528\u201c\u4ee3\u7406\u725b\u987f\u201d\u6b65\u2014\u2014\u6bcf\u4e2a\u79bb\u5b50\u6b65\u90fd\u8df3\u5230\u7ecf\u5f53\u524dNEP\u80fd\u91cf\u548c\u529b\u6821\u6b63\u540e\u7684\u4ee3\u7406\u52bf\u5728\u4fe1\u8d56\u57df\u5185\u7684\u6781\u5c0f\u70b9(\u4f53\u76f8\u540c\u65f6\u4f18\u5316\u6676\u80de)\uff0c\u56e0\u6b64\u6bcf\u4e2a\u6781\u5c0f\u503c\u53ea\u9700\u5c11\u91cf\u79bb\u5b50\u6b65\u800c\u4e0d\u662f\u6570\u5341\u6b65\uff1b\u7b5b\u9009\u6b65\u957f\u6309\u4ee3\u7406\u52bf\u4e0a\u7684\u9003\u9038\u80fd\u8c37\u6bd4\u4f8b\u81ea\u9002\u5e94\uff0c\u5f53\u5728\u7ebf\u6d4b\u5f97\u7684\u4ee3\u7406\u8bef\u5dee\u8fc7\u5927\u6216\u5899\u949f\u65f6\u95f4\u8c03\u63a7\u5668\u89e6\u53d1\u65f6\uff0c\u81ea\u52a8\u9000\u56de\u4e0d\u7ecf\u7b5b\u9009\u7684\u666e\u901a\u79fb\u52a8\u3002"
   ],
   "ref": "Wales & Doye, J. Phys. Chem. A 101, 5111 (1997) [basin hopping]; Shapeev, Multiscale Model. Simul. 14, 1153 (2016) [moment tensor potentials]; Baskes, Phys. Rev. B 46, 2727 (1992) [MEAM angular densities]; Jacobsen, Jorgensen & Hammer, Phys. Rev. Lett. 120, 026102 (2018) [on-the-fly learned structure search]; Kolsbjerg, Peterson & Hammer, Phys. Rev. B 97, 195424 (2018) [NN-accelerated global optimisation]; Podryabinkin, Tikhonov, Shapeev & Oganov, Phys. Rev. B 99, 064114 (2019) [MLIP pre-relaxation in crystal structure prediction]; del Rio, Mortensen & Jacobsen, Phys. Rev. B 100, 104103 (2019) [GPMin surrogate-accelerated local optimisation]; Bisbo & Hammer, Phys. Rev. Lett. 124, 086102 (2020) [GOFEE, contrasted]"
  },
  {
   "key": "memetic",
   "rank": 3,
   "name": "Adaptive memetic algorithm (GA + BH chains)",
   "short": "AMA",
   "type": "innovative",
   "score_t": 68.3753471666667,
   "ci_lo": 67.63542623140799,
   "ci_hi": 69.11526810192541,
   "p_best": 0.0,
   "gmre": 0.11252795204756681,
   "avg_rank": 7.0256410256410255,
   "solved": 39,
   "pooled_sr": 0.8564102564102564,
   "speedup": 2.01802718605968,
   "score_all": 69.71839648441485,
   "score_dev": 78.4482170497777,
   "score_wall": 84.11674987996788,
   "overhead": 1.0807860838812118,
   "desc": [
    "A small niched population of relaxed structures (seeded with only two random structures and filled by offspring) is evolved by three competing operators: Deaven-Ho cut-and-splice (registry-preserving on surfaces) or lattice heredity (bulk), short self-terminating Metropolis basin-hopping chains started from good, not yet exhausted members, and new random structures, half of which are grown atom by atom at well-bonded sites. The ionic-step budget is shared among the operators online by credit assignment: each earns a rank-based reward only for minima that are new to an archive of all minima seen so far and is chosen with probability proportional to its forgotten reward per ionic step, so the search behaves like a GA, a basin hopping or a random search depending on which currently pays off. A second (meta-Lamarckian) credit level selects the BH move: adaptive shake, twist, rigid move, lattice strain, unlike-atom swap (best of 4 trial swaps by unrelaxed energy) or relocation of the highest-energy atoms to the best-bonded of 48 candidate sites, which on supports and in pores include sites next to host atoms so that atoms can wet the support. Fingerprint niching and elitist immigration after stagnation keep the population diverse.",
    "\u81ea\u9002\u5e94\u6a21\u56e0\u7b97\u6cd5\uff1a\u4e00\u4e2a\u5c0f\u89c4\u6a21\u3001\u5e26\u5c0f\u751f\u5883\u7684\u5df2\u5f1b\u8c6b\u7ed3\u6784\u79cd\u7fa4\uff08\u4ec5\u4ee5\u4e24\u4e2a\u968f\u673a\u7ed3\u6784\u8d77\u6b65\uff0c\u5176\u4f59\u7531\u5b50\u4ee3\u586b\u5145\uff09\u7531\u4e09\u79cd\u76f8\u4e92\u7ade\u4e89\u7684\u7b97\u5b50\u6f14\u5316\uff1aDeaven-Ho \u526a\u5207\u62fc\u63a5\u4ea4\u53c9\uff08\u8868\u9762\u4f53\u7cfb\u4fdd\u6301\u5438\u9644\u4f4d\u70b9\u914d\u51c6\uff09\u6216\u6676\u683c\u9057\u4f20\uff08\u4f53\u76f8\uff09\uff1b\u4ece\u4f18\u826f\u4e14\u5c1a\u672a\u201c\u8017\u5c3d\u201d\u7684\u4e2a\u4f53\u51fa\u53d1\u3001\u53ef\u81ea\u884c\u7ec8\u6b62\u7684\u77ed\u7a0b Metropolis \u76c6\u5730\u8df3\u8dc3\u94fe\uff1b\u4ee5\u53ca\u65b0\u7684\u968f\u673a\u7ed3\u6784\uff0c\u5176\u4e2d\u4e00\u534a\u5728\u6210\u952e\u826f\u597d\u7684\u4f4d\u70b9\u4e0a\u9010\u539f\u5b50\u751f\u957f\u5f97\u5230\u3002\u79bb\u5b50\u6b65\u9884\u7b97\u901a\u8fc7\u4fe1\u7528\u5206\u914d\u5728\u7ebf\u5206\u7ed9\u5404\u7b97\u5b50\uff1a\u53ea\u6709\u4ea7\u751f\u201c\u5df2\u89c1\u6781\u5c0f\u503c\u6863\u6848\u201d\u4e2d\u6ca1\u6709\u7684\u65b0\u6781\u5c0f\u503c\u65f6\uff0c\u7b97\u5b50\u624d\u83b7\u5f97\u57fa\u4e8e\u6392\u540d\u7684\u5956\u52b1\uff0c\u5e76\u6309\u5176\u5e26\u9057\u5fd8\u7684\u201c\u6bcf\u79bb\u5b50\u6b65\u5956\u52b1\u201d\u6210\u6bd4\u4f8b\u5730\u88ab\u9009\u4e2d\uff0c\u56e0\u6b64\u641c\u7d22\u4f1a\u6839\u636e\u5f53\u524d\u54ea\u79cd\u7b56\u7565\u66f4\u6709\u6548\u800c\u8868\u73b0\u4e3a\u9057\u4f20\u7b97\u6cd5\u3001\u76c6\u5730\u8df3\u8dc3\u6216\u968f\u673a\u641c\u7d22\u3002\u7b2c\u4e8c\u5c42\uff08\u5143\u62c9\u9a6c\u514b\u5f0f\uff09\u4fe1\u7528\u5206\u914d\u9009\u62e9\u76c6\u5730\u8df3\u8dc3\u7684\u79fb\u52a8\u7c7b\u578b\uff1a\u81ea\u9002\u5e94\u6270\u52a8\u3001\u626d\u8f6c\u3001\u521a\u6027\u79fb\u52a8\u3001\u6676\u683c\u5e94\u53d8\u3001\u5f02\u79cd\u539f\u5b50\u4ea4\u6362\uff084 \u6b21\u8bd5\u4ea4\u6362\u4e2d\u53d6\u672a\u5f1b\u8c6b\u80fd\u91cf\u6700\u4f4e\u8005\uff09\uff0c\u6216\u628a\u80fd\u91cf\u6700\u9ad8\u7684\u539f\u5b50\u8fc1\u79fb\u5230 48 \u4e2a\u5019\u9009\u4f4d\u70b9\u4e2d\u6210\u952e\u6700\u597d\u7684\u4f4d\u7f6e\u2014\u2014\u5728\u8f7d\u4f53\u4e0a\u6216\u5b54\u9053\u5185\uff0c\u5019\u9009\u4f4d\u70b9\u4e5f\u5305\u62ec\u57fa\u5e95\u539f\u5b50\u65c1\u7684\u4f4d\u7f6e\uff0c\u4f7f\u539f\u5b50\u53ef\u4ee5\u94fa\u5c55\u5230\u8f7d\u4f53\u4e0a\u3002\u6307\u7eb9\u5c0f\u751f\u5883\u548c\u505c\u6ede\u540e\u7684\u7cbe\u82f1\u4fdd\u7559\u5f0f\u79fb\u6c11\u7ef4\u6301\u79cd\u7fa4\u591a\u6837\u6027\u3002"
   ],
   "ref": "P. Moscato, Caltech C3P Report 826 (1989); Y.-S. Ong & A. J. Keane, IEEE Trans. Evol. Comput. 8, 99 (2004); D. M. Deaven & K. M. Ho, Phys. Rev. Lett. 75, 288 (1995); A. R. Oganov & C. W. Glass, J. Chem. Phys. 124, 244704 (2006); D. J. Wales & J. P. K. Doye, J. Phys. Chem. A 101, 5111 (1997)"
  },
  {
   "key": "aosbh",
   "rank": 4,
   "name": "Adaptive operator selection basin hopping",
   "short": "AOS-BH",
   "type": "innovative",
   "score_t": 67.92153551619539,
   "ci_lo": 67.2595801017204,
   "ci_hi": 68.58349093067038,
   "p_best": 0.0,
   "gmre": 0.10905512138503284,
   "avg_rank": 7.230769230769231,
   "solved": 39,
   "pooled_sr": 0.8892307692307693,
   "speedup": 1.9557469564629226,
   "score_all": 69.34973039880404,
   "score_dev": 78.63299713576043,
   "score_wall": 84.27898463591552,
   "overhead": 1.0355287705004779,
   "desc": [
    "Basin hopping in which an online multi-armed bandit chooses every move from a category-aware portfolio of structure operators: global and local rattles, relocation of the least-bound atoms (ranked by NEP per-atom energies) to the most coordinated free sites or, for supported clusters, to apex sites on top of the cluster (turning wetting 2D rafts into 3D islands), cluster twists, rigid moves on the support or in the pore, unlike-atom swaps, cell strains, cut-and-splice with archived minima and fresh random structures. The bandit (discounted Thompson sampling with per-move ionic-step costs) credits each operator with success per ionic step (new best minimum, novel low-lying minimum, downhill hop), so effort shifts automatically to the moves that pay off on each system without per-benchmark tuning. Move amplitudes and the Metropolis temperature adapt online, relaxations that cannot reach Metropolis range are aborted early with a calibrated energy-tail predictor, and stagnating walkers restart from random or perturbed archived structures.",
    "\u5728\u57fa\u8df3\uff08basin hopping\uff09\u6846\u67b6\u4e2d\uff0c\u7531\u5728\u7ebf\u591a\u81c2\u8001\u864e\u673a\u7b97\u6cd5\u4e3a\u6bcf\u4e00\u6b65\u4ece\u4e00\u7ec4\u6309\u4f53\u7cfb\u7c7b\u522b\u914d\u7f6e\u7684\u7ed3\u6784\u7b97\u5b50\u4e2d\u9009\u62e9\u79fb\u52a8\u65b9\u5f0f\uff1a\u5168\u5c40\u4e0e\u5c40\u90e8\u968f\u673a\u6270\u52a8\u3001\u5c06\u7ed3\u5408\u6700\u5f31\u7684\u539f\u5b50\uff08\u6309 NEP \u539f\u5b50\u80fd\u91cf\u6392\u5e8f\uff09\u8fc1\u79fb\u5230\u914d\u4f4d\u6700\u9ad8\u7684\u7a7a\u4f4d\uff0c\u5bf9\u8d1f\u8f7d\u56e2\u7c07\u8fd8\u53ef\u8fc1\u79fb\u5230\u56e2\u7c07\u9876\u90e8\u7684\u9876\u4f4d\uff08\u628a\u6da6\u6e7f\u8f7d\u4f53\u7684\u4e8c\u7ef4\u7b4f\u72b6\u7ed3\u6784\u53d8\u4e3a\u4e09\u7ef4\u5c9b\uff09\u3001\u56e2\u7c07\u626d\u8f6c\u3001\u8f7d\u4f53\u6216\u5b54\u9053\u4e2d\u56e2\u7c07\u7684\u521a\u4f53\u79fb\u52a8\u3001\u5f02\u79cd\u539f\u5b50\u4ea4\u6362\u3001\u6676\u80de\u5e94\u53d8\u3001\u4e0e\u5b58\u6863\u4f4e\u80fd\u7ed3\u6784\u7684\u5207\u5272\u62fc\u63a5\u4ee5\u53ca\u5168\u65b0\u7684\u968f\u673a\u7ed3\u6784\u3002\u8be5\u8001\u864e\u673a\uff08\u5e26\u6298\u6263\u5e76\u8ba1\u5165\u79bb\u5b50\u6b65\u4ee3\u4ef7\u7684 Thompson \u91c7\u6837\uff09\u6309\u6bcf\u4e2a\u79bb\u5b50\u6b65\u7684\u6210\u529f\u7387\uff08\u65b0\u7684\u5168\u5c40\u6700\u4f18\u3001\u65b0\u7684\u4f4e\u80fd\u6781\u5c0f\u3001\u4e0b\u5761\u8df3\u8dc3\uff09\u4e3a\u5404\u7b97\u5b50\u8bb0\u529f\uff0c\u4ece\u800c\u65e0\u9700\u9488\u5bf9\u5177\u4f53\u4f53\u7cfb\u8c03\u53c2\u5373\u53ef\u81ea\u52a8\u628a\u8ba1\u7b97\u91cf\u8f6c\u5411\u5728\u5f53\u524d\u4f53\u7cfb\u4e0a\u6709\u6548\u7684\u79fb\u52a8\u3002\u79fb\u52a8\u5e45\u5ea6\u4e0e Metropolis \u6e29\u5ea6\u5728\u7ebf\u81ea\u9002\u5e94\uff1b\u5229\u7528\u7ecf\u6821\u51c6\u7684\u80fd\u91cf\u5c3e\u90e8\u9884\u6d4b\u5668\u63d0\u524d\u7ec8\u6b62\u65e0\u6cd5\u8fdb\u5165 Metropolis \u63a5\u53d7\u8303\u56f4\u7684\u5f1b\u8c6b\uff1b\u641c\u7d22\u505c\u6ede\u65f6\u4ece\u968f\u673a\u7ed3\u6784\u6216\u6270\u52a8\u540e\u7684\u5b58\u6863\u6781\u5c0f\u91cd\u65b0\u5f00\u59cb\u3002"
   ],
   "ref": "Wales & Doye, J. Phys. Chem. A 101, 5111 (1997); Fialho, Da Costa, Schoenauer & Sebag, Ann. Math. Artif. Intell. 60, 25 (2010); Thierens, GECCO 2005, 1539; Xia et al., IJCAI 2015; Raj & Kalyani, arXiv:1707.09727 (2017); Deaven & Ho, Phys. Rev. Lett. 75, 288 (1995); Rondina & Da Silva, J. Chem. Inf. Model. 53, 2282 (2013)"
  },
  {
   "key": "softmode",
   "rank": 5,
   "name": "Soft-mode guided hopping",
   "short": "SMH",
   "type": "innovative",
   "score_t": 66.90401115342225,
   "ci_lo": 66.15468555562303,
   "ci_hi": 67.65333675122146,
   "p_best": 0.0,
   "gmre": 0.10165303147457369,
   "avg_rank": 7.153846153846154,
   "solved": 39,
   "pooled_sr": 0.8441025641025641,
   "speedup": 1.8230011061994227,
   "score_all": 68.89462724996439,
   "score_dev": 81.83363187748824,
   "score_wall": 82.2640476547895,
   "overhead": 1.1175205624066726,
   "desc": [
    "Basin hopping whose trial moves follow the softest collective vibrational modes of the current minimum instead of random displacements of all atoms. The modes cost no energy evaluations: they come from a bond-stiffness model Hessian built from covalent radii (exponential pair springs; substrate atoms act as anchors and bulk crystals include the six cell-strain components), and the same model Hessian preconditions the L-BFGS relaxations. The jump amplitude adapts online so that 65% of jumps escape into a new basin, alloys add unlike-atom swaps with a self-tuned probability, and Metropolis acceptance with restarts after stagnation is kept from basin hopping. New is the use of free model-Hessian soft modes, instead of the costly true-Hessian softening of USPEX softmutation or minima hopping, together with escape-rate control and model-Hessian preconditioning.",
    "\u4e00\u79cd\u76c6\u5730\u8df3\u8dc3\uff08basin hopping\uff09\u65b9\u6cd5\uff1a\u8bd5\u63a2\u6b65\u4e0d\u518d\u968f\u673a\u6270\u52a8\u6240\u6709\u539f\u5b50\uff0c\u800c\u662f\u6cbf\u5f53\u524d\u6781\u5c0f\u7ed3\u6784\u6700\u8f6f\u7684\u96c6\u4f53\u632f\u52a8\u6a21\u5f0f\u79fb\u52a8\u3002\u8fd9\u4e9b\u6a21\u5f0f\u4e0d\u6d88\u8017\u4efb\u4f55\u80fd\u91cf\u8ba1\u7b97\uff1a\u5b83\u4eec\u6765\u81ea\u7531\u5171\u4ef7\u534a\u5f84\u6784\u5efa\u7684\u952e\u521a\u5ea6\u6a21\u578b Hessian\uff08\u6307\u6570\u578b\u539f\u5b50\u5bf9\u5f39\u7c27\uff1b\u886c\u5e95\u539f\u5b50\u4f5c\u4e3a\u951a\u70b9\uff0c\u4f53\u76f8\u6676\u4f53\u989d\u5916\u5305\u542b\u516d\u4e2a\u6676\u80de\u5e94\u53d8\u5206\u91cf\uff09\uff0c\u540c\u4e00\u6a21\u578b Hessian \u8fd8\u7528\u4f5c L-BFGS \u5c40\u90e8\u5f1b\u8c6b\u7684\u9884\u6761\u4ef6\u5b50\u3002\u8df3\u8dc3\u5e45\u5ea6\u5728\u7ebf\u81ea\u9002\u5e94\uff0c\u4f7f 65% \u7684\u8df3\u8dc3\u9003\u9038\u5230\u65b0\u7684\u76c6\u5730\uff1b\u5408\u91d1\u4f53\u7cfb\u989d\u5916\u4f7f\u7528\u6982\u7387\u81ea\u8c03\u8282\u7684\u5f02\u79cd\u539f\u5b50\u4ea4\u6362\uff0c\u5e76\u4fdd\u7559\u76c6\u5730\u8df3\u8dc3\u7684 Metropolis \u63a5\u53d7\u51c6\u5219\u548c\u505c\u6ede\u540e\u4ece\u968f\u673a\u7ed3\u6784\u91cd\u542f\u3002\u5176\u65b0\u9896\u4e4b\u5904\u5728\u4e8e\uff1a\u4f7f\u7528\u96f6\u4ee3\u4ef7\u7684\u6a21\u578b Hessian \u8f6f\u6a21\uff08\u4ee3\u66ff USPEX \u8f6f\u6a21\u7a81\u53d8\u6216\u6781\u5c0f\u8df3\u8dc3\u4e2d\u4ee3\u4ef7\u9ad8\u6602\u7684\u771f\u5b9e Hessian \u8f6f\u5316\uff09\uff0c\u5e76\u7ed3\u5408\u9003\u9038\u7387\u63a7\u5236\u548c\u6a21\u578b Hessian \u9884\u6761\u4ef6\u3002"
   ],
   "ref": "A. O. Lyakhov, A. R. Oganov & M. Valle, Comput. Phys. Commun. 181, 1623 (2010) [softmutation]; M. Schoenborn, S. Goedecker, S. Roy & A. R. Oganov, J. Chem. Phys. 130, 144108 (2009) [minima-hopping softening]; G. Henkelman & H. Jonsson, J. Chem. Phys. 111, 7010 (1999) [dimer]; R. Lindh et al., Chem. Phys. Lett. 241, 423 (1995) [model Hessian]; D. Packwood et al., J. Chem. Phys. 144, 164109 (2016) [preconditioning]; A. R. Atilgan et al., Biophys. J. 80, 505 (2001) [anisotropic network model]; D. J. Wales & J. P. K. Doye, J. Phys. Chem. A 101, 5111 (1997) [basin hopping]"
  },
  {
   "key": "ga",
   "rank": 6,
   "name": "Genetic algorithm (cut-and-splice)",
   "short": "GA",
   "type": "baseline",
   "score_t": 66.37198055997332,
   "ci_lo": 65.81895612906456,
   "ci_hi": 66.92500499088209,
   "p_best": 0.0,
   "gmre": 0.09798495935245363,
   "avg_rank": 7.653846153846154,
   "solved": 39,
   "pooled_sr": 0.8856410256410256,
   "speedup": 1.757219501467676,
   "score_all": 67.13122900095284,
   "score_dev": 72.06634386731974,
   "score_wall": 82.85071630872693,
   "overhead": 1.028269968034872,
   "desc": [
    "Faithful baseline implementation, with literature parameter values, of the standard Lamarckian cluster genetic algorithm (Deaven-Ho / Birmingham Cluster GA / ASE-GA): a population of 20 locally relaxed structures evolves in steady state, with parents chosen by roulette-wheel selection on Johnston's tanh fitness of the normalised energy (plus the ASE-GA pairing and duplicate history penalties). Children are made by Deaven-Ho cut-and-splice crossover (a vertical cut for supported clusters with registry-preserving alignment; for bulk the Abraham-Probert periodic cut in fractional coordinates with lattice heredity) or, with probability 0.2, by standard mutations (rattle, mirror, twist, atom relocation, permutation of unlike atoms; cell strain for bulk). Every child is relaxed with L-BFGS and replaces the worst member if it is lower and not a duplicate (energy + fingerprint); after 10 generations' worth of candidates (200) without a new best structure, the GA restarts from a new random population.",
    "\u6807\u51c6\u62c9\u9a6c\u514b\u5f0f\u56e2\u7c07\u9057\u4f20\u7b97\u6cd5\uff08Deaven-Ho \u526a\u5207\u62fc\u63a5\u3001\u4f2f\u660e\u7ff0\u56e2\u7c07\u9057\u4f20\u7b97\u6cd5 BCGA \u4e0e ASE-GA\uff09\u7684\u5fe0\u5b9e\u57fa\u7ebf\u5b9e\u73b0\uff0c\u91c7\u7528\u6587\u732e\u6807\u51c6\u53c2\u6570\uff1a\u7531 20 \u4e2a\u7ecf\u5c40\u90e8\u5f1b\u8c6b\u7684\u7ed3\u6784\u7ec4\u6210\u7684\u79cd\u7fa4\u4ee5\u7a33\u6001\u65b9\u5f0f\u8fdb\u5316\uff0c\u7236\u4ee3\u901a\u8fc7\u8f6e\u76d8\u8d4c\u9009\u62e9\uff0c\u9002\u5e94\u5ea6\u4e3a Johnston \u7684\u5f52\u4e00\u5316\u80fd\u91cf tanh \u51fd\u6570\uff08\u5e76\u5e26\u6709 ASE-GA \u7684\u914d\u5bf9\u6b21\u6570\u4e0e\u91cd\u590d\u7ed3\u6784\u60e9\u7f5a\uff09\u3002\u5b50\u4ee3\u7531 Deaven-Ho \u526a\u5207\u62fc\u63a5\u4ea4\u53c9\u4ea7\u751f\uff08\u8d1f\u8f7d\u56e2\u7c07\u91c7\u7528\u5782\u76f4\u4e8e\u8868\u9762\u7684\u5207\u9762\u5e76\u4fdd\u6301\u5438\u9644\u4f4d\u70b9\u5bf9\u9f50\uff1b\u4f53\u76f8\u91c7\u7528 Abraham-Probert \u5728\u5206\u6570\u5750\u6807\u4e0b\u7684\u5468\u671f\u6027\u5207\u5272\u5e76\u7ee7\u627f\u52a0\u6743\u5e73\u5747\u7684\u6676\u683c\uff09\uff0c\u6216\u4ee5 0.2 \u7684\u6982\u7387\u7531\u6807\u51c6\u53d8\u5f02\u4ea7\u751f\uff08\u968f\u673a\u6270\u52a8\u3001\u955c\u50cf\u3001\u534a\u56e2\u7c07\u626d\u8f6c\u3001\u539f\u5b50\u91cd\u5b9a\u4f4d\u3001\u5f02\u79cd\u539f\u5b50\u7f6e\u6362\uff1b\u4f53\u76f8\u53e6\u6709\u6676\u80de\u5e94\u53d8\uff09\u3002\u6bcf\u4e2a\u5b50\u4ee3\u90fd\u7528 L-BFGS \u5c40\u90e8\u5f1b\u8c6b\uff0c\u82e5\u80fd\u91cf\u4f4e\u4e8e\u79cd\u7fa4\u4e2d\u6700\u5dee\u4e2a\u4f53\u4e14\u4e0d\u4e0e\u5df2\u6709\u7ed3\u6784\u91cd\u590d\uff08\u80fd\u91cf\u52a0\u6307\u7eb9\u5224\u636e\uff09\u5219\u5c06\u5176\u66ff\u6362\uff1b\u82e5\u8fde\u7eed 10 \u4ee3\uff08200 \u4e2a\u5019\u9009\u7ed3\u6784\uff09\u672a\u627e\u5230\u66f4\u4f18\u7ed3\u6784\uff0c\u5219\u4ee5\u65b0\u7684\u968f\u673a\u79cd\u7fa4\u91cd\u65b0\u5f00\u59cb\u3002"
   ],
   "ref": "D. M. Deaven & K. M. Ho, Phys. Rev. Lett. 75, 288 (1995); R. L. Johnston, Dalton Trans. 2003, 4193 (Birmingham Cluster GA); L. B. Vilhelmsen & B. Hammer, J. Chem. Phys. 141, 044711 (2014) (ASE-GA); N. L. Abraham & M. I. J. Probert, Phys. Rev. B 73, 224104 (2006) (periodic cut for crystals)"
  },
  {
   "key": "tabu",
   "rank": 7,
   "name": "Tabu basin hopping",
   "short": "TabuBH",
   "type": "innovative",
   "score_t": 64.55737916330108,
   "ci_lo": 63.851149462294934,
   "ci_hi": 65.26360886430722,
   "p_best": 0.0,
   "gmre": 0.0864413169655077,
   "avg_rank": 8.333333333333334,
   "solved": 39,
   "pooled_sr": 0.8707692307692307,
   "speedup": 1.5502008564188423,
   "score_all": 65.70629095352963,
   "score_dev": 73.17421759001529,
   "score_wall": 80.90041754001325,
   "overhead": 1.038432516554173,
   "desc": [
    "Basin hopping steered by a tabu memory of every local minimum it has found (energy-binned hash plus a species-resolved distance fingerprint, so recognising a minimum costs no extra force calls). Minima are accepted by a Metropolis test on E + lambda*log(1+visits) with a short recency tabu list; falling back into a known minimum enlarges the next perturbation, repeated revisits trigger restarts from random structures or rarely used low-energy archive minima, and relaxations that are about to end in a stored minimum are stopped early. Cluster moves relocate the atoms with the highest per-atom NEP energy to the surface; what is new is that one memory steers acceptance, step size, restarts and relaxation cost at once (tabu search + energy-landscape paving + minima-hopping-style feedback).",
    "\u7531\u7981\u5fcc\u8bb0\u5fc6\u5f15\u5bfc\u7684\u76c6\u5730\u8df3\u8dc3\uff08basin hopping\uff09\uff1a\u7b97\u6cd5\u8bb0\u5f55\u5df2\u627e\u5230\u7684\u6bcf\u4e00\u4e2a\u5c40\u90e8\u6781\u5c0f\uff08\u6309\u80fd\u91cf\u5206\u7bb1\u7684\u54c8\u5e0c\u52a0\u6309\u5143\u7d20\u533a\u5206\u7684\u8ddd\u79bb\u6307\u7eb9\uff0c\u8bc6\u522b\u6781\u5c0f\u65e0\u9700\u989d\u5916\u7684\u529b\u8ba1\u7b97\uff09\u3002\u5bf9 E + \u03bb\u00b7log(1+\u8bbf\u95ee\u6b21\u6570) \u505a Metropolis \u63a5\u53d7\u5224\u636e\u5e76\u914d\u5408\u77ed\u671f\u7981\u5fcc\u8868\uff1b\u843d\u56de\u5df2\u77e5\u6781\u5c0f\u65f6\u589e\u5927\u4e0b\u4e00\u6b21\u6270\u52a8\uff0c\u53cd\u590d\u91cd\u8bbf\u5219\u4ece\u968f\u673a\u7ed3\u6784\u6216\u5f88\u5c11\u4f7f\u7528\u7684\u4f4e\u80fd\u5b58\u6863\u6781\u5c0f\u91cd\u65b0\u5f00\u59cb\uff0c\u5373\u5c06\u6536\u655b\u5230\u5df2\u77e5\u6781\u5c0f\u7684\u5f1b\u8c6b\u4f1a\u88ab\u63d0\u524d\u7ec8\u6b62\u3002\u56e2\u7c07\u79fb\u52a8\u6309\u6bcf\u539f\u5b50 NEP \u80fd\u91cf\u628a\u7ed3\u5408\u6700\u5f31\u7684\u539f\u5b50\u91cd\u65b0\u653e\u5230\u8868\u9762\uff1b\u65b0\u9896\u4e4b\u5904\u5728\u4e8e\u540c\u4e00\u4efd\u8bb0\u5fc6\u540c\u65f6\u63a7\u5236\u63a5\u53d7\u3001\u6b65\u957f\u3001\u91cd\u542f\u548c\u5f1b\u8c6b\u6210\u672c\uff08\u7981\u5fcc\u641c\u7d22 + \u80fd\u91cf\u666f\u89c2\u94fa\u5e73 + \u6781\u5c0f\u8df3\u8dc3\u5f0f\u53cd\u9988\uff09\u3002"
   ],
   "ref": "Glover, ORSA J. Comput. 1, 190 (1989) and 2, 4 (1990) [tabu search]; Cvijovic & Klinowski, Science 267, 664 (1995) [taboo search for continuous global optimisation]; Wales & Doye, J. Phys. Chem. A 101, 5111 (1997) [basin hopping]; Hansmann & Wille, Phys. Rev. Lett. 88, 068105 (2002) [energy landscape paving]; Goedecker, J. Chem. Phys. 120, 9911 (2004) [history feedback of minima hopping]; Garivier & Moulines, ALT 2011, LNCS 6925, 174 [discounted UCB bandits]; Shao, Cheng & Cai, J. Comput. Chem. 25, 1693 (2004) and Takeuchi, J. Chem. Inf. Model. 46, 2066 (2006) [surface relocation of high-energy atoms]"
  },
  {
   "key": "symm",
   "rank": 8,
   "name": "Symmetry-seeded search",
   "short": "SYMM",
   "type": "innovative",
   "score_t": 63.5635030403338,
   "ci_lo": 62.88037934995781,
   "ci_hi": 64.24662673070979,
   "p_best": 0.0,
   "gmre": 0.080705863995988,
   "avg_rank": 10.23076923076923,
   "solved": 39,
   "pooled_sr": 0.821025641025641,
   "speedup": 1.4473437457521072,
   "score_all": 65.10865757552723,
   "score_dev": 75.15216205428437,
   "score_wall": 79.43598279898927,
   "overhead": 1.072694673222044,
   "desc": [
    "Two-armed search whose exploration arm generates random but symmetric starting structures with self-written group-theory code: gas-phase clusters get a random point group whose orbits (centre, rotation axes, mirror planes, general positions) are filled by a knapsack partition of the exact composition, supported clusters a vertical Cn/Cnv group centred on a top, bridge or hollow site, zeolite guests symmetric motifs inside the pore, and bulk crystals Wyckoff orbits of 37 space groups with a random supercell; for alloys and ionic compositions symmetric 'skeletons' are decorated with species by core-shell, random or electronegativity-contrast rules. The exploitation arm is a Metropolis basin-hopping walker (adaptive steps, cell strain, unlike-atom swaps and, for clusters, a move that projects the structure onto its detected approximate point group) that jumps to better seeds and restarts on stagnation. Discounted probability-matching bandits split the effort between seeding and hopping, and among symmetric, C1 and plain random seeds, by the rate of new low-lying minima per ionic step. New is the combination of AIRSS/PyXtal/CALYPSO-style symmetric random seeding, in one code for clusters, supported clusters, zeolite guests and crystals, with bandit-balanced basin hopping, plus the skeleton decoration and the symmetrise move.",
    "\u5bf9\u79f0\u6027\u64ad\u79cd\u641c\u7d22\u5305\u542b\u4e24\u4e2a\u5206\u652f\u3002\u63a2\u7d22\u5206\u652f\u7528\u81ea\u7f16\u7684\u7fa4\u8bba\u4ee3\u7801\u751f\u6210\u968f\u673a\u4f46\u5177\u6709\u5bf9\u79f0\u6027\u7684\u521d\u59cb\u7ed3\u6784\uff1a\u6c14\u76f8\u56e2\u7c07\u968f\u673a\u9009\u53d6\u70b9\u7fa4\uff0c\u5e76\u4ee5\u7cbe\u786e\u7ec4\u6210\u7684\u80cc\u5305\u5212\u5206\u586b\u5145\u5176\u5404\u7c7b\u8f68\u9053\uff08\u4e2d\u5fc3\u3001\u65cb\u8f6c\u8f74\u3001\u955c\u9762\u4e0e\u4e00\u822c\u4f4d\u7f6e\uff09\uff1b\u8d1f\u8f7d\u56e2\u7c07\u91c7\u7528\u4ee5\u9876\u4f4d\u3001\u6865\u4f4d\u6216\u7a7a\u4f4d\u4e3a\u8f74\u5fc3\u7684\u7ad6\u76f4 Cn/Cnv \u70b9\u7fa4\uff1b\u5206\u5b50\u7b5b\u5ba2\u4f53\u56e2\u7c07\u5728\u5b54\u9053\u5185\u653e\u7f6e\u5bf9\u79f0\u7ed3\u6784\u5355\u5143\uff1b\u4f53\u76f8\u6676\u4f53\u586b\u5145 37 \u4e2a\u7a7a\u95f4\u7fa4\u7684 Wyckoff \u8f68\u9053\u5e76\u968f\u673a\u6269\u80de\uff1b\u5bf9\u5408\u91d1\u548c\u79bb\u5b50\u578b\u7ec4\u6210\uff0c\u5148\u751f\u6210\u5bf9\u79f0\u201c\u9aa8\u67b6\u201d\uff0c\u518d\u6309\u6838\u58f3\u3001\u968f\u673a\u6216\u7535\u8d1f\u6027\u5dee\u6700\u5927\u5316\u89c4\u5219\u5206\u914d\u5143\u7d20\u3002\u5229\u7528\u5206\u652f\u662f Metropolis \u57fa\u8df3\u884c\u8d70\u8005\uff08\u81ea\u9002\u5e94\u6b65\u957f\u3001\u6676\u80de\u5e94\u53d8\u3001\u5f02\u79cd\u539f\u5b50\u4ea4\u6362\uff0c\u4ee5\u53ca\u5bf9\u56e2\u7c07\u5c06\u7ed3\u6784\u6295\u5f71\u5230\u5176\u68c0\u6d4b\u51fa\u7684\u8fd1\u4f3c\u70b9\u7fa4\u7684\u201c\u5bf9\u79f0\u5316\u201d\u79fb\u52a8\uff09\uff0c\u9047\u5230\u66f4\u4f18\u7684\u79cd\u5b50\u7ed3\u6784\u65f6\u8df3\u8f6c\u8fc7\u53bb\uff0c\u505c\u6ede\u65f6\u4ece\u65b0\u79cd\u5b50\u91cd\u542f\u3002\u5e26\u6298\u6263\u7684\u6982\u7387\u5339\u914d\u8001\u864e\u673a\u6309\u6bcf\u4e2a\u79bb\u5b50\u6b65\u83b7\u5f97\u65b0\u4f4e\u80fd\u6781\u5c0f\u7684\u901f\u7387\uff0c\u5728\u64ad\u79cd\u4e0e\u8df3\u8dc3\u4e4b\u95f4\u3001\u4ee5\u53ca\u5bf9\u79f0\u3001C1 \u4e0e\u666e\u901a\u968f\u673a\u79cd\u5b50\u4e4b\u95f4\u5206\u914d\u8ba1\u7b97\u91cf\u3002\u521b\u65b0\u4e4b\u5904\u5728\u4e8e\u628a AIRSS/PyXtal/CALYPSO \u5f0f\u7684\u5bf9\u79f0\u968f\u673a\u64ad\u79cd\u5728\u540c\u4e00\u5957\u4ee3\u7801\u4e2d\u7edf\u4e00\u7528\u4e8e\u56e2\u7c07\u3001\u8d1f\u8f7d\u56e2\u7c07\u3001\u5206\u5b50\u7b5b\u5ba2\u4f53\u4e0e\u6676\u4f53\uff0c\u5e76\u4e0e\u8001\u864e\u673a\u5e73\u8861\u7684\u57fa\u8df3\u76f8\u7ed3\u5408\uff0c\u53e6\u52a0\u9aa8\u67b6\u88c5\u9970\u4e0e\u5bf9\u79f0\u5316\u79fb\u52a8\u3002"
   ],
   "ref": "C. J. Pickard & R. J. Needs, J. Phys.: Condens. Matter 23, 053201 (2011) (AIRSS); S. Fredericks, K. Parrish, D. Sayre & Q. Zhu, Comput. Phys. Commun. 261, 107810 (2021) (PyXtal); Y. Wang, J. Lv, L. Zhu & Y. Ma, Phys. Rev. B 82, 094116 (2010) and Comput. Phys. Commun. 183, 2063 (2012) (CALYPSO); D. J. Wales & J. P. K. Doye, J. Phys. Chem. A 101, 5111 (1997) (basin hopping)"
  },
  {
   "key": "pso",
   "rank": 9,
   "name": "Particle swarm optimisation (CALYPSO)",
   "short": "PSO",
   "type": "baseline",
   "score_t": 63.44429351287806,
   "ci_lo": 62.610995025927785,
   "ci_hi": 64.27759199982835,
   "p_best": 0.0,
   "gmre": 0.08004400407179343,
   "avg_rank": 11.41025641025641,
   "solved": 39,
   "pooled_sr": 0.7589743589743589,
   "speedup": 1.4354742386999972,
   "score_all": 64.78134020853996,
   "score_dev": 73.47214373034235,
   "score_wall": 78.51644677867117,
   "overhead": 1.1469837274088095,
   "desc": [
    "CALYPSO-style particle swarm optimisation: a swarm of 20-30 locally relaxed structures moves by the PSO velocity update towards each particle's personal best and the best of its nearest neighbours in fingerprint space (local PSO, inertia weight decreasing from 0.9 to 0.4, c1 = c2 = 2, velocity clamping), while 40% of every generation are fresh random structures. As in CALYPSO, random crystals are built with space-group symmetry and random gas-phase clusters with point-group symmetry, near-duplicate structures are removed by a fingerprint similarity check, and the swarm restarts after 10 generations without a better global best. The only addition is an alignment step for permutable atoms (per-species Hungarian assignment, plus Kabsch rotation for free clusters) before every velocity update.",
    "CALYPSO \u98ce\u683c\u7684\u7c92\u5b50\u7fa4\u4f18\u5316\uff1a\u7531 20-30 \u4e2a\u5c40\u90e8\u5f1b\u8c6b\u7ed3\u6784\u7ec4\u6210\u7684\u7c92\u5b50\u7fa4\u6309 PSO \u901f\u5ea6\u66f4\u65b0\u516c\u5f0f\u79fb\u52a8\uff0c\u8d8b\u5411\u6bcf\u4e2a\u7c92\u5b50\u7684\u4e2a\u4f53\u6700\u4f18\u548c\u5176\u5728\u6307\u7eb9\u7a7a\u95f4\u4e2d\u6700\u8fd1\u90bb\u7c92\u5b50\u7684\u6700\u4f18\u7ed3\u6784\uff08\u5c40\u90e8 PSO\uff0c\u60ef\u6027\u6743\u91cd\u7531 0.9 \u7ebf\u6027\u964d\u81f3 0.4\uff0cc1 = c2 = 2\uff0c\u901f\u5ea6\u9650\u5e45\uff09\uff0c\u6bcf\u4e00\u4ee3\u53e6\u6709 40% \u4e3a\u65b0\u7684\u968f\u673a\u7ed3\u6784\u3002\u4e0e CALYPSO \u4e00\u81f4\uff0c\u968f\u673a\u6676\u4f53\u6309\u7a7a\u95f4\u7fa4\u5bf9\u79f0\u6027\u751f\u6210\uff0c\u968f\u673a\u6c14\u76f8\u56e2\u7c07\u6309\u70b9\u7fa4\u5bf9\u79f0\u6027\u751f\u6210\uff0c\u501f\u52a9\u6307\u7eb9\u76f8\u4f3c\u6027\u5224\u636e\u5254\u9664\u8fd1\u4f3c\u91cd\u590d\u7684\u7ed3\u6784\uff0c\u8fde\u7eed 10 \u4ee3\u5168\u5c40\u6700\u4f18\u4e0d\u518d\u6539\u8fdb\u65f6\u91cd\u542f\u7c92\u5b50\u7fa4\u3002\u552f\u4e00\u7684\u8865\u5145\u662f\u9488\u5bf9\u53ef\u7f6e\u6362\u539f\u5b50\u7684\u5bf9\u9f50\u6b65\u9aa4\uff1a\u6bcf\u6b21\u901f\u5ea6\u66f4\u65b0\u524d\u6309\u5143\u7d20\u505a\u5308\u7259\u5229\u7b97\u6cd5\u5339\u914d\uff0c\u81ea\u7531\u56e2\u7c07\u8fd8\u989d\u5916\u505a Kabsch \u65cb\u8f6c\u5bf9\u9f50\u3002"
   ],
   "ref": "Y. Wang, J. Lv, L. Zhu, Y. Ma, Phys. Rev. B 82, 094116 (2010); Y. Wang, J. Lv, L. Zhu, Y. Ma, Comput. Phys. Commun. 183, 2063 (2012); J. Lv, Y. Wang, L. Zhu, Y. Ma, J. Chem. Phys. 137, 084104 (2012); Y. Wang et al., J. Phys.: Condens. Matter 27, 203203 (2015)"
  },
  {
   "key": "uspex",
   "rank": 10,
   "name": "USPEX evolutionary algorithm",
   "short": "USPEX",
   "type": "baseline",
   "score_t": 62.27798829080861,
   "ci_lo": 61.66626866516997,
   "ci_hi": 62.88970791644724,
   "p_best": 0.0,
   "gmre": 0.0738481548678635,
   "avg_rank": 9.782051282051283,
   "solved": 39,
   "pooled_sr": 0.8523076923076923,
   "speedup": 1.3243605828772085,
   "score_all": 63.49840713996547,
   "score_dev": 71.43112965948522,
   "score_wall": 78.32954861540487,
   "overhead": 1.0596170503910434,
   "desc": [
    "Generational evolutionary algorithm in the style of USPEX: a population of 10-30 locally relaxed structures (2 x number of search atoms) evolves by spatial heredity (~50%; a random plane or crystal slab cuts two fitness-ranked parents and their halves are combined, with a weighted-average lattice for crystals), new random structures (~20%), soft mutation along the softest vibrational mode of a bond-hardness spring model (~20%), swaps of unlike atoms (multi-element systems) and random lattice strain (bulk). The best 60% of the distinct structures are parents and the best 15% are kept unchanged; duplicates are removed with Oganov-Valle fingerprints (crystals) or distance fingerprints (clusters). This is a standard baseline that uses the USPEX default operator mix and parameter values. The search restarts when the best structure has not improved for n_search generations.",
    "USPEX \u98ce\u683c\u7684\u4ee3\u9645\u8fdb\u5316\u7b97\u6cd5\uff1a\u7531 10-30 \u4e2a\uff08\u641c\u7d22\u539f\u5b50\u6570\u7684 2 \u500d\uff09\u7ecf\u5c40\u90e8\u5f1b\u8c6b\u7684\u7ed3\u6784\u7ec4\u6210\u79cd\u7fa4\uff0c\u901a\u8fc7\u4ee5\u4e0b\u7b97\u5b50\u4ea7\u751f\u4e0b\u4e00\u4ee3\uff1a\u7a7a\u95f4\u9057\u4f20\uff08\u7ea6 50%\uff0c\u7528\u968f\u673a\u5e73\u9762\u6216\u6676\u4f53\u5207\u7247\u5207\u5206\u4e24\u4e2a\u6309\u80fd\u91cf\u6392\u5e8f\u9009\u51fa\u7684\u7236\u4ee3\u5e76\u62fc\u63a5\uff0c\u6676\u4f53\u7684\u6676\u683c\u53d6\u4e24\u8005\u7684\u968f\u673a\u52a0\u6743\u5e73\u5747\uff09\u3001\u968f\u673a\u65b0\u7ed3\u6784\uff08\u7ea6 20%\uff09\u3001\u6cbf\u952e\u786c\u5ea6\u5f39\u7c27\u6a21\u578b\u6700\u8f6f\u632f\u52a8\u6a21\u5f0f\u7684\u8f6f\u6a21\u7a81\u53d8\uff08\u7ea6 20%\uff09\u3001\u4e0d\u540c\u5143\u7d20\u539f\u5b50\u4ea4\u6362\uff08\u591a\u5143\u7d20\u4f53\u7cfb\uff09\u4ee5\u53ca\u968f\u673a\u6676\u683c\u5e94\u53d8\uff08\u4f53\u76f8\uff09\u3002\u4e0d\u91cd\u590d\u7ed3\u6784\u4e2d\u80fd\u91cf\u6700\u4f4e\u7684 60% \u4f5c\u4e3a\u7236\u4ee3\uff0c\u6700\u597d\u7684 15% \u76f4\u63a5\u4fdd\u7559\u5230\u4e0b\u4e00\u4ee3\uff1b\u6676\u4f53\u7528 Oganov-Valle \u6307\u7eb9\u3001\u56e2\u7c07\u7528\u8ddd\u79bb\u6307\u7eb9\u5254\u9664\u91cd\u590d\u7ed3\u6784\u3002\u8fd9\u662f\u91c7\u7528 USPEX \u9ed8\u8ba4\u7b97\u5b50\u6bd4\u4f8b\u548c\u53c2\u6570\u503c\u7684\u6807\u51c6\u57fa\u7ebf\u65b9\u6cd5\u3002\u82e5\u6700\u4f18\u7ed3\u6784\u8fde\u7eed n_search \u4ee3\u6ca1\u6709\u6539\u8fdb\uff0c\u641c\u7d22\u91cd\u65b0\u5f00\u59cb\u3002"
   ],
   "ref": "A. R. Oganov & C. W. Glass, J. Chem. Phys. 124, 244704 (2006); A. O. Lyakhov, A. R. Oganov, H. T. Stokes & Q. Zhu, Comput. Phys. Commun. 184, 1172 (2013); A. O. Lyakhov, A. R. Oganov & M. Valle, Comput. Phys. Commun. 181, 1623 (2010); A. O. Lyakhov & A. R. Oganov, Phys. Rev. B 84, 092103 (2011); A. R. Oganov & M. Valle, J. Chem. Phys. 130, 104504 (2009); Q. Zhu, L. Li, A. R. Oganov & P. B. Allen, Phys. Rev. B 87, 195317 (2013)"
  },
  {
   "key": "egbh",
   "rank": 11,
   "name": "Energy-guided basin hopping",
   "short": "EGBH",
   "type": "innovative",
   "score_t": 60.50227960640658,
   "ci_lo": 59.63429582354076,
   "ci_hi": 61.3702633892724,
   "p_best": 0.0,
   "gmre": 0.06532334089733359,
   "avg_rank": 12.179487179487179,
   "solved": 39,
   "pooled_sr": 0.7138461538461538,
   "speedup": 1.1439362714798722,
   "score_all": 62.85343436812608,
   "score_dev": 78.1359403193028,
   "score_wall": 76.03859809259046,
   "overhead": 1.1012686591550866,
   "desc": [
    "Energy-guided basin hopping (EGBH) is a basin-hopping walk whose moves are steered by the per-atom energies that NEP89 returns for free with every evaluation. Weakly bound atoms (high site energy relative to their own species) are moved preferentially to dynamic-lattice candidate sites (apex sites above bonded triangles, bridge and atop sites of the cluster, support or crystal) that are ranked by an online, element-resolved site-energy model learned from the potential's own energy decomposition; alloys and compounds also get model-guided swaps and an exchange scan that ranks all swaps of the current minimum by their single-point energies. Tabu lists, energy-weighted shakes, twists, rigid and strain moves and fresh random structures diversify the search, and the move probabilities adapt online to each move's energy gain per ionic step. New compared with standard basin hopping and dynamic lattice searching is that the ML potential's site energies decide both which atoms to move and, via the learned model, where atoms of each element want to sit.",
    "\u80fd\u91cf\u5f15\u5bfc\u76c6\u5730\u8df3\u8dc3\uff08EGBH\uff09\u662f\u4e00\u79cd\u76c6\u5730\u8df3\u8dc3\u968f\u673a\u6e38\u8d70\uff0c\u5176\u79fb\u52a8\u7531 NEP89 \u6bcf\u6b21\u8ba1\u7b97\u65f6\u514d\u8d39\u7ed9\u51fa\u7684\u5355\u539f\u5b50\u80fd\u91cf\u5f15\u5bfc\u3002\u5f31\u675f\u7f1a\u539f\u5b50\uff08\u4f4d\u70b9\u80fd\u91cf\u76f8\u5bf9\u4e8e\u540c\u79cd\u5143\u7d20\u504f\u9ad8\uff09\u88ab\u4f18\u5148\u79fb\u52a8\u5230\u52a8\u6001\u6676\u683c\u5019\u9009\u4f4d\u70b9\uff08\u56e2\u7c07\u3001\u8f7d\u4f53\u6216\u6676\u4f53\u4e0a\u952e\u5408\u4e09\u89d2\u5f62\u4e0a\u65b9\u7684\u9876\u70b9\u4f4d\u3001\u6865\u4f4d\u548c\u9876\u4f4d\uff09\uff0c\u8fd9\u4e9b\u4f4d\u70b9\u7531\u4e00\u4e2a\u5728\u7ebf\u5b66\u4e60\u3001\u6309\u5143\u7d20\u533a\u5206\u7684\u4f4d\u70b9\u80fd\u91cf\u6a21\u578b\u6392\u5e8f\uff0c\u8be5\u6a21\u578b\u76f4\u63a5\u4ece\u52bf\u51fd\u6570\u81ea\u8eab\u7684\u80fd\u91cf\u5206\u89e3\u4e2d\u5b66\u4e60\uff1b\u5408\u91d1\u548c\u5316\u5408\u7269\u8fd8\u4f7f\u7528\u6a21\u578b\u5f15\u5bfc\u7684\u5f02\u79cd\u539f\u5b50\u4ea4\u6362\uff0c\u4ee5\u53ca\u7528\u5355\u70b9\u80fd\u91cf\u5bf9\u5f53\u524d\u6781\u5c0f\u7ed3\u6784\u7684\u6240\u6709\u4ea4\u6362\u8fdb\u884c\u6392\u5e8f\u7684\u4ea4\u6362\u626b\u63cf\u3002\u7981\u5fcc\u8868\u3001\u80fd\u91cf\u52a0\u6743\u6270\u52a8\u3001\u626d\u8f6c\u3001\u521a\u4f53\u79fb\u52a8\u3001\u6676\u80de\u5e94\u53d8\u548c\u5168\u65b0\u968f\u673a\u7ed3\u6784\u4fdd\u8bc1\u641c\u7d22\u7684\u591a\u6837\u6027\uff0c\u5404\u7c7b\u79fb\u52a8\u7684\u6982\u7387\u6839\u636e\u5176\u6bcf\u4e2a\u79bb\u5b50\u6b65\u5e26\u6765\u7684\u80fd\u91cf\u6536\u76ca\u5728\u7ebf\u81ea\u9002\u5e94\u8c03\u6574\u3002\u4e0e\u6807\u51c6\u76c6\u5730\u8df3\u8dc3\u548c\u52a8\u6001\u6676\u683c\u641c\u7d22\u76f8\u6bd4\uff0c\u5176\u521b\u65b0\u4e4b\u5904\u5728\u4e8e\u7528\u673a\u5668\u5b66\u4e60\u52bf\u7684\u4f4d\u70b9\u80fd\u91cf\u540c\u65f6\u51b3\u5b9a\u79fb\u52a8\u54ea\u4e9b\u539f\u5b50\uff0c\u5e76\u901a\u8fc7\u6240\u5b66\u6a21\u578b\u5224\u65ad\u6bcf\u79cd\u5143\u7d20\u7684\u539f\u5b50\u503e\u5411\u4e8e\u5360\u636e\u54ea\u4e9b\u4f4d\u7f6e\u3002"
   ],
   "ref": "Wales & Doye, J. Phys. Chem. A 101, 5111 (1997) [basin hopping]; Shao, Cheng & Cai, J. Comput. Chem. 25, 1693 (2004) [dynamic lattice searching]; Takeuchi, J. Chem. Inf. Model. 46, 2066 (2006) [moving the highest-energy atoms to the best surface sites]; Rossi & Ferrando, J. Phys.: Condens. Matter 21, 084208 (2009) [exchange moves for nanoalloys]; Behler & Parrinello, PRL 98, 146401 (2007) [atom-centred radial descriptors]; Glover, ORSA J. Comput. 1, 190 (1989) [tabu search]"
  },
  {
   "key": "race",
   "rank": 12,
   "name": "Racing basin hopping",
   "short": "RaceBH",
   "type": "innovative",
   "score_t": 59.30724576978415,
   "ci_lo": 58.468147308655794,
   "ci_hi": 60.14634423091251,
   "p_best": 0.0,
   "gmre": 0.06014747123049586,
   "avg_rank": 11.871794871794872,
   "solved": 39,
   "pooled_sr": 0.7410256410256411,
   "speedup": 1.0527705915382504,
   "score_all": 61.54287481615679,
   "score_dev": 76.07446361757894,
   "score_wall": 74.87130819972256,
   "overhead": 1.09270566335113,
   "desc": [
    "Basin hopping in which every local relaxation races against the Metropolis acceptance threshold: the Metropolis random number is drawn before relaxing, and the L-BFGS relaxation is advanced one iteration at a time. It is abandoned as soon as an optimistic lower bound of its final energy shows that the trial will be rejected anyway, and it stops at a loose force threshold when the trial is surely accepted but cannot become a new global best. The bound is calibrated online by conformal prediction, separately for random restarts and for local moves, on a random 10% of trials that are relaxed in full, which keeps the probability of a wrong abort at or below 10% for any energy scale. The steps saved on losing trials pay for bold moves: cut-and-regrow of high-energy atoms at well-coordinated sites, swaps, rigid moves of supported clusters and raced random restarts.",
    "\u4e00\u79cd\u76c6\u5730\u8df3\u8dc3\uff08basin hopping\uff09\u65b9\u6cd5\uff0c\u5176\u4e2d\u6bcf\u4e00\u6b21\u5c40\u90e8\u5f1b\u8c6b\u90fd\u4e0e Metropolis \u63a5\u53d7\u9608\u503c\u8fdb\u884c\u201c\u7ade\u901f\u201d\uff1aMetropolis \u5224\u636e\u6240\u7528\u7684\u968f\u673a\u6570\u5728\u5f1b\u8c6b\u5f00\u59cb\u4e4b\u524d\u5c31\u5df2\u62bd\u53d6\uff0cL-BFGS \u5f1b\u8c6b\u5219\u9010\u6b65\u63a8\u8fdb\u3001\u6bcf\u6b21\u53ea\u8d70\u4e00\u6b65\u8fed\u4ee3\u3002\u4e00\u65e6\u6700\u7ec8\u80fd\u91cf\u7684\u4e50\u89c2\u4e0b\u754c\u8868\u660e\u8be5\u8bd5\u63a2\u65e0\u8bba\u5982\u4f55\u90fd\u4f1a\u88ab\u62d2\u7edd\uff0c\u5f1b\u8c6b\u5c31\u7acb\u5373\u4e2d\u6b62\uff1b\u5982\u679c\u8bd5\u63a2\u5fc5\u7136\u88ab\u63a5\u53d7\u3001\u4f46\u4e0d\u53ef\u80fd\u6210\u4e3a\u65b0\u7684\u5168\u5c40\u6700\u4f18\uff0c\u5219\u5728\u8f83\u5bbd\u677e\u7684\u529b\u6536\u655b\u9608\u503c\u5904\u63d0\u524d\u505c\u6b62\u3002\u8be5\u4e0b\u754c\u901a\u8fc7\u4fdd\u5f62\u9884\u6d4b\uff08conformal prediction\uff09\u5728\u7ebf\u6821\u51c6\uff0c\u968f\u673a\u91cd\u542f\u4e0e\u5c40\u90e8\u79fb\u52a8\u5404\u81ea\u5355\u72ec\u6821\u51c6\uff1a\u968f\u673a\u62bd\u53d6 10% \u7684\u8bd5\u63a2\u505a\u5b8c\u6574\u5f1b\u8c6b\u4f5c\u4e3a\u6821\u51c6\u6837\u672c\uff0c\u56e0\u6b64\u65e0\u8bba\u4f53\u7cfb\u7684\u80fd\u91cf\u5c3a\u5ea6\u5982\u4f55\uff0c\u9519\u8bef\u4e2d\u6b62\u7684\u6982\u7387\u90fd\u4e0d\u8d85\u8fc7 10%\u3002\u5728\u5fc5\u8d25\u8bd5\u63a2\u4e0a\u8282\u7701\u4e0b\u6765\u7684\u6b65\u6570\u88ab\u7528\u4e8e\u66f4\u5927\u80c6\u7684\u79fb\u52a8\uff1a\u5728\u9ad8\u914d\u4f4d\u7a7a\u4f4d\u5904\u201c\u5207\u9664\u518d\u751f\u957f\u201d\u9ad8\u80fd\u539f\u5b50\u3001\u4ea4\u6362\u4e0d\u540c\u5143\u7d20\u539f\u5b50\u3001\u5bf9\u8d1f\u8f7d\u56e2\u7c07\u505a\u521a\u6027\u5e73\u79fb\u8f6c\u52a8\uff0c\u4ee5\u53ca\u53c2\u4e0e\u7ade\u901f\u7684\u968f\u673a\u91cd\u542f\u3002"
   ],
   "ref": "Wales & Doye, J. Phys. Chem. A 101, 5111 (1997); Maron & Moore, NIPS 6 (1994) and Artif. Intell. Rev. 11, 193 (1997); Jamieson & Talwalkar, AISTATS (2016); Li et al., JMLR 18, 1 (2018); Vovk, Gammerman & Shafer, Algorithmic Learning in a Random World, Springer (2005); Iwamatsu & Okabe, Chem. Phys. Lett. 399, 396 (2004); Shao, Cheng & Cai, J. Comput. Chem. 25, 1693 (2004)"
  },
  {
   "key": "de",
   "rank": 13,
   "name": "Differential evolution",
   "short": "DE",
   "type": "baseline",
   "score_t": 59.247025236761615,
   "ci_lo": 58.53645844932038,
   "ci_hi": 59.95759202420285,
   "p_best": 0.0,
   "gmre": 0.059897784238804104,
   "avg_rank": 10.833333333333334,
   "solved": 39,
   "pooled_sr": 0.8220512820512821,
   "speedup": 1.0741807238040588,
   "score_all": 60.603246380899435,
   "score_dev": 69.41868381779511,
   "score_wall": 75.37478979043078,
   "overhead": 1.0575121587512124,
   "desc": [
    "Classic DE/rand/1/bin (Storn & Price) on a population of 20 locally relaxed structures (Lamarckian, as in the cluster code PDECO): for every target a mutant a + F(b - c) (F = 0.5) is built from three other random members, binomially crossed with the target atom by atom (CR = 0.9; for bulk the cell is one extra gene), relaxed, and it replaces the target only if it is lower in energy and not a duplicate of another member. Because atoms are permutable, the parents are first aligned per species by Hungarian assignment, plus Kabsch rotation for gas-phase clusters, lattice translations for supported and zeolite clusters, and canonical reduced cells with fractional coordinates for bulk. It is a standard baseline: the only additions are this alignment, duplicate rejection and the constraint repair needed for atoms.",
    "\u7ecf\u5178\u7684 DE/rand/1/bin \u5dee\u5206\u8fdb\u5316\uff08Storn & Price\uff09\uff0c\u79cd\u7fa4\u7531 20 \u4e2a\u7ecf\u8fc7\u5c40\u90e8\u5f1b\u8c6b\u7684\u7ed3\u6784\u7ec4\u6210\uff08\u62c9\u9a6c\u514b\u5f0f\uff0c\u4e0e\u56e2\u7c07\u4f18\u5316\u7a0b\u5e8f PDECO \u76f8\u540c\uff09\uff1a\u5bf9\u6bcf\u4e2a\u76ee\u6807\u4e2a\u4f53\uff0c\u7528\u53e6\u5916\u4e09\u4e2a\u968f\u673a\u4e2a\u4f53\u6784\u9020\u53d8\u5f02\u5411\u91cf a + F(b - c)\uff08F = 0.5\uff09\uff0c\u518d\u4ee5\u539f\u5b50\u4e3a\u5355\u4f4d\u4e0e\u76ee\u6807\u4e2a\u4f53\u505a\u4e8c\u9879\u4ea4\u53c9\uff08CR = 0.9\uff1b\u4f53\u76f8\u6676\u4f53\u7684\u6676\u80de\u4f5c\u4e3a\u989d\u5916\u4e00\u4e2a\u57fa\u56e0\uff09\uff0c\u5f1b\u8c6b\u540e\u53ea\u6709\u5f53\u80fd\u91cf\u66f4\u4f4e\u4e14\u4e0e\u5176\u4ed6\u4e2a\u4f53\u4e0d\u91cd\u590d\u65f6\u624d\u66ff\u6362\u76ee\u6807\u4e2a\u4f53\u3002\u7531\u4e8e\u540c\u79cd\u539f\u5b50\u53ef\u4ee5\u4e92\u6362\uff0c\u6784\u9020\u5dee\u5206\u5411\u91cf\u524d\u5148\u6309\u5143\u7d20\u7528\u5308\u7259\u5229\u7b97\u6cd5\u5339\u914d\u539f\u5b50\uff1b\u6c14\u76f8\u56e2\u7c07\u53e6\u505a Kabsch \u65cb\u8f6c\u5bf9\u9f50\uff0c\u8d1f\u8f7d\u56e2\u7c07\u548c\u5206\u5b50\u7b5b\u5185\u56e2\u7c07\u53ea\u505a\u6676\u683c\u5e73\u79fb\uff0c\u4f53\u76f8\u5219\u4f7f\u7528\u7ea6\u5316\u6676\u80de\u4e2d\u7684\u5206\u6570\u5750\u6807\u3002\u8fd9\u662f\u4e00\u4e2a\u6807\u51c6\u57fa\u7ebf\u65b9\u6cd5\uff0c\u53ea\u4e3a\u539f\u5b50\u4f53\u7cfb\u8865\u5145\u4e86\u5bf9\u9f50\u3001\u53bb\u91cd\u548c\u7ea6\u675f\u4fee\u590d\u3002"
   ],
   "ref": "R. Storn & K. Price, J. Glob. Optim. 11, 341 (1997); Z. Chen, X. Jiang, J. Li, S. Li & L. Wang, J. Comput. Chem. 34, 1046 (2013) (PDECO); Y.-Y. Zhang, W. Gao, S. Chen, H. Xiang & X.-G. Gong, Comput. Mater. Sci. 98, 51 (2015) (IM2ODE)"
  },
  {
   "key": "growth",
   "rank": 14,
   "name": "Cut-and-regrow (learned-site growth)",
   "short": "CRG",
   "type": "innovative",
   "score_t": 58.98302030391205,
   "ci_lo": 58.09698972889199,
   "ci_hi": 59.86905087893211,
   "p_best": 0.0,
   "gmre": 0.05881533961844566,
   "avg_rank": 11.26923076923077,
   "solved": 37,
   "pooled_sr": 0.696923076923077,
   "speedup": 1.374948952737647,
   "score_all": 61.92843506619406,
   "score_dev": 81.07363102102734,
   "score_wall": 73.16877437404906,
   "overhead": 1.1162076737943336,
   "desc": [
    "A Metropolis walk over relaxed minima whose only structural move is cut-and-regrow: k atoms are removed (those with the highest NEP per-atom energy, a random contiguous fragment, or the least-coordinated ones) and regrown one by one at geometrically enumerated hollow, bridge and atop sites on the remaining cluster, the support or zeolite wall, or inside the periodic cell (bulk: plus cell strain; alloys/compounds: plus energy-guided species swaps). What is new: the sites are ranked by a per-species ridge model of NEP per-atom energies that is refitted on the fly from relaxation start and end points at no extra ionic steps; the cut size grows adaptively on stagnation up to about n/3 before a random restart; and each local relaxation is two-stage, finished to full accuracy only if the trial can still pass the pre-drawn Metropolis threshold.",
    "\u5728\u5f1b\u8c6b\u540e\u7684\u5c40\u90e8\u6781\u5c0f\u4e4b\u95f4\u8fdb\u884c Metropolis \u968f\u673a\u884c\u8d70\uff0c\u552f\u4e00\u7684\u7ed3\u6784\u79fb\u52a8\u662f\u201c\u5207\u9664-\u518d\u751f\u957f\u201d\uff1a\u5148\u79fb\u9664 k \u4e2a\u539f\u5b50\uff08NEP \u5355\u539f\u5b50\u80fd\u91cf\u6700\u9ad8\u7684\u539f\u5b50\u3001\u968f\u673a\u7684\u7a7a\u95f4\u8fde\u7eed\u7247\u6bb5\u6216\u914d\u4f4d\u6570\u6700\u4f4e\u7684\u539f\u5b50\uff09\uff0c\u518d\u5c06\u5b83\u4eec\u9010\u4e2a\u91cd\u65b0\u751f\u957f\u5230\u51e0\u4f55\u679a\u4e3e\u7684\u7a7a\u4f4d\uff08\u4e09\u539f\u5b50\u7a74\u4f4d\u3001\u6865\u4f4d\u3001\u9876\u4f4d\uff09\u4e0a\u2014\u2014\u4f4d\u7f6e\u53ef\u4ee5\u5728\u5269\u4f59\u56e2\u7c07\u4e0a\u3001\u8f7d\u4f53\u6216\u5206\u5b50\u7b5b\u5b54\u58c1\u4e0a\uff0c\u6216\u5728\u5468\u671f\u6027\u6676\u80de\u5185\uff08\u4f53\u76f8\u540c\u65f6\u65bd\u52a0\u968f\u673a\u6676\u80de\u5e94\u53d8\uff1b\u5408\u91d1/\u5316\u5408\u7269\u53e6\u52a0\u6309\u80fd\u91cf\u5f15\u5bfc\u7684\u5143\u7d20\u4ea4\u6362\uff09\u3002\u521b\u65b0\u4e4b\u5904\uff1a\u5019\u9009\u4f4d\u70b9\u7531\u4e00\u4e2a\u6309\u5143\u7d20\u533a\u5206\u7684\u5cad\u56de\u5f52\u6a21\u578b\u6392\u5e8f\uff0c\u8be5\u6a21\u578b\u62df\u5408 NEP \u5355\u539f\u5b50\u80fd\u91cf\uff0c\u5e76\u5229\u7528\u6bcf\u6b21\u5f1b\u8c6b\u8d77\u70b9\u548c\u7ec8\u70b9\u7684\u6570\u636e\u5728\u7ebf\u66f4\u65b0\uff0c\u4e0d\u6d88\u8017\u989d\u5916\u79bb\u5b50\u6b65\uff1b\u505c\u6ede\u65f6\u5207\u9664\u6570 k \u81ea\u9002\u5e94\u589e\u5927\u81f3\u7ea6 n/3\uff0c\u4e4b\u540e\u968f\u673a\u91cd\u542f\uff1b\u6bcf\u6b21\u5c40\u90e8\u5f1b\u8c6b\u5206\u4e24\u9636\u6bb5\u8fdb\u884c\uff0c\u53ea\u6709\u5f53\u8bd5\u63a2\u7ed3\u6784\u4ecd\u53ef\u80fd\u901a\u8fc7\u9884\u5148\u62bd\u53d6\u7684 Metropolis \u9608\u503c\u65f6\u624d\u5f1b\u8c6b\u5230\u5b8c\u5168\u6536\u655b\u3002"
   ],
   "ref": "Wales & Doye, J. Phys. Chem. A 101, 5111 (1997) (basin hopping); Shao, Cheng & Cai, J. Chem. Phys. 120, 11401 (2004) (dynamic lattice searching); Rondina & Da Silva, J. Chem. Inf. Model. 53, 2282 (2013) (revised basin hopping); Deaven & Ho, Phys. Rev. Lett. 75, 288 (1995) (cut-and-splice); Northby, J. Chem. Phys. 87, 6166 (1987) and Takeuchi, J. Chem. Inf. Model. 46, 2066 (2006) (cluster growth sequences); Pickard & Needs, J. Phys.: Condens. Matter 23, 053201 (2011) (AIRSS random restarts)"
  },
  {
   "key": "bh",
   "rank": 15,
   "name": "Basin hopping",
   "short": "BH",
   "type": "baseline",
   "score_t": 58.21111341390532,
   "ci_lo": 57.22809073738492,
   "ci_hi": 59.19413609042573,
   "p_best": 0.0,
   "gmre": 0.055761365765980876,
   "avg_rank": 12.307692307692308,
   "solved": 39,
   "pooled_sr": 0.7912820512820513,
   "speedup": 1.0,
   "score_all": 58.03270227994769,
   "score_dev": 56.87302990922313,
   "score_wall": 75.07306263502265,
   "overhead": 1.0,
   "desc": [
    "Monte Carlo minimisation (basin hopping) with the standard GMIN settings: a Metropolis walk at kT = 0.1 eV on the relaxed energy surface. Every move displaces all search atoms uniformly within a sphere of radius <i>step</i> (bulk: plus a random symmetric cell strain, &sigma; = 0.05), relaxes with L-BFGS and accepts with probability min(1, exp(&minus;&Delta;E/kT)). Every 10 moves the step is multiplied by 1.1 or 0.9 depending on whether the acceptance ratio of those 10 moves is above 50% (bounded to 0.1&ndash;2 &Aring;, initial 0.5 &Aring;); detached cluster atoms are re-seated on the cluster surface. Literature parameters, not tuned.",
    "\u91c7\u7528 GMIN \u6807\u51c6\u8bbe\u7f6e\u7684\u8499\u7279\u5361\u6d1b\u6781\u5c0f\u5316\uff08\u76c6\u5730\u8df3\u8dc3\uff09\uff1a\u5728\u5f1b\u8c6b\u540e\u7684\u80fd\u91cf\u9762\u4e0a\u8fdb\u884c kT = 0.1 eV \u7684 Metropolis \u884c\u8d70\u3002\u6bcf\u6b21\u79fb\u52a8\u628a\u6240\u6709\u641c\u7d22\u539f\u5b50\u5728\u534a\u5f84\u4e3a <i>step</i> \u7684\u7403\u5185\u5747\u5300\u968f\u673a\u4f4d\u79fb\uff08\u4f53\u76f8\u518d\u52a0 &sigma; = 0.05 \u7684\u968f\u673a\u5bf9\u79f0\u6676\u80de\u5e94\u53d8\uff09\uff0c\u7528 L-BFGS \u5f1b\u8c6b\uff0c\u5e76\u4ee5 min(1, exp(&minus;&Delta;E/kT)) \u7684\u6982\u7387\u63a5\u53d7\u3002\u6bcf 10 \u6b21\u79fb\u52a8\u6839\u636e\u8fd9 10 \u6b21\u79fb\u52a8\u7684\u63a5\u53d7\u7387\u662f\u5426\u9ad8\u4e8e 50% \u5c06\u6b65\u957f\u4e58\u4ee5 1.1 \u6216 0.9\uff08\u9650\u5236\u5728 0.1&ndash;2 &Aring;\uff0c\u521d\u503c 0.5 &Aring;\uff09\uff1b\u56e2\u7c07\u4e2d\u8131\u79bb\u7684\u539f\u5b50\u88ab\u91cd\u65b0\u653e\u56de\u56e2\u7c07\u8868\u9762\u3002\u91c7\u7528\u6587\u732e\u53c2\u6570\uff0c\u672a\u8c03\u53c2\u3002"
   ],
   "ref": "Li & Scheraga, PNAS 84, 6611 (1987); Wales & Doye, J. Phys. Chem. A 101, 5111 (1997)"
  },
  {
   "key": "abc",
   "rank": 16,
   "name": "Artificial bee colony (ABCluster)",
   "short": "ABC",
   "type": "baseline",
   "score_t": 53.712659057659984,
   "ci_lo": 52.96927928162041,
   "ci_hi": 54.45603883369956,
   "p_best": 0.0,
   "gmre": 0.040867660012675854,
   "avg_rank": 13.346153846153847,
   "solved": 38,
   "pooled_sr": 0.7143589743589743,
   "speedup": 0.8034957186395443,
   "score_all": 56.20643357230455,
   "score_dev": 72.41596791749429,
   "score_wall": 68.87962356719274,
   "overhead": 1.0522796894437558,
   "desc": [
    "Swarm-intelligence search over a population of SN=10 locally relaxed structures (food sources). In every cycle, employed bees create one neighbour per source by moving a random subset of atoms (bulk: also the lattice) along the difference to another, aligned source, v = x_i + phi (x_i - x_k) with phi in [-1,1], relax it and keep it only if it is lower in energy; onlooker bees repeat this on sources drawn with probability proportional to fitness, and scout bees replace sources that have not improved for limit=3 cycles with new random relaxed structures. This is the standard method of Karaboga & Basturk as adapted to clusters in ABCluster; the only additions are per-species Hungarian/Procrustes alignment before differencing, fractional-coordinate plus lattice-vector moves for variable-cell bulk, and re-seating of supported-cluster atoms that a move carries across the periodic vacuum towards the underside of the slab.",
    "\u4eba\u5de5\u8702\u7fa4\u7b97\u6cd5\uff1a\u4ee5 SN=10 \u4e2a\u7ecf\u5c40\u90e8\u5f1b\u8c6b\u7684\u7ed3\u6784\u4f5c\u4e3a\u201c\u871c\u6e90\u201d\u8fdb\u884c\u7fa4\u4f53\u667a\u80fd\u641c\u7d22\u3002\u6bcf\u4e00\u8f6e\u4e2d\uff0c\u96c7\u4f63\u8702\u4e3a\u6bcf\u4e2a\u871c\u6e90\u751f\u6210\u4e00\u4e2a\u90bb\u57df\u89e3\uff1a\u5c06\u968f\u673a\u9009\u53d6\u7684\u4e00\u90e8\u5206\u539f\u5b50\uff08\u4f53\u76f8\u8fd8\u5305\u62ec\u6676\u683c\uff09\u6cbf\u8be5\u871c\u6e90\u4e0e\u53e6\u4e00\u4e2a\u7ecf\u8fc7\u5bf9\u9f50\u7684\u871c\u6e90\u4e4b\u5dee\u79fb\u52a8\uff0cv = x_i + \u03c6(x_i \u2212 x_k)\uff0c\u03c6\u2208[\u22121,1]\uff0c\u5c40\u90e8\u5f1b\u8c6b\u540e\u4ec5\u5f53\u80fd\u91cf\u66f4\u4f4e\u65f6\u624d\u66ff\u6362\u539f\u871c\u6e90\uff1b\u89c2\u5bdf\u8702\u6309\u9002\u5e94\u5ea6\u6210\u6bd4\u4f8b\u5730\u9009\u62e9\u871c\u6e90\u91cd\u590d\u8be5\u64cd\u4f5c\uff1b\u4fa6\u5bdf\u8702\u628a\u8fde\u7eed limit=3 \u8f6e\u672a\u6539\u8fdb\u7684\u871c\u6e90\u66ff\u6362\u4e3a\u65b0\u7684\u968f\u673a\u5f1b\u8c6b\u7ed3\u6784\u3002\u8fd9\u662f Karaboga \u4e0e Basturk \u63d0\u51fa\u3001\u5e76\u7531 ABCluster \u63a8\u5e7f\u5230\u56e2\u7c07\u7684\u6807\u51c6\u65b9\u6cd5\uff1b\u6b64\u5904\u4ec5\u589e\u52a0\u4e86\u5dee\u5206\u524d\u6309\u5143\u7d20\u7684\u5308\u7259\u5229/Procrustes \u7ed3\u6784\u5bf9\u9f50\u3001\u53ef\u53d8\u6676\u80de\u4f53\u76f8\u4e2d\u5bf9\u5206\u6570\u5750\u6807\u548c\u6676\u683c\u77e2\u91cf\u7684\u540c\u65f6\u64cd\u4f5c\uff0c\u4ee5\u53ca\u628a\u88ab\u79fb\u52a8\u7a7f\u8fc7\u5468\u671f\u6027\u771f\u7a7a\u5c42\u3001\u79fb\u5411\u57fa\u5e95\u4e0b\u8868\u9762\u7684\u8d1f\u8f7d\u56e2\u7c07\u539f\u5b50\u91cd\u65b0\u653e\u56de\u56e2\u7c07\u4e0a\u3002"
   ],
   "ref": "D. Karaboga & B. Basturk, J. Glob. Optim. 39, 459 (2007); J. Zhang & M. Dolg, Phys. Chem. Chem. Phys. 17, 24173 (2015) (ABCluster)"
  },
  {
   "key": "metabh",
   "rank": 17,
   "name": "Metadynamics-biased basin hopping",
   "short": "MetaBH",
   "type": "innovative",
   "score_t": 53.20117130976383,
   "ci_lo": 52.1386560340071,
   "ci_hi": 54.26368658552056,
   "p_best": 0.0,
   "gmre": 0.03944892193849057,
   "avg_rank": 14.333333333333334,
   "solved": 39,
   "pooled_sr": 0.6738461538461539,
   "speedup": 0.7074597509689725,
   "score_all": 55.876994537251015,
   "score_dev": 73.26984551591778,
   "score_wall": 69.77978191645636,
   "overhead": 1.021329372858304,
   "desc": [
    "Basin hopping whose Metropolis test uses E + V(s) instead of E: s is an energy-agnostic structural descriptor of each local minimum (coordination numbers per element pair, Steinhardt q4/q6, size and shape of clusters, substrate contacts and height of supported clusters, volume per atom of crystals) and V is a well-tempered metadynamics bias made of broad Gaussians (each covering a whole funnel of similar minima) deposited at the visited minima, so structural regions where the walker has lingered are gradually filled and it is pushed towards unexplored structure types, while the true NEP energy alone defines the best structure. Moves combine random displacements with an adaptive step, relocation of high per-atom-energy atoms to well-coordinated hollow sites, unlike-atom swaps, rigid moves of supported or confined clusters and occasional random-structure jumps; trial relaxations stop early once an online-calibrated estimate of the remaining energy drop shows that they cannot pass the pre-drawn Metropolis threshold. What is new is the history-dependent bias over collective variables, borrowed from free-energy metadynamics, applied to the discrete walk between minima of basin hopping.",
    "\u5728\u76c6\u5730\u8df3\u8dc3\uff08basin hopping\uff09\u7684 Metropolis \u5224\u636e\u4e2d\u7528 E + V(s) \u4ee3\u66ff E\uff1as \u662f\u6bcf\u4e2a\u5c40\u90e8\u6781\u5c0f\u7ed3\u6784\u7684\u4e0e\u80fd\u91cf\u65e0\u5173\u7684\u7ed3\u6784\u63cf\u8ff0\u7b26\uff08\u6309\u5143\u7d20\u5bf9\u7684\u914d\u4f4d\u6570\u3001Steinhardt q4/q6\u3001\u56e2\u7c07\u7684\u5c3a\u5bf8\u4e0e\u5f62\u72b6\u3001\u8d1f\u8f7d\u56e2\u7c07\u4e0e\u57fa\u5e95\u7684\u63a5\u89e6\u53ca\u9ad8\u5ea6\u3001\u6676\u4f53\u7684\u6bcf\u539f\u5b50\u4f53\u79ef\uff09\uff0cV \u662f\u5728\u5df2\u8bbf\u95ee\u6781\u5c0f\u5904\u6c89\u79ef\u5bbd\u9ad8\u65af\u51fd\u6570\uff08\u6bcf\u4e2a\u8986\u76d6\u7531\u76f8\u4f3c\u6781\u5c0f\u6784\u6210\u7684\u6574\u4e2a\u6f0f\u6597\uff09\u6784\u6210\u7684 well-tempered \u5143\u52a8\u529b\u5b66\u504f\u7f6e\u52bf\uff0c\u4ece\u800c\u9010\u6b65\u586b\u5e73\u6e38\u8d70\u8005\u957f\u65f6\u95f4\u505c\u7559\u7684\u7ed3\u6784\u533a\u57df\uff0c\u628a\u5b83\u63a8\u5411\u5c1a\u672a\u63a2\u7d22\u7684\u7ed3\u6784\u7c7b\u578b\uff0c\u800c\u6700\u4f18\u7ed3\u6784\u4ecd\u53ea\u7531\u771f\u5b9e\u7684 NEP \u80fd\u91cf\u51b3\u5b9a\u3002\u79fb\u52a8\u5305\u62ec\u6b65\u957f\u81ea\u9002\u5e94\u7684\u968f\u673a\u4f4d\u79fb\u3001\u628a\u5355\u539f\u5b50\u80fd\u91cf\u9ad8\u7684\u539f\u5b50\u79fb\u5230\u914d\u4f4d\u826f\u597d\u7684\u7a7a\u4f4d\uff08hollow site\uff09\u3001\u5f02\u79cd\u539f\u5b50\u4ea4\u6362\u3001\u8d1f\u8f7d\u6216\u9650\u57df\u56e2\u7c07\u7684\u521a\u6027\u79fb\u52a8\u4ee5\u53ca\u5076\u5c14\u7684\u968f\u673a\u7ed3\u6784\u8df3\u8dc3\uff1b\u5f53\u5728\u7ebf\u6807\u5b9a\u7684\u5269\u4f59\u80fd\u91cf\u4e0b\u964d\u4f30\u8ba1\u8868\u660e\u67d0\u6b21\u8bd5\u63a2\u5f1b\u8c6b\u5df2\u4e0d\u53ef\u80fd\u901a\u8fc7\u9884\u5148\u62bd\u53d6\u7684 Metropolis \u9608\u503c\u65f6\uff0c\u63d0\u524d\u7ec8\u6b62\u8be5\u5f1b\u8c6b\u3002\u521b\u65b0\u4e4b\u5904\u5728\u4e8e\u628a\u81ea\u7531\u80fd\u8ba1\u7b97\u4e2d\u4f5c\u7528\u4e8e\u96c6\u4f53\u53d8\u91cf\u7684\u5143\u52a8\u529b\u5b66\u5386\u53f2\u4f9d\u8d56\u504f\u7f6e\u5f15\u5165\u5230\u76c6\u5730\u8df3\u8dc3\u5728\u6781\u5c0f\u4e4b\u95f4\u7684\u79bb\u6563\u6e38\u8d70\u4e2d\u3002"
   ],
   "ref": "Laio & Parrinello, PNAS 99, 12562 (2002); Barducci, Bussi & Parrinello, PRL 100, 020603 (2008); Iwamatsu & Okabe, Chem. Phys. Lett. 399, 396 (2004); Wales & Doye, J. Phys. Chem. A 101, 5111 (1997); Steinhardt, Nelson & Ronchetti, PRB 28, 784 (1983); cf. energy-landscape paving, Hansmann & Wille, PRL 88, 068105 (2002)"
  },
  {
   "key": "ssw",
   "rank": 18,
   "name": "Stochastic surface walking",
   "short": "SSW",
   "type": "baseline",
   "score_t": 51.73436558885866,
   "ci_lo": 50.62618789884492,
   "ci_hi": 52.8425432788724,
   "p_best": 0.0,
   "gmre": 0.03564765513248854,
   "avg_rank": 15.205128205128204,
   "solved": 39,
   "pooled_sr": 0.6051282051282051,
   "speedup": 0.6240176985719796,
   "score_all": 52.468659650317974,
   "score_dev": 57.24157104980336,
   "score_wall": 68.99017421226232,
   "overhead": 0.9647860484548447,
   "desc": [
    "Metropolis Monte Carlo walk between local minima in which every trial move is a smooth climb out of the current basin: Gaussian bias potentials (width 0.6 \u00c5, up to 10 per move) are added one after another along a random direction that a biased dimer rotation softens towards low-curvature modes, the structure is relaxed on the biased surface after each addition, and finally all biases are removed and the structure is fully relaxed and accepted or rejected at 1000 K. Standard SSW of Shang & Liu with literature parameters (crystals: atoms and lattice in one generalised coordinate set as in LASP); every force call of the dimer rotations, the climb and the relaxations counts as an ionic step.",
    "\u5728\u5c40\u57df\u6781\u5c0f\u4e4b\u95f4\u8fdb\u884c Metropolis \u8499\u7279\u5361\u6d1b\u884c\u8d70\uff0c\u6bcf\u4e00\u6b21\u8bd5\u63a2\u79fb\u52a8\u90fd\u4ece\u5f53\u524d\u52bf\u9631\u4e2d\u5e73\u6ed1\u5730\u201c\u722c\u51fa\u201d\uff1a\u6cbf\u4e00\u4e2a\u968f\u673a\u65b9\u5411\uff08\u7528\u504f\u7f6e\u4e8c\u805a\u4f53\u65cb\u8f6c\u5411\u4f4e\u66f2\u7387\u7684\u8f6f\u6a21\u4fee\u6b63\uff09\u9010\u4e2a\u52a0\u5165\u9ad8\u65af\u504f\u7f6e\u52bf\uff08\u5bbd\u5ea6 0.6 \u00c5\uff0c\u6bcf\u6b65\u6700\u591a 10 \u4e2a\uff09\uff0c\u6bcf\u52a0\u4e00\u4e2a\u5c31\u5728\u504f\u7f6e\u52bf\u80fd\u9762\u4e0a\u505a\u5c40\u57df\u5f1b\u8c6b\uff0c\u6700\u540e\u53bb\u6389\u5168\u90e8\u504f\u7f6e\u52bf\u5e76\u5b8c\u5168\u5f1b\u8c6b\u5230\u65b0\u7684\u6781\u5c0f\uff0c\u518d\u6309 1000 K \u7684 Metropolis \u51c6\u5219\u63a5\u53d7\u6216\u62d2\u7edd\u3002\u8fd9\u662f\u91c7\u7528\u6587\u732e\u53c2\u6570\u7684\u6807\u51c6 SSW \u65b9\u6cd5\uff08Shang \u548c Liu\uff09\uff0c\u6676\u4f53\u6309 LASP \u7684\u65b9\u5f0f\u628a\u539f\u5b50\u548c\u6676\u683c\u81ea\u7531\u5ea6\u653e\u5728\u540c\u4e00\u7ec4\u5e7f\u4e49\u5750\u6807\u4e2d\uff1b\u4e8c\u805a\u4f53\u65cb\u8f6c\u3001\u722c\u5761\u548c\u5f1b\u8c6b\u4e2d\u7684\u6bcf\u4e00\u6b21\u529b\u8ba1\u7b97\u90fd\u8ba1\u4e3a\u4e00\u4e2a\u79bb\u5b50\u6b65\u3002"
   ],
   "ref": "C. Shang, Z.-P. Liu, J. Chem. Theory Comput. 9, 1838 (2013) (SSW); C. Shang, Z.-P. Liu, J. Chem. Theory Comput. 8, 2215 (2012) (BP-CBD biased dimer rotation/translation); X.-J. Zhang, C. Shang, Z.-P. Liu, J. Chem. Theory Comput. 9, 3252 (2013); C. Shang, X.-J. Zhang, Z.-P. Liu, Phys. Chem. Chem. Phys. 16, 17845 (2014) (SSW-crystal); S.-D. Huang, C. Shang, P.-L. Kang, X.-J. Zhang, Z.-P. Liu, WIREs Comput. Mol. Sci. 9, e1415 (2019) (LASP)"
  },
  {
   "key": "mh",
   "rank": 19,
   "name": "Minima hopping",
   "short": "MH",
   "type": "baseline",
   "score_t": 50.14332479636007,
   "ci_lo": 49.30812936071879,
   "ci_hi": 50.97852023200135,
   "p_best": 0.0,
   "gmre": 0.031937413695851034,
   "avg_rank": 15.846153846153847,
   "solved": 39,
   "pooled_sr": 0.6543589743589744,
   "speedup": 0.572751640085107,
   "score_all": 50.126893962273385,
   "score_dev": 50.0200935407099,
   "score_wall": 67.85654235657348,
   "overhead": 0.9388600369590275,
   "desc": [
    "Minima hopping (Goedecker 2004): from the current local minimum a short molecular-dynamics run with Maxwell-Boltzmann velocities at temperature T crosses a barrier, is stopped at the second potential-energy minimum along the trajectory and is relaxed with L-BFGS; T is raised (x1.1) when the walker falls back into the same or an already visited minimum and lowered (/1.1) when a new minimum is found, and every different minimum is accepted if its energy is less than Ediff above the current one, with Ediff self-adjusting (x0.98 on acceptance, /0.98 on rejection) so that about half of them are accepted. As in the later versions of the Goedecker group, the initial velocities are first softened towards low-curvature directions with up to 20 gradient-only dimer iterations (Schoenborn et al. 2009), the MD time step adapts to energy conservation, and bulk crystals use variable-cell escape dynamics in which the lattice vectors move as well (Amsler & Goedecker 2010), followed by a variable-cell relaxation and Minkowski reduction of the cell. It is a faithful baseline with the ASE / literature default parameters (T0 = 1000 K, Ediff0 = 0.5 eV, mdmin = 2); only safety measures were added: escapes that break energy conservation or squash the cell are stopped early and counted as too hot (T is lowered), and atoms that detach from a cluster or adsorbate are put back before the relaxation.",
    "\u6781\u5c0f\u8df3\u8dc3\u6cd5\uff08Goedecker 2004\uff09\uff1a\u4ece\u5f53\u524d\u5c40\u90e8\u6781\u5c0f\u51fa\u53d1\uff0c\u4ee5\u6e29\u5ea6 T \u4e0b\u7684\u9ea6\u514b\u65af\u97e6-\u73bb\u5c14\u5179\u66fc\u901f\u5ea6\u8fdb\u884c\u4e00\u6bb5\u77ed\u7684\u5206\u5b50\u52a8\u529b\u5b66\u6a21\u62df\u4ee5\u8d8a\u8fc7\u52bf\u5792\uff0c\u5728\u8f68\u8ff9\u4e0a\u9047\u5230\u7b2c\u4e8c\u4e2a\u52bf\u80fd\u6781\u5c0f\u65f6\u505c\u6b62\uff0c\u518d\u7528 L-BFGS \u5f1b\u8c6b\uff1b\u82e5\u843d\u56de\u540c\u4e00\u4e2a\u6216\u5df2\u8bbf\u95ee\u8fc7\u7684\u6781\u5c0f\u5219\u5347\u9ad8 T\uff08\u00d71.1\uff09\uff0c\u627e\u5230\u65b0\u6781\u5c0f\u5219\u964d\u4f4e T\uff08\u00f71.1\uff09\uff1b\u4e0e\u5f53\u524d\u4e0d\u540c\u7684\u6781\u5c0f\u53ea\u8981\u80fd\u91cf\u6bd4\u5f53\u524d\u9ad8\u51fa\u4e0d\u5230 Ediff \u5c31\u88ab\u63a5\u53d7\uff0cEdiff \u81ea\u9002\u5e94\u8c03\u6574\uff08\u63a5\u53d7\u65f6 \u00d70.98\uff0c\u62d2\u7edd\u65f6 \u00f70.98\uff09\uff0c\u4f7f\u5927\u7ea6\u4e00\u534a\u7684\u6781\u5c0f\u88ab\u63a5\u53d7\u3002\u4e0e Goedecker \u8bfe\u9898\u7ec4\u540e\u6765\u7684\u7248\u672c\u4e00\u6837\uff0c\u521d\u59cb\u901f\u5ea6\u5148\u7ecf\u8fc7\u6700\u591a 20 \u6b21\u53ea\u7528\u68af\u5ea6\u7684\u4e8c\u805a\u4f53\u8fed\u4ee3\u5411\u4f4e\u66f2\u7387\u65b9\u5411\u8f6f\u5316\uff08Sch\u00f6nborn \u7b49 2009\uff09\uff0cMD \u65f6\u95f4\u6b65\u957f\u6839\u636e\u80fd\u91cf\u5b88\u6052\u60c5\u51b5\u81ea\u9002\u5e94\u8c03\u6574\uff1b\u4f53\u76f8\u6676\u4f53\u91c7\u7528\u6676\u683c\u77e2\u91cf\u4e5f\u968f\u4e4b\u8fd0\u52a8\u7684\u53ef\u53d8\u6676\u80de\u9003\u9038\u52a8\u529b\u5b66\uff08Amsler & Goedecker 2010\uff09\uff0c\u968f\u540e\u8fdb\u884c\u53ef\u53d8\u6676\u80de\u5f1b\u8c6b\u5e76\u5bf9\u6676\u80de\u505a Minkowski \u7ea6\u5316\u3002\u8fd9\u662f\u91c7\u7528 ASE/\u6587\u732e\u9ed8\u8ba4\u53c2\u6570\uff08T0 = 1000 K\u3001Ediff0 = 0.5 eV\u3001mdmin = 2\uff09\u7684\u5fe0\u5b9e\u57fa\u7ebf\u5b9e\u73b0\uff0c\u4ec5\u52a0\u5165\u4e86\u5b89\u5168\u63aa\u65bd\uff1a\u7834\u574f\u80fd\u91cf\u5b88\u6052\u6216\u628a\u6676\u80de\u538b\u6241\u7684\u9003\u9038\u4f1a\u88ab\u63d0\u524d\u7ec8\u6b62\u5e76\u89c6\u4e3a\u8fc7\u70ed\uff08\u964d\u4f4e T\uff09\uff0c\u8131\u79bb\u56e2\u7c07\u6216\u5438\u9644\u7269\u7684\u539f\u5b50\u5728\u5f1b\u8c6b\u524d\u88ab\u653e\u56de\u539f\u5904\u3002"
   ],
   "ref": "S. Goedecker, J. Chem. Phys. 120, 9911 (2004) (minima hopping); S. E. Schoenborn, S. Goedecker, S. Roy & A. R. Oganov, J. Chem. Phys. 130, 144108 (2009) (softening); M. Amsler & S. Goedecker, J. Chem. Phys. 133, 224104 (2010) (variable-cell minima hopping); A. A. Peterson, Top. Catal. 57, 40 (2014) (ASE MinimaHopping, default parameters); M. Krummenacher et al., SoftwareX 25, 101632 (2024) (minimahopping reference code: time-step feedback, softening details)"
  },
  {
   "key": "ptbh",
   "rank": 20,
   "name": "Parallel-tempering basin hopping",
   "short": "PTBH",
   "type": "baseline",
   "score_t": 49.085900538562335,
   "ci_lo": 48.1671716453548,
   "ci_hi": 50.00462943176987,
   "p_best": 0.0,
   "gmre": 0.029687731678995265,
   "avg_rank": 16.41025641025641,
   "solved": 39,
   "pooled_sr": 0.6461538461538462,
   "speedup": 0.5324068245313202,
   "score_all": 50.93890495475391,
   "score_dev": 62.98343365999911,
   "score_wall": 66.0334747516845,
   "overhead": 0.9933814782427841,
   "desc": [
    "Basin-hopping parallel tempering (BHPT, also called replica-exchange basin hopping): six standard basin-hopping walkers (the move set, L-BFGS quench and adaptive step size of the BH baseline) run at temperatures on a fixed geometric ladder kT = 0.05-0.5 eV, share one ionic-step budget and take one BH step each in turn. After every round, with probability 0.5, neighbouring temperatures swap their current minima with the replica-exchange criterion min(1, exp[(1/kT_i - 1/kT_j)(E_i - E_j)]), so that low-lying minima found by the hot, freely exploring walkers migrate down to the cold walkers, which refine them. This is the standard method of Strodel et al. (GMIN keyword BHPT) with literature parameter values; the only changes are the serial interleaving of the replicas on a single budget, a per-temperature step size adapted from the acceptance of the last 10 moves, and, for variable-cell bulk, Minkowski reduction of the lattice before each cell-strain move and restarting a replica whose cell relaxation aborted.",
    "\u57fa\u4e8e\u5e76\u884c\u56de\u706b\u7684\u76c6\u5730\u8df3\u8dc3\uff08BHPT\uff0c\u53c8\u79f0\u526f\u672c\u4ea4\u6362\u76c6\u5730\u8df3\u8dc3\uff09\uff1a\u516d\u4e2a\u6807\u51c6\u76c6\u5730\u8df3\u8dc3\u884c\u8d70\u8005\uff08\u4e0e BH \u57fa\u7ebf\u76f8\u540c\u7684\u79fb\u52a8\u65b9\u5f0f\u3001L-BFGS \u5c40\u90e8\u5f1b\u8c6b\u548c\u81ea\u9002\u5e94\u6b65\u957f\uff09\u5206\u522b\u5904\u4e8e kT = 0.05\u20130.5 eV \u7684\u56fa\u5b9a\u51e0\u4f55\u6e29\u5ea6\u9636\u68af\u4e0a\uff0c\u5171\u4eab\u540c\u4e00\u4e2a\u79bb\u5b50\u6b65\u9884\u7b97\uff0c\u8f6e\u6d41\u5404\u8d70\u4e00\u6b65\u3002\u6bcf\u8f6e\u7ed3\u675f\u540e\u4ee5 0.5 \u7684\u6982\u7387\u8ba9\u76f8\u90bb\u6e29\u5ea6\u7684\u526f\u672c\u6309\u526f\u672c\u4ea4\u6362\u5224\u636e min(1, exp[(1/kT_i \u2212 1/kT_j)(E_i \u2212 E_j)]) \u4ea4\u6362\u5404\u81ea\u5f53\u524d\u7684\u5c40\u90e8\u6781\u5c0f\uff0c\u4f7f\u9ad8\u6e29\u526f\u672c\u81ea\u7531\u63a2\u7d22\u65f6\u53d1\u73b0\u7684\u4f4e\u80fd\u6781\u5c0f\u9010\u6b65\u4f20\u9012\u5230\u4f4e\u6e29\u526f\u672c\u4e2d\u8fdb\u4e00\u6b65\u7cbe\u4fee\u3002\u8fd9\u662f Strodel \u7b49\u4eba\u63d0\u51fa\u7684\u6807\u51c6\u65b9\u6cd5\uff08GMIN \u5173\u952e\u5b57 BHPT\uff09\uff0c\u91c7\u7528\u6587\u732e\u4e2d\u7684\u53c2\u6570\u503c\uff1b\u552f\u4e00\u7684\u6539\u52a8\u662f\u5404\u526f\u672c\u5728\u5355\u8fdb\u7a0b\u4e2d\u4ea4\u66ff\u8fd0\u884c\u5e76\u5171\u4eab\u9884\u7b97\u3001\u6bcf\u4e2a\u6e29\u5ea6\u7684\u6b65\u957f\u6839\u636e\u6700\u8fd1 10 \u6b21\u79fb\u52a8\u7684\u63a5\u53d7\u7387\u81ea\u9002\u5e94\u8c03\u6574\uff0c\u4ee5\u53ca\u5bf9\u53d8\u80de\u4f53\u76f8\u5728\u6bcf\u6b21\u6676\u80de\u5e94\u53d8\u79fb\u52a8\u524d\u505a Minkowski \u6676\u683c\u7ea6\u5316\u3001\u5e76\u5728\u6676\u80de\u5f1b\u8c6b\u4e2d\u6b62\u65f6\u8ba9\u8be5\u526f\u672c\u4ece\u65b0\u7684\u968f\u673a\u7ed3\u6784\u91cd\u65b0\u5f00\u59cb\u3002"
   ],
   "ref": "Strodel, Lee, Whittleston & Wales, J. Am. Chem. Soc. 132, 13300 (2010) (basin-hopping parallel tempering, GMIN keyword BHPT); Wales & Doye, J. Phys. Chem. A 101, 5111 (1997) (basin hopping); Swendsen & Wang, Phys. Rev. Lett. 57, 2607 (1986) and Hukushima & Nemoto, J. Phys. Soc. Jpn. 65, 1604 (1996) (replica exchange / parallel tempering)"
  },
  {
   "key": "rs",
   "rank": 21,
   "name": "Random search",
   "short": "RS",
   "type": "baseline",
   "score_t": 34.622242377201374,
   "ci_lo": 33.27525385241098,
   "ci_hi": 35.96923090199177,
   "p_best": 0.0,
   "gmre": 0.010931185677744697,
   "avg_rank": 18.512820512820515,
   "solved": 36,
   "pooled_sr": 0.34512820512820513,
   "speedup": 0.21720356479794764,
   "score_all": 39.040244611430225,
   "score_dev": 67.75725913391784,
   "score_wall": 49.130274347038764,
   "overhead": 1.082152419130307,
   "desc": [
    "Ab initio random structure searching (AIRSS) style sampling: independent random structures (with a random cell for bulk crystals) are generated inside the search region with the shared minimum-distance and connectivity constraints, and each is relaxed with L-BFGS. There is no memory between trials, so its efficiency is the probability of landing in the global-minimum basin per ionic step; it is the reference for how much a search strategy gains over pure sampling.",
    "\u4eff\u7167 AIRSS\uff08\u4ece\u5934\u968f\u673a\u7ed3\u6784\u641c\u7d22\uff09\u7684\u968f\u673a\u91c7\u6837\uff1a\u5728\u641c\u7d22\u533a\u57df\u5185\u6309\u7edf\u4e00\u7684\u6700\u5c0f\u539f\u5b50\u95f4\u8ddd\u4e0e\u8fde\u901a\u6027\u7ea6\u675f\u72ec\u7acb\u751f\u6210\u968f\u673a\u7ed3\u6784\uff08\u4f53\u76f8\u540c\u65f6\u968f\u673a\u751f\u6210\u6676\u80de\uff09\uff0c\u6bcf\u4e2a\u7ed3\u6784\u7528 L-BFGS \u5f1b\u8c6b\u3002\u5404\u6b21\u8bd5\u9a8c\u4e4b\u95f4\u6ca1\u6709\u8bb0\u5fc6\uff0c\u56e0\u6b64\u5176\u6548\u7387\u5c31\u662f\u6bcf\u4e2a\u79bb\u5b50\u6b65\u843d\u5165\u5168\u5c40\u6700\u4f18\u76c6\u5730\u7684\u6982\u7387\uff1b\u5b83\u662f\u8861\u91cf\u641c\u7d22\u7b56\u7565\u76f8\u5bf9\u7eaf\u968f\u673a\u91c7\u6837\u6536\u76ca\u7684\u53c2\u7167\u3002"
   ],
   "ref": "Pickard & Needs, J. Phys.: Condens. Matter 23, 053201 (2011)"
  },
  {
   "key": "sa",
   "rank": 22,
   "name": "Simulated annealing (MD)",
   "short": "SA",
   "type": "baseline",
   "score_t": 13.96558124071463,
   "ci_lo": 11.890656868331948,
   "ci_hi": 16.040505613097313,
   "p_best": 0.0,
   "gmre": 0.002624021790610837,
   "avg_rank": 21.705128205128204,
   "solved": 27,
   "pooled_sr": 0.12153846153846154,
   "speedup": 0.05232948112541668,
   "score_all": 14.662133936997648,
   "score_dev": 19.189726462837275,
   "score_wall": 24.1884653959942,
   "overhead": 0.8867965705681508,
   "desc": [
    "Classic simulated annealing carried out with molecular dynamics: every cycle starts from a fresh random structure, heats it to 2500 K with a Langevin thermostat and cools it geometrically to 300 K over 3000 MD steps (2 fs time step, shorter for light elements), then quenches it to the nearest local minimum with L-BFGS; independent cycles are repeated until the budget is spent. Bulk crystals are annealed at zero pressure with a Berendsen barostat and quenched with a variable-cell relaxation. Nothing is new: it is a faithful baseline with standard literature parameters; only safety measures were added (an elastic container that pulls evaporated fragments back to the cluster, a speed cap against MD explosions) and the last anneal is shortened to fit the remaining budget.",
    "\u7ecf\u5178\u7684\u5206\u5b50\u52a8\u529b\u5b66\u6a21\u62df\u9000\u706b\uff1a\u6bcf\u4e2a\u5faa\u73af\u4ece\u4e00\u4e2a\u65b0\u7684\u968f\u673a\u7ed3\u6784\u51fa\u53d1\uff0c\u7528\u6717\u4e4b\u4e07\u6052\u6e29\u5668\u52a0\u70ed\u5230 2500 K\uff0c\u5e76\u5728 3000 \u4e2a MD \u6b65\u5185\uff08\u65f6\u95f4\u6b65\u957f 2 fs\uff0c\u8f7b\u5143\u7d20\u76f8\u5e94\u7f29\u77ed\uff09\u6309\u51e0\u4f55\u7ea7\u6570\u964d\u6e29\u5230 300 K\uff0c\u968f\u540e\u7528 L-BFGS \u6dec\u706b\u5230\u6700\u8fd1\u7684\u5c40\u90e8\u6781\u5c0f\uff1b\u5404\u5faa\u73af\u76f8\u4e92\u72ec\u7acb\uff0c\u91cd\u590d\u8fdb\u884c\u76f4\u5230\u9884\u7b97\u7528\u5b8c\u3002\u4f53\u76f8\u6676\u4f53\u5728\u96f6\u538b\u4e0b\u7528 Berendsen \u6052\u538b\u5668\u9000\u706b\uff0c\u5e76\u4ee5\u53ef\u53d8\u6676\u80de\u5f1b\u8c6b\u6dec\u706b\u3002\u8be5\u65b9\u6cd5\u6ca1\u6709\u65b0\u7684\u6539\u52a8\uff0c\u662f\u91c7\u7528\u6587\u732e\u6807\u51c6\u53c2\u6570\u7684\u5fe0\u5b9e\u57fa\u7ebf\u5b9e\u73b0\uff1b\u4ec5\u52a0\u5165\u4e86\u5b89\u5168\u63aa\u65bd\uff08\u628a\u84b8\u53d1\u51fa\u53bb\u7684\u788e\u7247\u62c9\u56de\u56e2\u7c07\u7684\u5f39\u6027\u5bb9\u5668\u3001\u9632\u6b62 MD \u53d1\u6563\u7684\u901f\u5ea6\u4e0a\u9650\uff09\uff0c\u5e76\u628a\u6700\u540e\u4e00\u6b21\u9000\u706b\u7f29\u77ed\u4ee5\u9002\u5e94\u5269\u4f59\u9884\u7b97\u3002"
   ],
   "ref": "S. Kirkpatrick, C. D. Gelatt & M. P. Vecchi, Science 220, 671 (1983); R. Biswas & D. R. Hamann, Phys. Rev. B 34, 895 (1986) (MD annealing of Si clusters); H. J. C. Berendsen et al., J. Chem. Phys. 81, 3684 (1984) (barostat); B. Leimkuhler & C. Matthews, Appl. Math. Res. Express 2013, 34 (BAOAB Langevin integrator)"
  }
 ],
 "benches": [
  {
   "name": "cl_Ag27Cu7",
   "category": "cluster",
   "title": "Ag27Cu7 nanoalloy",
   "description": "Gas-phase Ag27Cu7 nanoalloy (geometry plus homotop / chemical-ordering search). With the Gupta potential the GM is a perfect core-shell polyicosahedron (pIh7, D5h) with a Cu7 pentagonal-bipyramid core under a 27-atom Ag shell (Rossi et al., PRL 93, 105503 (2004)); NEP89 reproduces this structure.",
   "guard": "",
   "n_search": 34,
   "n_total": 34,
   "budget": 100000,
   "e_tol": 0.02,
   "e_ref": -92.5888781413134,
   "dev": false,
   "found_by": "gofee s3 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "EGBH",
   "best_ert": 2949.4,
   "bh_ert": 23714.24,
   "n_solved": 20,
   "dmin": 0.9263834199586145,
   "img": "img/gm_cl_Ag27Cu7.png"
  },
  {
   "name": "cl_Ag55",
   "category": "cluster",
   "title": "Ag55 cluster",
   "description": "Gas-phase Ag55. The Mackay icosahedron is the GM for many-body potentials (Cambridge Cluster Database) and is supported by DFT and photoelectron spectra of Ag55- (Haekkinen et al., PRL 93, 093401 (2004)). NEP89 reproduces it, about 2 eV below the cuboctahedron and Ino decahedron; the difficulty is the size of the landscape rather than near-degenerate competitors.",
   "guard": "",
   "n_search": 55,
   "n_total": 55,
   "budget": 43000,
   "e_tol": 0.02,
   "e_ref": -143.90428015624843,
   "dev": false,
   "found_by": "gofee s5 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 496.36,
   "bh_ert": 9713.52,
   "n_solved": 21,
   "dmin": 0.9324562638575253,
   "img": "img/gm_cl_Ag55.png"
  },
  {
   "name": "cl_Al8O12",
   "category": "cluster",
   "title": "(Al2O3)4 cluster",
   "description": "Gas-phase (Al2O3)4, an alumina dust-nucleation and gas-phase IR target; DFT global minima of small (Al2O3)n are compact cages of 4-membered Al2O2 and 6-membered Al3O3 rings with 3-5-fold Al and 2-4-fold O (Rahane, Deshpande & Kumar, JPCC 115, 18111 (2011)), and for n = 4 the B3LYP GM is a low-symmetry (C1) cage while PBE0 prefers a D3d isomer (Gobrecht et al., A&A 658, A167 (2022)). The NEP89 putative GM has these features (Cs cage; five 3-fold and three 4-fold Al; ten 2-fold, one 3-fold and one 4-fold O; two Al2O2 and eight Al3O3 rings; Al-O 1.71-1.98 A; no O-O or Al-Al bonds), but its identity with the DFT GM was not verified. A Cs isomer 0.20 eV higher (one 2-fold Al) forms a competing funnel that traps some basin-hopping runs. Artefact screening: NEP89 has an O-O bonded hole; a particle-swarm run found a cage with O-O 1.11 and 1.22 A, Al-O 1.53 A and only 5-fold Al, 0.08 eV below the physical minimum. An O-O guard floor of 1.9 A (guard_pairs; the shortest physical O-O distance here is 2.49 A) lifts it by 41 eV and leaves the physical minima unchanged.",
   "guard": "guard f = 0.75, O-O floor 1.9 A",
   "n_search": 20,
   "n_total": 20,
   "budget": 69000,
   "e_tol": 0.02,
   "e_ref": -131.45041469365586,
   "dev": false,
   "found_by": "surr s2 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 731.04,
   "bh_ert": 46793.666666666664,
   "n_solved": 22,
   "dmin": 0.9132574484805687,
   "img": "img/gm_cl_Al8O12.png"
  },
  {
   "name": "cl_Au20",
   "category": "cluster",
   "title": "Au20 cluster",
   "description": "Gas-phase Au20. DFT and photoelectron spectroscopy give a tetrahedral (Td) pyramid, a 20-atom fcc fragment (Li, Li, Zhai & Wang, Science 299, 864 (2003)). NEP89 instead prefers a low-symmetry structure with one interior atom; the relaxed Td pyramid is 0.11 eV higher.",
   "guard": "",
   "n_search": 20,
   "n_total": 20,
   "budget": 55000,
   "e_tol": 0.02,
   "e_ref": -54.218349709886525,
   "dev": false,
   "found_by": "gofee s24 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SurrBH",
   "best_ert": 1916.14,
   "bh_ert": 16519.877551020407,
   "n_solved": 21,
   "dmin": 1.0044465972544545,
   "img": "img/gm_cl_Au20.png"
  },
  {
   "name": "cl_B12",
   "category": "cluster",
   "title": "B12 cluster",
   "description": "Gas-phase B12. Photoelectron spectroscopy and ab initio calculations establish a quasi-planar C3v global minimum (Zhai et al., Nat. Mater. 2, 827 (2003)), with 3D isomers such as the icosahedron several eV higher. NEP89 reverses this ordering: its putative GM is the Ih icosahedron (B-B 1.73 A, the building block of bulk boron), 2.7 eV below the relaxed quasi-planar C3v structure, so this benchmark probes search on the NEP89 landscape rather than boron-cluster chemistry.",
   "guard": "",
   "n_search": 12,
   "n_total": 12,
   "budget": 20000,
   "e_tol": 0.02,
   "e_ref": -70.32854850851568,
   "dev": false,
   "found_by": "gofee s0 (freeze-smoke)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 58.28,
   "bh_ert": 5531.265306122449,
   "n_solved": 22,
   "dmin": 1.0315355292205008,
   "img": "img/gm_cl_B12.png"
  },
  {
   "name": "cl_Cu38",
   "category": "cluster",
   "title": "Cu38 cluster",
   "description": "Gas-phase Cu38. For many-body potentials (Gupta, Sutton-Chen) the GM is the Oh fcc truncated octahedron, separated from icosahedral/decahedral structures as in the LJ38 double funnel (Doye & Wales, New J. Chem. 22, 733 (1998); Cambridge Cluster Database). NEP89 agrees; the best non-fcc structure found lies 0.11 eV higher.",
   "guard": "",
   "n_search": 38,
   "n_total": 38,
   "budget": 150000,
   "e_tol": 0.02,
   "e_ref": -124.47014913283638,
   "dev": false,
   "found_by": "gofee s16 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 1430.88,
   "bh_ert": 364623.4705882353,
   "n_solved": 20,
   "dmin": 0.9350218270821619,
   "img": "img/gm_cl_Cu38.png"
  },
  {
   "name": "cl_Mg8O8",
   "category": "cluster",
   "title": "(MgO)8 cluster",
   "description": "Gas-phase (MgO)8. IR spectroscopy combined with DFT global optimisation (Haertelt et al., PCCP 14, 2849 (2012)) assigns cage-like structures containing hexagonal (MgO)3 rings, not rocksalt cuboids, to (MgO)n with n != 3k. NEP89 instead favours rocksalt fragments: its putative GM (a 3x3x2 rocksalt slab missing one corner MgO pair; Mg 3-5-fold coordinated, Mg-O 1.94-2.31 A, no O-O or Mg-Mg bonds) lies 0.25 eV below the 2x2x4 cuboid and 2.7 eV below a hand-built hexagonal-ring cage.",
   "guard": "",
   "n_search": 16,
   "n_total": 16,
   "budget": 7000,
   "e_tol": 0.02,
   "e_ref": -79.10845413910306,
   "dev": false,
   "found_by": "gofee s10 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 138.6,
   "bh_ert": 2225.92,
   "n_solved": 22,
   "dmin": 0.9378726176097884,
   "img": "img/gm_cl_Mg8O8.png"
  },
  {
   "name": "cl_Na8Cl8",
   "category": "cluster",
   "title": "(NaCl)8 cluster",
   "description": "Gas-phase (NaCl)8. Small alkali-halide clusters adopt rocksalt-cuboid structures in ab initio and Tosi-Fumi studies (Aguado et al., PRB 56, 15353 (1997); Doye & Wales, PRB 59, 2292 (1999)), and the NEP89 putative GM is the 2x2x4 rocksalt cuboid (Na-Cl 2.56-2.65 A). The landscape is soft: fmax = 0.05 relaxations of the same GM differ by up to 0.016 eV (0.3 meV after tight relaxation), hence e_tol = 0.05 eV.",
   "guard": "",
   "n_search": 16,
   "n_total": 16,
   "budget": 84000,
   "e_tol": 0.05,
   "e_ref": -46.39201873637941,
   "dev": false,
   "found_by": "gofee s13 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SSW",
   "best_ert": 2616.94,
   "bh_ert": 62673.2972972973,
   "n_solved": 22,
   "dmin": 0.9571413767645436,
   "img": "img/gm_cl_Na8Cl8.png"
  },
  {
   "name": "cl_Pt13",
   "category": "cluster",
   "title": "Pt13 cluster",
   "description": "Gas-phase Pt13.",
   "guard": "",
   "n_search": 13,
   "n_total": 13,
   "budget": 20000,
   "e_tol": 0.02,
   "e_ref": -60.512416331778795,
   "dev": true,
   "found_by": "gofee s11 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 81.34,
   "bh_ert": 1549.48,
   "n_solved": 22,
   "dmin": 0.9170113049034442,
   "img": "img/gm_cl_Pt13.png"
  },
  {
   "name": "cl_Pt19",
   "category": "cluster",
   "title": "Pt19 cluster",
   "description": "Gas-phase Pt19. PBE and hybrid DFT give a Pt18 three-layer trigonal prism capped on a triangular face (C3v; Kumar & Kawazoe, PRB 77, 205418 (2008); J. Mol. Model. (2024), doi:10.1007/s00894-024-06099-5). NEP89 instead prefers a hollow 19-vertex deltahedral cage (all atoms 5- or 6-coordinated, Pt-Pt 2.53-2.57 A), 1.5 eV below the relaxed DFT structure and 0.66 eV below the fcc octahedron, so this landscape is NEP89-specific.",
   "guard": "",
   "n_search": 19,
   "n_total": 19,
   "budget": 10000,
   "e_tol": 0.02,
   "e_ref": -93.65440564753219,
   "dev": false,
   "found_by": "softmode s9 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 173.08,
   "bh_ert": 2422.0,
   "n_solved": 22,
   "dmin": 0.9306395975419718,
   "img": "img/gm_cl_Pt19.png"
  },
  {
   "name": "cl_Pt7Cu6",
   "category": "cluster",
   "title": "Pt7Cu6 cluster",
   "description": "Gas-phase bimetallic Pt7Cu6 nanoalloy (13 atoms): geometric and homotop (chemical ordering) search.",
   "guard": "",
   "n_search": 13,
   "n_total": 13,
   "budget": 30000,
   "e_tol": 0.02,
   "e_ref": -51.24321950345032,
   "dev": true,
   "found_by": "gofee s9 (dev-gofee-v2)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 95.06,
   "bh_ert": 3955.0,
   "n_solved": 22,
   "dmin": 0.9138242426090697,
   "img": "img/gm_cl_Pt7Cu6.png"
  },
  {
   "name": "cl_Si20",
   "category": "cluster",
   "title": "Si20 cluster",
   "description": "Gas-phase Si20. Ion-mobility measurements and DFT show prolate Si_n clusters built from stacked tricapped-trigonal-prism units up to n ~ 25, with compact isomers close in energy around n = 20 (Ho et al., Nature 392, 582 (1998)). NEP89 has two near-degenerate putative minima, a compact oblate GM and a prolate isomer only 2 meV higher (tight relaxation), both with 4-7-fold coordinated Si and Si-Si >= 2.41 A, so a hit (E <= E_best + e_tol) can be either isomer.",
   "guard": "",
   "n_search": 20,
   "n_total": 20,
   "budget": 34000,
   "e_tol": 0.02,
   "e_ref": -97.2205070889481,
   "dev": false,
   "found_by": "gofee s16 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 342.3,
   "bh_ert": 5943.48,
   "n_solved": 22,
   "dmin": 1.096657867833187,
   "img": "img/gm_cl_Si20.png"
  },
  {
   "name": "cl_Ti6O12",
   "category": "cluster",
   "title": "(TiO2)6 cluster",
   "description": "Gas-phase (TiO2)6, a standard titania-nanocluster global-optimisation target; DFT global minima of small (TiO2)n are compact, with 4-/5-fold coordinated Ti and one or two terminal Ti=O groups (Qu & Kroes, JPCB 110, 8998 (2006); Lamiel-Garcia et al., Nanoscale 9, 1049 (2017)). The NEP89 putative GM has these features (two titanyl O at 1.69 A, four 4- and two 5-fold Ti, nine 4-membered Ti2O2 rings, no O-O bonds), but its identity with the DFT GM was not verified; the default repulsive guard (Ti-O r0 = 1.695 A) is marginally active on the titanyl bonds (0.3 meV).",
   "guard": "",
   "n_search": 18,
   "n_total": 18,
   "budget": 47500,
   "e_tol": 0.02,
   "e_ref": -153.06793358673255,
   "dev": false,
   "found_by": "gofee s30 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 421.54,
   "bh_ert": 15569.395833333334,
   "n_solved": 22,
   "dmin": 0.748396217891632,
   "img": "img/gm_cl_Ti6O12.png"
  },
  {
   "name": "su_Au8_MgO100",
   "category": "surface",
   "title": "Au8 / MgO(001)",
   "description": "Au8 on a frozen 3-layer MgO(001) slab (6x6 primitive surface cells, 216 atoms; NEP89 a = 4.203 A vs exp. 4.212 A), the classic model of size-selected Au_n/MgO catalysts (Ricci et al., Phys. Rev. Lett. 97, 036106 (2006)). The NEP89 putative GM is a flat Au8 island with all 8 Au in contact with the surface (Au-Au 2.74-2.83 A); NEP89 puts single Au atoms on top of O as DFT does, but places the best 3D isomers found (fcc 6+2 bilayers) >= 0.69 eV above the flat GM, whereas DFT finds 3D Au8 on bulk MgO(001) and planar Au8 only on metal-supported MgO films that charge the cluster (Ricci et al. 2006), i.e. NEP89 over-stabilises wetting. e_tol is 0.015 eV because distinct flat isomers lie 0.019 eV above the GM.",
   "guard": "",
   "n_search": 8,
   "n_total": 224,
   "budget": 19500,
   "e_tol": 0.015,
   "e_ref": -1304.4667494029097,
   "dev": false,
   "found_by": "gofee s49 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 345.26,
   "bh_ert": 5569.5625,
   "n_solved": 22,
   "dmin": 0.9813993050901497,
   "img": "img/gm_su_Au8_MgO100.png"
  },
  {
   "name": "su_Au8_TiO2_110",
   "category": "surface",
   "title": "Au8 / rutile TiO2(110)",
   "description": "Au8 on a frozen 3-trilayer stoichiometric rutile TiO2(110) slab (3x6 cell, 19.5 x 17.7 A, 324 atoms; NEP89 a = 4.606 A, c = 2.957 A vs exp. 4.594, 2.959 A), the model support of Au/TiO2 CO-oxidation catalysts (Valden, Lai and Goodman, Science 281, 1647 (1998)). The NEP89 putative GM is a compact 3D Au8 with 5 Au in contact, 3 on the bridging-O row (Au-O 2.20 A) and 2 atop 5-fold Ti in the trough (Au-Ti 2.68 A); DFT likewise finds small Au_n turning 3D on stoichiometric TiO2(110) (Au7) but binds them mainly through bridging and in-plane O (Chretien and Metiu, J. Chem. Phys. 127, 084704 (2007)), whereas NEP89 also favours Au-Ti5c contacts (a single Au sits atop Ti5c). The stoichiometric frozen slab lacks the O vacancies that anchor Au in experiment.",
   "guard": "",
   "n_search": 8,
   "n_total": 332,
   "budget": 37000,
   "e_tol": 0.02,
   "e_ref": -2917.7091157361056,
   "dev": false,
   "found_by": "gofee s11 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 2015.52,
   "bh_ert": 20624.47619047619,
   "n_solved": 21,
   "dmin": 0.9061261254550763,
   "img": "img/gm_su_Au8_TiO2_110.png"
  },
  {
   "name": "su_Cu8_TiC001",
   "category": "surface",
   "title": "Cu8 / TiC(001)",
   "description": "Cu8 on a frozen 4-layer TiC(001) slab (5x5 primitive cells, 200 atoms; NEP89 a = 4.285 A vs exp. 4.328 A), a model of Cu/TiC(001) catalysts for CO2 hydrogenation to methanol (Vidal et al., J. Phys. Chem. Lett. 3, 2275 (2012)). The NEP89 putative GM is a flat Cu8 island with every Cu on a top-C site (Cu-C 1.95 A), the adatom site found by DFT (Gomez et al., J. Phys. Chem. C 114, 1622 (2010)); DFT places the 2D-to-3D crossover at Cu7 and finds a Cu6+2 bilayer for Cu8 (Li et al., ACS Omega 6, 27259 (2021)), which NEP89 puts 0.55 eV above its flat GM, i.e. NEP89 over-stabilises wetting.",
   "guard": "",
   "n_search": 8,
   "n_total": 208,
   "budget": 27500,
   "e_tol": 0.02,
   "e_ref": -1896.1288275434201,
   "dev": false,
   "found_by": "gofee s7 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 46.8,
   "bh_ert": 15490.302325581395,
   "n_solved": 22,
   "dmin": 0.9087177896679114,
   "img": "img/gm_su_Cu8_TiC001.png"
  },
  {
   "name": "su_Pd10_Au111",
   "category": "surface",
   "title": "Pd10 / Au(111)",
   "description": "Pd10 on a frozen 4-layer Au(111) slab (7x7, 196 Au; NEP89 a(Au) = 4.111 A vs exp. 4.078 A), a model of Pd-Au bimetallic catalysts and PdAu(111) surface alloys (Maroun et al., Science 293, 1811 (2001); Chen et al., Science 310, 291 (2005)). The NEP89 putative GM is a flat Pd10 island with every Pd in an fcc hollow (the same island in hcp hollows is 0.24 eV higher), in line with the 2D close-packed Pd islands seen by STM on Au(111) (Casari et al., Phys. Rev. B 79, 195402 (2009)); the frozen substrate excludes the Pd-Au place exchange (surface alloying) observed at room temperature.",
   "guard": "",
   "n_search": 10,
   "n_total": 206,
   "budget": 15000,
   "e_tol": 0.02,
   "e_ref": -750.2946732958173,
   "dev": false,
   "found_by": "gofee s13 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 189.22,
   "bh_ert": 5995.0,
   "n_solved": 21,
   "dmin": 0.9750855635609539,
   "img": "img/gm_su_Pd10_Au111.png"
  },
  {
   "name": "su_Pd16_graphene",
   "category": "surface",
   "title": "Pd16 / graphene",
   "description": "Pd16 on frozen graphene (8x8, 128 C; NEP89 a = 2.476 A vs exp. 2.461 A), a model of graphene-supported Pd catalysts; DFT finds Pd clusters on graphene to be 3D from Pd4 on, because Pd-Pd bonding dominates the weak Pd-graphene interaction (Cabria et al., Phys. Rev. B 81, 035403 (2010)). The NEP89 putative GM is a Pd13 icosahedron with three capping atoms that touches graphene with a single vertex atom above a C6 hollow (Pd-C 2.39 A); other capping isomers and orientations lie within 0.031 eV (next family +0.074 eV) and runs that reached the GM structure differ by up to 0.024 eV, hence e_tol = 0.05 eV.",
   "guard": "",
   "n_search": 16,
   "n_total": 144,
   "budget": 12500,
   "e_tol": 0.05,
   "e_ref": -1253.0691754243953,
   "dev": false,
   "found_by": "gofee s5 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 328.06,
   "bh_ert": 10372.888888888889,
   "n_solved": 21,
   "dmin": 0.9529602714343607,
   "img": "img/gm_su_Pd16_graphene.png"
  },
  {
   "name": "su_Pt10_CeO2_111",
   "category": "surface",
   "title": "Pt10 / CeO2(111)",
   "description": "Pt10 on a frozen O-terminated CeO2(111) slab (3 O-Ce-O trilayers, 5x5 cell, 225 atoms; NEP89 a = 5.438 A vs exp. 5.411 A), a model of Pt/ceria oxidation and three-way catalysts. The NEP89 putative GM is a 3D Pt7+3 bilayer bound to surface O (Pt-O 1.99 A), and NEP89 Pt8 is planar, in line with the DFT 2D-to-3D transition above Pt8 for Pt_N on CeO2(111) (Paz-Borbon et al., Phys. Chem. Chem. Phys. 19, 17845 (2017)). NEP89 is charge-neutral: the Pt-to-ceria electron transfer and Ce4+ -> Ce3+ reduction found by DFT are not described, and the frozen slab excludes O spillover and vacancy formation.",
   "guard": "",
   "n_search": 10,
   "n_total": 235,
   "budget": 20000,
   "e_tol": 0.02,
   "e_ref": -2015.3373151313303,
   "dev": false,
   "found_by": "gofee s21 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 315.84,
   "bh_ert": 8322.061224489797,
   "n_solved": 22,
   "dmin": 0.8216567529196591,
   "img": "img/gm_su_Pt10_CeO2_111.png"
  },
  {
   "name": "su_Pt10_TiO2a101",
   "category": "surface",
   "title": "Pt10 / anatase TiO2(101)",
   "description": "Pt10 on a frozen 3-layer stoichiometric anatase TiO2(101) slab (oblique 15.2 x 15.3 A cell, 216 atoms; NEP89 a = 3.819 A, c = 9.296 A vs exp. 3.785, 9.514 A), the majority facet of anatase-supported Pt photo- and thermal catalysts. The NEP89 putative GM is a 3D Pt5+5 bilayer anchored on the terrace by 5-fold Ti (Pt-Ti 2.49-2.65 A) and 2-fold O (Pt-O 2.09 A), consistent with the strong Pt binding on anatase(101) terraces found by DFT and STM (Gong et al., J. Am. Chem. Soc. 130, 370 (2008)). Caveats: NEP89 Pt-Ti contacts are short (2.76 A in Pt3Ti), NEP89 is charge-neutral and its anatase c axis is 2.3% too short.",
   "guard": "",
   "n_search": 10,
   "n_total": 226,
   "budget": 21500,
   "e_tol": 0.02,
   "e_ref": -1996.7716827002791,
   "dev": false,
   "found_by": "gofee s38 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 634.5,
   "bh_ert": 17427.666666666668,
   "n_solved": 22,
   "dmin": 0.8408363544892754,
   "img": "img/gm_su_Pt10_TiO2a101.png"
  },
  {
   "name": "su_Pt4Sn4_Al2O3",
   "category": "surface",
   "title": "Pt4Sn4 / alpha-Al2O3(0001)",
   "description": "Pt4Sn4 on a frozen Al-terminated alpha-Al2O3(0001) slab ((2sqrt3 x 2sqrt3)R30, Al96O144; NEP89 a/c = 4.753/12.895 A vs exp. 4.759/12.991 A), a model of Pt-Sn/Al2O3 propane-dehydrogenation catalysts (sub-nanometre Pt and PtSn clusters on alumina: Baxter et al., ACS Catal. 7, 3322 (2017); Liu et al., ACS Catal. 13, 2802 (2023)). In the NEP89 putative GM the oxophilic Sn atoms bind surface O (Sn-O 2.37-2.55 A) and carry the Pt atoms on top (only Pt-Sn and Pt-Pt bonds, no Sn-Sn); note that NEP89 relaxes the surface Al 0.4 A below the top O plane (DFT: about 0.1 A above).",
   "guard": "",
   "n_search": 8,
   "n_total": 248,
   "budget": 15500,
   "e_tol": 0.02,
   "e_ref": -1796.8639679693674,
   "dev": false,
   "found_by": "gofee s36 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 303.6,
   "bh_ert": 5840.0204081632655,
   "n_solved": 22,
   "dmin": 0.9518593299085133,
   "img": "img/gm_su_Pt4Sn4_Al2O3.png"
  },
  {
   "name": "su_Pt8_MgO100",
   "category": "surface",
   "title": "Pt8 / MgO(001)",
   "description": "Pt8 cluster on a frozen 4-layer MgO(001) slab (3x3 conventional cells, 144 atoms).",
   "guard": "",
   "n_search": 8,
   "n_total": 152,
   "budget": 30000,
   "e_tol": 0.02,
   "e_ref": -903.4409653133708,
   "dev": true,
   "found_by": "gofee s46 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "CRG",
   "best_ert": 371.22,
   "bh_ert": 24759.74193548387,
   "n_solved": 22,
   "dmin": 0.9787404165065068,
   "img": "img/gm_su_Pt8_MgO100.png"
  },
  {
   "name": "su_Pt8_MoS2",
   "category": "surface",
   "title": "Pt8 / MoS2 monolayer",
   "description": "Pt8 on a frozen 1H-MoS2 monolayer (6x6, 108 atoms; NEP89 a = 3.150 A vs exp. 3.160 A), a model of Pt/MoS2 catalysts; DFT finds that Pt_n clusters on the MoS2 basal plane become 3D from n = 5 and that Pt particles bind to S (Saidi, Cryst. Growth Des. 15, 642 (2015)). The NEP89 putative GM is a 3D 5+3 Pt bilayer whose five lower Pt sit above Mo atoms, each bonded to three S (Pt-S 2.31-2.35 A, Pt-Pt 2.58-2.60 A); the lowest competing isomer, a 4+4 bilayer, is 0.16 eV higher.",
   "guard": "",
   "n_search": 8,
   "n_total": 116,
   "budget": 27500,
   "e_tol": 0.02,
   "e_ref": -853.7238779343829,
   "dev": false,
   "found_by": "gofee s15 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 163.38,
   "bh_ert": 11469.978260869566,
   "n_solved": 22,
   "dmin": 0.9466576680963015,
   "img": "img/gm_su_Pt8_MoS2.png"
  },
  {
   "name": "su_Pt8_SrTiO3_100",
   "category": "surface",
   "title": "Pt8 / SrTiO3(001)",
   "description": "Pt8 on a frozen TiO2-terminated SrTiO3(001) slab (SrO/TiO2/SrO/TiO2, 4x4 cell, 160 atoms; NEP89 a = 3.908 A vs exp. 3.905 A), a model of Pt/SrTiO3 photocatalysts and perovskite-supported Pt. The NEP89 putative GM is a single buckled Pt8 layer (6 Pt on the surface, Pt-O 2.19 A, Pt-Ti 2.61 A; 2 Pt 1.7 A higher), in line with DFT, which finds the TiO2 termination favourable for epitaxial Pt(100) films (Asthagiri and Sholl, J. Chem. Phys. 116, 9914 (2002)). NEP89 is charge-neutral and the frozen, unreconstructed slab excludes the surface reconstructions and O vacancies of real SrTiO3(001).",
   "guard": "",
   "n_search": 8,
   "n_total": 168,
   "budget": 13000,
   "e_tol": 0.02,
   "e_ref": -1306.263650749059,
   "dev": false,
   "found_by": "gofee s48 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 243.82,
   "bh_ert": 5100.918367346939,
   "n_solved": 22,
   "dmin": 0.8827736155609368,
   "img": "img/gm_su_Pt8_SrTiO3_100.png"
  },
  {
   "name": "ze_Au6_MFI",
   "category": "zeolite",
   "title": "Au6 @ MFI (channel intersection)",
   "description": "Au6 cluster at the intersection of the straight and sinusoidal 10-ring channels of a frozen all-silica MFI framework (silicalite-1; NEP89-relaxed orthorhombic cell, 288 framework atoms). Metal clusters encapsulated in MFI resist sintering (Goel, Zones and Iglesia, J. Am. Chem. Soc. 136, 15280 (2014)); for Au clusters in zeolites see Otto, Zones and Iglesia, J. Catal. 339, 195 (2016). Caveat: NEP89 is not fitted to metal/zeolite interfaces and the framework is rigid, so cluster-wall binding is qualitative (NEP89 GM: buckled Au6 anchored to the intersection wall); Au replaces Pd because NEP89 bonds Pd and Pt atoms to SiO4 edges of MFI (M-Si 2.4-2.5 A).",
   "guard": "",
   "n_search": 6,
   "n_total": 294,
   "budget": 11000,
   "e_tol": 0.02,
   "e_ref": -2275.943148475035,
   "dev": false,
   "found_by": "gofee s18 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 275.4,
   "bh_ert": 7341.928571428572,
   "n_solved": 21,
   "dmin": 0.9525413732525707,
   "img": "img/gm_ze_Au6_MFI.png"
  },
  {
   "name": "ze_Au7_BEA",
   "category": "zeolite",
   "title": "Au7 @ BEA (channel intersection)",
   "description": "Au7 cluster at an intersection of the 12-ring channels of a frozen all-silica zeolite beta (polymorph A; NEP89-relaxed tetragonal cell, 192 framework atoms). Metal clusters immobilised inside beta crystals resist sintering (Wang et al., Nat. Catal. 1, 540 (2018)). Caveat: NEP89 is not fitted to metal/zeolite interfaces and the framework is rigid, so cluster-wall binding is qualitative (NEP89 GM: planar Au7 spanning the intersection).",
   "guard": "",
   "n_search": 7,
   "n_total": 199,
   "budget": 12000,
   "e_tol": 0.02,
   "e_ref": -1525.04207834328,
   "dev": false,
   "found_by": "gofee s21 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 211.54,
   "bh_ert": 4574.265306122449,
   "n_solved": 21,
   "dmin": 0.960076651048957,
   "img": "img/gm_ze_Au7_BEA.png"
  },
  {
   "name": "ze_Cu6_AEI",
   "category": "zeolite",
   "title": "Cu6 @ AEI",
   "description": "Cu6 cluster in the pear-shaped aei cage (8-ring windows, 3.8 A) of a frozen all-silica AEI (SSZ-39) framework (NEP89-relaxed conventional cell, 144 atoms); Cu-SSZ-39 is a hydrothermally stable NH3-SCR deNOx catalyst (Moliner et al., Chem. Commun. 48, 8264 (2012)) in which Cu can agglomerate into clusters. Framework Al, ionic/oxidic Cu and framework relaxation are not modelled, NEP89 binds Cu atoms to the cage wall (Cu-O ~2.1 A, Cu-Si ~2.4 A) and places this framework 6.7 kJ/mol SiO2 below alpha-quartz (calorimetry: all-silica zeolites lie ~7-14 kJ/mol above), so the global minimum is a model-PES optimum.",
   "guard": "",
   "n_search": 6,
   "n_total": 150,
   "budget": 16700,
   "e_tol": 0.02,
   "e_ref": -1151.4645259552685,
   "dev": false,
   "found_by": "gofee s45 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SurrBH",
   "best_ert": 2159.88,
   "bh_ert": 80417.66666666667,
   "n_solved": 22,
   "dmin": 0.921104259246525,
   "img": "img/gm_ze_Cu6_AEI.png"
  },
  {
   "name": "ze_Pt4_CHA",
   "category": "zeolite",
   "title": "Pt4 @ CHA",
   "description": "Pt4 cluster inside the cha cage of a frozen all-silica chabazite framework (hexagonal cell, 108 atoms).",
   "guard": "",
   "n_search": 4,
   "n_total": 112,
   "budget": 20000,
   "e_tol": 0.02,
   "e_ref": -868.0088367841913,
   "dev": true,
   "found_by": "gofee s38 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 90.62,
   "bh_ert": 541.24,
   "n_solved": 22,
   "dmin": 0.9117913651522352,
   "img": "img/gm_ze_Pt4_CHA.png"
  },
  {
   "name": "ze_Pt6_TON",
   "category": "zeolite",
   "title": "Pt6 @ TON",
   "description": "Pt6 cluster in the one-dimensional 10-ring channel (4.6 x 5.7 A) of a frozen all-silica TON (ZSM-22/Theta-1) framework (NEP89-relaxed from a symmetry-broken start, 1x1x3 supercell, 216 atoms; density within 0.3 % of Theta-1); Pt/ZSM-22 is the classic shape-selective n-alkane hydroisomerisation catalyst (Martens and co-workers). Framework Al/H+ sites and framework relaxation are absent, NEP89 binds Pt to siloxane O (Pt-O ~2.2 A) and places this framework 3.6 kJ/mol SiO2 below alpha-quartz, so the global minimum is a model-PES optimum (Pt is used because NEP89 spuriously embeds Ir/Rh atoms into silica walls).",
   "guard": "",
   "n_search": 6,
   "n_total": 222,
   "budget": 17900,
   "e_tol": 0.01,
   "e_ref": -1726.85842460497,
   "dev": false,
   "found_by": "gofee s21 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "TabuBH",
   "best_ert": 7997.977272727273,
   "bh_ert": 38516.88888888889,
   "n_solved": 22,
   "dmin": 0.9175836171125673,
   "img": "img/gm_ze_Pt6_TON.png"
  },
  {
   "name": "ze_Pt8_FAU",
   "category": "zeolite",
   "title": "Pt8 @ FAU (supercage)",
   "description": "Pt8 cluster in the supercage (~11.2 A) of a frozen all-silica faujasite (siliceous Y; NEP89-relaxed rhombohedral primitive cell, 144 framework atoms). Pt clusters in the supercages of Y zeolite are the classic encapsulated noble-metal catalyst (Gallezot et al., J. Catal. 39, 334 (1975)). Caveat: NEP89 is not fitted to metal/zeolite interfaces and the framework is rigid, so cluster-wall binding is qualitative (NEP89 GM: flat Pt8 anchored to the wall by four Pt-O).",
   "guard": "",
   "n_search": 8,
   "n_total": 152,
   "budget": 12000,
   "e_tol": 0.02,
   "e_ref": -1174.3636939071741,
   "dev": false,
   "found_by": "gofee s30 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 581.18,
   "bh_ert": 3885.84,
   "n_solved": 22,
   "dmin": 0.9176478508551441,
   "img": "img/gm_ze_Pt8_FAU.png"
  },
  {
   "name": "ze_Pt8_MWW",
   "category": "zeolite",
   "title": "Pt8 @ MWW",
   "description": "Pt8 cluster in the 12-ring supercage (7.1 x 18.2 A, 10-ring windows) of a frozen all-silica MWW (MCM-22/ITQ-1) framework (NEP89-relaxed hexagonal cell, 216 atoms); subnanometric Pt clusters encapsulated in MCM-22 cavities are sinter-resistant, size-selective catalysts (Liu et al., Nat. Mater. 16, 132 (2017)). Framework Al/H+ sites and framework relaxation are absent, NEP89 places this framework 0.8 kJ/mol SiO2 below alpha-quartz and attracts Pt to the cage wall by ~0.7 eV/atom even at Pt-O distances > 3 A, so the global minimum is a model-PES optimum.",
   "guard": "",
   "n_search": 8,
   "n_total": 224,
   "budget": 5300,
   "e_tol": 0.01,
   "e_ref": -1735.795391452677,
   "dev": false,
   "found_by": "gofee s40 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 202.24,
   "bh_ert": 3919.054054054054,
   "n_solved": 22,
   "dmin": 0.9426191477253222,
   "img": "img/gm_ze_Pt8_MWW.png"
  },
  {
   "name": "ze_Pt9_LTA",
   "category": "zeolite",
   "title": "Pt9 @ LTA (alpha cage)",
   "description": "Pt9 cluster in the alpha cage (11.4 A) of a frozen all-silica LTA framework (ITQ-29; NEP89-relaxed, fcc-type 2x supercell, 144 framework atoms). Pt, Pd and Rh clusters encapsulated in LTA were prepared by Choi, Wu and Iglesia (J. Am. Chem. Soc. 132, 9129 (2010)). Caveat: NEP89 is not fitted to metal/zeolite interfaces and the framework is rigid, so cluster-wall binding is qualitative (NEP89 GM: planar Pt9 lying flat on the cage wall).",
   "guard": "",
   "n_search": 9,
   "n_total": 153,
   "budget": 41000,
   "e_tol": 0.01,
   "e_ref": -1175.253165816734,
   "dev": false,
   "found_by": "gofee s30 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SurrBH",
   "best_ert": 4975.9,
   "bh_ert": 18441.56818181818,
   "n_solved": 21,
   "dmin": 0.9337895201078896,
   "img": "img/gm_ze_Pt9_LTA.png"
  },
  {
   "name": "ze_Pt9_MOR",
   "category": "zeolite",
   "title": "Pt9 @ MOR",
   "description": "Pt9 cluster in the 12-ring main channel (6.5 x 7.0 A, with 8-ring side pockets) of a frozen all-silica mordenite framework (NEP89-relaxed 1x1x2 primitive supercell, 144 atoms); Pt/H-mordenite is the industrial light-naphtha isomerisation catalyst (Shell Hysomer process). Framework Al/H+ sites and framework relaxation are absent and NEP89 binds Pt to siloxane O atoms (Pt-O ~2.0 A), so the global minimum is a model-PES optimum (Pt is used because NEP89 spuriously embeds Rh/Ir atoms into silica walls).",
   "guard": "",
   "n_search": 9,
   "n_total": 153,
   "budget": 13900,
   "e_tol": 0.02,
   "e_ref": -1173.9511024223825,
   "dev": false,
   "found_by": "surr s15 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 484.48,
   "bh_ert": 6426.875,
   "n_solved": 18,
   "dmin": 0.9065963430926907,
   "img": "img/gm_ze_Pt9_MOR.png"
  },
  {
   "name": "bu_Al8O12",
   "category": "bulk",
   "title": "Al2O3 (Al8O12) crystal",
   "description": "Crystal structure prediction of Al2O3 with 4 formula units (20 atoms) per cell. The experimental ground state corundum (alpha-Al2O3, R-3c; this cell is twice its rhombohedral primitive cell) is also the NEP89 global minimum; theta-Al2O3 (beta-Ga2O3 type, mixed tetrahedral/octahedral Al, +36 meV/atom with NEP89) is a deep competing funnel.",
   "guard": "",
   "n_search": 20,
   "n_total": 20,
   "budget": 10000,
   "e_tol": 0.02,
   "e_ref": -152.73301826864844,
   "dev": false,
   "found_by": "surr s31 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 4834.422222222222,
   "bh_ert": 19928.65,
   "n_solved": 21,
   "dmin": 0.989427067774879,
   "img": "img/gm_bu_Al8O12.png"
  },
  {
   "name": "bu_Ca2C2O6",
   "category": "bulk",
   "title": "CaCO3 (Ca2C2O6) crystal",
   "description": "Variable-cell crystal-structure prediction of CaCO3 with two formula units (10 atoms) per cell: planar CO3 anions must assemble from random atoms. Experimental ground state: calcite (R-3c, 10-atom primitive cell); aragonite and vaterite are metastable. NEP89 caveats: the putative NEP89 global minimum is a vaterite-like layered polymorph (CO3 planes normal to the Ca layers, +6% volume) 7.4 meV/atom below calcite, and CaO + CO2 is only 0.32 eV/f.u. above calcite (exp. ~1.8 eV), a frequent trap.",
   "guard": "",
   "n_search": 10,
   "n_total": 10,
   "budget": 100000,
   "e_tol": 0.02,
   "e_ref": -75.38511676780774,
   "dev": false,
   "found_by": "surr s40 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SSW",
   "best_ert": 45424.704545454544,
   "bh_ert": 1611656.0,
   "n_solved": 22,
   "dmin": 0.910902176439192,
   "img": "img/gm_bu_Ca2C2O6.png"
  },
  {
   "name": "bu_Ga6N6",
   "category": "bulk",
   "title": "GaN (Ga6N6) crystal",
   "description": "Variable-cell crystal-structure prediction of GaN with six formula units (12 atoms) per cell. Experimental ground state: wurtzite (P6_3mc); zinc blende (~10 meV/atom higher in DFT), the 6H polytype and the high-pressure rocksalt phase compete. NEP89 caveat: NEP89 puts zinc blende 33 meV/atom below wurtzite (wrong polytype ordering), so its global minimum is zinc blende. Artefact screening: NEP89 has an N-N bonded collapsed hole (N-N 1.17 A, Ga-Ga 2.02 A, 12-fold Ga, 2.7 eV below zinc blende), found by symmetry-constrained random search. An N-N guard floor of 1.9 A (guard_pairs; physical N-N >= 3.1 A) lifts it by 46 eV and leaves the physical minima unchanged.",
   "guard": "guard f = 0.75, N-N floor 1.9 A",
   "n_search": 12,
   "n_total": 12,
   "budget": 10000,
   "e_tol": 0.02,
   "e_ref": -73.42292002410237,
   "dev": false,
   "found_by": "gofee s18 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 157.74,
   "bh_ert": 1142.4,
   "n_solved": 22,
   "dmin": 1.0146129263910166,
   "img": "img/gm_bu_Ga6N6.png"
  },
  {
   "name": "bu_Ga8O12",
   "category": "bulk",
   "title": "Ga2O3 (Ga8O12) crystal",
   "description": "Crystal structure prediction of Ga2O3 with 4 formula units (20 atoms) per cell. The experimental ground state beta-Ga2O3 (C2/m, half tetrahedral and half octahedral Ga; this cell is twice its primitive cell) is also the NEP89 global minimum; corundum-type alpha-Ga2O3 (+28.7 meV/atom with NEP89) is a deep competing funnel (the mirror image of bu_Al8O12, where corundum is the ground state and the beta-Ga2O3 type is the trap).",
   "guard": "",
   "n_search": 20,
   "n_total": 20,
   "budget": 32000,
   "e_tol": 0.02,
   "e_ref": -122.99726259749522,
   "dev": false,
   "found_by": "softmode s36 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SurrBH",
   "best_ert": 4902.1,
   "bh_ert": 44451.64,
   "n_solved": 22,
   "dmin": 0.9820908915936623,
   "img": "img/gm_bu_Ga8O12.png"
  },
  {
   "name": "bu_Mg2Al4O8",
   "category": "bulk",
   "title": "MgAl2O4 spinel (Mg2Al4O8) crystal",
   "description": "Variable-cell crystal-structure prediction of the spinel MgAl2O4 with two formula units (14 atoms, the fcc primitive cell of spinel) per cell. Experimental ground state: normal spinel (Fd-3m; Mg tetrahedral, Al octahedral); inverse cation orderings and MgO + Al2O3 (corundum) compete. NEP89 caveat: the inverse spinel (Al tetrahedral, Mg + Al octahedral) is 62 meV/atom below normal spinel, which is even 49 meV/atom above MgO + Al2O3, so the NEP89 global minimum is the inverse spinel.",
   "guard": "",
   "n_search": 14,
   "n_total": 14,
   "budget": 28000,
   "e_tol": 0.02,
   "e_ref": -101.20824862544704,
   "dev": false,
   "found_by": "bh s7 (pilot-bbu2-v4)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "SMH",
   "best_ert": 23464.64864864865,
   "bh_ert": 106421.09090909091,
   "n_solved": 22,
   "dmin": 0.959217514782911,
   "img": "img/gm_bu_Mg2Al4O8.png"
  },
  {
   "name": "bu_Mg4Cu8",
   "category": "bulk",
   "title": "MgCu2 (Mg4Cu8) Laves-phase crystal",
   "description": "Variable-cell crystal-structure prediction of the Laves phase MgCu2 with four formula units (12 atoms) per cell: a size-mismatched, topologically close-packed intermetallic. Experimental ground state: cubic C15 (Fd-3m); the hexagonal C14 (MgZn2-type) polytype and AlB2/MoSi2-type AB2 structures compete. NEP89 reproduces C15 as the global minimum, but C14 is only 0.5 meV/atom higher (within e_tol, so it also counts as a hit).",
   "guard": "",
   "n_search": 12,
   "n_total": 12,
   "budget": 60000,
   "e_tol": 0.02,
   "e_ref": -43.19434424561646,
   "dev": false,
   "found_by": "pso s44 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 527.76,
   "bh_ert": 16271.122448979591,
   "n_solved": 22,
   "dmin": 0.9263253787878787,
   "img": "img/gm_bu_Mg4Cu8.png"
  },
  {
   "name": "bu_Si4O8",
   "category": "bulk",
   "title": "SiO2 (Si4O8) crystal",
   "description": "Crystal structure prediction of SiO2 with 4 formula units (12 atoms) per cell, which fits alpha-cristobalite, tridymite and stishovite but not the experimental ground state alpha-quartz (Z=3; 29.6 meV/atom above the GM with NEP89). NEP89 over-stabilises open corner-sharing SiO4 frameworks (alpha-cristobalite 24.5 meV/atom below quartz): the putative NEP89 global minimum is an all-silica ABW zeolite framework (coordination sequence 4,10,21,36,54,...; 17.3 A^3/atom, 23% less dense than quartz), 5.1 meV/atom below alpha-cristobalite. NEP89 also has an unphysical hole with over-short Si=O bonds (1.30 A) and Si-Si bonds that lies 0.12 eV below this minimum; a Si-O guard floor of 1.45 A removes it (physical Si-O bonds are >= 1.5 A).",
   "guard": "guard f = 0.75, O-Si floor 1.45 A",
   "n_search": 12,
   "n_total": 12,
   "budget": 43000,
   "e_tol": 0.02,
   "e_ref": -94.58779859582535,
   "dev": false,
   "found_by": "softmode s41 (main)",
   "holes": 4,
   "hole_e": -102.84343507488973,
   "hole_algs": [
    "PSO",
    "SYMM"
   ],
   "fastest": "SMH",
   "best_ert": 5896.34,
   "bh_ert": 30071.513513513513,
   "n_solved": 22,
   "dmin": 0.9167597160716178,
   "img": "img/gm_bu_Si4O8.png"
  },
  {
   "name": "bu_Si6N8",
   "category": "bulk",
   "title": "Si3N4 (Si6N8) crystal",
   "description": "Crystal structure prediction of Si3N4 with 2 formula units (14 atoms) per cell, the primitive cell of both the experimental ground state beta-Si3N4 (P6_3/m) and spinel gamma-Si3N4. The putative NEP89 global minimum is not beta-Si3N4 but a hypothetical, chemically sensible network (tetrahedral Si, 3-coordinated but pyramidal N, no homopolar bonds) 12 meV/atom below beta-Si3N4 and 7% denser. Artefact screening: NEP89 has two collapsed holes, an N-N bonded phase (N-N 1.10-1.14 A, Si-Si 1.97 A, 28.5 eV below the physical minimum) and a dense phase with Si-Si 1.65 A (5.2 eV below), both found by symmetry-constrained random search. Guard factor 0.90 (Si-Si >= 2.0 A, Si-N >= 1.64 A) plus an N-N floor of 1.9 A remove both (re-relaxed >= 8.7 eV above the minimum); the physical minima (Si-N >= 1.68 A, N-N >= 2.7 A) are unchanged.",
   "guard": "guard f = 0.9, N-N floor 1.9 A",
   "n_search": 14,
   "n_total": 14,
   "budget": 88000,
   "e_tol": 0.02,
   "e_ref": -117.29907053066596,
   "dev": false,
   "found_by": "pso s42 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 8579.32,
   "bh_ert": 28991.162790697676,
   "n_solved": 22,
   "dmin": 0.9516436652095414,
   "img": "img/gm_bu_Si6N8.png"
  },
  {
   "name": "bu_Si8",
   "category": "bulk",
   "title": "Si8 crystal",
   "description": "Crystal structure prediction, 8 Si atoms per cell.",
   "guard": "",
   "n_search": 8,
   "n_total": 8,
   "budget": 20000,
   "e_tol": 0.02,
   "e_ref": -44.116393529824606,
   "dev": true,
   "found_by": "pso s7 (dev-pso-final)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "PSO",
   "best_ert": 56.9,
   "bh_ert": 524.86,
   "n_solved": 22,
   "dmin": 1.1080135135135134,
   "img": "img/gm_bu_Si8.png"
  },
  {
   "name": "bu_Sr4Ti4O12",
   "category": "bulk",
   "title": "SrTiO3 (Sr4Ti4O12) crystal",
   "description": "Variable-cell crystal-structure prediction of the perovskite SrTiO3 with four formula units (20 atoms) per cell, enough for octahedral tilt systems (a0a0c-, I4/mcm: the experimental low-temperature phase; cubic Pm-3m above 105 K; a-b+a- Pnma as in CaTiO3); ilmenite and hexagonal-perovskite arrangements compete. In NEP89 tilts gain < 1 meV/atom, so cubic and tilted perovskites are nearly degenerate. guard_factor 0.80: NEP89 has a short-range Sr-O hole (with the default 0.75 an unphysical Sr2Ti2O6 structure with Sr-O = 1.93 A was 0.046 eV below the perovskite).",
   "guard": "guard f = 0.8",
   "n_search": 20,
   "n_total": 20,
   "budget": 22000,
   "e_tol": 0.02,
   "e_ref": -163.9843367425835,
   "dev": false,
   "found_by": "pso s39 (main)",
   "holes": 16,
   "hole_e": -164.21446144361204,
   "hole_algs": [
    "AMA",
    "AOS-BH",
    "EGBH",
    "SMH",
    "SurrBH",
    "TabuBH"
   ],
   "fastest": "SYMM",
   "best_ert": 1351.28,
   "bh_ert": 30210.26923076923,
   "n_solved": 21,
   "dmin": 0.8662716724912186,
   "img": "img/gm_bu_Sr4Ti4O12.png"
  },
  {
   "name": "bu_Ti4O8",
   "category": "bulk",
   "title": "TiO2 (Ti4O8) crystal",
   "description": "Crystal structure prediction of TiO2 with 4 formula units per cell (rutile, anatase, brookite-like and high-pressure polymorphs compete). guard_factor 0.80: with the default guard (0.75) NEP89 has a dense collapsed phase (about 5.5 A^3/atom, Ti-Ti 2.21 A, O-O 1.2 A, 12-18 neighbours per Ti) about 1 eV below anatase; the stronger guard (Ti-Ti >= 2.56 A, Ti-O >= 1.81 A) removes it and is zero for rutile, anatase and brookite.",
   "guard": "guard f = 0.8",
   "n_search": 12,
   "n_total": 12,
   "budget": 30000,
   "e_tol": 0.02,
   "e_ref": -109.89136622839686,
   "dev": true,
   "found_by": "surr s0 (dev-surr-v4)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "GOFEE",
   "best_ert": 186.08,
   "bh_ert": 3700.94,
   "n_solved": 22,
   "dmin": 0.8584478162603869,
   "img": "img/gm_bu_Ti4O8.png"
  },
  {
   "name": "bu_Zn12O12",
   "category": "bulk",
   "title": "ZnO (Zn12O12) crystal",
   "description": "Crystal structure prediction of ZnO with 12 formula units (24 atoms) per cell. The experimental ground state wurtzite (P6_3mc) is also the NEP89 global minimum; the nearly degenerate tetrahedral stacking polytypes (4H +5, zinc blende +7 meV/atom) and rocksalt (+47 meV/atom) are competing minima.",
   "guard": "",
   "n_search": 24,
   "n_total": 24,
   "budget": 20000,
   "e_tol": 0.02,
   "e_ref": -106.39737385017128,
   "dev": false,
   "found_by": "softmode s49 (main)",
   "holes": 0,
   "hole_e": null,
   "hole_algs": [],
   "fastest": "DE",
   "best_ert": 2945.2,
   "bh_ert": 8328.829787234043,
   "n_solved": 22,
   "dmin": 1.0456843722328697,
   "img": "img/gm_bu_Zn12O12.png"
  }
 ],
 "friedman": {
  "chi2": 362.44329583460046,
  "p": 5.228104272739792e-64,
  "n": 39,
  "k": 22,
  "cd": 5.283455285859604
 },
 "sens": [
  {
   "tol": 0.005,
   "tau": 0.9134199134199134,
   "top": [
    "GOFEE",
    "SurrBH",
    "AMA"
   ]
  },
  {
   "tol": 0.01,
   "tau": 0.9826839826839827,
   "top": [
    "GOFEE",
    "SurrBH",
    "AMA"
   ]
  },
  {
   "tol": 0.05,
   "tau": 0.948051948051948,
   "top": [
    "GOFEE",
    "SurrBH",
    "AMA"
   ]
  },
  {
   "tol": 0.1,
   "tau": 0.8874458874458874,
   "top": [
    "GOFEE",
    "SurrBH",
    "AMA"
   ]
  }
 ],
 "top3": [
  "GOFEE",
  "SurrBH",
  "AMA"
 ],
 "e_tol": 0.02,
 "curves": [
  [
   "cluster",
   "img/curves_cluster.png"
  ],
  [
   "surface",
   "img/curves_surface.png"
  ],
  [
   "zeolite",
   "img/curves_zeolite.png"
  ],
  [
   "bulk",
   "img/curves_bulk.png"
  ]
 ],
 "unsolved": [],
 "findings": [
  [
   "<b>GOFEE (Gaussian-process surrogate search)</b> ranks first (score 82.7, 95% CI [81.3, 84.2], first in 100% of bootstrap replicates), followed by Online-surrogate pre-relaxation BH (78.5) and Adaptive memetic algorithm (GA + BH chains) (68.4).",
   "Best new algorithm <b>Online-surrogate pre-relaxation BH</b> vs best baseline <b>GOFEE (Gaussian-process surrogate search)</b>: 1.34&times; more ionic steps per global-minimum discovery (geometric mean over the 39 benchmarks solved by both).",
   "0 of 10 new algorithms score higher than every baseline.",
   "Basin hopping (literature settings) ranks 15 of 22; the top algorithm is 5.44&times; as efficient as BH (geometric mean of the ERT ratio over the benchmarks solved by both).",
   "Category winners: clusters &ndash; GOFEE (Gaussian-process surrogate search) (83); surfaces &ndash; GOFEE (Gaussian-process surrogate search) (96); zeolites &ndash; GOFEE (Gaussian-process surrogate search) (95); bulks &ndash; Symmetry-seeded search (90).",
   "Most robust: <b>Online-surrogate pre-relaxation BH</b> found the global minimum in 93% of all runs and on 39/39 benchmarks.",
   "Measured in wall-clock time instead of ionic steps, the best algorithm is <b>Adaptive operator selection basin hopping</b> (score 84.3).",
   "Hardest benchmarks: ze_Pt9_MOR (solved by 18/22), cl_Ag27Cu7 (solved by 20/22), cl_Cu38 (solved by 20/22)."
  ],
  [
   "<b>GOFEE (Gaussian-process surrogate search)</b> \u6392\u540d\u7b2c\u4e00\uff08\u5f97\u5206 82.7\uff0c95% \u7f6e\u4fe1\u533a\u95f4 [81.3, 84.2]\uff0c\u5728 100% \u7684 bootstrap \u6837\u672c\u4e2d\u7b2c\u4e00\uff09\uff0c\u5176\u540e\u4e3a Online-surrogate pre-relaxation BH\uff0878.5\uff09\u3001Adaptive memetic algorithm (GA + BH chains)\uff0868.4\uff09\u3002",
   "\u6700\u4f73\u521b\u65b0\u7b97\u6cd5 <b>Online-surrogate pre-relaxation BH</b> \u5bf9\u6bd4\u6700\u4f73\u4e3b\u6d41\u7b97\u6cd5 <b>GOFEE (Gaussian-process surrogate search)</b>\uff1a\u6bcf\u53d1\u73b0\u4e00\u6b21\u5168\u5c40\u6700\u4f18\u6240\u9700\u79bb\u5b50\u6b65\u4e3a\u540e\u8005\u7684 1.34 \u500d\uff08\u4e24\u8005\u90fd\u89e3\u51fa\u7684 39 \u4e2a\u57fa\u51c6\u4e0a\u7684\u51e0\u4f55\u5e73\u5747\uff09\u3002",
   "10 \u4e2a\u521b\u65b0\u7b97\u6cd5\u4e2d\u6709 0 \u4e2a\u5f97\u5206\u9ad8\u4e8e\u6240\u6709\u4e3b\u6d41\u7b97\u6cd5\u3002",
   "\u76c6\u5730\u8df3\u8dc3\uff08\u6587\u732e\u53c2\u6570\uff09\u6392\u540d\u7b2c 15/22\uff1b\u7b2c\u4e00\u540d\u7b97\u6cd5\u7684\u6548\u7387\u662f BH \u7684 5.44 \u500d\uff08\u4e24\u8005\u90fd\u89e3\u51fa\u7684\u57fa\u51c6\u4e0a ERT \u6bd4\u503c\u7684\u51e0\u4f55\u5e73\u5747\uff09\u3002",
   "\u5404\u7c7b\u522b\u7b2c\u4e00\uff1a\u56e2\u7c07\u2014\u2014GOFEE (Gaussian-process surrogate search)\uff0883\uff09\uff1b\u8868\u9762\u2014\u2014GOFEE (Gaussian-process surrogate search)\uff0896\uff09\uff1b\u5206\u5b50\u7b5b\u2014\u2014GOFEE (Gaussian-process surrogate search)\uff0895\uff09\uff1b\u4f53\u76f8\u2014\u2014Symmetry-seeded search\uff0890\uff09\u3002",
   "\u6700\u7a33\u5065\uff1a<b>Online-surrogate pre-relaxation BH</b> \u5728 93% \u7684\u8fd0\u884c\u4e2d\u627e\u5230\u5168\u5c40\u6700\u4f18\uff0c\u89e3\u51fa 39/39 \u4e2a\u57fa\u51c6\u3002",
   "\u82e5\u4ee5\u5899\u949f\u65f6\u95f4\u800c\u975e\u79bb\u5b50\u6b65\u8ba1\uff0c\u6700\u4f73\u7b97\u6cd5\u4e3a <b>Adaptive operator selection basin hopping</b>\uff08\u5f97\u5206 84.3\uff09\u3002",
   "\u6700\u96be\u7684\u57fa\u51c6\uff1aze_Pt9_MOR\uff0818/22 \u4e2a\u7b97\u6cd5\u89e3\u51fa\uff09\u3001cl_Ag27Cu7\uff0820/22 \u4e2a\u7b97\u6cd5\u89e3\u51fa\uff09\u3001cl_Cu38\uff0820/22 \u4e2a\u7b97\u6cd5\u89e3\u51fa\uff09\u3002"
  ]
 ],
 "notes": [
  "<h3>Notes on interpretation</h3>\n<ul>\n<li><b>Runs and cost.</b> &ldquo;50 runs&rdquo; means 50 independent random seeds per algorithm and benchmark, each with the\nfull ionic-step budget of the benchmark. Efficiency is measured per ionic step (one NEP89 energy+force evaluation of the\nwhole system), not per second; a wall-clock score is given separately. Every run used one CPU core of a 5-node\n(640-core) NERSC Perlmutter allocation.</li>\n<li><b>Development/test split.</b> The six development benchmarks (marked *) were used to develop and tune the new\nalgorithms and are excluded from the headline score. Developers also ran short crash tests (one seed) on all\nbenchmarks, and the developer of the adaptive memetic algorithm ran a 5-seed smoke test on held-out benchmarks; these\nruns checked robustness only, but we disclose them as a possible minor leak of test information.</li>\n<li><b>NEP89 is not DFT.</b> The reference structures are putative global minima of the NEP89 surface (among\nstructures in which the guard is inactive), and\nseveral differ from DFT or experiment. We keep them, because the benchmark measures search efficiency on a fixed\nsurface: Si<sub>8</sub> (&beta;-tin-like cell below diamond), GaN (zinc blende 33 meV/atom below wurtzite),\nSiO<sub>2</sub> (an ABW-type framework below &alpha;-cristobalite and quartz), Si<sub>3</sub>N<sub>4</sub> (a\nhypothetical network 12 meV/atom below &beta;-Si<sub>3</sub>N<sub>4</sub>), CaCO<sub>3</sub> (vaterite-like layers\n7 meV/atom below calcite), MgAl<sub>2</sub>O<sub>4</sub> (inverse spinel), TiO<sub>2</sub> (anatase 66 meV/atom below\nrutile), Au<sub>20</sub> (a low-symmetry isomer instead of the T<sub>d</sub> pyramid), Pt<sub>19</sub> (a hollow\ncage), B<sub>12</sub> (icosahedron instead of the quasi-planar cluster), (MgO)<sub>8</sub> (a rocksalt fragment\ninstead of ring cages), and over-wetting of Au<sub>8</sub>/MgO(001) and Cu<sub>8</sub>/TiC(001). The benchmark\ndescriptions give the details.</li>\n<li><b>Supported and confined clusters.</b> Substrates are frozen slabs or frameworks. NEP89 is charge-neutral and\nwas not fitted to metal/oxide or metal/zeolite interfaces, so binding energies and site preferences are qualitative.\nNEP89 bonds Pd and Pt atoms to the SiO<sub>4</sub> edges of MFI (M&ndash;Si 2.4&ndash;2.5 &Aring;), so Au clusters\nare used in MFI.</li>\n<li><b>Tolerance.</b> e<sub>tol</sub> = 0.02 eV except ze_Pt6_TON, ze_Pt8_MWW and ze_Pt9_LTA (0.01 eV) and\nsu_Au8_MgO100 (0.015 eV), where distinct isomers lie closer than 0.02 eV, and cl_Na8Cl8 and su_Pd16_graphene\n(0.05 eV), where runs that reach the same structure scatter by more than 0.02 eV.</li>\n<li><b>Artefact screening.</b> See Methods: extra guard settings were applied to six benchmarks after dedicated\nhole-hunting runs, the surface benchmarks got a vacuum wall that keeps the search atoms on the top face of the slab\n(binding to the frozen bottom face of the periodic image was 1.4 eV too favourable for Au<sub>8</sub>/TiO<sub>2</sub>(110)),\nand after the main experiment every rank-1 structure was re-checked (recomputed energy, shortest\ndistances, guard and wall energy, connectivity, density) and the guard and wall energy of every structure that counts\nas a hit was computed. This found NEP89 holes that the guard makes shallower but does not remove in two held-out\ncrystals, SiO<sub>2</sub> and SrTiO<sub>3</sub> (20 of the 49,500 runs ended in them). E<sub>ref</sub> is therefore\ntaken from structures in which the guard is inactive, and the ranking does not change if these 20 runs are counted as\nfailures (Methods). Runs made before a guard setting of a benchmark was\nchanged carry a different benchmark hash and are not used for E<sub>ref</sub>. The vacuum wall did not change the\nhashes: it is exactly zero for every stored slab structure, and the two development runs that had ended on the far\nside of the vacuum were removed.</li>\n<li><b>Wall-time cap.</b> The two surrogate-model algorithms (GOFEE and SurrBH) spend most of their time on training their surrogate\nmodels and relaxing on them, so their runs were capped at 1 h of wall time. A capped run that had not hit the global minimum\nis charged the full step budget, so that a slow algorithm does not look cheaper per ionic step; a hit before the cap counts normally.\n1,960 of the 2,250 GOFEE runs reached the cap (1,500 of them after a hit, 460 without one); no SurrBH run did. SurrBH also scales its surrogate work to the elapsed wall time so that a run fits in the cap, so its runs are not\nbit-for-bit reproducible on other hardware. All other algorithms ran without a time limit.</li>\n<li><b>Shared code.</b> All algorithms use the same evaluation context, relaxers and structure operators. Before the\nmain experiment the context was changed to start cell relaxations from a Minkowski-reduced lattice when the cell basis\nhas become very skewed (this removed spurious aborted relaxations in bulk searches), and basin hopping now adapts its\nstep from the acceptance ratio of the last 10 moves, as in GMIN. Two robustness fixes change nothing in normal runs: an\nevaluation on which NEP89 fails (neighbour-list overflow in a collapsed cell) is counted as one ionic step with a\nvery high energy instead of aborting the run, and the shared relocation operator falls back to the unchanged structure\nwhen no site can be found. Known simplifications kept because the algorithms were tuned with them: the shared cut-and-splice operator (used by GOFEE, AOS-BH and SurrBH) recentres the second parent\nonto the first in 3D, which moves supported-cluster atoms off their adsorption sites (GA uses its own operator), the\nshared relocation operator puts atoms only on the outer shell of a supported cluster (never directly on the support),\nand the Maxwell&ndash;Boltzmann velocity helper removes the unweighted mean velocity rather than the centre-of-mass\nvelocity.</li>\n</ul>",
  "<h3>\u89e3\u8bfb\u8bf4\u660e</h3>\n<ul>\n<li><b>\u8fd0\u884c\u6b21\u6570\u4e0e\u6210\u672c\u3002</b>&ldquo;50 \u8f6e&rdquo;\u6307\u6bcf\u4e2a\u7b97\u6cd5\u5728\u6bcf\u4e2a\u57fa\u51c6\u4e0a\u7528 50 \u4e2a\u72ec\u7acb\u968f\u673a\u79cd\u5b50\u5404\u8fd0\u884c\u4e00\u6b21\uff0c\u6bcf\u6b21\u8fd0\u884c\u90fd\u4f7f\u7528\u8be5\u57fa\u51c6\u7684\u5b8c\u6574\u79bb\u5b50\u6b65\u9884\u7b97\u3002\n\u6548\u7387\u6309\u79bb\u5b50\u6b65\uff08\u5bf9\u6574\u4e2a\u4f53\u7cfb\u505a\u4e00\u6b21 NEP89 \u80fd\u91cf+\u529b\u8ba1\u7b97\uff09\u800c\u4e0d\u662f\u6309\u79d2\u8ba1\u7b97\uff1b\u53e6\u5916\u5355\u72ec\u7ed9\u51fa\u6309\u5899\u949f\u65f6\u95f4\u7684\u5f97\u5206\u3002\u6bcf\u6b21\u8fd0\u884c\u5360\u7528 NERSC Perlmutter\n\u4e0a 5 \u4e2a\u8282\u70b9\uff08640 \u6838\uff09\u4e2d\u7684\u4e00\u4e2a CPU \u6838\u3002</li>\n<li><b>\u5f00\u53d1\u96c6\u4e0e\u6d4b\u8bd5\u96c6\u3002</b>6 \u4e2a\u5f00\u53d1\u57fa\u51c6\uff08\u6807 *\uff09\u7528\u4e8e\u5f00\u53d1\u548c\u8c03\u8bd5\u65b0\u7b97\u6cd5\uff0c\u4e0d\u8ba1\u5165\u4e3b\u5f97\u5206\u3002\u5f00\u53d1\u8005\u8fd8\u5728\u6240\u6709\u57fa\u51c6\u4e0a\u505a\u8fc7\u7b80\u77ed\u7684\u5d29\u6e83\u6d4b\u8bd5\uff081 \u4e2a\u79cd\u5b50\uff09\uff0c\n\u81ea\u9002\u5e94\u6a21\u56e0\u7b97\u6cd5\u7684\u5f00\u53d1\u8005\u5728\u7559\u51fa\u57fa\u51c6\u4e0a\u505a\u8fc7 5 \u4e2a\u79cd\u5b50\u7684\u5192\u70df\u6d4b\u8bd5\uff1b\u8fd9\u4e9b\u8fd0\u884c\u53ea\u7528\u4e8e\u68c0\u67e5\u7a33\u5065\u6027\uff0c\u4f46\u6211\u4eec\u4ecd\u5c06\u5176\u62ab\u9732\u4e3a\u53ef\u80fd\u7684\u8f7b\u5fae\u6d4b\u8bd5\u4fe1\u606f\u6cc4\u6f0f\u3002</li>\n<li><b>NEP89 \u4e0d\u7b49\u4e8e DFT\u3002</b>\u53c2\u8003\u7ed3\u6784\u662f NEP89 \u52bf\u80fd\u9762\u4e0a\uff08guard \u4e0d\u8d77\u4f5c\u7528\u7684\u7ed3\u6784\u4e2d\uff09\u7684\u63a8\u5b9a\u5168\u5c40\u6700\u4f18\uff0c\u5176\u4e2d\u82e5\u5e72\u4e0e DFT \u6216\u5b9e\u9a8c\u4e0d\u540c\u3002\u7531\u4e8e\u672c\u57fa\u51c6\u8861\u91cf\u7684\u662f\u5728\u7ed9\u5b9a\u52bf\u80fd\u9762\u4e0a\u7684\n\u641c\u7d22\u6548\u7387\uff0c\u6211\u4eec\u4fdd\u7559\u8fd9\u4e9b\u7ed3\u6784\uff1aSi<sub>8</sub>\uff08&beta;-tin \u578b\u6676\u80de\u4f4e\u4e8e\u91d1\u521a\u77f3\u7ed3\u6784\uff09\u3001GaN\uff08\u95ea\u950c\u77ff\u6bd4\u7ea4\u950c\u77ff\u4f4e 33 meV/\u539f\u5b50\uff09\u3001SiO<sub>2</sub>\n\uff08ABW \u578b\u9aa8\u67b6\u4f4e\u4e8e &alpha;-\u65b9\u77f3\u82f1\u548c\u77f3\u82f1\uff09\u3001Si<sub>3</sub>N<sub>4</sub>\uff08\u4e00\u79cd\u5047\u60f3\u7f51\u7edc\u6bd4 &beta;-Si<sub>3</sub>N<sub>4</sub> \u4f4e 12 meV/\u539f\u5b50\uff09\u3001\nCaCO<sub>3</sub>\uff08\u7403\u9730\u77f3\u578b\u5c42\u72b6\u7ed3\u6784\u6bd4\u65b9\u89e3\u77f3\u4f4e 7 meV/\u539f\u5b50\uff09\u3001MgAl<sub>2</sub>O<sub>4</sub>\uff08\u53cd\u5c16\u6676\u77f3\uff09\u3001TiO<sub>2</sub>\uff08\u9510\u949b\u77ff\u6bd4\u91d1\u7ea2\u77f3\u4f4e\n66 meV/\u539f\u5b50\uff09\u3001Au<sub>20</sub>\uff08\u4f4e\u5bf9\u79f0\u5f02\u6784\u4f53\u800c\u975e T<sub>d</sub> \u56db\u9762\u4f53\uff09\u3001Pt<sub>19</sub>\uff08\u7a7a\u5fc3\u7b3c\uff09\u3001B<sub>12</sub>\uff08\u4e8c\u5341\u9762\u4f53\u800c\u975e\u51c6\u5e73\u9762\u7ed3\u6784\uff09\u3001\n(MgO)<sub>8</sub>\uff08\u5ca9\u76d0\u788e\u7247\u800c\u975e\u73af\u72b6\u7b3c\uff09\u3001\u4ee5\u53ca Au<sub>8</sub>/MgO(001) \u4e0e Cu<sub>8</sub>/TiC(001) \u7684\u8fc7\u5ea6\u94fa\u5c55\u3002\u8be6\u89c1\u5404\u57fa\u51c6\u8bf4\u660e\u3002</li>\n<li><b>\u8d1f\u8f7d\u4e0e\u53d7\u9650\u56e2\u7c07\u3002</b>\u886c\u5e95\u4e3a\u51bb\u7ed3\u7684\u5e73\u677f\u6216\u9aa8\u67b6\u3002NEP89 \u4e0d\u542b\u7535\u8377\u8f6c\u79fb\uff0c\u4e5f\u672a\u9488\u5bf9\u91d1\u5c5e/\u6c27\u5316\u7269\u6216\u91d1\u5c5e/\u5206\u5b50\u7b5b\u754c\u9762\u62df\u5408\uff0c\u56e0\u6b64\u7ed3\u5408\u80fd\u4e0e\u4f4d\u70b9\u504f\u597d\n\u53ea\u5177\u6709\u5b9a\u6027\u610f\u4e49\u3002NEP89 \u4f1a\u4f7f Pd\u3001Pt \u539f\u5b50\u4e0e MFI \u7684 SiO<sub>4</sub> \u68f1\u6210\u952e\uff08M&ndash;Si 2.4&ndash;2.5 &Aring;\uff09\uff0c\u6240\u4ee5 MFI \u4e2d\u6539\u7528 Au \u56e2\u7c07\u3002</li>\n<li><b>\u5bb9\u5dee\u3002</b>e<sub>tol</sub> \u4e00\u822c\u4e3a 0.02 eV\uff1bze_Pt6_TON\u3001ze_Pt8_MWW\u3001ze_Pt9_LTA \u4e3a 0.01 eV\uff0csu_Au8_MgO100 \u4e3a 0.015 eV\uff08\u4e0d\u540c\u5f02\u6784\u4f53\n\u95f4\u8ddd\u5c0f\u4e8e 0.02 eV\uff09\uff1bcl_Na8Cl8 \u4e0e su_Pd16_graphene \u4e3a 0.05 eV\uff08\u5230\u8fbe\u540c\u4e00\u7ed3\u6784\u7684\u8fd0\u884c\u80fd\u91cf\u5206\u6563\u8d85\u8fc7 0.02 eV\uff09\u3002</li>\n<li><b>\u4f2a\u5f71\u7b5b\u67e5\u3002</b>\u89c1\u65b9\u6cd5\u90e8\u5206\uff1a\u7ecf\u4e13\u95e8\u7684&ldquo;\u7a7a\u6d1e&rdquo;\u641c\u5bfb\u540e\uff0c\u5bf9 6 \u4e2a\u57fa\u51c6\u52a0\u5f3a\u4e86 guard \u8bbe\u7f6e\uff1b\u8868\u9762\u57fa\u51c6\u589e\u52a0\u4e86\u771f\u7a7a\u52bf\u5899\uff0c\u4f7f\u641c\u7d22\u539f\u5b50\n\u7559\u5728\u5e73\u677f\u9876\u9762\uff08\u5bf9 Au<sub>8</sub>/TiO<sub>2</sub>(110)\uff0c\u5438\u9644\u5230\u5468\u671f\u955c\u50cf\u51bb\u7ed3\u5e95\u9762\u7684\u7ed3\u6784\u80fd\u91cf\u504f\u4f4e 1.4 eV\uff09\uff1b\u4e3b\u5b9e\u9a8c\u7ed3\u675f\u540e\u5bf9\u6bcf\u4e2a\u6392\u540d\u7b2c\u4e00\u7684\u7ed3\u6784\n\u91cd\u65b0\u68c0\u67e5\uff08\u91cd\u7b97\u80fd\u91cf\u3001\u6700\u77ed\u8ddd\u79bb\u3001guard \u4e0e\u52bf\u5899\u80fd\u91cf\u3001\u8fde\u901a\u6027\u3001\u5bc6\u5ea6\uff09\uff0c\u5e76\u8ba1\u7b97\u4e86\u6240\u6709\u8ba1\u4e3a\u547d\u4e2d\u7684\u7ed3\u6784\u7684 guard \u4e0e\u52bf\u5899\u80fd\u91cf\u3002\u7531\u6b64\u5728\u4e24\u4e2a\u7559\u51fa\u6676\u4f53\nSiO<sub>2</sub> \u4e0e SrTiO<sub>3</sub> \u4e2d\u53d1\u73b0\u4e86 guard \u53ea\u4f7f\u5176\u53d8\u6d45\u3001\u4f46\u6ca1\u6709\u6d88\u9664\u7684 NEP89 \u7a7a\u6d1e\uff0849,500 \u6b21\u8fd0\u884c\u4e2d\u6709 20 \u6b21\u505c\u5728\u5176\u4e2d\uff09\u3002\u56e0\u6b64\nE<sub>ref</sub> \u53d6\u81ea guard \u4e0d\u8d77\u4f5c\u7528\u7684\u7ed3\u6784\uff1b\u628a\u8fd9 20 \u6b21\u8fd0\u884c\u8ba1\u4e3a\u5931\u8d25\u4e5f\u4e0d\u6539\u53d8\u6392\u540d\uff08\u89c1\u65b9\u6cd5\uff09\u3002\u57fa\u51c6\u7684 guard \u8bbe\u7f6e\u4fee\u6539\u4e4b\u524d\u7684\u8fd0\u884c\u5e26\u6709\u4e0d\u540c\u7684\u57fa\u51c6\u54c8\u5e0c\uff0c\u4e0d\u7528\u4e8e\u786e\u5b9a E<sub>ref</sub>\u3002\n\u771f\u7a7a\u52bf\u5899\u6ca1\u6709\u6539\u53d8\u57fa\u51c6\u54c8\u5e0c\uff1a\u5b83\u5bf9\u6240\u6709\u5df2\u4fdd\u5b58\u7684\u8868\u9762\u7ed3\u6784\u4e25\u683c\u4e3a\u96f6\uff0c\u4e24\u4e2a\u6700\u7ec8\u505c\u5728\u771f\u7a7a\u5c42\u53e6\u4e00\u4fa7\u7684\u5f00\u53d1\u8fd0\u884c\u5df2\u88ab\u79fb\u9664\u3002</li>\n<li><b>\u5899\u949f\u65f6\u95f4\u4e0a\u9650\u3002</b>\u4e24\u4e2a\u4ee3\u7406\u6a21\u578b\u7b97\u6cd5\uff08GOFEE \u4e0e SurrBH\uff09\u7684\u5927\u90e8\u5206\u65f6\u95f4\u82b1\u5728\u4ee3\u7406\u6a21\u578b\u7684\u8bad\u7ec3\u548c\u5728\u4ee3\u7406\u6a21\u578b\u4e0a\u7684\u5f1b\u8c6b\u4e0a\uff0c\u56e0\u6b64\u6bcf\u6b21\u8fd0\u884c\u9650\u65f6 1 \u5c0f\u65f6\uff1b\n\u8fbe\u5230\u4e0a\u9650\u524d\u672a\u547d\u4e2d\u7684\u8fd0\u884c\u6309\u5168\u90e8\u9884\u7b97\u8ba1\u5165\u6b65\u6570\uff0c\u4ee5\u514d\u6162\u901f\u7b97\u6cd5\u5728\u6bcf\u79bb\u5b50\u6b65\u6548\u7387\u4e0a\u663e\u5f97\u66f4\u4fbf\u5b9c\uff1b\u5728\u4e0a\u9650\u524d\u547d\u4e2d\u7684\u8fd0\u884c\u7167\u5e38\u8ba1\u4e3a\u547d\u4e2d\u3002GOFEE \u7684 2,250 \u6b21\u8fd0\u884c\u4e2d\u6709 1,960 \u6b21\u8fbe\u5230\u4e0a\u9650\uff08\u5176\u4e2d 1,500 \u6b21\u5728\u6b64\u4e4b\u524d\u5df2\u547d\u4e2d\uff0c460 \u6b21\u672a\u547d\u4e2d\uff09\uff1bSurrBH \u6ca1\u6709\u8fd0\u884c\u8fbe\u5230\u4e0a\u9650\u3002SurrBH \u8fd8\u4f1a\u6839\u636e\u5df2\u7528\u5899\u949f\u65f6\u95f4\u8c03\u6574\u4ee3\u7406\u6a21\u578b\u7684\u5de5\u4f5c\u91cf\u4ee5\u4fbf\u5728\u4e0a\u9650\u5185\u5b8c\u6210\uff0c\u56e0\u6b64\u5176\u8fd0\u884c\u5728\u5176\u4ed6\u786c\u4ef6\u4e0a\n\u4e0d\u80fd\u9010\u4f4d\u590d\u73b0\u3002\u5176\u4f59\u7b97\u6cd5\u7684\u8fd0\u884c\u4e0d\u8bbe\u65f6\u95f4\u4e0a\u9650\u3002</li>\n<li><b>\u5171\u4eab\u4ee3\u7801\u3002</b>\u6240\u6709\u7b97\u6cd5\u4f7f\u7528\u540c\u4e00\u4e2a\u8ba1\u7b97\u4e0a\u4e0b\u6587\u3001\u5f1b\u8c6b\u5668\u4e0e\u7ed3\u6784\u64cd\u4f5c\u3002\u4e3b\u5b9e\u9a8c\u524d\u5bf9\u4e0a\u4e0b\u6587\u505a\u4e86\u4fee\u6539\uff1a\u5f53\u6676\u80de\u57fa\u77e2\u4e25\u91cd\u503e\u659c\u65f6\uff0c\u6676\u80de\u5f1b\u8c6b\u4ece\nMinkowski \u7ea6\u5316\u540e\u7684\u6676\u683c\u5f00\u59cb\uff08\u6d88\u9664\u4e86\u4f53\u76f8\u641c\u7d22\u4e2d\u865a\u5047\u7684\u5f1b\u8c6b\u4e2d\u6b62\uff09\uff1b\u76c6\u5730\u8df3\u8dc3\u6539\u4e3a\u6309\u6700\u8fd1 10 \u6b21\u79fb\u52a8\u7684\u63a5\u53d7\u7387\u8c03\u6574\u6b65\u957f\uff08\u4e0e GMIN \u4e00\u81f4\uff09\u3002\n\u4e24\u9879\u7a33\u5065\u6027\u4fee\u6b63\u4e0d\u5f71\u54cd\u6b63\u5e38\u8fd0\u884c\uff1aNEP89 \u8ba1\u7b97\u5931\u8d25\uff08\u584c\u7f29\u6676\u80de\u4e2d\u8fd1\u90bb\u8868\u6ea2\u51fa\uff09\u65f6\uff0c\u8be5\u6b21\u8ba1\u7b97\u8bb0\u4e3a\u4e00\u4e2a\u80fd\u91cf\u6781\u9ad8\u7684\u79bb\u5b50\u6b65\u800c\u4e0d\u518d\u4e2d\u6b62\u8fd0\u884c\uff1b\n\u5171\u4eab\u7684\u539f\u5b50\u91cd\u5b9a\u4f4d\u64cd\u4f5c\u5728\u627e\u4e0d\u5230\u4f4d\u7f6e\u65f6\u8fd4\u56de\u539f\u7ed3\u6784\u3002\u4ee5\u4e0b\u7b80\u5316\u56e0\u5404\u7b97\u6cd5\u5df2\u636e\u6b64\u8c03\u53c2\u800c\u4fdd\u7559\uff1a\u5171\u4eab\u7684 cut-and-splice \u4ea4\u53c9\u7b97\u5b50\uff08GOFEE\u3001AOS-BH \u4e0e SurrBH \u4f7f\u7528\uff09\u628a\u7b2c\u4e8c\u4e2a\u4eb2\u672c\u5728\u4e09\u7ef4\u4e0a\u5e73\u79fb\u5230\u7b2c\u4e00\u4e2a\u4eb2\u672c\u7684\n\u4e2d\u5fc3\uff0c\u8fd9\u4f1a\u4f7f\u8d1f\u8f7d\u56e2\u7c07\u7684\u539f\u5b50\u504f\u79bb\u5438\u9644\u4f4d\u70b9\uff08GA \u4f7f\u7528\u81ea\u5df1\u7684\u7b97\u5b50\uff09\uff1b\u5171\u4eab\u7684\u539f\u5b50\u91cd\u5b9a\u4f4d\u64cd\u4f5c\u53ea\u628a\u539f\u5b50\u653e\u5230\u8d1f\u8f7d\u56e2\u7c07\u7684\u5916\u58f3\u4e0a\uff08\u4e0d\u4f1a\u76f4\u63a5\u653e\u5230\u886c\u5e95\u4e0a\uff09\uff1bMaxwell&ndash;Boltzmann \u901f\u5ea6\u51fd\u6570\u53bb\u9664\u7684\u662f\u672a\u52a0\u6743\u7684\u5e73\u5747\u901f\u5ea6\u800c\u4e0d\u662f\u8d28\u5fc3\u901f\u5ea6\u3002</li>\n</ul>"
 ]
}