Protein-Ligand Split
A protein-ligand split defines how complexes, proteins, ligands, assays, and structures are separated across train, validation, and test sets. It is the core benchmark contract for structure-based modeling.
For a complex , where is a protein or pocket, is a ligand, is assay or label context, and is structure or pose information, a split function is:
The split should match the generalization claim.
Split Axes
| Split axis | Held-out unit | Claim tested | Common leakage risk |
|---|---|---|---|
| Ligand-side | scaffold, analog cluster, similarity group | new chemotypes for known targets | close analogs across split |
| Protein-side | sequence family, structure family, target class | new targets or homolog-shift | homologs across split |
| Complex-side | protein-ligand pair or binding mode | new pairings | same pocket and close ligand seen separately |
| Assay/source | assay, campaign, lab, dataset source | cross-assay or cross-source robustness | protocol identity encoded in labels |
| Temporal | publication or measurement time | future-data generalization | retrospective curation choices |
Grouped Split Constraint
Ligand grouping requires:
Protein grouping requires:
where may be scaffold or molecular similarity grouping, and may be sequence identity, protein family, structure family, or target class.
For strict protein-ligand generalization, both constraints may be required. For a narrow interpolation benchmark, the split can be looser, but the claim must also be narrower.
Benchmark Questions
- Pose prediction: is the held-out complex separated from close ligand analogs, homologous targets, and template structures?
- Affinity prediction: are assay context, target family, ligand scaffold, and label semantics separated enough for the claim?
- Virtual screening: are decoys realistic and are ligand-only shortcuts controlled?
- Generative design: are generated molecules evaluated against held-out targets without reusing target-derived pose information?
- Interaction modeling: are binding sites, ligand scaffolds, and interaction fingerprints leaking across split?
Checks
- What is the example unit: molecule, protein, complex, pose, assay row, or target-ligand pair?
- What is the split unit for proteins and for ligands?
- Are standardized molecules used before scaffold or similarity grouping?
- Are protein chains, isoforms, fragments, and homologs grouped before splitting?
- Are bound complexes, template databases, close analogs, or known poses excluded from test-time leakage?
- Are pose quality, affinity, enrichment, and generation claims evaluated under compatible split policies?
- Is the split contract reproducible from public fields rather than private curation notes?