Interaction Modeling

Interaction modeling은 molecule 하나나 protein 하나가 아니라 biological object와 chemical object 사이의 relation을 예측 단위로 삼는 문제를 다룹니다. 대표 예시는 target-conditioned activity, binding affinity, selectivity, protein-ligand interaction, protein-protein interaction, complex-level prediction입니다.

핵심 object는 아래 tuple입니다.

여기서 은 ligand 또는 molecule, 는 target 또는 protein, 는 assay 또는 measurement context, 는 optional structure, pocket, species, construct, mutation, source context입니다.

The prediction is:

각 representation이 정의되어야 label이나 metric을 믿을 수 있습니다.

Route Map

QuestionStartWatch
어떤 object들이 interact하는가?Entities, Protein, Ligand, Targettarget identity가 isoform, construct, mutation, species를 숨길 수 있음
label이 assay-conditioned인가?Target-assay-label contract, Bioactivity label, Assayendpoint, unit, censoring, threshold, source mismatch
interaction이 structural한가?Protein-ligand complex, Pocket, Protein-ligand interactionligand-defined pocket 또는 known pose가 inference에서 unavailable할 수 있음
output이 scalar relation인가?Interaction prediction, Binding affinityscore, probability, affinity, ranking은 서로 다른 claim
split은 어떻게 구성해야 하는가?Protein-ligand split, Scaffold split, Protein family splitpair만 hold out해도 ligand/protein neighborhood가 leak될 수 있음

Interaction Types

TypeUnitTypical outputMain risk
Target-conditioned activitymolecule-target-assay recordactive/inactive, pIC50, Ki, Kd, EC50assay/source conflict and label direction errors
Binding affinityprotein-ligand pair or complex, , , rank scoreunits, temperature, and experimental protocol mismatch
Pose-aware interactionprotein, pocket, ligand, posepose quality, contact pattern, interaction fingerprintknown-pose or ligand-frame leakage
Selectivitymolecule across several targetstarget-specific ranking or margintarget panel and missing-label bias
Protein-protein interactionprotein pair or complexprobability, interface, contact maphomolog and complex-family leakage

Representation Contract

각 side에서 어떤 representation을 쓰는지 명시합니다.

SideExamplesCheck
LigandSMILES, molecular graph, fingerprint, conformer, docked posededuplication과 split 전에 standardized되어야 함
Proteinsequence, protein embedding, structure, pocket graph, surfacesequence identity와 structure source를 기록해야 함
Assayendpoint, organism, construct, units, threshold, sourcegeneric label 하나로 뭉개면 안 됨
Contextpocket, template, species, mutation, conformer sourceinference time에 사용 가능한 정보여야 함

Pair model에서 feature map은 보통 아래처럼 씁니다.

Fusion method는 concatenation, cross-attention, graph construction, interaction fingerprint, structure-aware complex graph 등이 될 수 있습니다.

Score Semantics

Interaction score는 하나의 숫자처럼 보여도 의미가 다릅니다.

Score의미혼동하지 말 것
activity probabilityassay threshold 아래의 active/inactive decisionbinding affinity
affinity value, , IC50, 형태의 measurementpose quality
docking scoreranking 또는 heuristic energy proxycalibrated probability
enrichment scoreearly retrieval successabsolute affinity
selectivity margintarget panel differencesingle-target activity

Split and Leakage

Interaction claim에는 최소 하나의 explicit holdout axis가 필요합니다.

Claim필요한 split
known target에 대한 new moleculescaffold 또는 chemical-series split
new protein에 대한 known moleculeprotein-family 또는 sequence-identity split
new molecule과 new proteinscaffold split과 protein-family split
new assay/sourceassay, source, campaign split
new structure templatetemplate-aware 및 homolog-aware structure split

Random row split에서 broad interaction generalization을 주장하면 안 됩니다. Row split은 train/test 사이에 같은 ligand series, homologous protein, related assay, 거의 같은 complex template을 남길 수 있습니다.

Metrics

TaskPrimary metricDiagnostic
Binary activityPRC-AUC, enrichment, calibrated threshold metricROC-AUC, reliability, class prevalence
Affinity regressionMAE/RMSE in original units, Spearman/Pearsonassay slice error, activity-cliff error
Ranking or screeningenrichment, BEDROC, recall at budgetdecoy bias, negative provenance
Pose-aware interactionpose validity, contact recovery, interaction fingerprint similarityclash, strain, ligand-state mismatch

Checks

  • one example은 molecule, target, assay row, pair, complex, pose, ranked list 중 무엇인가?
  • target, assay, endpoint, unit, threshold, censoring, source가 보존되는가?
  • ligand scaffold, protein family, assay/source, template leakage를 따로 확인했는가?
  • metric이 activity prediction, affinity regression, screening, pose evaluation, selectivity 중 실제 decision과 맞는가?
  • model이 inference time에 unavailable한 pocket, pose, template, assay field를 쓰는가?
  • fingerprint model, sequence-similarity baseline, docking baseline, nearest-neighbor baseline 같은 cheap baseline이 있는가?