Skip to content

PD-14: Add 10.x pipeline notebook series - #16

Merged
ChanceChallacombe merged 8 commits into
mainfrom
pd-14-pipeline-notebooks
Jul 15, 2026
Merged

ChanceChallacombe merged 8 commits into
mainfrom
pd-14-pipeline-notebooks

Conversation

@ChanceChallacombe

Copy link
Copy Markdown
Contributor

Summary

  • Adds 7 new Jupyter notebooks (10.0–10.6) introducing the DataPipeline SDK with DuckDB caching
  • Titles, pip install block, and 10.6 pipeline order (Tm → sol → boltz2) all polished
  • Fresh cell outputs throughout; no hardcoded tokens or cache files

Notebooks

# Title
10.0 Screen 1,000 Peptides Before Lunch
10.1 Skip Repeated API Calls: Cache and Reuse Predictions Across Screening Runs
10.2 Select a Diverse Peptide Library by Clustering ESM2 Embeddings
10.3 Run a Screening Campaign Across Multiple Batches Without Repeating Predictions
10.4 Scan All Single-Point Variants for Thermal Stability and Solubility
10.5 Explore Protein Sequence Space: Similarity, Outliers, and Property Landscapes
10.6 Filter Designs by Fold Quality Before Running Stability and Solubility Predictions

Other changes

  • .gitignore: added .biolm/ and *.duckdb (SDK cache files)
  • requirements.txt: added biolmai[pipeline]

Test plan

  • Notebooks execute end-to-end with a valid BIOLMAI_TOKEN
  • No hardcoded secrets (verified — tokens via os.environ.get)
  • No cache files committed (.duckdb, .biolm/)
  • Cross-repo sync fires on merge and opens a biolm_web PR automatically

andrewcstewart and others added 8 commits July 15, 2026 10:22
Seven new notebooks demonstrating the biolmai.pipeline (DataPipeline /
DuckDBDataStore) SDK, revised to match repo conventions: standard BioLM
HTML headers and footers, 10.x series numbering, and typo fixes. Also
adds biolmai[pipeline] to requirements.txt.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
The biolmai.pipeline module is not yet publicly released. Adds a
blockquote notice to each of the 10.x notebooks directing users to
contact BioLM for early access.
- Remove ⚠️ Preview Feature banner from all 7 notebooks (pipelines is GA)
- Change `biolmai[pipeline]` install to `biolmai` (now ships with full package)
- Update titles to be more descriptive and biology-campaign-focused:
  10.1: Skip Repeated API Calls: Cache and Reuse Predictions Across Screening Runs
  10.2: Select a Diverse Peptide Library by Clustering ESM2 Embeddings
  10.3: Run a Screening Campaign Across Multiple Batches Without Repeating Predictions
  10.4: Scan All Single-Point Variants for Thermal Stability and Solubility
  10.5: Explore Protein Sequence Space: Similarity, Outliers, and Property Landscapes
  10.6: Filter Designs by Fold Quality Before Running Stability and Solubility Predictions
- Execute 10.0–10.3, 10.5 to add real API outputs (DataFrames, plots, pipeline logs)
- Fix 10.4: add ValidAminoAcidFilter, make tm/sol stages parallel (depends_on=["validate"]),
  improve wt_tm lookup error message; outputs pending API recovery
- Ignore .biolm/ pipeline cache dir and *.duckdb files
- Replace temperature-regression with temberture-regression (correct v3 slug) in all 10.x notebooks
- Execute 10.4 and 10.6 with live API to embed real outputs
- Fix 10.4 ThresholdFilter threshold (55°C → 48°C, matched to WT Tm of 51°C)
- Replace boltz2 with ESMFold in 10.6 (boltz2 requires custom molecules input format
  not supported by the pipeline SDK; ESMFold returns identical mean_plddt/ptm metrics
  and accepts plain sequence strings)
- Fix 10.4 source encoding corruption from previous session (char-split source repaired)
- Use add_cofolding_prediction (CofoldingPredictionStage) for correct
  molecules format required by boltz2
- Extract confidence.complex_plddt and confidence.ptm as filterable
  scalar predictions via new SDK extractions support
- Fix plddt ThresholdFilter threshold from 65.0 to 0.65 (boltz2 returns
  values in [0,1] scale, not [0,100])
- Fix ESMFold references in markdown header and note
- All three gates execute: fold (13→12) → tm (12→11) → solubility top-5
…boltz2)

Folding is more expensive than stability/solubility predictions. The previous
order (boltz2 first) was backwards — spend the costly structural validation
budget only on sequences that survive the cheap filters.

New order: temberture-regression → biolmsol top-7 → boltz2 validate survivors.
Boltz-2 now runs on 7 sequences instead of 13.
New titles (agreed): launch campaign / persist predictions / cover more space /
trickle pattern / predict mutations / embedding navigation / properties before structure.
Removed pip install code fence from requirements cell across all seven notebooks;
kept the BIOLMAI_TOKEN export line as plain inline code.
@ChanceChallacombe
ChanceChallacombe force-pushed the pd-14-pipeline-notebooks branch from f99a7aa to 441291e Compare July 15, 2026 17:23
@ChanceChallacombe
ChanceChallacombe merged commit 3c96da8 into main Jul 15, 2026
2 checks passed
@ChanceChallacombe
ChanceChallacombe deleted the pd-14-pipeline-notebooks branch July 15, 2026 17:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants