Skip to content

WIP - LSDB API + Hyrax - #1062

Draft
drewoldag wants to merge 3 commits into
mainfrom
awo/lsdb-api-hyrax
Draft

drewoldag wants to merge 3 commits into
mainfrom
awo/lsdb-api-hyrax

Conversation

@drewoldag

Copy link
Copy Markdown
Collaborator

Demo notebook showing how we could potentially use an LSDB style API to send data to Hyrax.

Current blocker is that we need a way to preview cols and nested cols in dataframe when dynamincally building dataset instance so that the getters can be created. At this point, I just pass a placeholder empty dataframe, and it has no columns, so no getters are created. If we could create a stub nested dataframe with appropriate columns and use that to prime the dataset class, that would be ideal.

@drewoldag drewoldag self-assigned this Sep 29, 2026
@review-notebook-app

Copy link
Copy Markdown

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@codecov

codecov Bot commented Sep 29, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 25.75758% with 49 lines in your changes missing coverage. Please review.
✅ Project coverage is 69.87%. Comparing base (1281289) to head (6c890c1).

Files with missing lines Patch % Lines
src/hyrax/datasets/hyrax_dataframe_dataset.py 24.61% 49 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1062      +/-   ##
==========================================
- Coverage   70.20%   69.87%   -0.33%     
==========================================
  Files          91       92       +1     
  Lines        8961     9027      +66     
==========================================
+ Hits         6291     6308      +17     
- Misses       2670     2719      +49     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant