Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use existing hipscat_index for mapping pixel #159

Merged
merged 4 commits into from
Nov 6, 2023

Conversation

delucchi-cmu
Copy link
Contributor

Change Description

Partially addresses issue #46 by allowing for import partitioning by a previously-computed _hipscat_index column.

Code Quality

  • I have read the Contribution Guide
  • My code follows the code style of this project
  • My code builds (or compiles) cleanly without any errors or warnings
  • My code contains relevant comments and necessary documentation

Copy link

codecov bot commented Nov 2, 2023

Codecov Report

Merging #159 (8be7886) into main (0af18cd) will decrease coverage by 0.26%.
Report is 4 commits behind head on main.
The diff coverage is 82.35%.

@@             Coverage Diff             @@
##              main     #159      +/-   ##
===========================================
- Coverage   100.00%   99.74%   -0.26%     
===========================================
  Files           24       27       +3     
  Lines         1022     1156     +134     
===========================================
+ Hits          1022     1153     +131     
- Misses           0        3       +3     
Files Coverage Δ
src/hipscat_import/catalog/arguments.py 100.00% <100.00%> (ø)
src/hipscat_import/catalog/run_import.py 100.00% <ø> (ø)
src/hipscat_import/index/map_reduce.py 100.00% <100.00%> (ø)
src/hipscat_import/catalog/map_reduce.py 96.62% <76.92%> (-3.38%) ⬇️

... and 5 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Copy link
Contributor

@hombit hombit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I run this branch for SFD map importing and it worked fine!

The only real issue from listed bellow is the hipscat version requirement.

@hombit hombit self-requested a review November 6, 2023 13:05
delucchi-cmu and others added 2 commits November 6, 2023 08:08
* Set lower default import order. (#153)

* Macauff pipeline boilerplate (#152)

* checkpoint

* checkpoint

* testing for MacauffArguments

* create boilerplate for macauff runner + tests

* remove commented out test

* add __future__.annotations

* linter problems

* add more tests for missing coverage

* refactor MacauffArguments required parameter tests

* address more comments from pr #152

* add dask pytest mark + black formatting

* Add a partition_info on SOAP results. (#157)

* Initial commit of metadata file conversion (#156)

* Initial commit of metadata file conversion

* Move shared logic for locating input files.

* Explicitly depend on pyyaml

---------

Co-authored-by: Max West <[email protected]>
@delucchi-cmu delucchi-cmu merged commit 857dc1c into main Nov 6, 2023
11 checks passed
@delucchi-cmu delucchi-cmu deleted the issue/46/hipscat_index branch November 6, 2023 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants