Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Application to public HSC DR3 as proof of concept #17

Open
tms-epcc opened this issue Feb 8, 2024 · 15 comments
Open

Application to public HSC DR3 as proof of concept #17

tms-epcc opened this issue Feb 8, 2024 · 15 comments
Assignees

Comments

@tms-epcc
Copy link
Collaborator

tms-epcc commented Feb 8, 2024

From FY24 Q1 QU

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Feb 8, 2024

08/FEB/23

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Mar 7, 2024

07/MAR/24

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Mar 25, 2024

25/MAR/24

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Apr 8, 2024

08/APR/24

  • O/G

@tms-epcc
Copy link
Collaborator Author

30/APR/24

  • discussed memory issues and possible solns at DESC telcon recently
  • PCA looks to be a way to deal with this so will investigate
  • also running a prelim analysis at lower resoln for paper
  • will then proceed from there

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented May 14, 2024

14/MAY/24

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Jun 4, 2024

04/JUN/24

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Jul 1, 2024

01/JUL/24

  • still looking at the above mentioned signal issues.
  • identified possible sources but as yet not been able to mitigate
  • sky mask has generated some unwanted cross-correlations
  • suspect HSC pipeline is missing an item so this will be looked into
  • this will be helpful for DESC regardless

@tms-epcc
Copy link
Collaborator Author

29/JUL/24

  • have identified the source of the unwanted cross-correlations
  • this is due to cuts in the data at the download stage
  • now redoing without the cuts to see what the effect is
  • looks likely that this is dealing with the issue so probably no need for simulated data after all

@tms-epcc
Copy link
Collaborator Author

20/AUG/24

  • the above approach was successful.
  • now have a means to get accurate power spectra
  • implementing this as python script
  • no need to establish if this needs to incorporate into TxPipe (see Google doc for the masks and the responsibilities -Boris will check)
  • next step is to produce first final power spectra

@tms-epcc
Copy link
Collaborator Author

12/SEP/24

  • believe have accurate power spectra
  • now using these to derive constraints on the distribution model
  • also look at improving the linear deprojection method eg. remove assumptions and deal with memory issues

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Oct 1, 2024

01/OCT/24

  • now have code for fitting basic halo distribution model. This gives preliminary result
  • Next stage is to improve this values
  • 3rd pt above still o/g

@tms-epcc
Copy link
Collaborator Author

21/OCT/24

  • halo distributions: rerunning to identify issues

@tms-epcc
Copy link
Collaborator Author

tms-epcc commented Nov 13, 2024

13/NOV/24

  • still having issues with the halos, getting poor fits.
  • continued testing with HSC DR1
  • still investigating these
  • but note the pipeline itself is ok for the purposes of LSST:UK so the final step will be to confirm power spectra from the pipeline are realistic from HSC DR1

@tms-epcc
Copy link
Collaborator Author

11/DEC/24

  • found halo model that works with HSC DR3
  • so will keep DR1 in reserve instead
  • the final step will however still be to confirm power spectra from the pipeline are realistic from HSC DR1. This will be a sanity check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants