Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compare results of the 'get_AUC' function with previous function from Kelly (invitrodb_v3_5 data) #55

Open
sedavid01 opened this issue Oct 5, 2023 · 2 comments
Assignees
Labels
bug Something isn't working question Further information is requested

Comments

@sedavid01
Copy link
Collaborator

sedavid01 commented Oct 5, 2023

I did a test run of the get_AUC function and compared results to the function I previously used for the 'hill' function (invitrodb_v3_5 data). The AUC's are dissimilar between methods but would need to do a full analysis with a set of curves to understand how variable the AUCs are.
For DTXSID6020226 in endpoint (aeid 2494) I found an AUC of 186.66 using the get_AUC function. I found an AUC of 109.31 using my previous function (integration based). These differences may not be surprising because different model parameters were used. I looked at a second chemical and observed a similar difference.

@sedavid01 @gracezhihuizhao let me know if you would like to dig deeper into this analysis.

Originally posted by @Kelly-Carstens-EPA in #22 (comment)

Goal: Analyze why we are getting different values with the get_AUC function from what Kelly previously estimated. (A) How frequently do we end up with dissimilar AUC estimates (B) Identify potential differences between Kelly's approach and ours and (C) Determine if there is a bug that needs to be fixed and/or path forward.

@sedavid01 sedavid01 added question Further information is requested bug Something isn't working labels Oct 5, 2023
@Kelly-Carstens-EPA
Copy link

Kelly-Carstens-EPA commented Oct 5, 2023

Here is the script I wrote to test the get_AUC function and compare it to the AUC function I had previously used with invitrodb v3.5 data. The script is located in the Teams folder under files/Scripts "Testing_get_AUC_function_tcplfit2_05Oct2023_pass.R" or here.

@gracezhihuizhao
Copy link
Contributor

Attaching a pdf of codes used to compare results of the 'get_AUC' function with results of previous function from Kelly. Shows how to get the same results by using log transformation.
AUC-Compare Resuls.pdf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants