[PRE REVIEW]: madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes #7247

editorialbot · 2024-09-20T00:36:29Z

Submitting author: @gmatilde (Matilde Gargiani)
Repository: https://github.com/madupite/madupite
Branch with paper.md (empty if default branch):
Version: v1.0.0
Editor: @logological
Reviewers: @lukeolson, @victorapm, @bhttchr6
Managing EiC: Daniel S. Katz

Status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4"><img src="https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4/status.svg)](https://joss.theoj.org/papers/b7796be0782d9feb0bf5fb3bc37bc7e4)

Author instructions

Thanks for submitting your paper to JOSS @gmatilde. Currently, there isn't a JOSS editor assigned to your paper.

@gmatilde if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). You can search the list of people that have already agreed to review and may be suitable for this submission.

Editor instructions

The JOSS submission bot @editorialbot is here to help you find and assign reviewers and start the main review. To find out what @editorialbot can do for you type:

@editorialbot commands

The text was updated successfully, but these errors were encountered:

editorialbot · 2024-09-20T00:36:32Z

Hello human, I'm @editorialbot, a robot that can help you with some common editorial tasks.

For a list of things I can do to help you, just type:

@editorialbot commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@editorialbot generate pdf

editorialbot · 2024-09-20T00:37:01Z

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.5281/zenodo.11844058 is OK
- 10.1111/ecog.00888 is OK
- 10.1287/inte.15.6.73 is OK
- 10.1016/j.ifacol.2016.07.012 is OK
- 10.2172/2205494 is OK
- 10.1016/j.parco.2021.102831 is OK
- 10.1007/s10107-014-0783-z is OK
- 10.1109/LCSYS.2022.3181213 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Inexact Policy Iteration Methods for Large-Scale M...
- No DOI given, and none found for title: Markov decision processes with applications to fin...
- No DOI given, and none found for title: Handbook of Markov Decision Processes: Methods and...
- No DOI given, and none found for title: PETSc Web page
- No DOI given, and none found for title: nanobind: tiny and efficient C++/Python bindings
- No DOI given, and none found for title: Dynamic Programming and Optimal Control, Vol. II
- No DOI given, and none found for title: Dynamic Programming
- No DOI given, and none found for title: Reinforcement Learning: An Introduction

❌ MISSING DOIs

- 10.1016/j.ifacol.2023.10.316 may be a valid DOI for title: Inexact GMRES Policy Iteration for Large-Scale Mar...
- 10.1109/tac.2023.3270060 may be a valid DOI for title: Parallel and Flexible Dynamic Programming via the ...
- 10.1007/978-3-319-47766-4_6 may be a valid DOI for title: Markov Decision Processes for Screening and Treatm...
- 10.1007/978-1-4612-1986-6_8 may be a valid DOI for title: Efficient Management of Parallelism in Object Orie...

❌ INVALID DOIs

- None

editorialbot · 2024-09-20T00:37:13Z

Software report:

github.com/AlDanial/cloc v 1.90  T=0.05 s (1137.0 files/s, 301559.6 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
SVG                              2              0             39           9447
C++                             11            300            113           1417
Python                          14            300            125            898
C/C++ Header                     8            157            123            554
Jupyter Notebook                 3              0            657            379
reStructuredText                 8            305            397            216
TeX                              1              0              0            180
CMake                            1             26             18            122
YAML                             4             10             13            122
Markdown                         3             40              0            116
DOS Batch                        1              8              1             26
TOML                             1              3              0             23
make                             1              4              7              9
Bourne Shell                     3              6             11              7
-------------------------------------------------------------------------------
SUM:                            61           1159           1504          13516
-------------------------------------------------------------------------------

Commit count by author:

   148	Robin Sieber
   125	Robin
    79	Philip Pawlowsky
    64	Vaclav Hapla
    44	gmatilde
     6	vhapla
     5	ppawlowsky
     4	philippawlowsky
     2	Matilde Gargiani

editorialbot · 2024-09-20T00:37:17Z

Paper file info:

📄 Wordcount for paper.md is 1253

✅ The paper includes a Statement of need section

editorialbot · 2024-09-20T00:37:19Z

License info:

✅ License found: MIT License (Valid open source OSI approved license)

editorialbot · 2024-09-20T00:38:19Z

👉📄 Download article proof 📄 View article proof on GitHub 📄 👈

editorialbot · 2024-09-20T00:39:13Z

Five most similar historical JOSS papers:

PyBADS: Fast and robust black-box optimization in Python
Submitting author: @GurjeetSinghSangra
Handling editor: @rkurchin (Active)
Reviewers: @jungtaekkim, @vankesteren
Similarity score: 0.7104

pyOptSparse: A Python framework for large-scale constrained nonlinear optimization of sparse systems
Submitting author: @nwu63
Handling editor: @poulson (Retired)
Reviewers: @jgoldfar, @vissarion, @matbesancon
Similarity score: 0.7063

Pakman: a modular, efficient and portable tool for approximate Bayesian inference
Submitting author: @ThomasPak
Handling editor: @jedbrown (Active)
Reviewers: @jmlarson1, @gonsie
Similarity score: 0.7061

PySD: System Dynamics Modeling in Python
Submitting author: @rogersamso
Handling editor: @pdebuyl (Active)
Reviewers: @blsqr, @sixpearls
Similarity score: 0.6982

pymdp: A Python library for active inference in discrete state spaces
Submitting author: @conorheins
Handling editor: @emdupre (Active)
Reviewers: @seankmartin, @patrickmineault
Similarity score: 0.6966

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

danielskatz · 2024-09-20T00:40:46Z

👋 @gmatilde - thanks for your submission.

While I look for an editor, you could work on the possibly missing DOIs that editorialbot suggests, but note that some may be incorrect. Please feel free to make changes to your .bib file, then use the command @editorialbot check references to check again, and the command @editorialbot generate pdf when the references are right to make a new PDF. editorialbot commands need to be the first entry in a new comment.

danielskatz · 2024-09-20T00:44:08Z

👋 @faroit - would you be able to edit this JOSS submission?

danielskatz · 2024-09-20T00:44:16Z

@editorialbot invite @faroit as editor

editorialbot · 2024-09-20T00:44:19Z

Invitation to edit this submission sent!

faroit · 2024-09-20T14:05:03Z

@danielskatz sorry this is outside of my domain but can probably contribute reviewers once an editor is found

danielskatz · 2024-09-21T23:14:19Z

👋 @logological - Do you think that you could edit this JOSS submission?

danielskatz · 2024-09-21T23:14:31Z

@editorialbot invite @logological as editor

editorialbot · 2024-09-21T23:14:34Z

Invitation to edit this submission sent!

gmatilde · 2024-09-25T16:43:27Z

👋 @gmatilde - thanks for your submission.

While I look for an editor, you could work on the possibly missing DOIs that editorialbot suggests, but note that some may be incorrect. Please feel free to make changes to your .bib file, then use the command @editorialbot check references to check again, and the command @editorialbot generate pdf when the references are right to make a new PDF. editorialbot commands need to be the first entry in a new comment.

Dear Daniel, thanks a lot for your message. We have just added the missing DOIs.

editorialbot · 2024-09-25T16:44:56Z

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.5281/zenodo.11844058 is OK
- 10.1111/ecog.00888 is OK
- 10.1287/inte.15.6.73 is OK
- 10.1007/978-3-319-47766-4_6 is OK
- 10.1016/j.ifacol.2016.07.012 is OK
- 10.2172/2205494 is OK
- 10.1007/978-1-4612-1986-6_8 is OK
- 10.1016/j.parco.2021.102831 is OK
- 10.1007/s10107-014-0783-z is OK
- 10.1109/LCSYS.2022.3181213 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Inexact Policy Iteration Methods for Large-Scale M...
- No DOI given, and none found for title: Markov decision processes with applications to fin...
- No DOI given, and none found for title: Handbook of Markov Decision Processes: Methods and...
- No DOI given, and none found for title: PETSc Web page
- No DOI given, and none found for title: nanobind: tiny and efficient C++/Python bindings
- No DOI given, and none found for title: Dynamic Programming and Optimal Control, Vol. II
- No DOI given, and none found for title: Dynamic Programming
- No DOI given, and none found for title: Reinforcement Learning: An Introduction

❌ MISSING DOIs

- 10.1109/tac.2023.3270060 may be a valid DOI for title: Parallel and Flexible Dynamic Programming via the ...

❌ INVALID DOIs

- https://doi.org/10.1016/j.ifacol.2023.10.316 is INVALID because of 'https://doi.org/' prefix

danielskatz · 2024-09-25T16:46:10Z

@gmatilde - thanks, though it looks like a couple more changes are still needed... (maybe you're working on them now)

gmatilde · 2024-09-25T16:47:22Z

yes :) I just pushed again

gmatilde · 2024-09-25T16:48:17Z

this is a list of reviewers who we think might be interested in reviewing our paper:

Martin Huber @mhubii
Dominic Kempf @dokempf
@himscipy
@sixpearls

gmatilde · 2024-09-25T16:48:56Z

@editorialbot check references

editorialbot · 2024-09-25T16:49:18Z

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.1016/j.ifacol.2023.10.316 is OK
- 10.5281/zenodo.11844058 is OK
- 10.1111/ecog.00888 is OK
- 10.1287/inte.15.6.73 is OK
- 10.1007/978-3-319-47766-4_6 is OK
- 10.1016/j.ifacol.2016.07.012 is OK
- 10.2172/2205494 is OK
- 10.1007/978-1-4612-1986-6_8 is OK
- 10.1016/j.parco.2021.102831 is OK
- 10.1007/s10107-014-0783-z is OK
- 10.1109/LCSYS.2022.3181213 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Inexact Policy Iteration Methods for Large-Scale M...
- No DOI given, and none found for title: Markov decision processes with applications to fin...
- No DOI given, and none found for title: Handbook of Markov Decision Processes: Methods and...
- No DOI given, and none found for title: PETSc Web page
- No DOI given, and none found for title: nanobind: tiny and efficient C++/Python bindings
- No DOI given, and none found for title: Dynamic Programming and Optimal Control, Vol. II
- No DOI given, and none found for title: Dynamic Programming
- No DOI given, and none found for title: Reinforcement Learning: An Introduction

❌ MISSING DOIs

- 10.1109/tac.2023.3270060 may be a valid DOI for title: Parallel and Flexible Dynamic Programming via the ...

❌ INVALID DOIs

- None

gmatilde · 2024-09-25T16:52:27Z

@editorialbot check references

editorialbot · 2024-09-25T16:52:49Z

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

✅ OK DOIs

- 10.1016/j.ifacol.2023.10.316 is OK
- 10.1109/TAC.2023.3270060 is OK
- 10.5281/zenodo.11844058 is OK
- 10.1111/ecog.00888 is OK
- 10.1287/inte.15.6.73 is OK
- 10.1007/978-3-319-47766-4_6 is OK
- 10.1016/j.ifacol.2016.07.012 is OK
- 10.2172/2205494 is OK
- 10.1007/978-1-4612-1986-6_8 is OK
- 10.1016/j.parco.2021.102831 is OK
- 10.1007/s10107-014-0783-z is OK
- 10.1109/LCSYS.2022.3181213 is OK

🟡 SKIP DOIs

- No DOI given, and none found for title: Inexact Policy Iteration Methods for Large-Scale M...
- No DOI given, and none found for title: Markov decision processes with applications to fin...
- No DOI given, and none found for title: Handbook of Markov Decision Processes: Methods and...
- No DOI given, and none found for title: PETSc Web page
- No DOI given, and none found for title: nanobind: tiny and efficient C++/Python bindings
- No DOI given, and none found for title: Dynamic Programming and Optimal Control, Vol. II
- No DOI given, and none found for title: Dynamic Programming
- No DOI given, and none found for title: Reinforcement Learning: An Introduction

❌ MISSING DOIs

- None

❌ INVALID DOIs

- None

gmatilde · 2024-09-25T16:53:55Z

@editorialbot generate pdf

danielskatz · 2024-09-25T17:15:51Z

Thanks @logological - Given loads on existing reviewers, I'm happy that you are willing to do this. I'll assign it to you now, but no there's no need to start it until next week...

danielskatz · 2024-09-25T17:16:05Z

@editorialbot assign @logological as editor

editorialbot · 2024-09-25T17:16:08Z

Assigned! @logological is now the editor

logological · 2024-10-04T22:44:47Z

@gmatilde I'm now ready to start the editing process – thanks for bearing with me. I see no obvious problems with your suggested reviewers so I'll go ahead and start inviting them.

logological · 2024-10-04T22:46:25Z

@mhubii @dokempf @Himscipy We've received a submission entitled "madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes". Would you be interested in reviewing it for the Journal of Open Source Software?

mhubii · 2024-10-05T16:38:04Z

hi @logological , currently reviewing 2 submissions already, but thank you for consideration.

logological · 2024-10-06T01:31:46Z

@sixpearls We've received a submission entitled "madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes". Would you be interested in reviewing it for the Journal of Open Source Software?

logological · 2024-10-09T17:24:30Z

@TimKam @sivaramambikasaran @victorapm We've received a submission entitled "madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes". Would you be interested in reviewing it for the Journal of Open Source Software?

victorapm · 2024-10-09T17:30:26Z

Thanks @logological, I can help reviewing

logological · 2024-10-09T17:48:00Z

Thanks, @victorapm! I'll let you know when we have enough additional reviewers to start the process.

danielskatz · 2024-10-23T20:20:46Z

👋 @logological - how are you doing on finding reviewers? Do you need any help?

logological · 2024-10-24T19:29:19Z

@danielskatz I had to take a brief pause for some submission deadlines. I'll keep working my way through a list of potential reviewers now.

logological · 2024-10-24T19:31:11Z

@alberto743 @lukeolson @bhttchr6 We've received a submission entitled "madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes". Would you be interested in reviewing it for the Journal of Open Source Software?

alberto743 · 2024-10-24T22:59:10Z

@logological Thank you for considering me as a potential reviewer for this work. I already have two other pending reviews for JOSS. Realistically, I will not be available for additional reviews before the beginning of February 2025. If you do not find other reviewers, come back to me in about two months.

bhttchr6 · 2024-10-24T23:20:43Z

Hello, Yes, I am interested in reviewing the article. Thanks, Regards, Anurag

…

On Thu, Oct 24, 2024 at 12:31 PM Tristan Miller ***@***.***> wrote: @alberto743 <https://github.com/alberto743> @lukeolson <https://github.com/lukeolson> @bhttchr6 <https://github.com/bhttchr6> We've received a submission entitled "madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes". Would you be interested in reviewing it for the Journal of Open Source Software? — Reply to this email directly, view it on GitHub <#7247 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALK7EVWR2U55NI4CZRXJIJ3Z5FDJPAVCNFSM6AAAAABOQ7N6MGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMZWGE4DONZRG4> . You are receiving this because you were mentioned.Message ID: ***@***.***>

lukeolson · 2024-10-24T23:26:46Z

@logological - yes, happy to review.

logological · 2024-10-25T15:40:35Z

Great – we now have enough reviewers to start. I'll set up a separate issue for the review. @lukeolson, @bhttchr6, and @victorapm, you can begin reviewing there right away, or as soon as it's convenient for you. Note that we ask that reviews be completed in two to three weeks, if possible.

logological · 2024-10-25T15:41:00Z

@editorialbot add @lukeolson as reviewer

editorialbot · 2024-10-25T15:41:02Z

@lukeolson added to the reviewers list!

logological · 2024-10-25T15:41:12Z

@editorialbot add @victorapm as reviewer

editorialbot · 2024-10-25T15:41:14Z

@victorapm added to the reviewers list!

logological · 2024-10-25T15:41:22Z

@editorialbot add @bhttchr6 as reviewer

editorialbot · 2024-10-25T15:41:25Z

@bhttchr6 added to the reviewers list!

logological · 2024-10-25T15:41:40Z

@editorialbot start review

editorialbot · 2024-10-25T15:41:45Z

OK, I've started the review over in #7411.

editorialbot added pre-review Track: 7 (CSISM) Computer science, Information Science, and Mathematics labels Sep 20, 2024

editorialbot added C++ TeX Python labels Sep 20, 2024

editorialbot assigned logological Sep 25, 2024

editorialbot assigned lukeolson Oct 25, 2024

editorialbot assigned victorapm Oct 25, 2024

editorialbot assigned bhttchr6 Oct 25, 2024

editorialbot closed this as completed Oct 25, 2024

[PRE REVIEW]: madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes #7247

[PRE REVIEW]: madupite: A High-Performance Distributed Solver for Large-Scale Markov Decision Processes #7247

Comments

editorialbot commented Sep 20, 2024 • edited Loading

Status

editorialbot commented Sep 20, 2024

editorialbot commented Sep 20, 2024

editorialbot commented Sep 20, 2024

editorialbot commented Sep 20, 2024

editorialbot commented Sep 20, 2024

editorialbot commented Sep 20, 2024

editorialbot commented Sep 20, 2024

danielskatz commented Sep 20, 2024

danielskatz commented Sep 20, 2024

danielskatz commented Sep 20, 2024

editorialbot commented Sep 20, 2024

faroit commented Sep 20, 2024

danielskatz commented Sep 21, 2024

danielskatz commented Sep 21, 2024

editorialbot commented Sep 21, 2024

gmatilde commented Sep 25, 2024

editorialbot commented Sep 25, 2024

danielskatz commented Sep 25, 2024

gmatilde commented Sep 25, 2024

gmatilde commented Sep 25, 2024

gmatilde commented Sep 25, 2024

editorialbot commented Sep 25, 2024

gmatilde commented Sep 25, 2024

editorialbot commented Sep 25, 2024

gmatilde commented Sep 25, 2024

danielskatz commented Sep 25, 2024

danielskatz commented Sep 25, 2024

editorialbot commented Sep 25, 2024

logological commented Oct 4, 2024

logological commented Oct 4, 2024

mhubii commented Oct 5, 2024

logological commented Oct 6, 2024

logological commented Oct 9, 2024

victorapm commented Oct 9, 2024

logological commented Oct 9, 2024

danielskatz commented Oct 23, 2024

logological commented Oct 24, 2024

logological commented Oct 24, 2024

alberto743 commented Oct 24, 2024

bhttchr6 commented Oct 24, 2024 via email

lukeolson commented Oct 24, 2024

logological commented Oct 25, 2024

logological commented Oct 25, 2024

editorialbot commented Oct 25, 2024

logological commented Oct 25, 2024

editorialbot commented Oct 25, 2024

logological commented Oct 25, 2024

editorialbot commented Oct 25, 2024

logological commented Oct 25, 2024

editorialbot commented Oct 25, 2024

editorialbot commented Sep 20, 2024 •

edited

Loading