chore: Update compose with secondary store setup && minor refactors

[ethenotethan]

Fixes Issue

Fixes #

Changes proposed

Screenshots (Optional)

Note to reviewers

[samlaf]

Don't need to do this in this PR but could we convert our Makefile into a Justfile?
Justfile commands allow embedding shell scripts directly, so we don't need to maintain a whole bunch of separate scripts.
Personally find it much cleaner setup.

[ethenotethan]

yeah I'm down to use it - lets file an issue

[samlaf]

What is mc? I don't have it on my system. Is this an external dependency we're adding? Prob want to document it somewhere. Eventually we'll prob want to have a mise file like op (or go all out and use nix)

[ethenotethan]

oo probably worth noting that this script is only runnable in the minio-init service since it references the docker network from within

[samlaf]

What's the goal for this docker-compose file? Is it just for manual testing?

It's not mentioned anywhere in the README, its not in CI, and don't think we use it for anything explicit right now. Might be good to document it and add it to ci if we want to keep it around?

[ethenotethan]

some ideas around this; we coulda add feature testing to ensure lightweight dispersal/retrieval in a more real environment than the one we codify for E2E testing. The idea is you have one script that does a E2E set/get assertion which takes in specific feature flags denoting a specific runtime behavior of proxy which wrap around it; ie:

• fallback_dest: [S3, redis, nil] w/ 3 variations
• cache_dest: [S3, redis, nil] w/ 3 variations
• cert_verification: [true, false] w 2 variations

3 * 3 * 2 = 18 permutations; but less since `fallback_dest` and `cache_dest` can only be sampled with replacement for `nil` so it'd be - ( 2 * 2) or:

18 - 4 = 14 test case permutations

Think this would be good to have since it also provides a more infra level overview of what wiring proxy with dependencies look like. This would definitely help devx when people have to spin-up additional infra and wire it with proxy.