Skip to content

new architecture #8453

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 674 commits into
base: master
Choose a base branch
from
Open

new architecture #8453

wants to merge 674 commits into from

Conversation

williamstein
Copy link
Contributor

No description provided.

@williamstein williamstein changed the title create a btrfs fileserver for projects new architecture Aug 11, 2025
@williamstein
debug line included by accident
8433ad2
@williamstein
lite: allow formatting
e1869f1 
- just allow in all cases -- TODO: we should obviously
  just have the backend report an error and suggesting to
  fix instead of silently failing like currently!
@williamstein
add script to generate 150MB tarball that's enough to run current ver…
b75fb9d 
…sion of cocalc-lite
@williamstein
make startup more robust
04bc6ea
@williamstein
lite: create basic electron app
3496544
@williamstein
menus for windows; fix binary extensions -- this actually works
35c1713
@williamstein
add some lite-related top level commands
8673678
@williamstein
lite: MVP for "database" changefeeds
b135c2c
@williamstein
switch to clone so we can mutate binaries for electron
02de555
@williamstein
rewrite directory listing to not use find so it is cross platform
a62e94b 
- this sort of thing will be very important to support mac and windows!
@williamstein
do not hardcode exact path to bash, e.g., on macos /usr/bin/bash does…
e78e17f 
…n't exist
@williamstein
switch to lite variable instead of customize redux for checks -- it's…
1cc9e65 
… clearly much faster this way, and using redux is not needed since the state of lite doesn't change, so UI doesn't need to react to that.
@williamstein
lite: implementing very lightway hub user queries for cocalc-lite, an…
f9e1593 
…d so we don't have to use pglite
@williamstein
lite: work in progress on user queries
3fc3042
@williamstein
got lightweight queries working, backed by conat dkv, and NOT efficie…
49a85b1 
…nt at all.
@williamstein
set the default project's title and state
4c11c32
@williamstein
lite: remove upgrades/users tabs
cea4813
@williamstein
remove more icons in lite mode
4c0ea69
@williamstein
put cocalc lite config data in ~/.cocalc/lite
2baf336
@williamstein
lite: remove settings as well
b00ce98
@williamstein
project runner: do not use rlimit for memory -- it's not really appro…
a3838fc 
…priate
@williamstein
move core file download to conat, so it can be used in lite; improve …
883ca8a 
…typing; allow for specifying client
@williamstein
lite: enable file download
a615e67
@williamstein
lite: support favicon
b8f998e
@williamstein
lite: implement blob upload and download; also disable standby timeout
df911dd
@williamstein
don't try to stage mutagen on tmpfs
22e567a
@williamstein
include more of dropbear
2f4bd74
@williamstein
add dbclient ssh wrapper; add sync-times script
e12986d
@williamstein
work in progress to use dropbear with mutagen seemlessly
dcc545e
@williamstein
when project key changes for some reason, restart ssh container
97e0cb5 
- I don't understand why this is necessary but it (1) is (perhaps due to
  a bug somewhere), but (2) a good idea probably anyways, since
  one would only change the key if something were suspicious and then
  you would want to reset all connections, etc.
@williamstein
install dropbear
fa6db2c
@williamstein
rewriting to use sidecar for project runner and mutagen etc -- it's j…
05b3b1d 
…ust much easier
@williamstein
fully embrace sidecar for project runner
d5cedb5
@williamstein
explain the sidecar container that currently provides mutagen's daemon
582c996 
(but we're calling sidecar, since maybe it does more later.)
@williamstein
work in progress on file server
8ce861e
@williamstein
work in progress adding more state to project runner
264bfdd
@williamstein
project runner with integrated sync/forwarding/ssh config
8d7ae41
@williamstein
project runner: refactor to be flexible and extensible now that we kn…
cbcf18b 
…ow how it will work
@williamstein
project-runner: quick proof of concept of rsync first
c8d8465
@williamstein
project runner: start/config of mutagen in sidecar
e07ea46
@williamstein
add an rsync step in
919fcad
@williamstein
fix a number of issues with project-runner and file-server ssh server
36c3358
@williamstein
add readme about the project runner
ee95392
@williamstein
make not having commands like "file" non-fatal to open uknown files
bbf93bd
@williamstein
add way for project runner to log progress so user can see it.
8d3ca92
@williamstein
add rsync progress for copying home directory
f1fdc7e
@williamstein
refactor rsync progress code
1c1199a
@williamstein
similar progress for rootfs
5e93fda
@williamstein
improve tracking of project transition states better, especially beca…
d1756ef 
…use they can be arbitrarily long, in theory
@williamstein
very rough first draft of frontend UI for seeing the project boot log
2f379c6
@williamstein
switch from dropbear to openssh in file-server container
3461dfc
@williamstein
switch project sidecar to use ubuntu instead of alpine for maybe bett…
5840c50 
…er speed with rsync (and less surprises)
@williamstein
use lz4 compression for initial rsync's; do them in parallel
580a643
@williamstein
make file-server container secure, hopefully
f7c13c4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
A-file system PR-work in progress
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@williamstein