🌐 HorizonPush

🚧 Experimental & Work in Progress: HorizonPush is actively being developed. Expect breaking changes, incomplete features, and evolving APIs.

HorizonPush is a file-sharing and synchronization tool leveraging iroh for peer-to-peer transfers and multi-provider blob streaming. It provides an extensible WebAssembly (Wasm) API, integrates with S3 for storage, and includes a Tauri-based desktop application.

🏛️ Architecture

flowchart TD
    Client([Client Request]) --> HorizonNode
    
    subgraph "Edge Compute Layer"
        HorizonNode["Horizon Node<br><small>(Edge Compute Node)</small>"] --> WasmEngine
        
        subgraph "Wasm Plugin System"
            WasmEngine{{"Wasm Runtime Engine"}}
            WasmEngine --> Plugin1[["Transform Plugin"]]
            WasmEngine --> Plugin2[["Auth Plugin"]]
            WasmEngine --> Plugin3[["Caching Plugin"]]
            WasmEngine --> Plugin4[["Custom Logic..."]]
        end
        
        WasmEngine --> IrohNode
        
        subgraph "Iroh Storage"
            IrohNode[Iroh Node]
            IrohNode --> IrohDocs[(Iroh Documents)]
            IrohNode --> IrohBlobs[(Iroh Blobs)]
        end
    end
    
    IrohNode -- "Cache Miss/Not Found" --> FallbackMechanism
    
    subgraph "Fallback Layer"
        FallbackMechanism{Fallback Mechanism}
        FallbackMechanism --> AWS[(AWS S3)]
        FallbackMechanism --> GCP[(GCP Storage)]
        FallbackMechanism --> Azure[(Azure Blob)]
        FallbackMechanism --> Other[(Other S3 Providers)]
    end
    
    AWS & GCP & Azure & Other --> CacheUpdate[Update Iroh Storage]
    CacheUpdate --> IrohDocs
    CacheUpdate --> IrohBlobs
    
    IrohDocs & IrohBlobs --> Response([Response to Client])
    FallbackMechanism --> Response
    
    classDef edge fill:#f9f,stroke:#333,stroke-width:2px;
    classDef storage fill:#bbf,stroke:#33f,stroke-width:1px;
    classDef fallback fill:#fbb,stroke:#f33,stroke-width:1px;
    classDef wasm fill:#bfb,stroke:#3b3,stroke-width:1px;
    
    class HorizonNode,IrohNode edge;
    class WasmEngine,Plugin1,Plugin2,Plugin3,Plugin4 wasm;
    class IrohDocs,IrohBlobs storage;
    class AWS,GCP,Azure,Other,FallbackMechanism fallback;

Loading

⭐ Features

• 📂 Decentralized File Sharing: Uses iroh-blobs for secure, verifiable blob transfers.
• 🔀 Multi-Provider Blob Streaming: Enables efficient file distribution by leveraging multiple sources.
• 🧩 WebAssembly Plugin Support: Extend functionality with third-party Wasm plugins.
• ☁️ S3 Integration: Acts as an S3-compatible storage proxy with local caching.
• 🖥️ Tauri Desktop App: Provides a cross-platform, native UI for managing transfers.

🧩 WebAssembly API

HorizonPush exposes a Wasm API, allowing developers to extend its functionality with custom plugins. The Wasm runtime has access to:

• 📜 iroh-docs: Multi-dimensional key-value document store.
• 📦 iroh-blobs: Secure blob transfers with BLAKE3 verification.
• ⚙️ horizon-sdk: Helper functions for interacting with HorizonPush internals.

📜 iroh Integration with S3

HorizonPush acts as an S3 proxy with intelligent caching:

• 🔄 S3 API Compatibility: Supports standard S3 operations (PUT, GET, DELETE).
• 💾 Local-First Syncing: Keeps frequently accessed files locally.
• 🗄️ Transparent Caching: Moves rarely used files to S3 storage.

🖥️ Working with awscli

At the moment signing is not implemented, so if you want to test you should not sign the request. This will be solved in the near future

1. create a bucket

aws --endpoint-url http://localhost:3000/s3 s3 mb s3://horizon_bucket --no-sign-request

2. copy an object to the bucket

aws --endpoint-url http://localhost:3000/s3 s3 cp my_test_file.txt s3://horizon_bucket --no-sign-request  

3. check the head of the object

aws --endpoint-url http://localhost:3000/s3 s3api head-object --bucket blutona --key README.md --no-sign-request

4. export the bucket ticket for another horizon node

5. import the bucket ticket from another horizon node

5. download the object

aws --endpoint-url http://localhost:3000/s3 s3 cp s3://horizon_bucket/my_test_file.txt test-download.txt --no-sign-request

🖥️ Tauri Desktop App

The HorizonPush desktop application provides a native UI for:

• 📂 Managing file transfers
• ⚙️ Configuring S3 settings
• 🧩 Installing and managing Wasm plugins

▶️ Running the Tauri App

cd crates/apps/horizon-push
npm install
npm run tauri dev

▶️ Running the Horizon Server

cargo run --bin horizon-push start-server

🤝 Contributing

Contributions are welcome! Submit issues and pull requests on GitHub.