# Development Guide ## Prerequisites - Go 1.21+ - Node.js 18+ (for anyone-client in dev mode) - macOS or Linux ## Building ```bash # Build all binaries make build # Outputs: # bin/orama-node — the node binary # bin/orama — the CLI # bin/gateway — standalone gateway (optional) # bin/identity — identity tool # bin/rqlite-mcp — RQLite MCP server ``` ## Running Tests ```bash make test ``` ## Running Locally (macOS) The node runs in "direct mode" on macOS — processes are managed directly instead of via systemd. ```bash # Start a single node make run-node # Start multiple nodes for cluster testing make run-node2 make run-node3 ``` ## Deploying to VPS There are two deployment workflows: **development** (fast iteration, no git required) and **production** (via git). ### Development Deployment (Fast Iteration) Use this when iterating quickly — no need to commit or push to git. ```bash # 1. Build the CLI for Linux GOOS=linux GOARCH=amd64 go build -o orama-cli-linux ./cmd/cli # 2. Generate a source archive (excludes .git, node_modules, bin/, etc.) ./scripts/generate-source-archive.sh # Creates: /tmp/network-source.tar.gz # 3. Copy CLI and source to the VPS sshpass -p '' scp -o StrictHostKeyChecking=no orama-cli-linux ubuntu@:/tmp/orama sshpass -p '' scp -o StrictHostKeyChecking=no /tmp/network-source.tar.gz ubuntu@:/tmp/ # 4. On the VPS: extract source and install the CLI ssh ubuntu@ sudo rm -rf /home/debros/src && sudo mkdir -p /home/debros/src sudo tar xzf /tmp/network-source.tar.gz -C /home/debros/src sudo chown -R debros:debros /home/debros/src sudo mv /tmp/orama /usr/local/bin/orama && sudo chmod +x /usr/local/bin/orama # 5. Upgrade using local source (skips git pull) sudo orama upgrade --no-pull --restart ``` ### Production Deployment (Via Git) For production releases — pulls source from GitHub on the VPS. ```bash # 1. Commit and push your changes git push origin # 2. Build the CLI for Linux GOOS=linux GOARCH=amd64 go build -o orama-cli-linux ./cmd/cli # 3. Deploy the CLI to the VPS sshpass -p '' scp orama-cli-linux ubuntu@:/tmp/orama ssh ubuntu@ "sudo mv /tmp/orama /usr/local/bin/orama && sudo chmod +x /usr/local/bin/orama" # 4. Run upgrade (downloads source from GitHub) ssh ubuntu@ "sudo orama upgrade --branch --restart" ``` ### Deploying to All 3 Nodes To deploy to all nodes, repeat steps 3-5 (dev) or 3-4 (production) for each VPS IP. ### CLI Flags Reference #### `orama install` | Flag | Description | |------|-------------| | `--vps-ip ` | VPS public IP address (required) | | `--domain ` | Domain for HTTPS certificates | | `--base-domain ` | Base domain for deployment routing (e.g., dbrs.space) | | `--nameserver` | Configure this node as a nameserver (CoreDNS + Caddy) | | `--join ` | Join existing cluster via HTTPS URL (e.g., `https://node1.dbrs.space`) | | `--token ` | Invite token for joining (from `orama invite` on existing node) | | `--branch ` | Git branch to use (default: main) | | `--no-pull` | Skip git clone/pull, use existing `/home/debros/src` | | `--force` | Force reconfiguration even if already installed | | `--skip-firewall` | Skip UFW firewall setup | | `--skip-checks` | Skip minimum resource checks (RAM/CPU) | #### `orama invite` | Flag | Description | |------|-------------| | `--expiry ` | Token expiry duration (default: 1h) | #### `orama upgrade` | Flag | Description | |------|-------------| | `--branch ` | Git branch to pull from | | `--no-pull` | Skip git pull, use existing source | | `--restart` | Restart all services after upgrade | ### Node Join Flow ```bash # 1. Genesis node (first node, creates cluster) sudo orama install --vps-ip 1.2.3.4 --domain node1.dbrs.space \ --base-domain dbrs.space --nameserver # 2. On genesis node, generate an invite orama invite # Output: sudo orama install --join https://node1.dbrs.space --token --vps-ip # 3. On the new node, run the printed command sudo orama install --join https://node1.dbrs.space --token abc123... \ --vps-ip 5.6.7.8 --nameserver ``` The join flow establishes a WireGuard VPN tunnel before starting cluster services. All inter-node communication (RQLite, IPFS, Olric) uses WireGuard IPs (10.0.0.x). No cluster ports are ever exposed publicly. #### DNS Prerequisite The `--join` URL should use the HTTPS domain of the genesis node (e.g., `https://node1.dbrs.space`). For this to work, the domain registrar for `dbrs.space` must have NS records pointing to the genesis node's IP so that `node1.dbrs.space` resolves publicly. **If DNS is not yet configured**, you can use the genesis node's public IP with HTTP as a fallback: ```bash sudo orama install --join http://1.2.3.4 --vps-ip 5.6.7.8 --token abc123... --nameserver ``` This works because Caddy's `:80` block proxies all HTTP traffic to the gateway. However, once DNS is properly configured, always use the HTTPS domain URL. **Important:** Never use `http://:6001` — port 6001 is the internal gateway and is blocked by UFW from external access. The join request goes through Caddy on port 80 (HTTP) or 443 (HTTPS), which proxies to the gateway internally. ## Debugging Production Issues Always follow the local-first approach: 1. **Reproduce locally** — set up the same conditions on your machine 2. **Find the root cause** — understand why it's happening 3. **Fix in the codebase** — make changes to the source code 4. **Test locally** — run `make test` and verify 5. **Deploy** — only then deploy the fix to production Never fix issues directly on the server — those fixes are lost on next deployment. ## Project Structure See [ARCHITECTURE.md](ARCHITECTURE.md) for the full architecture overview. Key directories: ``` cmd/ cli/ — CLI entry point (orama command) node/ — Node entry point (orama-node) gateway/ — Standalone gateway entry point pkg/ cli/ — CLI command implementations gateway/ — HTTP gateway, routes, middleware deployments/ — Deployment types, service, storage environments/ — Production (systemd) and development (direct) modes rqlite/ — Distributed SQLite via RQLite ```