Automated incremental backups for external servers

Problem Context

Users run Proxmox homelabs with PBS for local backups but struggle to automate backups for external servers (FTP/SSH/SFTP). They need a local tool to pull data on a schedule without installing software on remote hosts. Manual processes lead to inconsistent backups and higher risk of data loss.

Pain Points

Current workarounds fail because they require manual FTP/SSH logins, lack incremental updates (wasting bandwidth), and don’t enforce retention policies. Users waste time tracking backups and risk losing data when manual steps are skipped. Existing tools either lack automation or require proprietary software.

Impact

Spotty backups can lead to data loss, which for businesses means downtime, lost revenue, or compliance violations. For homelab users, it’s frustration and wasted time fixing broken backups. The lack of automation forces users to prioritize backups over other critical tasks, creating technical debt.

Urgency

This problem is urgent because manual backups are unreliable and prone to human error. Users can’t scale their backup processes without automation, and the risk of data loss grows as the number of external servers increases. The user explicitly states they want ‘less work to keep an eye on’ and ‘less frequent’ manual interventions.

Target Audience

Homelab enthusiasts, DevOps engineers, and sysadmins managing external servers (FTP/SSH/SFTP) who need automated, incremental backups. This includes users of Proxmox, self-hosted NAS, and small businesses with remote servers. Communities like r/selfhosted, r/proxmox, and r/homelab frequently discuss this pain point.

Solution Approach

A lightweight, open-source CLI tool that runs in an LXC container and automates incremental backups from external servers via FTP/SSH/SFTP. It schedules backups, tracks changes, and enforces retention policies (e.g., 7-day daily backups, 1-month weekly backups). The tool integrates with Proxmox PBS for local storage and can be monitored via a simple web UI (optional).

Key Features

1. Incremental backups: Only transfers new/changed files to minimize bandwidth and storage.
2. Retention policies: Automatically deletes old backups based on custom rules (e.g., ‘keep 7 daily backups’).
3. Proxmox PBS integration: Stores backups in a PBS-compatible directory for seamless local management.

User Experience

Users configure the tool once via a CLI wizard (e.g., ./backup-cli setup), defining remote servers, protocols, schedules, and retention rules. Backups run silently in the background, and users can check status via a web UI or logs. The tool notifies them of failures (e.g., via email or system alerts), reducing manual oversight. For Proxmox users, backups appear in PBS like any other dataset.

Differentiation

Unlike generic backup tools, this focuses on *external server automation- (FTP/SSH/SFTP) with *incremental updates- and retention policies—a gap in existing solutions. It’s designed for Proxmox/LXC users, avoiding Docker-only or desktop apps. The open-source GPL license and CLI-first approach align with the target audience’s preferences.

Scalability

The tool scales by adding more servers (per-server pricing) or users (team licensing). Retention policies reduce storage costs over time, and the web UI can be extended for multi-user management. Future features could include cloud sync (e.g., Backblaze B2) or database backup support, expanding use cases.

Expected Impact

Users save 5+ hours/week on manual backups and reduce data loss risk. Businesses avoid downtime costs, and homelab users gain peace of mind. The tool fits into existing 3-2-1 backup strategies, making it a ‘must-have’ for Proxmox/LXC users. Automated retention policies eliminate cleanup tasks, further reducing overhead.