On-Prem Setup
Install benchmax on your own infrastructure, connect your data, and start monitoring AI agent conversations.
Requirements
- Linux server (Ubuntu, Debian, Amazon Linux, RHEL, or Fedora)
- 2GB+ free disk space
- Port 80 open (and 443 if you want SSL later)
- An OpenAI API key
1. Install
Run the bootstrap script to install Docker, Docker Compose, and Python if missing, then download benchmax:
curl -sSL https://raw.githubusercontent.com/rishabhjain30/recordroom-onprem/main/bootstrap.sh | bashIf Docker was just installed, log out and back in for permissions to take effect. Then run the installer:
cd /opt/recordroom && bash scripts/install.shYou'll be asked for:
- Domain or IP address (default: localhost)
- HTTP port (default: 80)
- Database — built-in Postgres (recommended) or external
- OpenAI API key
- Admin email, password, and name
Once complete, open http://<your-server-ip> in your browser and log in.
2. Set Up Your Data Source
Install the benchmax CLI on your local machine and point it at your server:
npm install -g @recordroom/cli
recordroom config set server http://YOUR-SERVER-IP
recordroom auth loginThen copy the setup guide below and paste it to your coding agent (Claude Code, Cursor, etc.) along with your server URL. The agent will walk you through connecting your database, configuring sync, writing a parser, and setting up quality analysis.
Setup Guide for Your Coding Agent
Your agent will walk you through:
- Connecting your database
- Exploring your schema
- Configuring sync
- Writing inbox/detail queries
- Writing a trace parser
- Setting up quality analysis skills
Paste this into Claude Code, Cursor, or any AI coding agent
3. Day-to-Day Commands
All commands run from /opt/recordroom:
| Command | What it does |
|---|---|
| bash scripts/status.sh | Check service health |
| bash scripts/logs.sh [service] [-n lines] | View logs |
| bash scripts/restart.sh [service] | Restart services |
| bash scripts/backup.sh | Backup database |
| bash scripts/restore.sh <file> | Restore from backup |
| bash scripts/upgrade.sh [version] | Upgrade to new version |
4. Enable SSL (Optional)
If you have a domain pointed at your server:
bash scripts/enable-ssl.sh yourdomain.comGets a free Let's Encrypt certificate, configures HTTPS, sets up auto-renewal, and redirects HTTP to HTTPS.
5. Upgrade
cd /opt/recordroom
bash scripts/upgrade.sh 1.0.4Backs up your database, pulls new images, runs migrations, and restarts services. Rolls back automatically if the health check fails.
Troubleshooting
Docker permission denied after install
Log out and back in, then re-run install.sh
Services not starting
Run bash scripts/logs.sh backend -n 50 and bash scripts/status.sh
Forgot admin password
Sign up again at the login page.
Config files
App config: /opt/recordroom/.env
Nginx: /opt/recordroom/nginx/nginx.conf
Need help? Contact [email protected]