quickwit v0.1.0

Quickwit — a fast, cloud-native search engine for logs, traces and analytics, with sub-second search over object storage. Deployed as a single host-networked Nomad service.

nomad-pack run quickwit --registry nomploy

…or one line (add registry + run)

curl -fsSL https://packs.nomploy.com/install.sh | sh -s -- quickwit

Needs nomad-pack on PATH. The script only adds the nomploy registry and runs this pack.

Source ↗ Project ↗ ★ 11.7k ⚑ Report an issue

2 tasks http 7280 1 volume image quickwit/quickwit:latest tracks :latest image bumped today

Variables 8

values.hcl

Save as values.hcl, edit, then run:

nomad-pack run quickwit -f values.hcl --registry nomploy

# The name of the Nomad job.
job_name = "quickwit"

# The Nomad namespace to deploy into.
namespace = "default"

# The datacenters to deploy to.
datacenters = ["*"]

# The Quickwit container image. Pin a tag in production.
image = "quickwit/quickwit:latest"

# Host port for the REST API / web UI (QW_REST_LISTEN_PORT).
port = 7280

# Named volume mounted at /quickwit/qwdata (indexes and metadata).
data_volume = "quickwit_data"

# Placement constraints. On a nomploy cluster: attribute = "$${meta.nomploy_control_plane}", operator = "=", value = "true".
constraints = []

# The task resources.
resources = {
    cpu    = 300
    memory = 256
  }

Name	Type	Default	Description
job_name	string	"quickwit"	The name of the Nomad job.
namespace	string	"default"	The Nomad namespace to deploy into.
datacenters	list	["*"]	The datacenters to deploy to.
image	string	"quickwit/quickwit:latest"	The Quickwit container image. Pin a tag in production.
port	number	7280	Host port for the REST API / web UI (QW_REST_LISTEN_PORT).
data_volume	string	"quickwit_data"	Named volume mounted at /quickwit/qwdata (indexes and metadata).
constraints	list	[]	Placement constraints. On a nomploy cluster: attribute = "$${meta.nomploy_control_plane}", operator = "=", value = "true".
resources	object	{ cpu = 300 memory = 256 }	The task resources.

Back up this pack

This pack stores data in one Docker named volume: quickwit_data

restic

# Run on the node hosting this pack. Point restic at your repo first:
#   export RESTIC_REPOSITORY="s3:https://<account>.r2.cloudflarestorage.com/<bucket>"
#   export RESTIC_PASSWORD="<repo-password>"
#   export AWS_ACCESS_KEY_ID=<key>  AWS_SECRET_ACCESS_KEY=<secret>
restic backup \
  /var/lib/docker/volumes/quickwit_data/_data

rclone (sync to S3/R2)

rclone sync /var/lib/docker/volumes/quickwit_data/_data backup:<bucket>/quickwit_data

Paths assume the default Docker volume location (/var/lib/docker/volumes). Restore by stopping the job, restoring files into the same volume, and re-running the pack.

Readme

quickwit

Quickwit — a fast, cloud-native search engine for logs, traces and analytics. It delivers sub-second full-text search with a small footprint, is OTEL-native (ingest logs and traces directly), and can store indexes on local disk or object storage. A lightweight alternative to an Elasticsearch cluster for observability data.

Single host-networked Nomad service with a persistent index volume.

Deploy

nomad-pack registry add nomploy https://github.com/Nomploy/nomad-packs
nomad-pack run quickwit --registry=nomploy

Configure

Variable	Default	Description
`port`	`7280`	REST API / web UI port (`QW_REST_LISTEN_PORT`).
`image`	`quickwit/quickwit:latest`	Container image. Pin a tag in production.
`data_volume`	`quickwit_data`	`/quickwit/qwdata` — indexes and metadata.
`resources`	`{ cpu = 300, memory = 256 }`	Task resources. Bump for heavy ingestion/search.

Open the UI at http://<host>:7280, then create indexes and push data via the REST API or the OTLP endpoints. A prestart init task makes the data volume writable. To scale storage, point Quickwit at S3/rustfs and back the metastore with postgres. Pin the job to the node holding the volume with constraints.