roq-clickhouse

Purpose

  • Monitor event-logs streamed to a filesystem

  • Upload history to a Clickhouse timeseries database.

Conda

1conda install \
2  --channel https://roq-trading.com/conda/stable \
3  roq-clickhouse

1roq-clickhouse \
2      --name "clickhouse" \
3      --metrics_listen_address "$TCP_LISTEN_PORT" \
4      --event_log_dir "$EVENT_LOG_DIR" \
5      --flagfile "$FLAG_FILE"

Flags

1roq-clickhouse --help

--event_log_dir

One or more event-log directories

--event_log_exclude

One or more exclude regex patterns

--event_log_include

One or more include regex patterns

--uri

ClickHouse URI, e.g. tcp://localhost:8123

--username

Username (optional)

--password

Password (optional)

--retention_policy_time_to_live_days

Time-to-live (in days) (optional)

--print_ddl

Print the basic DDL script (useful for manually creating a database).

Environments

1# flagfile
2
3--uri=http://localhost:8123
4--database_name=roq
5--create_database=True
6--retention_policy_time_to_live_days=2