19860142 CustomerApi.Jobs.AnomalyMonitorJob
Queue anomaly_monitors
Attempt 1 of 1
Priority 0
Tags ...
Node customer_api@10.10.1.214
Queue Time 00:00.014
Run Time 00:00.088
Inserted 4h ago
Scheduled 4h ago
Completed
Cancelled
Discarded 4h ago

Args

%{"monitor_id" => "be8ac33a-cb65-4467-a63c-0cb9c4b920bf"}

Meta

%{
  "cron" => true,
  "cron_expr" => "0 * * * *",
  "cron_name" => "be8ac33a-cb65-4467-a63c-0cb9c4b920bf",
  "cron_tz" => "Etc/UTC",
  "partition" => true,
  "partition_key" => "23IntOh7EG1yWdaSThucC7PtZFXTJYIxJFo9G7BNwww",
  "structured" => true
}

Errors

Attempt 1—4h ago

** (Ch.Error) Code: 74. DB::ErrnoException: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/304/30462fdcc66616c1d3a92f22ac16f548/0: , errno: 5, strerror: Input/output error: Cache info: Buffer path: ch-s3-c5c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/zko/fnmcyglvdlowwetkldoqfhuyjepqi, hash key: 30462fdcc66616c1d3a92f22ac16f548, file_offset_of_buffer_end: 0, read_until_position: 30397, internal buffer end: 0, read_type: CACHED, last caller: ba1fa41d-e697-4e37-8168-fdbfc1c2ac4b:40498, file segment info: File segment: [0, 1426985], key: 30462fdcc66616c1d3a92f22ac16f548, state: DOWNLOADED, downloaded size: 1426986, reserved size: 1426986, downloader id: None, current write offset: 1426986, caller id: ba1fa41d-e697-4e37-8168-fdbfc1c2ac4b:40498, kind: Regular, unbound: 0. (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.7375 (official build))

    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:1113: Ecto.Adapters.SQL.raise_sql_call_error/1
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:19: Ecto.Repo.Queryable.all/3
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:163: Ecto.Repo.Queryable.one/3
    (customer_api 1.21.0+0fcb3e63) lib/customer_api/data/click_house/anomaly_monitor_stats.ex:21: CustomerApi.Data.ClickHouse.AnomalyMonitorStats.stats/1
    (customer_api 1.21.0+0fcb3e63) lib/customer_api/jobs/anomaly_monitor_job.ex:59: anonymous fn/1 in CustomerApi.Jobs.AnomalyMonitorJob.process/1
    (appcues_metrics 3.0.3) lib/appcues_metrics.ex:338: Appcues.Metrics.record_fn_time/3