19826635 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 4 of 10
Priority 0
Tags ...
Node customer_api@10.10.0.159
Queue Time 00:42.243
Run Time 00:00.389
Inserted 3h ago
Scheduled 1h ago
Completed 1h ago (00:01)
Cancelled
Discarded

Args

%{
  "account_id" => "206047",
  "date" => "2026-03-06",
  "query" => "users_reached",
  "window_days" => 7
}

Meta

%{
  "deps" => ["generate_event_counts"],
  "name" => "generate_users_reached",
  "on_hold" => false,
  "orig_scheduled_at" => 1772761252485941,
  "recorded" => true,
  "return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKpdOKs3MSUktik8tS80riUeVZiiXyCsoji8uLSpLrUSXAwCPoB3d",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-79a8-755f-9f5e-8b3c589fce50"
}

Recorded Output

%{users_reached: 2, builder_event_users_reached: 0, nps_survey_users_reached: 0}

Errors

Attempt 3—1h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "dReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    42

    # 3
    67

    # 4
    ["ryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefetche", "t to read data part all_21886005_22284903_36_22488012 (state Active) failed with error. It can mean that some re", "chronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column attributes): (attem", "position: 22809036799, typename: DB::Asy", "441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb ", "d64:2128, kind: Regular, unbound: 0: While reading or decompressing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-", "e8cb85c6-8131-42b2-8bb9-5c3360a1", "28, current write offset: 22808625152, caller id:", ", downloader id: e8cb85c6-8131-42b2-8bb9-5c3360a1fd64:2", "ALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 41164", "ment info: File segment: [22808625152, 22812819455], key: 8bdd623835f487b01cc7ef2def9fca65, state: PART", "HE, last caller: e8cb85c6-8131-42b2-8bb9-5c3360a1fd64:2128, file se", "809673728, read_type: REMOTE_FS_READ_AND_PUT_IN_CA", "ca65, file_offset_of_buffer_end: 22809036799, read_until_position: 22809564382, internal buffer end: 2", "key: 8bdd623835f487b01cc7ef2def9", ": Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb, hash", "60a1fd64:2128, kind: Regular, unbound: 0: Cache inf", "2808625152, caller id: e8cb85c6-8131-42b2-8bb9-5c3", "served size: 411647, downloader id: e8cb85c6-8131-42b2-8bb9-5c3360a1fd64:2128, current write offset: ", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2808625152, 22812819455], key: 8bdd623835f487b01cc", "9fca65/22808625152: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22808625152: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 2—1h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "ool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    42

    # 3
    67

    # 4
    ["r happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadP", "can mean that some retryable err", "903_36_22488012 (state Active) failed with error. It", "read data part all_21886005_2228", "dBuffer, compressed data header: <uninitialized>): (while reading column attributes): (attempt to", "rgetree/ral/buegwywkjlctzzxlwskoenbibskfb (position: 22809036799, typename: DB::AsynchronousBoundedRe", "s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/m", "1a51eab-356e-4f99-ae50-c20ddf462cad:2161, kind: Regular, unbound: 0: While reading or decompressing ch", "der id: f1a51eab-356e-4f99-ae50-c20ddf462cad:2161, current write offset: 22808625152, caller id: ", "9fca65, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 411647, downlo", "5152, 22812819455], key: 8bdd623835f487b01cc7ef2de", "cad:2161, file segment info: File segment: [228086", "f1a51eab-356e-4f99-ae50-c20ddf46", "osition: 22809564382, internal buffer end: 22809673728, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller:", "oenbibskfb, hash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 22809036799, read_until_", "8441591d3836/mergetree/ral/buegwywkjlctzzxlws", "df462cad:2161, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb", "2808625152, caller id: f1a51eab-356e-4f99-ae50-c20", "served size: 411647, downloader id: f1a51eab-356e-4f99-ae50-c20ddf462cad:2161, current write offset: ", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2808625152, 22812819455], key: 8bdd623835f487b01cc", "9fca65/22808625152: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22808625152: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—1h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "ool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    44

    # 3
    67

    # 4
    ["r happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadP", "can mean that some retryable err", "903_36_22488012 (state Active) failed with error. It", "eader: <uninitialized>): (while reading column attributes): (attempt to read data part all_21886005_2228", "lctzzxlwskoenbibskfb (position: 22809036799, typename: DB::AsynchronousBoundedReadBuffer, compressed data ", "bound: 0: While reading or decompressing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywk", "4793-bcec-0c6f73caa731:1057, kind: Regular, u", "ader id: 0bef6059-efeb-4793-bcec-0c6f73caa731:1057, current write offset: 22808625152, caller id: 0bef6059-efeb", "ED_NO_CONTINUATION, downloaded size: 0, reserved size: 411647, downl", " segment: [22808625152, 22812819455], key: 8bdd623835f487b01cc7ef2def9fca65, state: PARTIALLY_DOWNLOA", "-efeb-4793-bcec-0c6f73caa731:1057, file segment info: Fil", "ion: 22809564382, internal buffer end: 22809673728, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 0bef605", "b, hash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 22809036799, read_until_posi", "41591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibsk", "73caa731:1057, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8", "2808625152, caller id: 0bef6059-efeb-4793-bcec-0c6", "served size: 411647, downloader id: 0bef6059-efeb-4793-bcec-0c6f73caa731:1057, current write offset: ", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2808625152, 22812819455], key: 8bdd623835f487b01cc", "9fca65/22808625152: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22808625152: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4