19825715 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 4 of 10
Priority 0
Tags ...
Node customer_api@10.10.0.158
Queue Time 00:00.680
Run Time 00:02.947
Inserted 9h ago
Scheduled 8h ago
Completed 8h ago (00:03)
Cancelled —
Discarded —

Args 

%{
  "account_id" => "200135",
  "date" => "2026-03-06",
  "query" => "users_reached",
  "window_days" => 30
}

Meta 

%{
  "deps" => ["generate_event_counts"],
  "name" => "generate_users_reached",
  "on_hold" => false,
  "orig_scheduled_at" => 1772762125831385,
  "recorded" => true,
  "return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-7995-7576-9a56-ede5168305d0"
}

Recorded Output 

%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}

Errors

Attempt 3—8h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "edReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    43

    # 3
    67

    # 4
    ["yable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefetch", "error. It can mean that some ret", "hile reading column timestamp): (attempt to read data part all_12396311_12661295_36_22488012 (state Active) failed with", "tion: 486539264, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (", "ssing ch-s3-890/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/kbe/thtxwbxroafmpswjtipikkrwaqapk (pos", "3, kind: Regular, unbound: 0: While reading or decompr", "4, caller id: c2792615-0dea-4160-b1f2-adf13e9af551:441", "-adf13e9af551:44163, current write offset: 4865392", "CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: c2792615-0dea-4160-b1f", "6c096593188bde6d0, state: PARTIALLY_DOWNLOADED_NO", " File segment: [486539264, 490733567], key: 8d4f6b2b8d03d4", "2615-0dea-4160-b1f2-adf13e9af551:44163, file segment info", "sition: 486559674, internal buffer end: 487587840, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: c27", "d0, file_offset_of_buffer_end: 486539264, read_until_p", "-8441591d3836/mergetree/kbe/thtxwbxroafmpswjtipikkrwaqapk, hash key: 8d4f6b2b8d03d416c096593188bde", " Cache info: Buffer path: ch-s3-890/aa8129e2-f47e-4b75-bbc", "adf13e9af551:44163, kind: Regular, unbound: 0", "ea-4160-b1f2-adf13e9af551:44163, current write offset: 486539264, caller id: c2792615-0dea-4160-b1f2", "LOADING, downloaded size: 0, reserved size: 1048576, downloader id: c2792615-0", "ystem, current cache state: File segment: [486539264, 490733567], key: 8d4f6b2b8d03d416c096593188bde6d0, state: DOW", "bde6d0/486539264: , errno: 30, strerror: Read-only file ", "sharedS3DiskCache/8d4/8d4f6b2b8d03d416c09659318", "e6d0/486539264: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8d4/8d4f6b2b8d03d416c096593188b"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 2—8h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "lgorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    46

    # 3
    67

    # 4
    ["pened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, a", "art all_12396311_12661295_36_22488012 (state Active) failed with error. It can mean that some retryable error ha", "er, compressed data header: <uninitialized>): (while reading column timestamp): (attempt to read data ", "tree/kbe/thtxwbxroafmpswjtipikkrwaqapk (position: 486539264, typename: DB::AsynchronousBoundedReadBuf", "r, unbound: 0: While reading or decompressing ch-s3-890/aa8129e2-f47e-4b75-bbcb-8441591d3836/merg", "53a408-2fc3-40bb-8447-94c41da3e8b5:42217, kind: Regul", "der id: d553a408-2fc3-40bb-8447-94c41da3e8b5:42217, current write offset: 486539264, caller id: d", "D_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downlo", "t info: File segment: [486539264, 490733567], key: 8d4f6b2b8d03d416c096593188bde6d0, state: PARTIALLY_DOWNLOAD", "2fc3-40bb-8447-94c41da3e8b5:42217, file segme", "n: 486559674, internal buffer end: 487587840, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: d553a408", "sh key: 8d4f6b2b8d03d416c096593188bde6d0, file_offset_of_buffer_end: 486539264, read_until_positi", "fo: Buffer path: ch-s3-890/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/kbe/thtxwbxroafmpswjtipikkrwaqapk, h", "c41da3e8b5:42217, kind: Regular, unbound: 0: Cache i", "c3-40bb-8447-94c41da3e8b5:42217, current write offset: 486539264, caller id: d553a408-2fc3-40bb-8447-9", "LOADING, downloaded size: 0, reserved size: 1048576, downloader id: d553a408-2", "ystem, current cache state: File segment: [486539264, 490733567], key: 8d4f6b2b8d03d416c096593188bde6d0, state: DOW", "bde6d0/486539264: , errno: 30, strerror: Read-only file ", "sharedS3DiskCache/8d4/8d4f6b2b8d03d416c09659318", "e6d0/486539264: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8d4/8d4f6b2b8d03d416c096593188b"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—8h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "efetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    44

    # 3
    67

    # 4
    ["rror happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Pr", "ead data part all_12396311_12661295_36_22488012 (state Active) failed with error. It can mean that some retryable ", "nousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column timestamp): (attempt to ", "486539264, typename: DB::Asynchr", "mpressing ch-s3-890/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/kbe/thtxwbxroafmpswjtipikkrwaqapk (position:", "unbound: 0: While reading or dec", "565349-995d-4b7e-9c32-e44b4d2126d3:42702, kind: Regular,", "der id: 48565349-995d-4b7e-9c32-e44b4d2126d3:42702, current write offset: 486539264, caller id: 4", "D_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downlo", "t info: File segment: [486539264, 490733567], key: 8d4f6b2b8d03d416c096593188bde6d0, state: PARTIALLY_DOWNLOAD", "995d-4b7e-9c32-e44b4d2126d3:42702, file segme", "n: 486559674, internal buffer end: 487587840, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 48565349", "sh key: 8d4f6b2b8d03d416c096593188bde6d0, file_offset_of_buffer_end: 486539264, read_until_positi", "r path: ch-s3-890/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/kbe/thtxwbxroafmpswjtipikkrwaqapk, h", ":42702, kind: Regular, unbound: 0: Cache info: Buff", "539264, caller id: 48565349-995d-4b7e-9c32-e44b4d2126d", "5d-4b7e-9c32-e44b4d2126d3:42702, current write offset: 48", "LOADING, downloaded size: 0, reserved size: 1048576, downloader id: 48565349-9", "ystem, current cache state: File segment: [486539264, 490733567], key: 8d4f6b2b8d03d416c096593188bde6d0, state: DOW", "bde6d0/486539264: , errno: 30, strerror: Read-only file ", "sharedS3DiskCache/8d4/8d4f6b2b8d03d416c09659318", "e6d0/486539264: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8d4/8d4f6b2b8d03d416c096593188b"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4