19824451 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 6 of 10
Priority 0
Tags ...
Node customer_api@10.10.1.214
Queue Time 00:00.929
Run Time 00:01.007
Inserted 22h ago
Scheduled 20h ago
Completed 20h ago (00:02)
Cancelled —
Discarded —

Args 

%{
  "account_id" => "90019",
  "date" => "2026-03-06",
  "query" => "users_reached",
  "window_days" => 7
}

Meta 

%{
  "deps" => ["generate_event_counts"],
  "name" => "generate_users_reached",
  "on_hold" => false,
  "orig_scheduled_at" => 1772760135145966,
  "recorded" => true,
  "return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-795a-7527-a21a-b641f6fc22c4"
}

Recorded Output 

%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}

Errors

Attempt 5—20h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "PTOR) (version 25.10.1.7375 (official build))\n"

    # 2
    55

    # 3
    67

    # 4
    ["uery: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRI", " with error. It can mean that some retryable error happened, or data is corrupted. Please retry the ", "e reading column user_id): (attempt to read data part all_21886005_22284903_36_22488012 (state Active) faile", "dd-9606900afe09:2096, kind: Regular, unbound: 0: (whi", "e: 4194304, reserved size: 4194304, downloader id: None, current write offset: 1463812096, caller id: da5d7c69-0009-4fc8-a", "74e4e5a68b19bd9bfc8d2, state: DOWNLOADED, downloaded si", "5dd-9606900afe09:2096, file segment info: File segment: [1459617792, 1463812095], key: 470c50b4c4", "l_position: 1462202295, internal buffer end: 2576717, read_type: CACHED, last caller: da5d7c69-0009-4fc8-", "yjflqohmigxvnnwtiri, hash key: 470c50b4c4774e4e5a68b19bd9bfc8d2, file_offset_of_buffer_end: 1462194509, read_unt", "rror: Cache info: Buffer path: ch-s3-30f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/dxa/fvnzpxwzu", "bd9bfc8d2/1459617792: , errno: 5, strerror: Input/output ", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/470/470c50b4c4774e4e5a68b1"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 4—20h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    " build))\n"

    # 2
    55

    # 3
    67

    # 4
    ["hedReadPool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.7375 (official", "e error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefet", " to read data part all_21886005_22284903_36_22488012 (state Active) failed with error. It can mean that some retryab", " id: 14581788-72c2-4f37-8e98-50763b41536c:2062, kind: Regular, unbound: 0: (while reading column user_id): (attemp", "d size: 4194304, reserved size: 4194304, downloader id: None, current write offset: 1463812096, calle", "1459617792, 1463812095], key: 470c50b4c4774e4e5a68b19bd9bfc8d2, state: DOWNLOADED, download", "e98-50763b41536c:2062, file segment info: File segment: ", "l_position: 1462202295, internal buffer end: 2576717, read_type: CACHED, last caller: 14581788-72c2-4f37-", "yjflqohmigxvnnwtiri, hash key: 470c50b4c4774e4e5a68b19bd9bfc8d2, file_offset_of_buffer_end: 1462194509, read_unt", "rror: Cache info: Buffer path: ch-s3-30f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/dxa/fvnzpxwzu", "bd9bfc8d2/1459617792: , errno: 5, strerror: Input/output ", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/470/470c50b4c4774e4e5a68b1"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 3—20h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "ild))\n"

    # 2
    43

    # 3
    67

    # 4
    ["eadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official bu", "MergeTreeSelect(pool: Prefetched", "ror. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executing", "17273_23386396_70_23386047 (state Active) failed with e", "d data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_22", "yhjowgdfnmjfzowyrobn (position: 11756204703, typename: DB::AsynchronousBoundedReadBuffer, compress", "lar, unbound: 0: While reading or decompressing ch-s3-226/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/seb/qmrsjfrl", "9a193fd-9c69-4900-84f7-72ec49de1b2a:1133, kind: Reg", "der id: 39a193fd-9c69-4900-84f7-72ec49de1b2a:1133, current write offset: 11752439808, caller id: ", "D_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downlo", "11752439808, 11756634111], key: 975f98ddce96141488b520b0b7fa13ba, state: PARTIALLY_DOWNLOAD", "4f7-72ec49de1b2a:1133, file segment info: File segment: ", "last caller: 39a193fd-9c69-4900-", "REMOTE_FS_READ_AND_PUT_IN_CACHE,", " 11756272153, internal buffer end: 11753488384, read_type:", "wyrobn, hash key: 975f98ddce96141488b520b0b7fa13ba, file_offset_of_buffer_end: 11756204703, read_until_position", "e info: Buffer path: ch-s3-226/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/seb/qmrsjfrlbyhjowgdfnmjfz", "set: 11752439808, caller id: 39a193fd-9c69-4900-84f7-72ec49de1b2a:1133, kind: Regular, unbound: 0: Cac", "ze: 0, reserved size: 1048576, downloader id: 39a193fd-9c69-4900-84f7-72ec49de1b2a:1133, current write of", "1488b520b0b7fa13ba, state: DOWNLOADING, downloaded s", "-only file system, current cache state: File segment: [11752439808, 11756634111], key: 975f98ddce961", "ache/sharedS3DiskCache/975/975f98ddce96141488b520b0b7fa13ba/11752439808: , errno: 30, strerror: Rea", "13ba/11752439808: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/975/975f98ddce96141488b520b0b7f"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 2—21h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "5 (official build))\n"

    # 2
    53

    # 3
    67

    # 4
    ["ool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.737", ", or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedRead", " It can mean that some retryable error happene", "(state Active) failed with error", "ar, unbound: 0: (while reading column user_id): (attempt to read data part all_21886005_22284903_36_22488012", "37880fe-57fa-4cc0-b6a0-88f53583f91e:1178, kind: Regu", ": 4194304, reserved size: 4194304, downloader id: None, current write offset: 1463812096, caller id: ", "4e4e5a68b19bd9bfc8d2, state: DOWNLOADED, downloaded siz", "6a0-88f53583f91e:1178, file segment info: File segment: [1459617792, 1463812095], key: 470c50b4c47", "l_position: 1462202295, internal buffer end: 2576717, read_type: CACHED, last caller: 437880fe-57fa-4cc0-", "yjflqohmigxvnnwtiri, hash key: 470c50b4c4774e4e5a68b19bd9bfc8d2, file_offset_of_buffer_end: 1462194509, read_unt", "rror: Cache info: Buffer path: ch-s3-30f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/dxa/fvnzpxwzu", "bd9bfc8d2/1459617792: , errno: 5, strerror: Input/output ", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/470/470c50b4c4774e4e5a68b1"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—21h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "R) (version 25.10.1.7375 (official build))\n"

    # 2
    55

    # 3
    67

    # 4
    ["cuting MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTO", "n mean that some retryable error happened, or data is corrupted. Please retry the query: While ex", "ttempt to read data part all_21886005_22284903_36_22488012 (state Active) failed with error. It c", "6228dfa-9ca9-4a5f-b890-eacfa3775fa1:1012, kind: Regular, unbound: 0: (while reading column user_id): (", ": 4194304, reserved size: 4194304, downloader id: None, current write offset: 1463812096, caller id: ", "4e4e5a68b19bd9bfc8d2, state: DOWNLOADED, downloaded siz", "890-eacfa3775fa1:1012, file segment info: File segment: [1459617792, 1463812095], key: 470c50b4c47", "l_position: 1462202295, internal buffer end: 2576717, read_type: CACHED, last caller: f6228dfa-9ca9-4a5f-", "yjflqohmigxvnnwtiri, hash key: 470c50b4c4774e4e5a68b19bd9bfc8d2, file_offset_of_buffer_end: 1462194509, read_unt", "rror: Cache info: Buffer path: ch-s3-30f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/dxa/fvnzpxwzu", "bd9bfc8d2/1459617792: , errno: 5, strerror: Input/output ", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/470/470c50b4c4774e4e5a68b1"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4