19821279 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 8 of 10
Priority 0
Tags ...
Node customer_api@10.10.1.109
Queue Time 00:00.609
Run Time 00:00.580
Inserted 21h ago
Scheduled 19h ago
Completed 19h ago (00:01)
Cancelled
Discarded

Args

%{
  "account_id" => "129543",
  "date" => "2026-03-06",
  "query" => "users_reached",
  "window_days" => 1
}

Meta

%{
  "deps" => ["generate_event_counts"],
  "name" => "generate_users_reached",
  "on_hold" => false,
  "orig_scheduled_at" => 1772759760305157,
  "recorded" => true,
  "return" => "g1AAAABXeJwrYWBgYC7nLS1OLSqOL0pNTM5ITUliYODJK5dOKs3MSUktik8tS80riUdXwR9ULpFXUBxfXFpUllqJKp3IAAAFWh64",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-7903-70a2-971d-2921b21a9ff6"
}

Recorded Output

%{
  users_reached: 3182,
  builder_event_users_reached: 3922,
  nps_survey_users_reached: 0
}

Errors

Attempt 7—19h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "5 (official build))\n"

    # 2
    53

    # 3
    67

    # 4
    ["ool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.737", ", or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedRead", " It can mean that some retryable error happene", "umn account_id): (attempt to read data part all_8001707_8780928_70_22488012 (state Active) failed with error", "75, kind: Regular, unbound: 0: (while reading co", "ize: 3708715, downloader id: None, current write offset: 3708715, caller id: 5e847f9e-8cbd-477e-9b28-7c0ee23874fd:2", "egment: [0, 3708714], key: 79a959c592d083afe46faa582a7872e3, state: DOWNLOADED, downloaded size: 3708715, reserved ", "77e-9b28-7c0ee23874fd:2075, file segment info: File ", "position: 2335320, internal buffer end: 2335108, read_type: CACHED, last caller: 5e847f9e-8cbd-", "e3, file_offset_of_buffer_end: 2335108, read_until", "-8441591d3836/mergetree/ueq/qqpsoidpufsvhqxezfqzhcfchpbsx, hash key: 79a959c592d083afe46faa582a787", " Cache info: Buffer path: ch-s3-9ea/aa8129e2-f47e-4b75-bbc", "82a7872e3/0: , errno: 5, strerror: Input/output error", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/79a/79a959c592d083afe46faa"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 6—19h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "5 (official build))\n"

    # 2
    53

    # 3
    67

    # 4
    ["ool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.737", ", or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedRead", " It can mean that some retryable error happene", "umn account_id): (attempt to read data part all_8001707_8780928_70_22488012 (state Active) failed with error", "68, kind: Regular, unbound: 0: (while reading co", "ize: 3708715, downloader id: None, current write offset: 3708715, caller id: db51cc13-85df-4f45-8c04-49023e54863d:2", "egment: [0, 3708714], key: 79a959c592d083afe46faa582a7872e3, state: DOWNLOADED, downloaded size: 3708715, reserved ", "f45-8c04-49023e54863d:2068, file segment info: File ", "position: 2335161, internal buffer end: 2334949, read_type: CACHED, last caller: db51cc13-85df-", "e3, file_offset_of_buffer_end: 2334949, read_until", "-8441591d3836/mergetree/ueq/qqpsoidpufsvhqxezfqzhcfchpbsx, hash key: 79a959c592d083afe46faa582a787", " Cache info: Buffer path: ch-s3-9ea/aa8129e2-f47e-4b75-bbc", "82a7872e3/0: , errno: 5, strerror: Input/output error", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/79a/79a959c592d083afe46faa"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 5—19h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "5 (official build))\n"

    # 2
    53

    # 3
    67

    # 4
    ["ool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.737", ", or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedRead", " It can mean that some retryable error happene", "umn account_id): (attempt to read data part all_8001707_8780928_70_22488012 (state Active) failed with error", "76, kind: Regular, unbound: 0: (while reading co", "ize: 3708715, downloader id: None, current write offset: 3708715, caller id: 9b49356c-5b71-4a89-9706-da4a2dd088e8:2", "egment: [0, 3708714], key: 79a959c592d083afe46faa582a7872e3, state: DOWNLOADED, downloaded size: 3708715, reserved ", "a89-9706-da4a2dd088e8:2076, file segment info: File ", "position: 2335161, internal buffer end: 2334949, read_type: CACHED, last caller: 9b49356c-5b71-", "e3, file_offset_of_buffer_end: 2334949, read_until", "-8441591d3836/mergetree/ueq/qqpsoidpufsvhqxezfqzhcfchpbsx, hash key: 79a959c592d083afe46faa582a787", " Cache info: Buffer path: ch-s3-9ea/aa8129e2-f47e-4b75-bbc", "82a7872e3/0: , errno: 5, strerror: Input/output error", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/79a/79a959c592d083afe46faa"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 4—19h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "ool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.7375 (official build))\n"

    # 2
    55

    # 3
    67

    # 4
    ["r happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadP", "can mean that some retryable err", "n timestamp): (attempt to read data part all_7702421_8001706_36_22488012 (state Active) failed with error. It", "aller id: 210c5675-8856-4442-8c71-0b12103ea5d9:2036, kind: Regular, unbound: 0: (while reading colu", "ded size: 4194304, reserved size: 4194304, downloader id: None, current write offset: 553648128, ", "t info: File segment: [549453824, 553648127], key: 4600de250f6bec65a9e963c4890cd47e, state: DOWNLOADED, downlo", "fer end: 135164, read_type: CACHED, last caller: 210c5675-8856-4442-8c71-0b12103ea5d9:2036, file segme", "49588988, read_until_position: 549610320, internal bu", "0f6bec65a9e963c4890cd47e, file_offset_of_buffer_end: ", "8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ase/amwdguomkencpfdjtamcgbvkknrqq, hash key: 4600de2", "4890cd47e/549453824: , errno: 5, strerror: Input/output error: Cache info: Buffer path: ch-s3-4e5/a", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/460/4600de250f6bec65a9e963"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 3—19h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "ool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25.10.1.7375 (official build))\n"

    # 2
    55

    # 3
    67

    # 4
    ["r happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadP", "can mean that some retryable err", "n timestamp): (attempt to read data part all_7702421_8001706_36_22488012 (state Active) failed with error. It", "aller id: 34d1728a-90ec-436e-96fa-cb5ff2c279e7:2099, kind: Regular, unbound: 0: (while reading colu", "ded size: 4194304, reserved size: 4194304, downloader id: None, current write offset: 553648128, ", "t info: File segment: [549453824, 553648127], key: 4600de250f6bec65a9e963c4890cd47e, state: DOWNLOADED, downlo", "fer end: 135164, read_type: CACHED, last caller: 34d1728a-90ec-436e-96fa-cb5ff2c279e7:2099, file segme", "49588988, read_until_position: 549610320, internal bu", "0f6bec65a9e963c4890cd47e, file_offset_of_buffer_end: ", "8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ase/amwdguomkencpfdjtamcgbvkknrqq, hash key: 4600de2", "4890cd47e/549453824: , errno: 5, strerror: Input/output error: Cache info: Buffer path: ch-s3-4e5/a", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/460/4600de250f6bec65a9e963"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 2—20h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "M_FILE_DESCRIPTOR) (version 25.10.1.7375 (official build))\n"

    # 2
    54

    # 3
    67

    # 4
    ["ergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_READ_FRO", "an that some retryable error happened, or data is corrupted. Please retry the query: While executing ", "mn account_id): (attempt to read data part all_8001707_8780928_70_22488012 (state Active) failed with error. It can m", "64, kind: Regular, unbound: 0: (while reading col", "ize: 3708715, downloader id: None, current write offset: 3708715, caller id: beb4e5ac-dc17-4469-9408-bde04d6e4767:1", "egment: [0, 3708714], key: 79a959c592d083afe46faa582a7872e3, state: DOWNLOADED, downloaded size: 3708715, reserved ", "469-9408-bde04d6e4767:1164, file segment info: File ", "position: 2335161, internal buffer end: 2334949, read_type: CACHED, last caller: beb4e5ac-dc17-", "e3, file_offset_of_buffer_end: 2334949, read_until", "-8441591d3836/mergetree/ueq/qqpsoidpufsvhqxezfqzhcfchpbsx, hash key: 79a959c592d083afe46faa582a787", " Cache info: Buffer path: ch-s3-9ea/aa8129e2-f47e-4b75-bbc", "82a7872e3/0: , errno: 5, strerror: Input/output error", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/79a/79a959c592d083afe46faa"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—20h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    ".10.1.7375 (official build))\n"

    # 2
    54

    # 3
    67

    # 4
    ["g MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_READ_FROM_FILE_DESCRIPTOR) (version 25", "n that some retryable error happened, or data is corrupted. Please retry the query: While executi", "unt_id): (attempt to read data part all_8001707_8780928_70_22488012 (state Active) failed with error. It can me", "03, kind: Regular, unbound: 0: (while reading column acc", "ize: 3708715, downloader id: None, current write offset: 3708715, caller id: cf5f8ef1-ac5b-4c02-a192-ad63d51c5543:1", "egment: [0, 3708714], key: 79a959c592d083afe46faa582a7872e3, state: DOWNLOADED, downloaded size: 3708715, reserved ", "c02-a192-ad63d51c5543:1803, file segment info: File ", "position: 2335320, internal buffer end: 2335108, read_type: CACHED, last caller: cf5f8ef1-ac5b-", "e3, file_offset_of_buffer_end: 2335108, read_until", "-8441591d3836/mergetree/ueq/qqpsoidpufsvhqxezfqzhcfchpbsx, hash key: 79a959c592d083afe46faa582a787", " Cache info: Buffer path: ch-s3-9ea/aa8129e2-f47e-4b75-bbc", "82a7872e3/0: , errno: 5, strerror: Input/output error", "de: 74. DB::Exception: Cannot read from file /mnt/clickhouse-cache/sharedS3DiskCache/79a/79a959c592d083afe46faa"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4