19827295 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 3 of 10
Priority 0
Tags ...
Node customer_api@10.10.0.159
Queue Time 02:25.000
Run Time 00:00.862
Inserted 16h ago
Scheduled 14h ago
Completed 14h ago (00:01)
Cancelled
Discarded

Args

%{
  "account_id" => "207897",
  "date" => "2026-03-06",
  "query" => "users_reached",
  "window_days" => 7
}

Meta

%{
  "deps" => ["generate_event_counts"],
  "name" => "generate_users_reached",
  "on_hold" => false,
  "orig_scheduled_at" => 1772761269141470,
  "recorded" => true,
  "return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-79b5-7e87-b80a-ecad27d73ea0"
}

Recorded Output

%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}

Errors

Attempt 2—14h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "cial build))\n"

    # 2
    44

    # 3
    67

    # 4
    ["g MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offi", "n that some retryable error happened, or data is corrupted. Please retry the query: While executi", "488012 (state Active) failed with error. It can me", "lized>): (while reading column attributes): (attempt to read data part all_21555100_21886004_39_2", "wbbu (position: 19129647824, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uniniti", "ng or decompressing ch-s3-f5c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wvf/idbrdejafwayreqmpmhxwquf", "ffset: 19126026240, caller id: a16c76ca-d73b-4b18-bb3b-ece556394da2:2402, kind: Regular, unbound: 0: While read", "c76ca-d73b-4b18-bb3b-ece556394da2:2402, current write ", ": PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: a1", "0543], key: 69d309e37e9d94388dfb6ed896b8e6f8, stat", "ast caller: a16c76ca-d73b-4b18-bb3b-ece556394da2:2402, file segment info: File segment: [19126026240, 191302", " 19127074816, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, ", "19129783567, internal buffer end", "ufjwbbu, hash key: 69d309e37e9d94388dfb6ed896b8e6f8, file_offset_of_buffer_end: 19129647824, read_until_position:", "5-bbcb-8441591d3836/mergetree/wvf/idbrdejafwayreqmpmhxw", "-ece556394da2:2402, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-f5c/aa8129e2-f47e-4b", "-4b18-bb3b-ece556394da2:2402, current write offset: 19126026240, caller id: a16c76ca-d73b-4b18-bb3", "8e6f8, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: a16c76ca-d73", "le system, current cache state: File segment: [19126026240, 19130220543], key: 69d309e37e9d94388dfb6ed896", "errno: 30, strerror: Read-only f", "ystem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/69d/69d309e37e9d94388dfb6ed896b8e6f8/19126026240: ,", "e6f8/19126026240: , errno: 30, strerror: Read-only file ", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/69d/69d309e37e9d94388dfb6ed896b"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—14h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "build))\n"

    # 2
    42

    # 3
    67

    # 4
    ["(version 25.10.1.7375 (official ", "e retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE)", "t can mean that some retryable error happened, or data is corrupted. Plea", "4_39_22488012 (state Active) failed with error. ", "ed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_21555100_218860", "dbrdejafwayreqmpmhxwqufjwbbu (position: 19129647824, typename: DB::AsynchronousBoundedReadBuffer, compres", "c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wvf/", "reading or decompressing ch-s3-f", "36fc1265e:2161, kind: Regular, unbound: 0: While", "9126026240, caller id: 6a59cedb-5a00-4603-a102-90", "3-a102-90036fc1265e:2161, current write offset: ", "e: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 6a59cedb-5a00-46", "ile segment info: File segment: [19126026240, 19130220543], key: 69d309e37e9d94388dfb6ed896b8e6f8, sta", "E_FS_READ_AND_PUT_IN_CACHE, last caller: 6a59cedb-5a00-4603-a102-90036fc1265e:2161, ", "783567, internal buffer end: 19127074816, read_type: REMO", "qufjwbbu, hash key: 69d309e37e9d94388dfb6ed896b8e6f8, file_offset_of_buffer_end: 19129647824, read_until_position: 1912", " info: Buffer path: ch-s3-f5c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wvf/idbrdejafwayreqmpmhx", "t: 19126026240, caller id: 6a59cedb-5a00-4603-a102-90036fc1265e:2161, kind: Regular, unbound: 0: Cach", "-4603-a102-90036fc1265e:2161, current write offs", "8e6f8, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 6a59cedb-5a0", "le system, current cache state: File segment: [19126026240, 19130220543], key: 69d309e37e9d94388dfb6ed896", "errno: 30, strerror: Read-only f", "ystem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/69d/69d309e37e9d94388dfb6ed896b8e6f8/19126026240: ,", "e6f8/19126026240: , errno: 30, strerror: Read-only file ", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/69d/69d309e37e9d94388dfb6ed896b"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4