19829611 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 5 of 10
Priority 0
Tags ...
Node customer_api@10.10.0.170
Queue Time 00:26.028
Run Time 00:00.762
Inserted 9h ago
Scheduled 7h ago
Completed 7h ago (00:01)
Cancelled —
Discarded —

Args 

%{
  "account_id" => "209848",
  "date" => "2026-03-06",
  "query" => "users_reached",
  "window_days" => 7
}

Meta 

%{
  "deps" => ["generate_event_counts"],
  "name" => "generate_users_reached",
  "on_hold" => false,
  "orig_scheduled_at" => 1772760439681943,
  "recorded" => true,
  "return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-79e1-7095-9d50-4d244dc13929"
}

Recorded Output 

%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}

Errors

Attempt 4—7h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "al build))\n"

    # 2
    43

    # 3
    67

    # 4
    ["Select(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offici", "at some retryable error happened, or data is corrupted. Please retry the query: While executing MergeTre", "2 (state Active) failed with error. It can mean t", "tialized>): (while reading column attributes): (attempt to read data part all_21886005_22284903_36_224880", "zzxlwskoenbibskfb (position: 22928747577, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <unin", "und: 0: While reading or decompressing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlc", "97d-421c-a7c0-fe687746a7e0:2377, kind: Regular, unb", "oader id: 6fe779ba-397d-421c-a7c0-fe687746a7e0:2377, current write offset: 22926065664, caller id: 6fe779ba-", "65, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, down", "664, 22930259967], key: 8bdd623835f487b01cc7ef2def9fc", "746a7e0:2377, file segment info: File segment: [2292606", ": 22927114240, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6fe779ba-397d-421c-a7c0-fe68", "7, read_until_position: 22928809691, internal buffer en", "al/buegwywkjlctzzxlwskoenbibskfb, hash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 229287475", "r, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/", "397d-421c-a7c0-fe687746a7e0:2377, kind: Regul", "22926065664, caller id: 6fe779ba", "served size: 1048576, downloader id: 6fe779ba-397d-421c-a7c0-fe687746a7e0:2377, current write offset:", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2926065664, 22930259967], key: 8bdd623835f487b01cc", "9fca65/22926065664: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22926065664: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 3—7h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "LE) (version 25.10.1.7375 (official build))\n"

    # 2
    43

    # 3
    67

    # 4
    [" query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FI", "ate Active) failed with error. It can mean that some retryable error happened, or data is corrupted. Please retry th", "zed>): (while reading column attributes): (attempt to read data part all_21886005_22284903_36_22488012 (s", "koenbibskfb (position: 22928747577, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitial", "ading or decompressing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlw", "eb8b5fd:2314, kind: Regular, unbound: 0: While r", "-8084-3a700eb8b5fd:2314, current write offset: 22926065664, caller id: fe681027-a0a7-43bc-8084-3a70", "N, downloaded size: 0, reserved size: 1048576, downloader id: fe681027-a0a7-43b", "ef2def9fca65, state: PARTIALLY_DOWNLOADED_NO_CONTINUATI", "2926065664, 22930259967], key: 8bdd623835f487b01cc", "eb8b5fd:2314, file segment info: File segment: [", ": 22927114240, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: fe681027-a0a7-43bc-8084-3a70", "7, read_until_position: 22928809691, internal buffer en", "al/buegwywkjlctzzxlwskoenbibskfb, hash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 229287475", "r, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/", "a0a7-43bc-8084-3a700eb8b5fd:2314, kind: Regul", "22926065664, caller id: fe681027", "served size: 1048576, downloader id: fe681027-a0a7-43bc-8084-3a700eb8b5fd:2314, current write offset:", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2926065664, 22930259967], key: 8bdd623835f487b01cc", "9fca65/22926065664: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22926065664: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 2—7h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "build))\n"

    # 2
    41

    # 3
    67

    # 4
    ["(version 25.10.1.7375 (official ", "e retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE)", "t can mean that some retryable error happened, or data is corrupted. Plea", "3_36_22488012 (state Active) failed with error. ", "ed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_21886005_222849", "7, typename: DB::AsynchronousBoundedReadBuffer, compres", "ing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb (position: 229287475", "2, kind: Regular, unbound: 0: While reading or decompres", ", caller id: 1f5f39bc-b596-4149-a135-2ba6d13fde5d:21", "-a135-2ba6d13fde5d:2182, current write offset: 2292606566", "downloader id: 1f5f39bc-b596-414", "f2def9fca65, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576,", "13fde5d:2182, file segment info: File segment: [22926065664, 22930259967], key: 8bdd623835f487b01cc7", ": 22927114240, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 1f5f39bc-b596-4149-a135-2ba6", "7, read_until_position: 22928809691, internal buffer en", "al/buegwywkjlctzzxlwskoenbibskfb, hash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 229287475", "r, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/", "b596-4149-a135-2ba6d13fde5d:2182, kind: Regul", "22926065664, caller id: 1f5f39bc", "served size: 1048576, downloader id: 1f5f39bc-b596-4149-a135-2ba6d13fde5d:2182, current write offset:", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2926065664, 22930259967], key: 8bdd623835f487b01cc", "9fca65/22926065664: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22926065664: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—7h ago 

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "build))\n"

    # 2
    40

    # 3
    67

    # 4
    ["(version 25.10.1.7375 (official ", "e retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE)", "t can mean that some retryable error happened, or data is corrupted. Plea", "3_36_22488012 (state Active) failed with error. ", "ed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_21886005_222849", "7, typename: DB::AsynchronousBoundedReadBuffer, compres", "ing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb (position: 229287475", ", kind: Regular, unbound: 0: While reading or decompres", "4, caller id: 92d46ad7-f461-4093-85e3-9cdb341af1b3:106", "e3-9cdb341af1b3:1067, current write offset: 229260656", "ION, downloaded size: 0, reserved size: 1048576, downloader id: 92d46ad7-f461-4093-8", "def9fca65, state: PARTIALLY_DOWNLOADED_NO_CONTINUA", "6065664, 22930259967], key: 8bdd623835f487b01cc7ef", "41af1b3:1067, file segment info: File segment: [229", ": 22927114240, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 92d46ad7-f461-4093-85e3-9cdb", "7, read_until_position: 22928809691, internal buffer en", "al/buegwywkjlctzzxlwskoenbibskfb, hash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 229287475", "r, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/", "f461-4093-85e3-9cdb341af1b3:1067, kind: Regul", "22926065664, caller id: 92d46ad7", "served size: 1048576, downloader id: 92d46ad7-f461-4093-85e3-9cdb341af1b3:1067, current write offset:", "ef2def9fca65, state: DOWNLOADING, downloaded size: 0, r", "2926065664, 22930259967], key: 8bdd623835f487b01cc", "9fca65/22926065664: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/22926065664: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4