19832482 CustomerApi.Jobs.GenerateAccountMetrics
Queue clickhouse_account_metrics
Attempt 4 of 10
Priority 0
Tags ...
Node customer_api@10.10.0.170
Queue Time 02:56.016
Run Time 00:06.927
Inserted 11h ago
Scheduled 9h ago
Completed 9h ago (00:07)
Cancelled
Discarded

Args

%{
  "account_id" => "218786",
  "date" => "2026-03-06",
  "query" => "event_counts",
  "window_days" => 30
}

Meta

%{
  "deps" => ["generate_user_counts"],
  "name" => "generate_event_counts",
  "on_hold" => false,
  "orig_scheduled_at" => 1772758484121248,
  "recorded" => true,
  "return" => "g1AAAAGueJxVkV9KxDAQhyPIPqzbsoiIRxAP4jVCmvy2DaZJyKSNgm/eQhAfPI638QRO/2zRl8D38ZvJTJKFEHdlhxE+UyM+3n4YUgqJQaT3UhVrWmTpgjIwSpSrkwuFJHWheI58fZdDG5Qj2VuiOVEtnKB0B8OZfVdqH0ka5KR05t6cOkzGY2DlJq4mjin0IWMO7KNqIUeLwqO87j7LgXQC/KI4cN2HxjpIPEckC6+xlFm/jsd0nLrSkEa8bO7mj0ugGDzNlUf0yvLgKmf0MS/bro74eRjrFZsw8HXzsqs58flPhAg/i3ONdlY/LZFGec9LbhPVKkY9gOT5G24f70vdDNYZpE1eXD78AjIPndA",
  "structured" => true,
  "workflow" => true,
  "workflow_id" => "019cc07f-7a4f-7751-abda-090608a99246"
}

Recorded Output

%{
  events: 10322930,
  errors: 29338,
  widget_loaded: 0,
  flows_shown: 41931,
  goals_missed: 0,
  goals_reached: 2664,
  nps_detractors: 0,
  nps_neutrals: 0,
  nps_promoters: 0,
  page_views: 8128159,
  screen_views: 0,
  mobile_experiences: 0,
  pins_shown: 0,
  nps_survey_shown: 0,
  nps_survey_responses: 0,
  emails_attempted: 0,
  emails_sent: 0,
  emails_bounced: 0,
  emails_failed: 0,
  emails_opened: 0,
  emails_clicked: 0,
  banners_shown: 0,
  appcues_events: 1459752,
  builder_events: 66602
}

Errors

Attempt 3—9h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "hread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"

    # 2
    45

    # 3
    67

    # 4
    [" data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: T", "some retryable error happened, o", "d data part all_91457979_91873571_40_112386651 (state Active) failed with error. It can mean that", "onousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column timestamp): (attempt to re", "1321122563, typename: DB::Asynch", "mpressing ch-s3-eb6/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wjb/sepdyjkqvdlwxlqzcvipfnjslaajt (position:", "unbound: 0: While reading or dec", "3e87b1c-d80d-4db2-9b2d-4aa8070dbe79:2307, kind: Regular,", "307, current write offset: 1317011456, caller id: ", "6, downloader id: 83e87b1c-d80d-4db2-9b2d-4aa8070dbe79:", ": 9631dc22e7d626c2f19edbdd6d0a7154, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 10485", "er: 83e87b1c-d80d-4db2-9b2d-4aa8070dbe79:2307, file segment info: File segment: [1317011456, 1321205759], ke", "_position: 1321154659, internal buffer end: 1318060032, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last cal", "njslaajt, hash key: 9631dc22e7d626c2f19edbdd6d0a7154, file_offset_of_buffer_end: 1321122563, read_unti", " info: Buffer path: ch-s3-eb6/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wjb/sepdyjkqvdlwxlqzcvip", "set: 1317011456, caller id: 83e87b1c-d80d-4db2-9b2d-4aa8070dbe79:2307, kind: Regular, unbound: 0: Cach", "ze: 0, reserved size: 1048576, downloader id: 83e87b1c-d80d-4db2-9b2d-4aa8070dbe79:2307, current write of", "f19edbdd6d0a7154, state: DOWNLOADING, downloaded s", "-only file system, current cache state: File segment: [1317011456, 1321205759], key: 9631dc22e7d626c", "che/sharedS3DiskCache/963/9631dc22e7d626c2f19edbdd6d0a7154/1317011456: , errno: 30, strerror: Rea", "7154/1317011456: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-c", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/963/9631dc22e7d626c2f19edbdd6d0"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 2—9h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "E) (version 25.10.1.7375 (official build))\n"

    # 2
    46

    # 3
    67

    # 4
    ["ergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FIL", "or. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executing ", "979_91873571_40_112386651 (state Active) failed with er", "ffer, compressed data header: <uninitialized>): (while reading column timestamp): (attempt to read data part all_9145", "321122563, typename: DB::AsynchronousBoundedReadB", " ch-s3-eb6/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wjb/sepdyjkqvdlwxlqzcvipfnjslaajt (position: ", "e9e78e5-c648-416b-b57c-f237efed5e6a:2163, kind: Regular, unbound: 0: While reading or decompressin", "163, current write offset: 1317011456, caller id: ", "6, downloader id: be9e78e5-c648-416b-b57c-f237efed5e6a:", ": 9631dc22e7d626c2f19edbdd6d0a7154, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 10485", "er: be9e78e5-c648-416b-b57c-f237efed5e6a:2163, file segment info: File segment: [1317011456, 1321205759], ke", "_position: 1321154659, internal buffer end: 1318060032, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last cal", "njslaajt, hash key: 9631dc22e7d626c2f19edbdd6d0a7154, file_offset_of_buffer_end: 1321122563, read_unti", " info: Buffer path: ch-s3-eb6/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wjb/sepdyjkqvdlwxlqzcvip", "set: 1317011456, caller id: be9e78e5-c648-416b-b57c-f237efed5e6a:2163, kind: Regular, unbound: 0: Cach", "ze: 0, reserved size: 1048576, downloader id: be9e78e5-c648-416b-b57c-f237efed5e6a:2163, current write of", "f19edbdd6d0a7154, state: DOWNLOADING, downloaded s", "-only file system, current cache state: File segment: [1317011456, 1321205759], key: 9631dc22e7d626c", "che/sharedS3DiskCache/963/9631dc22e7d626c2f19edbdd6d0a7154/1317011456: , errno: 30, strerror: Rea", "7154/1317011456: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-c", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/963/9631dc22e7d626c2f19edbdd6d0"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4

Attempt 1—9h ago

** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4

The following arguments were given to Ch.RowBinary.decode_names/4:

    # 1
    "d))\n"

    # 2
    45

    # 3
    67

    # 4
    ["ool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official buil", ", or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedRead", " It can mean that some retryable error happene", "79_91873571_40_112386651 (state Active) failed with error", ", compressed data header: <uninitialized>): (while reading column timestamp): (attempt to read data part all_91457", "22563, typename: DB::AsynchronousBoundedReadBuffe", "-s3-eb6/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wjb/sepdyjkqvdlwxlqzcvipfnjslaajt (position: 1321", "fb64416-2594-470f-a33b-9023cd4f6c91:2371, kind: Regular, unbound: 0: While reading or decompressing c", "371, current write offset: 1317011456, caller id: ", "6, downloader id: efb64416-2594-470f-a33b-9023cd4f6c91:", ": 9631dc22e7d626c2f19edbdd6d0a7154, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 10485", "er: efb64416-2594-470f-a33b-9023cd4f6c91:2371, file segment info: File segment: [1317011456, 1321205759], ke", "_position: 1321154659, internal buffer end: 1318060032, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last cal", "njslaajt, hash key: 9631dc22e7d626c2f19edbdd6d0a7154, file_offset_of_buffer_end: 1321122563, read_unti", " info: Buffer path: ch-s3-eb6/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/wjb/sepdyjkqvdlwxlqzcvip", "set: 1317011456, caller id: efb64416-2594-470f-a33b-9023cd4f6c91:2371, kind: Regular, unbound: 0: Cach", "ze: 0, reserved size: 1048576, downloader id: efb64416-2594-470f-a33b-9023cd4f6c91:2371, current write of", "f19edbdd6d0a7154, state: DOWNLOADING, downloaded s", "-only file system, current cache state: File segment: [1317011456, 1321205759], key: 9631dc22e7d626c", "che/sharedS3DiskCache/963/9631dc22e7d626c2f19edbdd6d0a7154/1317011456: , errno: 30, strerror: Rea", "7154/1317011456: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-c", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/963/9631dc22e7d626c2f19edbdd6d0"]

    (ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
    (ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
    (db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
    (db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
    (ch 0.7.1) lib/ch.ex:94: Ch.query/4
    (ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
    (ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
    (ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4