19833942
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.170
Queue Time
02:50.690
Run Time
00:01.980
Inserted
5h ago
Scheduled
3h ago
Completed
3h ago (00:02)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "222921",
"date" => "2026-03-06",
"query" => "event_counts",
"window_days" => 7
}
Meta
%{
"deps" => ["generate_user_counts"],
"name" => "generate_event_counts",
"on_hold" => false,
"orig_scheduled_at" => 1772758594162052,
"recorded" => true,
"return" => "g1AAAAGoeJxVkc1NxDAQhb0XDpBEK8SBAhDVcISzNXHeZi0c2/I4MZRBF9RAFZTEJM4iuFh6n+fnPTsrpe7LFRb4zL06PD2ISCkkEerwWNpihxFZu0ADBlLl5uRCYc3nUDyZ0oyBHOvJMm/XbdUJZM4b6HxkPSAnMlmmCmlW4jELcqtuVx1TmELGVnAdaYReLMpq4uO5NGwS4CuSgtsp9NZB4y0iWXiD2mb9xZgqx3Uqz2nB+y+7+8MSOAbPW+cRE1lxTTljirnm3BnLw6wxdtmHWdZtSXdykvMfCBG+Rt+Bcda81pKevJeQ1ZGEe/ksHcVoZrC+/IH6+i5dP1s3IO2Q1A9N2Ztj",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-7a6d-7307-88ee-111f580bbf44"
}
Recorded Output
%{
events: 85028,
errors: 294,
widget_loaded: 0,
flows_shown: 99,
goals_missed: 0,
goals_reached: 0,
nps_detractors: 0,
nps_neutrals: 0,
nps_promoters: 0,
page_views: 37204,
screen_views: 0,
mobile_experiences: 0,
pins_shown: 0,
nps_survey_shown: 0,
nps_survey_responses: 0,
emails_attempted: 0,
emails_sent: 0,
emails_bounced: 0,
emails_failed: 0,
emails_opened: 0,
emails_clicked: 0,
banners_shown: 21928,
appcues_events: 47824,
builder_events: 0
}
Errors
Attempt 3—3h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"ial build))\n"
# 2
43
# 3
67
# 4
["eSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offic", "ean that some retryable error happened, or data is corrupted. Please retry the query: While executing MergeTr", "state Active) failed with error. It can ", "d>): (while reading column attributes): (attempt to read data part all_21886005_22284903_36_22488012 ", "zxlwskoenbibskfb (position: 33549006285, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitializ", "e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlct", ": While reading or decompressing ch-s3-c6c/aa812", "64-4d41-83ae-220bd2d3c64e:2205, kind: Regular, unbound: ", "loader id: c5d3c1c3-2864-4d41-83ae-220bd2d3c64e:2205, current write offset: 33546043392, caller id: c5d3c1c3-2", "f9fca65, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, dow", "6043392, 33550237695], key: 8bdd623835f487b01cc7ef2d", "d3c64e:2205, file segment info: File segment: [335", "_FS_READ_AND_PUT_IN_CACHE, last caller: c5d3c1c3-2864-4d41-83ae-220bd", "nd: 33549006285, read_until_position: 33549351357, internal buffer end: 33547091968, read_type: REMOT", "3835f487b01cc7ef2def9fca65, file_offset_of_buffer_", " path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb, hash key: 8bdd6", "et: 33546043392, caller id: c5d3c1c3-2864-4d41-83ae-220bd2d3c64e:2205, kind: Regular, unbound: 0: Cache info: Buffe", "864-4d41-83ae-220bd2d3c64e:2205, current write off", "f2def9fca65, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: c5d3c1c3-", "3546043392, 33550237695], key: 8bdd623835f487b01cc7", "9fca65/33546043392: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/33546043392: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—3h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"E) (version 25.10.1.7375 (official build))\n"
# 2
45
# 3
67
# 4
["ergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FIL", "an that some retryable error happened, or data is corrupted. Please retry the query: While executing ", "03_36_22488012 (state Active) failed with error. It can m", "r: <uninitialized>): (while reading column attributes): (attempt to read data part all_21886005_22284", "egwywkjlctzzxlwskoenbibskfb (position: 33549006285, typename: DB::AsynchronousBoundedReadBuffer, compressed data head", "c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/b", "f4a-4bed-9f97-1d4cf60a957e:1086, kind: Regular, unbound: 0: While reading or decompressing ch-s3-c", "oader id: e29ea349-bf4a-4bed-9f97-1d4cf60a957e:1086, current write offset: 33546043392, caller id: e29ea349-", "ED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, down", " segment: [33546043392, 33550237695], key: 8bdd623835f487b01cc7ef2def9fca65, state: PARTIALLY_DOWNLOA", "-bf4a-4bed-9f97-1d4cf60a957e:1086, file segment info: Fil", "ion: 33549351357, internal buffer end: 33547091968, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: e29ea34", "sh key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 33549006285, read_until_posi", "fo: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb, h", "f97-1d4cf60a957e:1086, kind: Regular, unbound: 0: Cache i", "f4a-4bed-9f97-1d4cf60a957e:1086, current write offset: 33546043392, caller id: e29ea349-bf4a-4bed-", "f2def9fca65, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: e29ea349-", "3546043392, 33550237695], key: 8bdd623835f487b01cc7", "9fca65/33546043392: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/33546043392: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—4h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
" (official build))\n"
# 2
45
# 3
67
# 4
[" MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375", "r. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executin", "6005_22284903_36_22488012 (state Active) failed with err", "ffer, compressed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_218", "tree/ral/buegwywkjlctzzxlwskoenbibskfb (position: 33549006285, typename: DB::AsynchronousBoundedReadB", "r, unbound: 0: While reading or decompressing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/merg", "4fcc-4c9f-afd0-a43d46a370fc:1077, kind: Regul", "33546043392, caller id: 4abe9daf", "served size: 1048576, downloader id: 4abe9daf-4fcc-4c9f-afd0-a43d46a370fc:1077, current write offset:", "dd623835f487b01cc7ef2def9fca65, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, r", "-4fcc-4c9f-afd0-a43d46a370fc:1077, file segment info: File segment: [33546043392, 33550237695], key: 8", "ion: 33549351357, internal buffer end: 33547091968, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4abe9da", "sh key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 33549006285, read_until_posi", "th: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb, h", ": 33546043392, caller id: 4abe9daf-4fcc-4c9f-afd0-a43d46a370fc:1077, kind: Regular, unbound: 0: Cache info: Buffer p", "fcc-4c9f-afd0-a43d46a370fc:1077, current write offse", "f2def9fca65, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 4abe9daf-", "3546043392, 33550237695], key: 8bdd623835f487b01cc7", "9fca65/33546043392: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/33546043392: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4