19822150
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.1.109
Queue Time
05:41.037
Run Time
00:02.745
Inserted
6h ago
Scheduled
5h ago
Completed
4h ago (00:03)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "81834",
"date" => "2026-03-06",
"query" => "event_counts",
"window_days" => 30
}
Meta
%{
"deps" => ["generate_user_counts"],
"name" => "generate_event_counts",
"on_hold" => false,
"orig_scheduled_at" => 1772757550080714,
"recorded" => true,
"return" => "g1AAAAGoeJxVkc9KxDAQh3NYPNhuqaIgeN4nEs8hSX/bDaZJyKQdRTz4ED6Lr+bR9M8uegl8HzOT3yRZCPHAV5jgM2lx+PkskFJIpCres+16ZOmC6tBpUX99c3V0gUnSKbDXQuyeue6DciQHS4ROCd6vnKDMqYgbbnwk2SEnZfI8WHA9G4+xKDfzfuaYwhAyloLrqHrIyYJLqPv3J67JJMCvqhTcDkFbB4nXiGThDdY267dshdp5Ko1pwtvF3f1xCRSDp6WzxaBsSa1yxhDzski1OSpvU7DZUIexXLdsupljOf+JEOEXce4xzpqXtUQr78uSl0SNitGMIHn+g/bjkRs9WtchbVLtfgF4OJv2",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-792b-7205-857c-9a953e716d3c"
}
Recorded Output
%{
events: 2488449,
errors: 11,
widget_loaded: 824759,
flows_shown: 1109,
goals_missed: 0,
goals_reached: 17,
nps_detractors: 0,
nps_neutrals: 0,
nps_promoters: 0,
page_views: 1407827,
screen_views: 0,
mobile_experiences: 0,
pins_shown: 0,
nps_survey_shown: 0,
nps_survey_responses: 0,
emails_attempted: 0,
emails_sent: 0,
emails_bounced: 0,
emails_failed: 0,
emails_opened: 0,
emails_clicked: 0,
banners_shown: 0,
appcues_events: 1080603,
builder_events: 4
}
Errors
Attempt 3—5h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"build))\n"
# 2
43
# 3
67
# 4
["(version 25.10.1.7375 (official ", "e retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE)", "t can mean that some retryable error happened, or data is corrupted. Plea", "g column timestamp): (attempt to read data part all_43206_46808_8_112386651 (state Active) failed with error. ", " (position: 518377982, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while readi", " or decompressing ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/abs/xhnfcplczdtlvaeaqwqkopncfawp", "ffset: 515899392, caller id: f2ef109a-a9ec-49a4-b86f-e45313aed572:2361, kind: Regular, unbound: 0: While readin", " f2ef109a-a9ec-49a4-b86f-e45313aed572:2361, current write ", "ADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id", "o: File segment: [515899392, 520093695], key: 1d8f02114e813949b1c505ace77935f1, state: PARTIALLY_DOWNL", "ead_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: f2ef109a-a9ec-49a4-b86f-e45313aed572:2361, file segment in", "internal buffer end: 516947968, ", "ey: 1d8f02114e813949b1c505ace77935f1, file_offset_of_buffer_end: 518377982, read_until_position: 518405508,", "th: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/abs/xhnfcplczdtlvaeaqwqkopncfawpz, hash ", "61, kind: Regular, unbound: 0: Cache info: Buffer p", "99392, caller id: f2ef109a-a9ec-49a4-b86f-e45313aed572:2", "ec-49a4-b86f-e45313aed572:2361, current write offset: 515", "LOADING, downloaded size: 0, reserved size: 1048576, downloader id: f2ef109a-a", "95], key: 1d8f02114e813949b1c505ace77935f1, state: DOW", "File segment: [515899392, 520093", " 30, strerror: Read-only file system, current cache state:", "em: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/1d8/1d8f02114e813949b1c505ace77935f1/515899392: , errno", "35f1/515899392: , errno: 30, strerror: Read-only file sys", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/1d8/1d8f02114e813949b1c505ace77"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—5h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
".10.1.7375 (official build))\n"
# 2
45
# 3
67
# 4
["le executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25", "e) failed with error. It can mean that some retryable error happened, or data is corrupted. Please retry the query: Wh", "ized>): (while reading column timestamp): (attempt to read data part all_43206_46808_8_112386651 (state Acti", "wqkopncfawpz (position: 518377982, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitia", "d: 0: While reading or decompressing ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/abs/xhnfcplczdtlvaea", "-4682-a6b9-90bb1705436d:1086, kind: Regular, unbou", "loader id: 79e8df08-c302-4682-a6b9-90bb1705436d:1086, current write offset: 515899392, caller id: 79e8df08-c30", "TIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, dow", " segment info: File segment: [515899392, 520093695], key: 1d8f02114e813949b1c505ace77935f1, state: PA", "_READ_AND_PUT_IN_CACHE, last caller: 79e8df08-c302-4682-a6b9-90bb1705436d:1086, fil", "r_end: 518377982, read_until_position: 518405508, internal buffer end: 516947968, read_type: REMOTE_F", "2114e813949b1c505ace77935f1, file_offset_of_buff", ": ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/abs/xhnfcplczdtlvaeaqwqkopncfawpz, hash key: 1d8f", ": 515899392, caller id: 79e8df08-c302-4682-a6b9-90bb1705436d:1086, kind: Regular, unbound: 0: Cache info: Buffer pat", "02-4682-a6b9-90bb1705436d:1086, current write offse", "LOADING, downloaded size: 0, reserved size: 1048576, downloader id: 79e8df08-c", "95], key: 1d8f02114e813949b1c505ace77935f1, state: DOW", "File segment: [515899392, 520093", " 30, strerror: Read-only file system, current cache state:", "em: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/1d8/1d8f02114e813949b1c505ace77935f1/515899392: , errno", "35f1/515899392: , errno: 30, strerror: Read-only file sys", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/1d8/1d8f02114e813949b1c505ace77"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—5h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
" (official build))\n"
# 2
43
# 3
67
# 4
[" MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375", "ith error. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executin", "ing column timestamp): (attempt to read data part all_43206_46808_8_112386651 (state Active) failed ", ": 518377982, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while rea", "r decompressing ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/abs/xhnfcplczdtlvaeaqwqkopncfawpz (positio", "e offset: 515899392, caller id: 15c6aa81-e500-40b2-a449-65e6f6f72f19:2393, kind: Regular, unbound: 0: While reading ", "wnloaded size: 0, reserved size: 1048576, downloader id: 15c6aa81-e500-40b2-a449-65e6f6f72f19:2393, current wri", "5f1, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, d", "899392, 520093695], key: 1d8f02114e813949b1c505ace779", "e6f6f72f19:2393, file segment info: File segment: [51", "fer end: 516947968, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 15c6aa81-e500-40b2-a449-6", " read_until_position: 518405508, internal bu", "eaqwqkopncfawpz, hash key: 1d8f02114e813949b1c505ace77935f1, file_offset_of_buffer_end: 518377982", ": 0: Cache info: Buffer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/abs/xhnfcplczdtlv", "00-40b2-a449-65e6f6f72f19:2393, kind: Regular, unboun", "515899392, caller id: 15c6aa81-e", "00-40b2-a449-65e6f6f72f19:2393, current write offset:", "LOADING, downloaded size: 0, reserved size: 1048576, downloader id: 15c6aa81-e", "95], key: 1d8f02114e813949b1c505ace77935f1, state: DOW", "File segment: [515899392, 520093", " 30, strerror: Read-only file system, current cache state:", "em: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/1d8/1d8f02114e813949b1c505ace77935f1/515899392: , errno", "35f1/515899392: , errno: 30, strerror: Read-only file sys", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/1d8/1d8f02114e813949b1c505ace77"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4