19818618
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.170
Queue Time
06:43.730
Run Time
00:05.211
Inserted
4h ago
Scheduled
3h ago
Completed
3h ago (00:06)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "35027",
"date" => "2026-03-06",
"query" => "event_counts",
"window_days" => 7
}
Meta
%{
"deps" => ["generate_user_counts"],
"name" => "generate_event_counts",
"on_hold" => false,
"orig_scheduled_at" => 1772756943019467,
"recorded" => true,
"return" => "g1AAAAGieJxVkM1OwzAQhA1qQSppVCEq8RQ8Dzdr40xTC8e2vE4Wrki8Dw/GnSvOTxFcLM3n9Xhms1LqUW4wwmdu1PbjvYiUQmLayl5s2yFrF6hFS0ruTi4Iaz4H8XSUqgvkWPeWeb7eLzqBzHkGtY+sW+REJk+WV1JNxGMoyDFdy37SMYU+ZJSBjewiddCjhZQ4m69vqdgkwC+oeN73obEOGq8RycIbTHQXrb8EU3KYXHlII95W9iQPf1gCx+C5vLyVA3qyJTXljD7mpefKuGxlqrHKJgzlu7npSk7l/AdChF+qr8A4a16WkYa8LyV/U9YUoxnA+rJ99fwpdTNY1yKtkNQP5EGbSw",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-78bc-753a-b57f-1b9823a87c98"
}
Recorded Output
%{
events: 361858,
errors: 5,
widget_loaded: 0,
flows_shown: 21,
goals_missed: 0,
goals_reached: 0,
nps_detractors: 1,
nps_neutrals: 2,
nps_promoters: 4,
page_views: 322807,
screen_views: 0,
mobile_experiences: 0,
pins_shown: 0,
nps_survey_shown: 46,
nps_survey_responses: 7,
emails_attempted: 0,
emails_sent: 0,
emails_bounced: 0,
emails_failed: 0,
emails_opened: 0,
emails_clicked: 0,
banners_shown: 0,
appcues_events: 22704,
builder_events: 0
}
Errors
Attempt 3—3h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"sion 25.10.1.7375 (official build))\n"
# 2
43
# 3
67
# 4
["y the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (ver", "iled with error. It can mean that some retryable error happened, or data is corrupted. Please ret", "ized>): (while reading column timestamp): (attempt to read data part all_0_3337_8_112386651 (state Active) f", "::AsynchronousBoundedReadBuffer, compressed data header: <uninitia", "-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl (position: 123041980, typename: D", "0-0d0b43030b63:2321, kind: Regular, unbound: 0: While reading or decompressing ch-s3-aa8129e2-f47", "caller id: 72369aff-35dc-4545-a4", "current write offset: 121634816,", "ownloaded size: 0, reserved size: 1048576, downloader id: 72369aff-35dc-4545-a4a0-0d0b43030b63:2321,", "d57d4cb, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, ", "634816, 125829119], key: 764853d7fdea556dbff305a5", "30b63:2321, file segment info: File segment: [12", "ernal buffer end: 122683392, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 72369aff-35dc-4545-a4a0-0d0b43", "przl, hash key: 764853d7fdea556dbff305a56d57d4cb, file_offset_of_buffer_end: 123041980, read_until_position: 123077056, in", " info: Buffer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxa", "fset: 121634816, caller id: 72369aff-35dc-4545-a4a0-0d0b43030b63:2321, kind: Regular, unbound: 0: Cach", "9aff-35dc-4545-a4a0-0d0b43030b63:2321, current write o", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 723", "125829119], key: 764853d7fdea556", "state: File segment: [121634816,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/121634816: , errno: 3", "d4cb/121634816: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—3h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"25.10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["ile executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version ", "th error. It can mean that some retryable error happened, or data is corrupted. Please retry the query: W", " reading column timestamp): (attempt to read data part all_0_3337_8_112386651 (state Active) failed w", "sition: 123041980, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (whil", "compressing ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl (p", "5ac:1098, kind: Regular, unbound: 0: While reading or d", "ce45c3dc-61d8-4298-9a28-94a96a88", "ownloader id: ce45c3dc-61d8-4298-9a28-94a96a8875ac:1098, current write offset: 121634816, caller id:", "DED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, ", " 764853d7fdea556dbff305a56d57d4cb, state: PARTIALLY_DOWNLO", "ler: ce45c3dc-61d8-4298-9a28-94a96a8875ac:1098, file segment info: File segment: [121634816, 125829119], key", "ead_until_position: 123077056, internal buffer end: 122683392, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last ca", "d/gpymoiaqdlaglkiiixxighxazprzl, hash key: 764853d7fdea556dbff305a56d57d4cb, file_offset_of_buffer_end: 123041980, ", "uffer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/n", "ffset: 121634816, caller id: ce45c3dc-61d8-4298-9a28-94a96a8875ac:1098, kind: Regular, unbound: 0: Cache info: ", "c3dc-61d8-4298-9a28-94a96a8875ac:1098, current write ", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: ce4", "125829119], key: 764853d7fdea556", "state: File segment: [121634816,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/121634816: , errno: 3", "d4cb/121634816: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—3h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"E) (version 25.10.1.7375 (official build))\n"
# 2
42
# 3
67
# 4
["ergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FIL", "an that some retryable error happened, or data is corrupted. Please retry the query: While executing ", "_8_112386651 (state Active) failed with error. It can m", ", compressed data header: <uninitialized>): (while reading column timestamp): (attempt to read data part all_0_333", "DB::AsynchronousBoundedReadBuffe", "47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl (position: 123041980, typename:", "or decompressing ch-s3-aa8129e2-", "c889f:2279, kind: Regular, unbound: 0: While reading", "634816, caller id: 4156478a-2d4c-4cd3-8304-52c078", "cd3-8304-52c0784c889f:2279, current write offset: 12", "ate: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 4156478a-2d4c-", "16, 125829119], key: 764853d7fdea556dbff305a56d57d4cb, s", "c889f:2279, file segment info: File segment: [121634", "ernal buffer end: 122683392, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 4156478a-2d4c-4cd3-8304-52c078", "przl, hash key: 764853d7fdea556dbff305a56d57d4cb, file_offset_of_buffer_end: 123041980, read_until_position: 123077056, in", " info: Buffer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxa", "fset: 121634816, caller id: 4156478a-2d4c-4cd3-8304-52c0784c889f:2279, kind: Regular, unbound: 0: Cach", "478a-2d4c-4cd3-8304-52c0784c889f:2279, current write o", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 1048576, downloader id: 415", "125829119], key: 764853d7fdea556", "state: File segment: [121634816,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/121634816: , errno: 3", "d4cb/121634816: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4