19832962
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.159
Queue Time
02:54.013
Run Time
00:06.785
Inserted
1d ago
Scheduled
23h ago
Completed
23h ago (00:07)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "220642",
"date" => "2026-03-06",
"query" => "event_counts",
"window_days" => 30
}
Meta
%{
"deps" => ["generate_user_counts"],
"name" => "generate_event_counts",
"on_hold" => false,
"orig_scheduled_at" => 1772758526878950,
"recorded" => true,
"return" => "g1AAAAHDeJxVkV1KAzEUhSNqwXamFBGqCC7DXYgbEEKSOW2jmSQkmV5dgL67CRchrsA3X3zSvZjMtKW+BM7HuT/nJjHGzmmENWyKkv186CxCcCELVn9TTbpZInHjRINGsipd0mRhHEUeV46sZIdXz1QtnTCRtzpGNIJRPegAoValis1/aWp95A1SECoN7Y9uqCrQosvUFHSgqC7IB9e6hN42eqGxF0vwtQZlkF7vqYoqAHZAeeBp66Q24Hj0CBpWodCx13a3Jzv+olnpHbuwxtMOv8/pbA8HRO9sRJlcXdMMrdA5ikgJrU99usmGxXyzLKcbKV2X5/bxN2SR33/AedgebGuU0ephsEhhbQ487FUswnvVIfLt39x+XtBUdto0CDt4cvf2B8LhovQ",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-7a58-7fb2-9638-87f6899b1dfc"
}
Recorded Output
%{
events: 14466153,
errors: 3542,
widget_loaded: 816155,
flows_shown: 204421,
goals_missed: 0,
goals_reached: 6109,
nps_detractors: 1101,
nps_neutrals: 355,
nps_promoters: 1670,
page_views: 7639402,
screen_views: 0,
mobile_experiences: 0,
pins_shown: 1489,
nps_survey_shown: 47639,
nps_survey_responses: 3126,
emails_attempted: 0,
emails_sent: 0,
emails_bounced: 0,
emails_failed: 0,
emails_opened: 0,
emails_clicked: 0,
banners_shown: 0,
appcues_events: 5229081,
builder_events: 613542
}
Errors
Attempt 3—23h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"dReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
43
# 3
67
# 4
["ryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefetche", "t to read data part all_12396311_12661295_36_22488012 (state Active) failed with error. It can mean that some re", "reading column identity): (attem", "qdcm (position: 34191691401, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while", " or decompressing ch-s3-88f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/arr/scdujhlwlpkygscxwaegfata", "e offset: 34187771904, caller id: 8d520ee9-011b-4bc1-b529-511dc269dc56:1582, kind: Regular, unbound: 0: While readin", "011b-4bc1-b529-511dc269dc56:1582, current wri", "NTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 8d520ee9", "state: PARTIALLY_DOWNLOADED_NO_C", "4191966207], key: a9378aa78d62fc44f41c80df7dbe15d4,", ":1582, file segment info: File segment: [34187771904, ", "ND_PUT_IN_CACHE, last caller: 8d520ee9-011b-4bc1-b529-511dc269dc5", "d: 34191691401, read_until_position: 34193396197, internal buffer end: 34188820480, read_type: REMOTE_FS_READ_", " a9378aa78d62fc44f41c80df7dbe15d4, file_offset_of_buffer_e", "h-s3-88f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/arr/scdujhlwlpkygscxwaegfatazqdcm, hash key", "1582, kind: Regular, unbound: 0: Cache info: Buffer path: ", "7771904, caller id: 8d520ee9-011b-4bc1-b529-511dc269dc56", "ize: 0, reserved size: 1048576, downloader id: 8d520ee9-011b-4bc1-b529-511dc269dc56:1582, current write offset: 341", "2fc44f41c80df7dbe15d4, state: DOWNLOADING, downloaded ", " File segment: [34187771904, 34191966207], key: a9378aa78d", "file system, current cache state", "/sharedS3DiskCache/a93/a9378aa78d62fc44f41c80df7dbe15d4/34187771904: , errno: 30, strerror: Read-only", "15d4/34187771904: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cach", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/a93/a9378aa78d62fc44f41c80df7db"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—23h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"lgorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
43
# 3
67
# 4
["pened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, a", "art all_12396311_12661295_36_22488012 (state Active) failed with error. It can mean that some retryable error ha", "fer, compressed data header: <uninitialized>): (while reading column identity): (attempt to read data ", "4191691401, typename: DB::AsynchronousBoundedReadBu", "ng ch-s3-88f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/arr/scdujhlwlpkygscxwaegfatazqdcm (position: ", "9, kind: Regular, unbound: 0: While reading or decompress", ", caller id: 6d132097-942b-4131-9ab4-b5fa9c1ab03e:22", ": 1048576, downloader id: 6d132097-942b-4131-9ab4-b5fa9c1ab03e:2299, current write offset: 3418777190", "downloaded size: 0, reserved siz", "5d4, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION,", ":2299, file segment info: File segment: [34187771904, 34191966207], key: a9378aa78d62fc44f41c80df7dbe", "ND_PUT_IN_CACHE, last caller: 6d132097-942b-4131-9ab4-b5fa9c1ab03", "d: 34191691401, read_until_position: 34193396197, internal buffer end: 34188820480, read_type: REMOTE_FS_READ_", " a9378aa78d62fc44f41c80df7dbe15d4, file_offset_of_buffer_e", "h-s3-88f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/arr/scdujhlwlpkygscxwaegfatazqdcm, hash key", "2299, kind: Regular, unbound: 0: Cache info: Buffer path: ", "7771904, caller id: 6d132097-942b-4131-9ab4-b5fa9c1ab03e", "ize: 0, reserved size: 1048576, downloader id: 6d132097-942b-4131-9ab4-b5fa9c1ab03e:2299, current write offset: 341", "2fc44f41c80df7dbe15d4, state: DOWNLOADING, downloaded ", " File segment: [34187771904, 34191966207], key: a9378aa78d", "file system, current cache state", "/sharedS3DiskCache/a93/a9378aa78d62fc44f41c80df7dbe15d4/34187771904: , errno: 30, strerror: Read-only", "15d4/34187771904: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cach", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/a93/a9378aa78d62fc44f41c80df7db"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—23h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"dReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
43
# 3
67
# 4
["ryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefetche", "t to read data part all_12396311_12661295_36_22488012 (state Active) failed with error. It can mean that some re", "reading column identity): (attem", "qdcm (position: 34191691401, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while", " or decompressing ch-s3-88f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/arr/scdujhlwlpkygscxwaegfata", "e offset: 34187771904, caller id: 101c5a48-df56-4421-8db5-1540ea785008:1040, kind: Regular, unbound: 0: While readin", "df56-4421-8db5-1540ea785008:1040, current wri", "NTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 101c5a48", "state: PARTIALLY_DOWNLOADED_NO_C", "91966207], key: a9378aa78d62fc44f41c80df7dbe15d4,", ":1040, file segment info: File segment: [34187771904, 34", "ND_PUT_IN_CACHE, last caller: 101c5a48-df56-4421-8db5-1540ea78500", "d: 34191691401, read_until_position: 34193396197, internal buffer end: 34188820480, read_type: REMOTE_FS_READ_", " a9378aa78d62fc44f41c80df7dbe15d4, file_offset_of_buffer_e", "h-s3-88f/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/arr/scdujhlwlpkygscxwaegfatazqdcm, hash key", "1040, kind: Regular, unbound: 0: Cache info: Buffer path: ", "7771904, caller id: 101c5a48-df56-4421-8db5-1540ea785008", "ize: 0, reserved size: 1048576, downloader id: 101c5a48-df56-4421-8db5-1540ea785008:1040, current write offset: 341", "2fc44f41c80df7dbe15d4, state: DOWNLOADING, downloaded ", " File segment: [34187771904, 34191966207], key: a9378aa78d", "file system, current cache state", "/sharedS3DiskCache/a93/a9378aa78d62fc44f41c80df7dbe15d4/34187771904: , errno: 30, strerror: Read-only", "15d4/34187771904: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cach", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/a93/a9378aa78d62fc44f41c80df7db"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4