19833499
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.159
Queue Time
00:21.956
Run Time
00:02.510
Inserted
6h ago
Scheduled
4h ago
Completed
4h ago (00:03)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "221630",
"date" => "2026-03-06",
"query" => "users_reached",
"window_days" => 7
}
Meta
%{
"deps" => ["generate_event_counts"],
"name" => "generate_users_reached",
"on_hold" => false,
"orig_scheduled_at" => 1772761448802348,
"recorded" => true,
"return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUmcWS6dVJqZk5JaFJ9alppXEo8qzVAukVdQHF9cWlSWWokuBwCzBB50",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-7a63-7b4e-966d-6f097eadd9e4"
}
Recorded Output
%{
users_reached: 153,
builder_event_users_reached: 0,
nps_survey_users_reached: 0
}
Errors
Attempt 3—4h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
".10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["le executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25", "e) failed with error. It can mean that some retryable error happened, or data is corrupted. Please retry the query: Wh", "ding column attributes): (attempt to read data part all_22284904_22717272_59_22712811 (state Acti", "r (position: 21722466473, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while re", "ompressing ch-s3-bfe/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/mhl/zoyfsiydchbjoddekclxlygyiuu", "aller id: 1da73ad3-49b7-47b5-b282-f1bbd6ef770c:1040, kind: Regular, unbound: 0: While reading or de", "2-f1bbd6ef770c:1040, current write offset: 21722300416, ", "ION, downloaded size: 0, reserved size: 166057, downloader id: 1da73ad3-49b7-47b5-b2", "5fcf52e, state: PARTIALLY_DOWNLOADED_NO_CONTINUA", " 21726494719], key: cfcde61893b81e4dcf4d018d", "70c:1040, file segment info: File segment: [21722300416", "S_READ_AND_PUT_IN_CACHE, last caller: 1da73ad3-49b7-47b5-b282-f1bbd6ef", "39, internal buffer end: 21723348992, read_type: REMOTE_", "ey: cfcde61893b81e4dcf4d018d05fcf52e, file_offset_of_buffer_end: 21722466473, read_until_position: 21722534", "1d3836/mergetree/mhl/zoyfsiydchbjoddekclxlygyiuuzr, hash ", "770c:1040, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-bfe/aa8129e2-f47e-4b75-bbcb-84415", "0416, caller id: 1da73ad3-49b7-47b5-b282-f1bbd6e", "-b282-f1bbd6ef770c:1040, current write offset: 217223", "cf52e, state: DOWNLOADING, downloaded size: 0, reserved size: 166057, downloader id: 1da73ad3-49b7-47b", "nly file system, current cache state: File segment: [21722300416, 21726494719], key: cfcde61893b81e4dcf4d018d05", "he/sharedS3DiskCache/cfc/cfcde61893b81e4dcf4d018d05fcf52e/21722300416: , errno: 30, strerror: Read-", "f52e/21722300416: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-ca", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/cfc/cfcde61893b81e4dcf4d018d05f"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—4h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"hread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
46
# 3
67
# 4
[" data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: T", "some retryable error happened, o", "tes): (attempt to read data part all_22284904_22717272_59_22712811 (state Active) failed with error. It can mean that", "ame: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column attrib", "3-bfe/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/mhl/zoyfsiydchbjoddekclxlygyiuuzr (position: 21722466473, type", "397-de1d-45d0-937d-1821bd4271cc:1520, kind: Regular, unbound: 0: While reading or decompressing ch-", "er id: 0784c397-de1d-45d0-937d-1821bd4271cc:1520, current write offset: 21722300416, caller id: 0784", "_NO_CONTINUATION, downloaded size: 0, reserved size: 166057, downloa", "le segment: [21722300416, 21726494719], key: cfcde61893b81e4dcf4d018d05fcf52e, state: PARTIALLY_DOWNLOADE", "-de1d-45d0-937d-1821bd4271cc:1520, file segment info: F", "ion: 21722534839, internal buffer end: 21723348992, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 0784c39", "sh key: cfcde61893b81e4dcf4d018d05fcf52e, file_offset_of_buffer_end: 21722466473, read_until_posi", "fo: Buffer path: ch-s3-bfe/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/mhl/zoyfsiydchbjoddekclxlygyiuuzr, h", "bd4271cc:1520, kind: Regular, unbound: 0: Cache i", "722300416, caller id: 0784c397-de1d-45d0-937d-182", "-937d-1821bd4271cc:1520, current write offset: 2", "cf52e, state: DOWNLOADING, downloaded size: 0, reserved size: 166057, downloader id: 0784c397-de1d-45d", "nly file system, current cache state: File segment: [21722300416, 21726494719], key: cfcde61893b81e4dcf4d018d05", "he/sharedS3DiskCache/cfc/cfcde61893b81e4dcf4d018d05fcf52e/21722300416: , errno: 30, strerror: Read-", "f52e/21722300416: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-ca", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/cfc/cfcde61893b81e4dcf4d018d05f"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—4h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"dReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
46
# 3
67
# 4
["ryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefetche", "tempt to read data part all_22284904_22717272_59_22712811 (state Active) failed with error. It can mean that some re", "ronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column attributes): (a", "21722466473, typename: DB::Async", "mpressing ch-s3-bfe/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/mhl/zoyfsiydchbjoddekclxlygyiuuzr (position:", "unbound: 0: While reading or dec", " 30917be7-eb7f-406e-84a9-51fb4530b235:1769, kind: Regular,", "ize: 166057, downloader id: 30917be7-eb7f-406e-84a9-51fb4530b235:1769, current write offset: 21722300416, caller id", "RTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved ", "gment info: File segment: [21722300416, 21726494719], key: cfcde61893b81e4dcf4d018d05fcf52e, state: P", "D_PUT_IN_CACHE, last caller: 30917be7-eb7f-406e-84a9-51fb4530b235:1769, file s", "_end: 21722466473, read_until_position: 21722534839, internal buffer end: 21723348992, read_type: REMOTE_FS_READ_A", "e/mhl/zoyfsiydchbjoddekclxlygyiuuzr, hash key: cfcde61893b81e4dcf4d018d05fcf52e, file_offset_of_buffe", "uffer path: ch-s3-bfe/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetr", "0b235:1769, kind: Regular, unbound: 0: Cache info: ", "-84a9-51fb4530b235:1769, current write offset: 21722300416, caller id: 30917be7-eb7f-406e-84a9-51fb45", "cf52e, state: DOWNLOADING, downloaded size: 0, reserved size: 166057, downloader id: 30917be7-eb7f-406", "nly file system, current cache state: File segment: [21722300416, 21726494719], key: cfcde61893b81e4dcf4d018d05", "he/sharedS3DiskCache/cfc/cfcde61893b81e4dcf4d018d05fcf52e/21722300416: , errno: 30, strerror: Read-", "f52e/21722300416: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-ca", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/cfc/cfcde61893b81e4dcf4d018d05f"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4