19826527
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.159
Queue Time
02:23.501
Run Time
00:04.237
Inserted
3h ago
Scheduled
1h ago
Completed
1h ago (00:05)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "205218",
"date" => "2026-03-06",
"query" => "users_reached",
"window_days" => 7
}
Meta
%{
"deps" => ["generate_event_counts"],
"name" => "generate_users_reached",
"on_hold" => false,
"orig_scheduled_at" => 1772760313000540,
"recorded" => true,
"return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-79a6-7781-877e-ea5d92011903"
}
Recorded Output
%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}
Errors
Attempt 3—1h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"refetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
43
# 3
67
# 4
["ome retryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: P", "8012 (state Active) failed with error. It can mean that ", "lized>): (while reading column attributes): (attempt to read data part all_5522313_5549930_17_224", "compressed data header: <uniniti", " 37833095297, typename: DB::AsynchronousBoundedReadBuffer,", "h-s3-4e0/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/lqk/mrnrocgtgcgaadodotaotzzksdfci (position", " unbound: 0: While reading or decompressing ", "2c70-5503-4cf6-98b0-450548527096:2295, kind: Regular", "6:2295, current write offset: 37832622080, caller id: b42", " 473217, downloader id: b4242c70-5503-4cf6-98b0-4505485270", "ac7a44d642fc6a87b4, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size", "37836816383], key: 14bddb800df7a", "95, file segment info: File segment: [37832622080,", " end: 37833670656, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: b4242c70-5503-4cf6-98b0-450548527096:2", "297, read_until_position: 37833896902, internal buffe", "gaadodotaotzzksdfci, hash key: 14bddb800df7abac7a44d642fc6a87b4, file_offset_of_buffer_end: 3783309", ": 0: Cache info: Buffer path: ch-s3-4e0/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/lqk/mrnrocgtg", "03-4cf6-98b0-450548527096:2295, kind: Regular, unboun", "4242c70-5503-4cf6-98b0-450548527096:2295, current write offset: 37832622080, caller id: b4242c70-5", "ac7a44d642fc6a87b4, state: DOWNLOADING, downloaded size: 0, reserved size: 473217, downloader id: ", "-only file system, current cache state: File segment: [37832622080, 37836816383], key: 14bddb800df7a", "ache/sharedS3DiskCache/14b/14bddb800df7abac7a44d642fc6a87b4/37832622080: , errno: 30, strerror: Rea", "87b4/37832622080: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/14b/14bddb800df7abac7a44d642fc6"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—2h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"ol, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
46
# 3
67
# 4
["able error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPo", "tempt to read data part all_5522313_5549930_17_22488012 (state Active) failed with error. It can mean that some retr", "ronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column attributes): (a", "37833095297, typename: DB::Async", "mpressing ch-s3-4e0/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/lqk/mrnrocgtgcgaadodotaotzzksdfci (position:", "unbound: 0: While reading or dec", " 56a2e2d5-5d79-48cf-b0ad-2db4878a5123:2359, kind: Regular,", "ize: 473217, downloader id: 56a2e2d5-5d79-48cf-b0ad-2db4878a5123:2359, current write offset: 37832622080, caller id", "RTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved ", "gment info: File segment: [37832622080, 37836816383], key: 14bddb800df7abac7a44d642fc6a87b4, state: P", "D_PUT_IN_CACHE, last caller: 56a2e2d5-5d79-48cf-b0ad-2db4878a5123:2359, file s", "_end: 37833095297, read_until_position: 37833896902, internal buffer end: 37833670656, read_type: REMOTE_FS_READ_A", "e/lqk/mrnrocgtgcgaadodotaotzzksdfci, hash key: 14bddb800df7abac7a44d642fc6a87b4, file_offset_of_buffe", "uffer path: ch-s3-4e0/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetr", "e offset: 37832622080, caller id: 56a2e2d5-5d79-48cf-b0ad-2db4878a5123:2359, kind: Regular, unbound: 0: Cache info: ", "6a2e2d5-5d79-48cf-b0ad-2db4878a5123:2359, current wri", "ac7a44d642fc6a87b4, state: DOWNLOADING, downloaded size: 0, reserved size: 473217, downloader id: ", "-only file system, current cache state: File segment: [37832622080, 37836816383], key: 14bddb800df7a", "ache/sharedS3DiskCache/14b/14bddb800df7abac7a44d642fc6a87b4/37832622080: , errno: 30, strerror: Rea", "87b4/37832622080: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/14b/14bddb800df7abac7a44d642fc6"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—2h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"ild))\n"
# 2
42
# 3
67
# 4
["eadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official bu", "MergeTreeSelect(pool: Prefetched", "ror. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executing", "13_5549930_17_22488012 (state Active) failed with e", "ata header: <uninitialized>): (while reading column attributes): (attempt to read data part all_5522", "dodotaotzzksdfci (position: 37833095297, typename: DB::AsynchronousBoundedReadBuffer, compressed ", "e2-f47e-4b75-bbcb-8441591d3836/mergetree/lqk/mrnrocgtgcga", ": While reading or decompressing ch-s3-4e0/aa812", "45-4dcf-b423-dcbe7ce7d59c:1058, kind: Regular, unbound: ", "loader id: 8fa90b12-d845-4dcf-b423-dcbe7ce7d59c:1058, current write offset: 37832622080, caller id: 8fa90b12-d", "87b4, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 473217, dow", ", 37836816383], key: 14bddb800df7abac7a44d642fc6", "058, file segment info: File segment: [3783262208", "d: 37833670656, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 8fa90b12-d845-4dcf-b423-dcbe7ce7d59c:", "87b4, file_offset_of_buffer_end: 37833095297, read_until_position: 37833896902, internal buffer e", "key: 14bddb800df7abac7a44d642fc6", "6/mergetree/lqk/mrnrocgtgcgaadodotaotzzksdfci, hash", " Buffer path: ch-s3-4e0/aa8129e2-f47e-4b75-bbcb-8441591d38", "ffset: 37832622080, caller id: 8fa90b12-d845-4dcf-b423-dcbe7ce7d59c:1058, kind: Regular, unbound: 0: Cache info", "fa90b12-d845-4dcf-b423-dcbe7ce7d59c:1058, current write ", "ac7a44d642fc6a87b4, state: DOWNLOADING, downloaded size: 0, reserved size: 473217, downloader id: ", "-only file system, current cache state: File segment: [37832622080, 37836816383], key: 14bddb800df7a", "ache/sharedS3DiskCache/14b/14bddb800df7abac7a44d642fc6a87b4/37832622080: , errno: 30, strerror: Rea", "87b4/37832622080: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/14b/14bddb800df7abac7a44d642fc6"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4