19828875
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.1.214
Queue Time
02:21.206
Run Time
00:01.040
Inserted
12h ago
Scheduled
10h ago
Completed
10h ago (00:02)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "209003",
"date" => "2026-03-06",
"query" => "users_reached",
"window_days" => 1
}
Meta
%{
"deps" => ["generate_event_counts"],
"name" => "generate_users_reached",
"on_hold" => false,
"orig_scheduled_at" => 1772760408120493,
"recorded" => true,
"return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-79d3-78cc-86cb-877c4a51d621"
}
Recorded Output
%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}
Errors
Attempt 3—10h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"lgorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
42
# 3
67
# 4
["pened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, a", "24202138_37_24192759 (state Active) failed with error. It can mean that some retryable error ha", ": (attempt to read data part all_23863211", "(while reading column attributes", "tion: 20515556725, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>):", "ssing ch-s3-963/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/lvu/evqtwtdncvzsgcwqczgpvwmavzrhe (pos", "8, kind: Regular, unbound: 0: While reading or decompr", ", caller id: 22a031dd-b55f-4649-8081-8474e7be7f54:23", "-8081-8474e7be7f54:2368, current write offset: 2051434086", "downloader id: 22a031dd-b55f-464", " downloaded size: 0, reserved size: 1048576,", " state: PARTIALLY_DOWNLOADED_NO_CONTINUATION", "e2986a5b225503694ca8e4f2183a7502", "-b55f-4649-8081-8474e7be7f54:2368, file segment info: File segment: [20514340864, 20518535167], key:", "ion: 20515647483, internal buffer end: 20515389440, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 22a031d", "sh key: e2986a5b225503694ca8e4f2183a7502, file_offset_of_buffer_end: 20515556725, read_until_posi", "er path: ch-s3-963/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/lvu/evqtwtdncvzsgcwqczgpvwmavzrhe, h", "be7f54:2368, kind: Regular, unbound: 0: Cache info: Buf", "4340864, caller id: 22a031dd-b55f-4649-8081-8474e", "ize: 0, reserved size: 1048576, downloader id: 22a031dd-b55f-4649-8081-8474e7be7f54:2368, current write offset: 205", "694ca8e4f2183a7502, state: DOWNLOADING, downloaded ", "-only file system, current cache state: File segment: [20514340864, 20518535167], key: e2986a5b22550", "ache/sharedS3DiskCache/e29/e2986a5b225503694ca8e4f2183a7502/20514340864: , errno: 30, strerror: Rea", "7502/20514340864: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/e29/e2986a5b225503694ca8e4f2183"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—10h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"dReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
45
# 3
67
# 4
["ryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefetche", "t to read data part all_23863211_24202138_37_24192759 (state Active) failed with error. It can mean that some re", "while reading column attributes): (attem", "mavzrhe (position: 20515556725, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): ", "5-bbcb-8441591d3836/mergetree/lvu/evqtwtdncvzsgcwqczgpv", " While reading or decompressing ch-s3-963/aa8129e2-f47e-4b", " offset: 20514340864, caller id: 043b858a-5e03-4697-ba3b-afdd3ad66d7b:2128, kind: Regular, unbound: 0", "loaded size: 0, reserved size: 1048576, downloader id: 043b858a-5e03-4697-ba3b-afdd3ad66d7b:2128, current writ", ", state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, dow", "518535167], key: e2986a5b225503694ca8e4f2183a750", "ller: 043b858a-5e03-4697-ba3b-afdd3ad66d7b:2128, file segment info: File segment: [20514340864, 2", "_position: 20515647483, internal buffer end: 20515389440, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last c", "02, file_offset_of_buffer_end: 20515556725, read_unti", "-8441591d3836/mergetree/lvu/evqtwtdncvzsgcwqczgpvwmavzrhe, hash key: e2986a5b225503694ca8e4f2183a7", "d66d7b:2128, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-963/aa8129e2-f47e-4b75-bbc", "4340864, caller id: 043b858a-5e03-4697-ba3b-afdd3", "ize: 0, reserved size: 1048576, downloader id: 043b858a-5e03-4697-ba3b-afdd3ad66d7b:2128, current write offset: 205", "694ca8e4f2183a7502, state: DOWNLOADING, downloaded ", "-only file system, current cache state: File segment: [20514340864, 20518535167], key: e2986a5b22550", "ache/sharedS3DiskCache/e29/e2986a5b225503694ca8e4f2183a7502/20514340864: , errno: 30, strerror: Rea", "7502/20514340864: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/e29/e2986a5b225503694ca8e4f2183"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—10h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"lgorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["pened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, a", "art all_23863211_24202138_37_24192759 (state Active) failed with error. It can mean that some retryable error ha", " (while reading column attributes): (attempt to read data ", "wmavzrhe (position: 20515556725, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>)", "e reading or decompressing ch-s3-963/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/lvu/evqtwtdncvzsgcwqczgp", "b-d84acbc33e14:2364, kind: Regular, unbound: 0: Whi", "d8-4802-9a3b-d84acbc33e14:2364, current write offset: 20514340864, caller id: 05257b01-9cd8-4802-9a", "ON, downloaded size: 0, reserved size: 1048576, downloader id: 05257b01-9", "83a7502, state: PARTIALLY_DOWNLOADED_NO_CONTINUAT", "864, 20518535167], key: e2986a5b225503694ca8e4f2", "e14:2364, file segment info: File segment: [2051434", "05257b01-9cd8-4802-9a3b-d84acbc3", "il_position: 20515647483, internal buffer end: 20515389440, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller:", "pvwmavzrhe, hash key: e2986a5b225503694ca8e4f2183a7502, file_offset_of_buffer_end: 20515556725, read_un", "8441591d3836/mergetree/lvu/evqtwtdncvzsgcwqcz", "c33e14:2364, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-963/aa8129e2-f47e-4b75-bbcb", "4340864, caller id: 05257b01-9cd8-4802-9a3b-d84ac", "ize: 0, reserved size: 1048576, downloader id: 05257b01-9cd8-4802-9a3b-d84acbc33e14:2364, current write offset: 205", "694ca8e4f2183a7502, state: DOWNLOADING, downloaded ", "-only file system, current cache state: File segment: [20514340864, 20518535167], key: e2986a5b22550", "ache/sharedS3DiskCache/e29/e2986a5b225503694ca8e4f2183a7502/20514340864: , errno: 30, strerror: Rea", "7502/20514340864: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/e29/e2986a5b225503694ca8e4f2183"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4