19833739
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
4 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.158
Queue Time
01:50.994
Run Time
00:02.376
Inserted
20h ago
Scheduled
18h ago
Completed
18h ago (00:03)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "222278",
"date" => "2026-03-06",
"query" => "users_reached",
"window_days" => 7
}
Meta
%{
"deps" => ["generate_event_counts"],
"name" => "generate_users_reached",
"on_hold" => false,
"orig_scheduled_at" => 1772760583049484,
"recorded" => true,
"return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-7a69-75fe-a439-c3763d0b6c31"
}
Recorded Output
%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}
Errors
Attempt 3—18h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
" (official build))\n"
# 2
45
# 3
67
# 4
[" MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375", "r. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executin", "273_23386396_70_23386047 (state Active) failed with err", ", compressed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_2271", "9923, typename: DB::AsynchronousBoundedReadBuffe", "g ch-s3-226/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/seb/qmrsjfrlbyhjowgdfnmjfzowyrobn (position: 285189", ": 9919c161-9839-4579-ae63-4715b13e5786:2361, kind: Regular, unbound: 0: While reading or decompressi", "ize: 1048576, downloader id: 9919c161-9839-4579-ae63-4715b13e5786:2361, current write offset: 28517072896, caller i", "e96141488b520b0b7fa13ba, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved ", "e63-4715b13e5786:2361, file segment info: File segment: [28517072896, 28521267199], key: 975f98dd", "last caller: 9919c161-9839-4579-", "REMOTE_FS_READ_AND_PUT_IN_CACHE,", " 28519020972, internal buffer end: 28518121472, read_type:", "wyrobn, hash key: 975f98ddce96141488b520b0b7fa13ba, file_offset_of_buffer_end: 28518909923, read_until_position", "e info: Buffer path: ch-s3-226/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/seb/qmrsjfrlbyhjowgdfnmjfz", "set: 28517072896, caller id: 9919c161-9839-4579-ae63-4715b13e5786:2361, kind: Regular, unbound: 0: Cac", "ze: 0, reserved size: 1048576, downloader id: 9919c161-9839-4579-ae63-4715b13e5786:2361, current write of", "1488b520b0b7fa13ba, state: DOWNLOADING, downloaded s", "-only file system, current cache state: File segment: [28517072896, 28521267199], key: 975f98ddce961", "ache/sharedS3DiskCache/975/975f98ddce96141488b520b0b7fa13ba/28517072896: , errno: 30, strerror: Rea", "13ba/28517072896: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/975/975f98ddce96141488b520b0b7f"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—18h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"ool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["r happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadP", "can mean that some retryable err", "903_36_22488012 (state Active) failed with error. It", "eader: <uninitialized>): (while reading column attributes): (attempt to read data part all_21886005_2228", "lctzzxlwskoenbibskfb (position: 33538613196, typename: DB::AsynchronousBoundedReadBuffer, compressed data ", "bound: 0: While reading or decompressing ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywk", "4599-86ed-485b08011c58:2358, kind: Regular, u", "ader id: 696a7ad1-44c8-4599-86ed-485b08011c58:2358, current write offset: 33537654784, caller id: 696a7ad1-44c8", "ED_NO_CONTINUATION, downloaded size: 0, reserved size: 958412, downl", " segment: [33537654784, 33541849087], key: 8bdd623835f487b01cc7ef2def9fca65, state: PARTIALLY_DOWNLOA", "ype: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 696a7ad1-44c8-4599-86ed-485b08011c58:2358, file segment info: Fil", "3538784137, internal buffer end: 33538703360, read_", "ash key: 8bdd623835f487b01cc7ef2def9fca65, file_offset_of_buffer_end: 33538613196, read_until_position: ", "91d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb, ", "58:2358, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441", " 33537654784, caller id: 696a7ad1-44c8-4599-86ed-485b08011", "c8-4599-86ed-485b08011c58:2358, current write offset", "f2def9fca65, state: DOWNLOADING, downloaded size: 0, reserved size: 958412, downloader id: 696a7ad1-4", "3537654784, 33541849087], key: 8bdd623835f487b01cc7", "9fca65/33537654784: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/33537654784: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—18h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"cial build))\n"
# 2
39
# 3
67
# 4
["g MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offi", "n that some retryable error happened, or data is corrupted. Please retry the query: While executi", "488012 (state Active) failed with error. It can me", "lized>): (while reading column attributes): (attempt to read data part all_21886005_22284903_36_2", "compressed data header: <uniniti", " 33538613196, typename: DB::AsynchronousBoundedReadBuffer,", "h-s3-c6c/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb (position", " unbound: 0: While reading or decompressing ", "344-b731-4e9f-a16d-163e6ce75f4e:1454, kind: Regular", "er id: 30ea3344-b731-4e9f-a16d-163e6ce75f4e:1454, current write offset: 33537654784, caller id: 30ea", "_NO_CONTINUATION, downloaded size: 0, reserved size: 958412, downloa", "le segment: [33537654784, 33541849087], key: 8bdd623835f487b01cc7ef2def9fca65, state: PARTIALLY_DOWNLOADE", "1-4e9f-a16d-163e6ce75f4e:1454, file segment info: F", " REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 30ea3344-b7", " internal buffer end: 33538703360, read_type", "read_until_position: 33538784137", "def9fca65, file_offset_of_buffer_end: 33538613196,", "hash key: 8bdd623835f487b01cc7ef", "441591d3836/mergetree/ral/buegwywkjlctzzxlwskoenbibskfb,", "e75f4e:1454, kind: Regular, unbound: 0: Cache info: Buffer path: ch-s3-c6c/aa8129e2-f47e-4b75-bbcb-", "537654784, caller id: 30ea3344-b731-4e9f-a16d-163e6", "31-4e9f-a16d-163e6ce75f4e:1454, current write offset: 3", "f2def9fca65, state: DOWNLOADING, downloaded size: 0, reserved size: 958412, downloader id: 30ea3344-b", "3537654784, 33541849087], key: 8bdd623835f487b01cc7", "9fca65/33537654784: , errno: 30, strerror: Read-only file system, current cache state: File segment: [", "sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2de", "ca65/33537654784: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cache", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8bd/8bdd623835f487b01cc7ef2def9"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4