19829291
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
7 of 10
Priority
0
Tags
...
Node
customer_api@10.10.1.109
Queue Time
00:00.079
Run Time
00:02.692
Inserted
1d ago
Scheduled
1d ago
Completed
1d ago (00:03)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "209039",
"date" => "2026-03-06",
"query" => "users_reached",
"window_days" => 30
}
Meta
%{
"deps" => ["generate_event_counts"],
"name" => "generate_users_reached",
"on_hold" => false,
"orig_scheduled_at" => 1772760433501704,
"recorded" => true,
"return" => "g1AAAABReJwrYWBgYC7nLS1OLSqOL0pNTM5ITUlkKJdOKs3MSUktik8tS80riUeXlsgrKI4vLi0qS61ElwMAjygd2w",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-79dc-7c3f-a85e-0daddb417625"
}
Recorded Output
%{users_reached: 0, builder_event_users_reached: 0, nps_survey_users_reached: 0}
Errors
Attempt 6—1d ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"E) (version 25.10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["ergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FIL", "an that some retryable error happened, or data is corrupted. Please retry the query: While executing ", "05_20_22488012 (state Active) failed with error. It can m", "r: <uninitialized>): (while reading column attributes): (attempt to read data part all_12661296_12746", "ihuflqgvmiglrrdawumkrbuhdn (position: 33967468295, typename: DB::AsynchronousBoundedReadBuffer, compressed data head", "29e2-f47e-4b75-bbcb-8441591d3836/mergetree/qgx/cn", "-414d-9a4e-1a7b0c2fff38:1092, kind: Regular, unbound: 0: While reading or decompressing ch-s3-660/aa8", "b6a7-0b0e-414d-9a4e-1a7b0c2fff38:1092, current write offset: 33965473792, caller id: 603ab6a7-0b0", "NLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 603", "nfo: File segment: [33965473792, 33969668095], key: 49ac74b9c9401e4b14d7512160e71c27, state: PARTIALLY_DO", "FS_READ_AND_PUT_IN_CACHE, last caller: 603ab6a7-0b0e-414d-9a4e-1a7b0c2fff38:1092, file segment ", ": 33967468295, read_until_position: 33967588400, internal buffer end: 33966522368, read_type: REMOTE", "b9c9401e4b14d7512160e71c27, file_offset_of_buffer_en", " path: ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawumkrbuhdn, hash key: 49ac7", "092, kind: Regular, unbound: 0: Cache info: Buffe", ", caller id: 603ab6a7-0b0e-414d-9a4e-1a7b0c2fff38:", ": 1048576, downloader id: 603ab6a7-0b0e-414d-9a4e-1a7b0c2fff38:1092, current write offset: 3396547379", ", key: 49ac74b9c9401e4b14d7512160e71c27, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [33965473792, 33969668095", "ckhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e71c27/33965473792: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "1c27/33965473792: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 5—1d ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"d))\n"
# 2
43
# 3
67
# 4
["ool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official buil", "d, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedRead", "that some retryable error happen", "mpt to read data part all_12661296_12746905_20_22488012 (state Active) failed with error. It can mean", ": (while reading column attributes): (att", "mkrbuhdn (position: 33967468295, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>", "e reading or decompressing ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdaw", "set: 33965473792, caller id: 53479c51-6e2e-4761-9a32-62e8addab47b:1454, kind: Regular, unbound: 0: Whi", "9c51-6e2e-4761-9a32-62e8addab47b:1454, current write of", "NLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 534", "nfo: File segment: [33965473792, 33969668095], key: 49ac74b9c9401e4b14d7512160e71c27, state: PARTIALLY_DO", "FS_READ_AND_PUT_IN_CACHE, last caller: 53479c51-6e2e-4761-9a32-62e8addab47b:1454, file segment ", ": 33967468295, read_until_position: 33967588400, internal buffer end: 33966522368, read_type: REMOTE", "b9c9401e4b14d7512160e71c27, file_offset_of_buffer_en", " path: ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawumkrbuhdn, hash key: 49ac7", "454, kind: Regular, unbound: 0: Cache info: Buffe", ", caller id: 53479c51-6e2e-4761-9a32-62e8addab47b:", ": 1048576, downloader id: 53479c51-6e2e-4761-9a32-62e8addab47b:1454, current write offset: 3396547379", ", key: 49ac74b9c9401e4b14d7512160e71c27, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [33965473792, 33969668095", "ckhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e71c27/33965473792: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "1c27/33965473792: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 4—1d ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"cial build))\n"
# 2
44
# 3
67
# 4
["g MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offi", "h error. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executi", "296_12746905_20_22488012 (state Active) failed wi", "ata header: <uninitialized>): (while reading column attributes): (attempt to read data part all_1266", "gx/cntihuflqgvmiglrrdawumkrbuhdn (position: 33967468295, typename: DB::AsynchronousBoundedReadBuffer, compressed ", "hile reading or decompressing ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/", "te offset: 33965473792, caller id: 272112ef-84a8-4632-bb7b-bf214c74470b:1092, kind: Regular, unbound: 0: ", "12ef-84a8-4632-bb7b-bf214c74470b:1092, current wr", "NLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 272", "nfo: File segment: [33965473792, 33969668095], key: 49ac74b9c9401e4b14d7512160e71c27, state: PARTIALLY_DO", "FS_READ_AND_PUT_IN_CACHE, last caller: 272112ef-84a8-4632-bb7b-bf214c74470b:1092, file segment ", ": 33967468295, read_until_position: 33967588400, internal buffer end: 33966522368, read_type: REMOTE", "b9c9401e4b14d7512160e71c27, file_offset_of_buffer_en", " path: ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawumkrbuhdn, hash key: 49ac7", "092, kind: Regular, unbound: 0: Cache info: Buffe", ", caller id: 272112ef-84a8-4632-bb7b-bf214c74470b:", ": 1048576, downloader id: 272112ef-84a8-4632-bb7b-bf214c74470b:1092, current write offset: 3396547379", ", key: 49ac74b9c9401e4b14d7512160e71c27, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [33965473792, 33969668095", "ckhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e71c27/33965473792: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "1c27/33965473792: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 3—1d ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
""
# 2
43
# 3
67
# 4
["eeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n", " mean that some retryable error happened, or data is corrupted. Please retry the query: While executing MergeT", "0_22488012 (state Active) failed with error. It ca", "data part all_12661296_12746905_", "nchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column attributes): (attempt to read", "-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawumkrbuhdn (position: 33967468295, typename: DB::As", "ch-s3-660/aa8129e2-f47e-4b75-bbc", "ler id: 28b97163-f814-4934-a7eb-ae5b5a9761b6:2120, kind: Regular, unbound: 0: While reading or decompressing", "ved size: 1048576, downloader id: 28b97163-f814-4934-a7eb-ae5b5a9761b6:2120, current write offset: 33965473792, ca", "74b9c9401e4b14d7512160e71c27, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, rese", ": 28b97163-f814-4934-a7eb-ae5b5a9761b6:2120, file segment info: File segment: [33965473792, 33969668095], key: 49a", "on: 33967588400, internal buffer end: 33966522368, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last calle", "krbuhdn, hash key: 49ac74b9c9401e4b14d7512160e71c27, file_offset_of_buffer_end: 33967468295, read_until_posit", "5-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawu", "path: ch-s3-660/aa8129e2-f47e-4b", "120, kind: Regular, unbound: 0: Cache info: Buffer", ", caller id: 28b97163-f814-4934-a7eb-ae5b5a9761b6:", ": 1048576, downloader id: 28b97163-f814-4934-a7eb-ae5b5a9761b6:2120, current write offset: 3396547379", ", key: 49ac74b9c9401e4b14d7512160e71c27, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [33965473792, 33969668095", "ckhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e71c27/33965473792: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "1c27/33965473792: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—1d ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
""
# 2
43
# 3
67
# 4
["eeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n", " mean that some retryable error happened, or data is corrupted. Please retry the query: While executing MergeT", "0_22488012 (state Active) failed with error. It ca", "data part all_12661296_12746905_", "nchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column attributes): (attempt to read", "-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawumkrbuhdn (position: 33967468295, typename: DB::As", "ch-s3-660/aa8129e2-f47e-4b75-bbc", "ler id: 49efa47d-8870-426b-92ee-56e3ff8e792a:2316, kind: Regular, unbound: 0: While reading or decompressing", "ved size: 1048576, downloader id: 49efa47d-8870-426b-92ee-56e3ff8e792a:2316, current write offset: 33965473792, ca", "74b9c9401e4b14d7512160e71c27, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, rese", ": 49efa47d-8870-426b-92ee-56e3ff8e792a:2316, file segment info: File segment: [33965473792, 33969668095], key: 49a", "on: 33967588400, internal buffer end: 33966522368, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last calle", "krbuhdn, hash key: 49ac74b9c9401e4b14d7512160e71c27, file_offset_of_buffer_end: 33967468295, read_until_posit", "5-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawu", "path: ch-s3-660/aa8129e2-f47e-4b", "316, kind: Regular, unbound: 0: Cache info: Buffer", ", caller id: 49efa47d-8870-426b-92ee-56e3ff8e792a:", ": 1048576, downloader id: 49efa47d-8870-426b-92ee-56e3ff8e792a:2316, current write offset: 3396547379", ", key: 49ac74b9c9401e4b14d7512160e71c27, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [33965473792, 33969668095", "ckhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e71c27/33965473792: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "1c27/33965473792: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—1d ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"5.10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["uery: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 2", " with error. It can mean that some retryable error happened, or data is corrupted. Please retry the ", "ed>): (while reading column attributes): (attempt to read data part all_14586091_14599092_13_22488012 (state Active) faile", "synchronousBoundedReadBuffer, compressed data header: <uninitiali", "cb-8441591d3836/mergetree/zoo/keqcisniqeftjtixaqlgwqpuhjbpv (position: 27396300493, typename: DB::", "cc51c:2391, kind: Regular, unbound: 0: While reading or decompressing ch-s3-358/aa8129e2-f47e-4b75-b", "92999424, caller id: 6e770515-cba7-4321-a341-bfd2b2", "1-a341-bfd2b2dcc51c:2391, current write offset: 27", "e: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, downloader id: 6e770515-cba7-43", "ile segment info: File segment: [27392999424, 27397193727], key: 023da05f2b319ee15cb576fa5f275812, sta", "d_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6e770515-cba7-4321-a341-bfd2b2dcc51c:2391, ", "buffer_end: 27396300493, read_until_position: 27396364478, internal buffer end: 27394048000, re", "rgetree/zoo/keqcisniqeftjtixaqlgwqpuhjbpv, hash key: 023da05f2b319ee15cb576fa5f275812, file_offset_of", "s3-358/aa8129e2-f47e-4b75-bbcb-8441591d3836/m", "1, kind: Regular, unbound: 0: Cache info: Buffer path: ch", ", caller id: 6e770515-cba7-4321-a341-bfd2b2dcc51c:23", ": 1048576, downloader id: 6e770515-cba7-4321-a341-bfd2b2dcc51c:2391, current write offset: 2739299942", ", key: 023da05f2b319ee15cb576fa5f275812, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [27392999424, 27397193727", "ckhouse-cache/sharedS3DiskCache/023/023da05f2b319ee15cb576fa5f275812/27392999424: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "5812/27392999424: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/023/023da05f2b319ee15cb576fa5f2"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4