19824146
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
6 of 10
Priority
0
Tags
...
Node
customer_api@10.10.1.109
Queue Time
00:29.660
Run Time
00:03.484
Inserted
16h ago
Scheduled
14h ago
Completed
14h ago (00:04)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "103254",
"date" => "2026-03-06",
"query" => "event_counts",
"window_days" => 1
}
Meta
%{
"deps" => ["generate_user_counts"],
"name" => "generate_event_counts",
"on_hold" => false,
"orig_scheduled_at" => 1772757872375897,
"recorded" => true,
"return" => "g1AAAAGleJxVkU1SxCAQhdGFC03ilDULb0c1pCdDSYCiSXrGe3gAvYB7z+bCTkgs3VD1PvrnPShKqWe+wxlDIaNuHz9F5BwzwZFbdv2ARfsIPfag+OHkI5Omc+QAH9wMETzp0RGt123VGcGeBbxyFxLpHksGW5aRipuFBJwE+UW3i045jrHgWnCfYEA9O2Sxc3P95oZsRgwVScHTGI3zqPGSMDsMFmubC7sxxYdlKk15xmtlRlJ+8fEPzkgpBlqbDziCE+NQCo6p1KgbI3kYkd0mTZxk4xp2Iyc5/4GYMKxg77He2ZdaYiAEyflrtIOU7ISk9w9Qb+/cmcn5HvMGQf0A5QWcaQ",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-7955-7a8f-ac1d-3f2766910f2a"
}
Recorded Output
%{
events: 135087,
errors: 20,
widget_loaded: 0,
flows_shown: 162,
goals_missed: 0,
goals_reached: 122,
nps_detractors: 0,
nps_neutrals: 0,
nps_promoters: 0,
page_views: 96764,
screen_views: 0,
mobile_experiences: 0,
pins_shown: 0,
nps_survey_shown: 6330,
nps_survey_responses: 0,
emails_attempted: 0,
emails_sent: 0,
emails_bounced: 0,
emails_failed: 0,
emails_opened: 0,
emails_clicked: 0,
banners_shown: 0,
appcues_events: 38305,
builder_events: 0
}
Errors
Attempt 5—14h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"(version 25.10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["ry: While executing MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) ", "led with error. It can mean that some retryable error happened, or data is corrupted. Please retry the qu", "ninitialized>): (while reading column timestamp): (attempt to read data part all_0_3337_8_112386651 (state Active) fa", "xxighxazprzl (position: 663066976, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <", "d: 0: While reading or decompressing ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkii", "6-48db-9972-c8be68a4e9fe:2212, kind: Regular, unbou", "wnloader id: 33d4110e-ac36-48db-9972-c8be68a4e9fe:2212, current write offset: 662700032, caller id: 33d4110e-ac", "DED_NO_CONTINUATION, downloaded size: 0, reserved size: 366944, d", "nfo: File segment: [662700032, 666894335], key: 764853d7fdea556dbff305a56d57d4cb, state: PARTIALLY_DOWNLO", "110e-ac36-48db-9972-c8be68a4e9fe:2212, file segment ", "osition: 663087526, internal buffer end: 663748608, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 33d", "d4cb, file_offset_of_buffer_end: 663066976, read_until_", "key: 764853d7fdea556dbff305a56d5", "fer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl, hash", "e offset: 662700032, caller id: 33d4110e-ac36-48db-9972-c8be68a4e9fe:2212, kind: Regular, unbound: 0: Cache info: Bu", "10e-ac36-48db-9972-c8be68a4e9fe:2212, current wri", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 366944, downloader id: 33d4", "666894335], key: 764853d7fdea556", "state: File segment: [662700032,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/662700032: , errno: 3", "d4cb/662700032: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 4—14h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["uting MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.", "an mean that some retryable error happened, or data is corrupted. Please retry the query: While exe", "hile reading column timestamp): (attempt to read data part all_0_3337_8_112386651 (state Active) failed with error. It ", " compressed data header: <uninitialized>): (", "e/nsd/gpymoiaqdlaglkiiixxighxazprzl (position: 663066976, typename: DB::AsynchronousBoundedReadBuffer", "ind: Regular, unbound: 0: While reading or decompressing ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetr", "866:2281, current write offset: 662700032, caller id: 6db8edb5-7030-4774-9fe6-38ecb4b6a866:2281, ", "6db8edb5-7030-4774-9fe6-38ecb4b6", "ADED_NO_CONTINUATION, downloaded size: 0, reserved size: 366944, downloader id:", "o: File segment: [662700032, 666894335], key: 764853d7fdea556dbff305a56d57d4cb, state: PARTIALLY_DOWNL", "ead_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6db8edb5-7030-4774-9fe6-38ecb4b6a866:2281, file segment in", "internal buffer end: 663748608, ", "ey: 764853d7fdea556dbff305a56d57d4cb, file_offset_of_buffer_end: 663066976, read_until_position: 663087526,", "fo: Buffer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl, hash ", "fe6-38ecb4b6a866:2281, kind: Regular, unbound: 0: Cache i", "db5-7030-4774-9fe6-38ecb4b6a866:2281, current write offset: 662700032, caller id: 6db8edb5-7030-4774-", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 366944, downloader id: 6db8", "666894335], key: 764853d7fdea556", "state: File segment: [662700032,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/662700032: , errno: 3", "d4cb/662700032: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 3—14h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"l, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
45
# 3
67
# 4
["or happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPoo", "ata part all_0_3337_8_112386651 (state Active) failed with error. It can mean that some retryable er", "nchronousBoundedReadBuffer, compressed data header: <uninitialized>): (while reading column timestamp): (attempt to read ", "cb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl (position: 663066976, typename: DB::As", " While reading or decompressing ch-s3-aa8129e2-f47e-4b75-b", "dd-af4f-eb351a91ac9a:1466, kind: Regular, unbound: 0", "d: 1d8c7163-d179-44dd-af4f-eb351a91ac9a:1466, current write offset: 662700032, caller id: 1d8c7163-d179-4", "ONTINUATION, downloaded size: 0, reserved size: 366944, downloader ", "gment: [662700032, 666894335], key: 764853d7fdea556dbff305a56d57d4cb, state: PARTIALLY_DOWNLOADED_NO_", "dd-af4f-eb351a91ac9a:1466, file segment info: File s", "l buffer end: 663748608, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 1d8c7163-d179-4", "ea556dbff305a56d57d4cb, file_offset_of_buffer_end: 663066976, read_until_position: 663087526, intern", "ath: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl, hash key: 764853d7f", "et: 662700032, caller id: 1d8c7163-d179-44dd-af4f-eb351a91ac9a:1466, kind: Regular, unbound: 0: Cache info: Buffer ", "163-d179-44dd-af4f-eb351a91ac9a:1466, current write off", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 366944, downloader id: 1d8c", "666894335], key: 764853d7fdea556", "state: File segment: [662700032,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/662700032: , errno: 3", "d4cb/662700032: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—15h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"lgorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
42
# 3
67
# 4
["pened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: PrefetchedReadPool, a", " to read data part all_0_3337_8_112386651 (state Active) failed with error. It can mean that some retryable error ha", "while reading column timestamp): (attemp", "ighxazprzl (position: 663066976, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitialized>): ", "8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiix", "7e1:2253, kind: Regular, unbound: 0: While reading or decompressing ch-s3-aa8129e2-f47e-4b75-bbcb", "2ead151d-efa9-4ffb-8378-0fca0420", "ownloader id: 2ead151d-efa9-4ffb-8378-0fca0420a7e1:2253, current write offset: 662700032, caller id:", " downloaded size: 0, reserved size: 366944, ", " state: PARTIALLY_DOWNLOADED_NO_CONTINUATION", "764853d7fdea556dbff305a56d57d4cb", "151d-efa9-4ffb-8378-0fca0420a7e1:2253, file segment info: File segment: [662700032, 666894335], key:", "osition: 663087526, internal buffer end: 663748608, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 2ea", "d4cb, file_offset_of_buffer_end: 663066976, read_until_", "key: 764853d7fdea556dbff305a56d5", "fer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl, hash", "e offset: 662700032, caller id: 2ead151d-efa9-4ffb-8378-0fca0420a7e1:2253, kind: Regular, unbound: 0: Cache info: Bu", "51d-efa9-4ffb-8378-0fca0420a7e1:2253, current wri", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 366944, downloader id: 2ead", "666894335], key: 764853d7fdea556", "state: File segment: [662700032,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/662700032: , errno: 3", "d4cb/662700032: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—15h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"10.1.7375 (official build))\n"
# 2
44
# 3
67
# 4
["uting MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.", "an mean that some retryable error happened, or data is corrupted. Please retry the query: While exe", "hile reading column timestamp): (attempt to read data part all_0_3337_8_112386651 (state Active) failed with error. It ", " compressed data header: <uninitialized>): (", "066976, typename: DB::AsynchronousBoundedReadBuffer", "h-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxazprzl (position: 66", " unbound: 0: While reading or decompressing ", "urrent write offset: 662700032, caller id: c0c15b84-1999-4e18-a7cb-ef3737bf8e68:1113, kind: Regular", "ownloaded size: 0, reserved size: 366944, downloader id: c0c15b84-1999-4e18-a7cb-ef3737bf8e68:1113, ", "d57d4cb, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, ", "f8e68:1113, file segment info: File segment: [662700032, 666894335], key: 764853d7fdea556dbff305a5", "ernal buffer end: 663748608, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: c0c15b84-1999-4e18-a7cb-ef3737", "przl, hash key: 764853d7fdea556dbff305a56d57d4cb, file_offset_of_buffer_end: 663066976, read_until_position: 663087526, in", " info: Buffer path: ch-s3-aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/nsd/gpymoiaqdlaglkiiixxighxa", "fset: 662700032, caller id: c0c15b84-1999-4e18-a7cb-ef3737bf8e68:1113, kind: Regular, unbound: 0: Cach", "b84-1999-4e18-a7cb-ef3737bf8e68:1113, current write o", "bff305a56d57d4cb, state: DOWNLOADING, downloaded size: 0, reserved size: 366944, downloader id: c0c1", "666894335], key: 764853d7fdea556", "state: File segment: [662700032,", ", strerror: Read-only file system, current cache", "stem: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d57d4cb/662700032: , errno: 3", "d4cb/662700032: , errno: 30, strerror: Read-only file s", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/764/764853d7fdea556dbff305a56d5"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4