19833814
CustomerApi.Jobs.GenerateAccountMetrics
Queue
clickhouse_account_metrics
Attempt
5 of 10
Priority
0
Tags
...
Node
customer_api@10.10.0.159
Queue Time
01:38.919
Run Time
00:03.016
Inserted
6h ago
Scheduled
4h ago
Completed
4h ago (00:04)
Cancelled
—
Discarded
—
Args
%{
"account_id" => "222548",
"date" => "2026-03-06",
"query" => "event_counts",
"window_days" => 30
}
Meta
%{
"deps" => ["generate_user_counts"],
"name" => "generate_event_counts",
"on_hold" => false,
"orig_scheduled_at" => 1772758587467742,
"recorded" => true,
"return" => "g1AAAAGleJxVkE1OxDAMhbMaIWir0YgFO1acg6NEafqmE5E6UZzWwwE4BEdhzaVYkv7xs4n0vjzbz85KqQc5YAJlbtXh67GIlEJicyO1uK5H1j6YDp1Rcnf2QVjzJQiZJ6n6YDzrwTEv3/WqE4y9FPAsDUXWHXIyNs8tlVQzIYwF+VnXs44pDCFjMdxG00NPDjLH+fiUim0CaEXFcBpC6zw0rhHJgSzWMkd7MJLj3JXHNOF1Y0ru/7AEjoF4qTxiMK6kNjljiHndc2NcrlJks8k2jGXcsulGzuX9B0IELWCvsd7Zl9XSGqKy5E+ixsRoR7Der6+ad2na0fkO6Ree3r4B+hybsg",
"structured" => true,
"workflow" => true,
"workflow_id" => "019cc07f-7a6a-74fe-9e9a-04735141e9f3"
}
Recorded Output
%{
events: 456735,
errors: 8,
widget_loaded: 0,
flows_shown: 37,
goals_missed: 0,
goals_reached: 63,
nps_detractors: 0,
nps_neutrals: 0,
nps_promoters: 0,
page_views: 440771,
screen_views: 0,
mobile_experiences: 0,
pins_shown: 110,
nps_survey_shown: 0,
nps_survey_responses: 0,
emails_attempted: 0,
emails_sent: 0,
emails_bounced: 0,
emails_failed: 0,
emails_opened: 0,
emails_clicked: 0,
banners_shown: 0,
appcues_events: 3737,
builder_events: 4741
}
Errors
Attempt 4—4h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"cial build))\n"
# 2
44
# 3
67
# 4
["g MergeTreeSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offi", "h error. It can mean that some retryable error happened, or data is corrupted. Please retry the query: While executi", "296_12746905_20_22488012 (state Active) failed wi", "pressed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_1266", "x/cntihuflqgvmiglrrdawumkrbuhdn (position: 38608545084, typename: DB::AsynchronousBoundedReadBuffer, co", "ound: 0: While reading or decompressing ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/q", "a-9fea-4633-abb4-f5a0124f14e3:2383, kind: Regular, un", "r id: 6a405a5a-9fea-4633-abb4-f5a0124f14e3:2383, current write offset: 38604374016, caller id: 6a405a", "reserved size: 1048576, download", "y: 49ac74b9c9401e4b14d7512160e71c27, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0,", "-9fea-4633-abb4-f5a0124f14e3:2383, file segment info: File segment: [38604374016, 38612762623], k", "ion: 38608591583, internal buffer end: 38605422592, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 6a405a5", "sh key: 49ac74b9c9401e4b14d7512160e71c27, file_offset_of_buffer_end: 38608545084, read_until_posi", "r path: ch-s3-660/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/qgx/cntihuflqgvmiglrrdawumkrbuhdn, h", " kind: Regular, unbound: 0: Cache info: Buff", ", caller id: 6a405a5a-9fea-4633-abb4-f5a0124f14e3:2383", ": 1048576, downloader id: 6a405a5a-9fea-4633-abb4-f5a0124f14e3:2383, current write offset: 3860437401", ", key: 49ac74b9c9401e4b14d7512160e71c27, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [38604374016, 38612762623", "ckhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e71c27/38604374016: , errno: 30, strerror: ", "system: Cannot open file /mnt/cl", "1c27/38604374016: , errno: 30, strerror: Read-only file", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/49a/49ac74b9c9401e4b14d7512160e"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 3—4h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"ial build))\n"
# 2
43
# 3
67
# 4
["eSelect(pool: PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (offic", "ean that some retryable error happened, or data is corrupted. Please retry the query: While executing MergeTr", "state Active) failed with error. It can ", "d>): (while reading column attributes): (attempt to read data part all_14359807_14374733_15_22488012 ", "d (position: 29851785055, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <uninitializ", "ompressing ch-s3-658/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/rue/ronuhradepaynmqteznmqielbqe", "aller id: 8c273b46-2b96-424e-a0c3-8749109c5355:2391, kind: Regular, unbound: 0: While reading or de", "09c5355:2391, current write offset: 29850861568, ", " downloader id: 8c273b46-2b96-424e-a0c3-8749", "63e0ad8ddc, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 923487", "861568, 29855055871], key: 8d42596c5da7f66d7da04", "749109c5355:2391, file segment info: File segment: [2985", "er end: 29851910144, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 8c273b46-2b96-424e-a0c3-", "51785055, read_until_position: 29851795524, internal buf", "6c5da7f66d7da04b63e0ad8ddc, file_offset_of_buffer_end: 29", "ath: ch-s3-658/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/rue/ronuhradepaynmqteznmqielbqekd, hash key: 8d425", ":2391, kind: Regular, unbound: 0: Cache info: Buffer ", "50861568, caller id: 8c273b46-2b96-424e-a0c3-8749109c535", "-424e-a0c3-8749109c5355:2391, current write offset: 29", "d8ddc, state: DOWNLOADING, downloaded size: 0, reserved size: 923487, downloader id: 8c273b46-2b9", "le system, current cache state: File segment: [29850861568, 29855055871], key: 8d42596c5da7f66d7da04b63e0", "e/sharedS3DiskCache/8d4/8d42596c5da7f66d7da04b63e0ad8ddc/29850861568: , errno: 30, strerror: Read-only f", "8ddc/29850861568: , errno: 30, strerror: Read-only file system: Cannot open file /mnt/clickhouse-cac", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/8d4/8d42596c5da7f66d7da04b63e0a"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 2—5h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
""
# 2
42
# 3
67
# 4
[" (version 25.10.1.7375 (official build))\n", " PrefetchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE", "me retryable error happened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool", "012 (state Active) failed with error. It can mean that s", "nitialized>): (while reading column attributes): (attempt to read data part all_12746906_13029460_34_2248", "ji (position: 16037366393, typename: DB::AsynchronousBoundedReadBuffer, compressed data header: <un", "ecompressing ch-s3-e63/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/blr/hijswiaasoznqsibyrjwzymmvx", "et: 16034824192, caller id: a26a9c48-6119-48b8-bced-697b1919d69a:1520, kind: Regular, unbound: 0: While reading or ", "19-48b8-bced-697b1919d69a:1520, current write off", "ON, downloaded size: 0, reserved size: 1048576, downloader id: a26a9c48-6", "egment: [16034824192, 16039018495], key: f4c4f70cdf0be15fcfbd2de8f5a2078a, state: PARTIALLY_DOWNLOADED_NO_CONTINUAT", "8b8-bced-697b1919d69a:1520, file segment info: File ", "rnal buffer end: 16035872768, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: a26a9c48-6119-", "6037366393, read_until_position: 16037422035, int", "0cdf0be15fcfbd2de8f5a2078a, file_offset_of_buffer_end: ", " path: ch-s3-e63/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/blr/hijswiaasoznqsibyrjwzymmvxcji, hash key: f4c4f", "520, kind: Regular, unbound: 0: Cache info: Buffe", ", caller id: a26a9c48-6119-48b8-bced-697b1919d69a:", ": 1048576, downloader id: a26a9c48-6119-48b8-bced-697b1919d69a:1520, current write offset: 1603482419", ", key: f4c4f70cdf0be15fcfbd2de8f5a2078a, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [16034824192, 16039018495", "t/clickhouse-cache/sharedS3DiskCache/f4c/f4c4f70cdf0be15fcfbd2de8f5a2078a/16034824192: , errno: 30, strerror: ", "file system: Cannot open file /m", "078a/16034824192: , errno: 30, strerror: Read-only", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/f4c/f4c4f70cdf0be15fcfbd2de8f5a"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4
Attempt 1—5h ago
** (FunctionClauseError) no function clause matching in Ch.RowBinary.decode_names/4
The following arguments were given to Ch.RowBinary.decode_names/4:
# 1
"tchedReadPool, algorithm: Thread). (CANNOT_OPEN_FILE) (version 25.10.1.7375 (official build))\n"
# 2
42
# 3
67
# 4
["ppened, or data is corrupted. Please retry the query: While executing MergeTreeSelect(pool: Prefe", "mean that some retryable error h", "0_34_22488012 (state Active) failed with error. It can", "ed data header: <uninitialized>): (while reading column attributes): (attempt to read data part all_12746906_130294", "r/hijswiaasoznqsibyrjwzymmvxcji (position: 16037366393, typename: DB::AsynchronousBoundedReadBuffer, compres", "ound: 0: While reading or decompressing ch-s3-e63/aa8129e2-f47e-4b75-bbcb-8441591d3836/mergetree/b", "867-4fc8-a900-152f5a2a9659:2323, kind: Regular, un", "oader id: 081c04d8-2867-4fc8-a900-152f5a2a9659:2323, current write offset: 16034824192, caller id: 081c04d8-", "5a2078a, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 1048576, down", " 16039018495], key: f4c4f70cdf0be15fcfbd2de8", "323, file segment info: File segment: [16034824192", "EMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 081c04d8-2867-4fc8-a900-152f5a2a9659:", "035, internal buffer end: 16035872768, read_type: ", "mmvxcji, hash key: f4c4f70cdf0be15fcfbd2de8f5a2078a, file_offset_of_buffer_end: 16037366393, read_until_position: 1603742", "5-bbcb-8441591d3836/mergetree/blr/hijswiaasoznqsibyrjwz", "path: ch-s3-e63/aa8129e2-f47e-4b", "323, kind: Regular, unbound: 0: Cache info: Buffer", ", caller id: 081c04d8-2867-4fc8-a900-152f5a2a9659:", ": 1048576, downloader id: 081c04d8-2867-4fc8-a900-152f5a2a9659:2323, current write offset: 1603482419", ", key: f4c4f70cdf0be15fcfbd2de8f5a2078a, state: DOWNLOADING, downloaded size: 0, reserved siz", "ead-only file system, current cache state: File segment: [16034824192, 16039018495", "t/clickhouse-cache/sharedS3DiskCache/f4c/f4c4f70cdf0be15fcfbd2de8f5a2078a/16034824192: , errno: 30, strerror: ", "file system: Cannot open file /m", "078a/16034824192: , errno: 30, strerror: Read-only", "de: 76. DB::Exception: Cannot open file /mnt/clickhouse-cache/sharedS3DiskCache/f4c/f4c4f70cdf0be15fcfbd2de8f5a"]
(ch 0.7.1) lib/ch/row_binary.ex:789: Ch.RowBinary.decode_names/4
(ch 0.7.1) lib/ch/query.ex:290: DBConnection.Query.Ch.Query.decode/3
(db_connection 2.9.0) lib/db_connection.ex:1470: DBConnection.decode/4
(db_connection 2.9.0) lib/db_connection.ex:849: DBConnection.execute/4
(ch 0.7.1) lib/ch.ex:94: Ch.query/4
(ecto_sql 3.13.4) lib/ecto/adapters/sql.ex:620: Ecto.Adapters.SQL.query!/4
(ecto_ch 0.8.6) lib/ecto/adapters/clickhouse.ex:323: Ecto.Adapters.ClickHouse.execute/5
(ecto 3.13.5) lib/ecto/repo/queryable.ex:241: Ecto.Repo.Queryable.execute/4