I/O error: Broken pipe, while writing to socket
Description
How to test
How to document
Attachments
- 14 Dec 2023, 11:07 AM
duplicates
Activity
Aaditya Dubey November 6, 2024 at 7:10 AM
Hi @Naresh
Please create a new ticket with the complete set of reproducible steps.
Naresh November 5, 2024 at 4:24 PM
Hi @Aaditya Dubey
Still I am seeing the below error.
2024.11.05 05:09:28.501028 [ 1591613 ] {2337e603-9011-4dea-a46f-d9521572f6be} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:50000). (NETWORK_ERROR) (version 23.8.2.7 (official build)) (from 127.0.0.1:50000) (in query: SELECT labels.key, labels.value FROM metrics WHERE (period_start >= 1728191248) AND (period_start <= 1730783248) ORDER BY labels.value ASC ), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001311785a in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.529428 [ 3709299 ] {17ea0057-1672-4623-953c-b3e2aa0d00c5} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:48238). (NETWORK_ERROR) (version 23.8.2.7 (official build)) (from 127.0.0.1:48238) (in query: SELECT labels.key, labels.value FROM metrics WHERE (period_start >= 1728191188) AND (period_start <= 1730783188) ORDER BY labels.value ASC ), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000713cffd in /usr/bin/clickhouse
DB::SerializationString::serializeBinaryBulk(DB::IColumn const&, DB::WriteBuffer&, unsigned long, unsigned long) const @ 0x0000000011407b03 in /usr/bin/clickhouse
DB::SerializationArray::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptrDB::ISerialization::SerializeBinaryBulkState&) const @ 0x00000000113d2afc in /usr/bin/clickhouse
DB::NativeWriter::write(DB::Block const&) @ 0x000000001314351b in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x0000000013117840 in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.529428 [ 3709299 ] {17ea0057-1672-4623-953c-b3e2aa0d00c5} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:48238). (NETWORK_ERROR) (version 23.8.2.7 (official build)) (from 127.0.0.1:48238) (in query: SELECT labels.key, labels.value FROM metrics WHERE (period_start >= 1728191188) AND (period_start <= 1730783188) ORDER BY labels.value ASC ), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000713cffd in /usr/bin/clickhouse
DB::SerializationString::serializeBinaryBulk(DB::IColumn const&, DB::WriteBuffer&, unsigned long, unsigned long) const @ 0x0000000011407b03 in /usr/bin/clickhouse
DB::SerializationArray::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptrDB::ISerialization::SerializeBinaryBulkState&) const @ 0x00000000113d2afc in /usr/bin/clickhouse
DB::NativeWriter::write(DB::Block const&) @ 0x000000001314351b in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x0000000013117840 in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.630840 [ 3709299 ] {17ea0057-1672-4623-953c-b3e2aa0d00c5} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:48238). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000713cffd in /usr/bin/clickhouse
DB::SerializationString::serializeBinaryBulk(DB::IColumn const&, DB::WriteBuffer&, unsigned long, unsigned long) const @ 0x0000000011407b03 in /usr/bin/clickhouse
DB::SerializationArray::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptrDB::ISerialization::SerializeBinaryBulkState&) const @ 0x00000000113d2afc in /usr/bin/clickhouse
DB::NativeWriter::write(DB::Block const&) @ 0x000000001314351b in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x0000000013117840 in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.630840 [ 3709299 ] {17ea0057-1672-4623-953c-b3e2aa0d00c5} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:48238). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000713cffd in /usr/bin/clickhouse
DB::SerializationString::serializeBinaryBulk(DB::IColumn const&, DB::WriteBuffer&, unsigned long, unsigned long) const @ 0x0000000011407b03 in /usr/bin/clickhouse
DB::SerializationArray::serializeBinaryBulkWithMultipleStreams(DB::IColumn const&, unsigned long, unsigned long, DB::ISerialization::SerializeBinaryBulkSettings&, std::shared_ptrDB::ISerialization::SerializeBinaryBulkState&) const @ 0x00000000113d2afc in /usr/bin/clickhouse
DB::NativeWriter::write(DB::Block const&) @ 0x000000001314351b in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x0000000013117840 in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.631052 [ 3709299 ] {17ea0057-1672-4623-953c-b3e2aa0d00c5} <Warning> TCPHandler: Client has gone away.
2024.11.05 05:09:28.631052 [ 3709299 ] {17ea0057-1672-4623-953c-b3e2aa0d00c5} <Warning> TCPHandler: Client has gone away.
2024.11.05 05:09:28.633451 [ 1591613 ] {2337e603-9011-4dea-a46f-d9521572f6be} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:50000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001311785a in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.633451 [ 1591613 ] {2337e603-9011-4dea-a46f-d9521572f6be} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:50000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87bf71 in /usr/bin/clickhouse
DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001311785a in /usr/bin/clickhouse
DB::TCPHandler::runImpl() @ 0x000000001310e2d2 in /usr/bin/clickhouse
DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
? @ 0x00007f4caad9ac12 in ?
? @ 0x00007f4caae1ef54 in ?
2024.11.05 05:09:28.633646 [ 1591613 ] {2337e603-9011-4dea-a46f-d9521572f6be} <Warning> TCPHandler: Client has gone away.
2024.11.05 05:09:28.633646 [ 1591613 ] {2337e603-9011-4dea-a46f-d9521572f6be} <Warning> TCPHandler: Client has gone away.
Aaditya Dubey September 7, 2024 at 12:33 PM
Hi @Naresh
We still haven't heard any news from you. So, I assume the issue no longer persists and will close the ticket. If you disagree, reply and create a follow-up with a new Jira report.
Aaditya Dubey August 9, 2024 at 6:04 AMEdited
Hi @Naresh
We are still waiting for the above information; please share.
I wonder if it is not due to disk space exhaustion. Normally, the clickhouse client should not disconnect on its own. Please check this as well.
Naresh August 7, 2024 at 11:51 AM
Hi @Jiří Čtvrtka
It's not an external click house DB. I am running it in the Docker container.
Observed the below errors in click-house server log file.
2023.12.14 05:15:15.134927 [ 18968 ] {30f2ce28-1247-4d36-9ae8-e5a9d1e7a680} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:45910). (NETWORK_ERROR) (version 23.8.2.7 (official build)) (from 127.0.0.1:45910) (in query: SELECT SUM(num_queries) AS num_queries, SUM(num_queries_with_errors) AS num_queries_with_errors, SUM(num_queries_with_warnings) AS num_queries_with_warnings, SUM(m_query_time_cnt) AS m_query_time_cnt, SUM(m_query_time_sum) AS m_query_time_sum, MIN(m_query_time_min) AS m_query_time_min, MAX(m_query_time_max) AS m_query_time_max, AVG(m_query_time_p99) AS m_query_time_p99, SUM(m_lock_time_cnt) AS m_lock_time_cnt, SUM(m_lock_time_sum) AS m_lock_time_sum, MIN(m_lock_time_min) AS m_lock_time_min, MAX(m_lock_time_max) AS m_lock_time_max, AVG(m_lock_time_p99) AS m_lock_time_p99, SUM(m_rows_sent_cnt) AS m_rows_sent_cnt, SUM(m_rows_sent_sum) AS m_rows_sent_sum, MIN(m_rows_sent_min) AS m_rows_sent_min, MAX(m_rows_sent_max) AS m_rows_sent_max, AVG(m_rows_sent_p99) AS m_rows_sent_p99, SUM(m_rows_examined_cnt) AS m_rows_examined_cnt, SUM(m_rows_examined_sum) AS m_rows_examined_sum, MIN(m_rows_examined_min) AS m_rows_examined_min, MAX(m_rows_examined_max) AS m_rows_examined_max, AVG(m_rows_examined_p99) AS m_rows_examined_p99, SUM(m_rows_affected_cnt) AS m_rows_affected_cnt, SUM(m_rows_affected_sum) AS m_rows_affected_sum, MIN(m_rows_affected_min) AS m_rows_affected_min, MAX(m_rows_affected_max) AS m_rows_affected_max, AVG(m_rows_affected_p99) AS m_rows_affected_p99, SUM(m_rows_read_cnt) AS m_rows_read_cnt, SUM(m_rows_read_sum) AS m_rows_read_sum, MIN(m_rows_read_min) AS m_rows_read_min, MAX(m_rows_read_max) AS m_rows_read_max, AVG(m_rows_read_p99) AS m_rows_read_p99, SUM(m_merge_passes_cnt) AS m_merge_passes_cnt, SUM(m_merge_passes_sum) AS m_merge_passes_sum, MIN(m_merge_passes_min) AS m_merge_passes_min, MAX(m_merge_passes_max) AS m_merge_passes_max, AVG(m_merge_passes_p99) AS m_merge_passes_p99, SUM(m_innodb_io_r_ops_cnt) AS m_innodb_io_r_ops_cnt, SUM(m_innodb_io_r_ops_sum) AS m_innodb_io_r_ops_sum, MIN(m_innodb_io_r_ops_min) AS m_innodb_io_r_ops_min, MAX(m_innodb_io_r_ops_max) AS m_innodb_io_r_ops_max, AVG(m_innodb_io_r_ops_p99) AS m_innodb_io_r_ops_p99, SUM(m_innodb_io_r_bytes_cnt) AS m_innodb_io_r_bytes_cnt, SUM(m_innodb_io_r_bytes_sum) AS m_innodb_io_r_bytes_sum, MIN(m_innodb_io_r_bytes_min) AS m_innodb_io_r_bytes_min, MAX(m_innodb_io_r_bytes_max) AS m_innodb_io_r_bytes_max, AVG(m_innodb_io_r_bytes_p99) AS m_innodb_io_r_bytes_p99, SUM(m_innodb_io_r_wait_cnt) AS m_innodb_io_r_wait_cnt, SUM(m_innodb_io_r_wait_sum) AS m_innodb_io_r_wait_sum, MIN(m_innodb_io_r_wait_min) AS m_innodb_io_r_wait_min, MAX(m_innodb_io_r_wait_max) AS m_innodb_io_r_wait_max, AVG(m_innodb_io_r_wait_p99) AS m_innodb_io_r_wait_p99, SUM(m_innodb_rec_lock_wait_cnt) AS m_innodb_rec_lock_wait_cnt, SUM(m_innodb_rec_lock_wait_sum) AS m_innodb_rec_lock_wait_sum, MIN(m_innodb_rec_lock_wait_min) AS m_innodb_rec_lock_wait_min, MAX(m_innodb_rec_lock_wait_max) AS m_innodb_rec_lock_wait_max, AVG(m_innodb_rec_lock_wait_p99) AS m_innodb_rec_lock_wait_p99, SUM(m_innodb_queue_wait_cnt) AS m_innodb_queue_wait_cnt, SUM(m_innodb_queue_wait_sum) AS m_innodb_queue_wait_sum, MIN(m_innodb_queue_wait_min) AS m_innodb_queue_wait_min, MAX(m_innodb_queue_wait_max) AS m_innodb_queue_wait_max, AVG(m_innodb_queue_wait_p99) AS m_innodb_queue_wait_p99, SUM(m_innodb_pages_distinct_cnt) AS m_innodb_pages_distinct_cnt, SUM(m_innodb_pages_distinct_sum) AS m_innodb_pages_distinct_sum, MIN(m_innodb_pages_distinct_min) AS m_innodb_pages_distinct_min, MAX(m_innodb_pages_distinct_max) AS m_innodb_pages_distinct_max, AVG(m_innodb_pages_distinct_p99) AS m_innodb_pages_distinct_p99, SUM(m_query_length_cnt) AS m_query_length_cnt, SUM(m_query_length_sum) AS m_query_length_sum, MIN(m_query_length_min) AS m_query_length_min, MAX(m_query_length_max) AS m_query_length_max, AVG(m_query_length_p99) AS m_query_length_p99, SUM(m_bytes_sent_cnt) AS m_bytes_sent_cnt, SUM(m_bytes_sent_sum) AS m_bytes_sent_sum, MIN(m_bytes_sent_min) AS m_bytes_sent_min, MAX(m_bytes_sent_max) AS m_bytes_sent_max, AVG(m_bytes_sent_p99) AS m_bytes_sent_p99, SUM(m_tmp_tables_cnt) AS m_tmp_tables_cnt, SUM(m_tmp_tables_sum) AS m_tmp_tables_sum, MIN(m_tmp_tables_min) AS m_tmp_tables_min, MAX(m_tmp_tables_max) AS m_tmp_tables_max, AVG(m_tmp_tables_p99) AS m_tmp_tables_p99, SUM(m_tmp_disk_tables_cnt) AS m_tmp_disk_tables_cnt, SUM(m_tmp_disk_tables_sum) AS m_tmp_disk_tables_sum, MIN(m_tmp_disk_tables_min) AS m_tmp_disk_tables_min, MAX(m_tmp_disk_tables_max) AS m_tmp_disk_tables_max, AVG(m_tmp_disk_tables_p99) AS m_tmp_disk_tables_p99, SUM(m_tmp_table_sizes_cnt) AS m_tmp_table_sizes_cnt, SUM(m_tmp_table_sizes_sum) AS m_tmp_table_sizes_sum, MIN(m_tmp_table_sizes_min) AS m_tmp_table_sizes_min, MAX(m_tmp_table_sizes_max) AS m_tmp_table_sizes_max, AVG(m_tmp_table_sizes_p99) AS m_tmp_table_sizes_p99, SUM(m_qc_hit_sum) AS m_qc_hit_sum, SUM(m_full_scan_sum) AS m_full_scan_sum, SUM(m_full_join_sum) AS m_full_join_sum, SUM(m_tmp_table_sum) AS m_tmp_table_sum, SUM(m_tmp_table_on_disk_sum) AS m_tmp_table_on_disk_sum, SUM(m_filesort_sum) AS m_filesort_sum, SUM(m_filesort_on_disk_sum) AS m_filesort_on_disk_sum, SUM(m_select_full_range_join_sum) AS m_select_full_range_join_sum, SUM(m_select_range_sum) AS m_select_range_sum, SUM(m_select_range_check_sum) AS m_select_range_check_sum, SUM(m_sort_range_sum) AS m_sort_range_sum, SUM(m_sort_rows_sum) AS m_sort_rows_sum, SUM(m_sort_scan_sum) AS m_sort_scan_sum, SUM(m_no_index_used_sum) AS m_no_index_used_sum, SUM(m_no_good_index_used_sum) AS m_no_good_index_used_sum, SUM(m_docs_returned_cnt) AS m_docs_returned_cnt, SUM(m_docs_returned_sum) AS m_docs_returned_sum, MIN(m_docs_returned_min) AS m_docs_returned_min, MAX(m_docs_returned_max) AS m_docs_returned_max, AVG(m_docs_returned_p99) AS m_docs_returned_p99, SUM(m_response_length_cnt) AS m_response_length_cnt, SUM(m_response_length_sum) AS m_response_length_sum, MIN(m_response_length_min) AS m_response_length_min, MAX(m_response_length_max) AS m_response_length_max, AVG(m_response_length_p99) AS m_response_length_p99, SUM(m_docs_scanned_cnt) AS m_docs_scanned_cnt, SUM(m_docs_scanned_sum) AS m_docs_scanned_sum, MIN(m_docs_scanned_min) AS m_docs_scanned_min, MAX(m_docs_scanned_max) AS m_docs_scanned_max, AVG(m_docs_scanned_p99) AS m_docs_scanned_p99, SUM(m_shared_blks_hit_sum) AS m_shared_blks_hit_sum, SUM(m_shared_blks_read_sum) AS m_shared_blks_read_sum, SUM(m_shared_blks_dirtied_sum) AS m_shared_blks_dirtied_sum, SUM(m_shared_blks_written_sum) AS m_shared_blks_written_sum, SUM(m_local_blks_hit_sum) AS m_local_blks_hit_sum, SUM(m_local_blks_read_sum) AS m_local_blks_read_sum, SUM(m_local_blks_dirtied_sum) AS m_local_blks_dirtied_sum, SUM(m_local_blks_written_sum) AS m_local_blks_written_sum, SUM(m_temp_blks_read_sum) AS m_temp_blks_read_sum, SUM(m_temp_blks_written_sum) AS m_temp_blks_written_sum, SUM(m_blk_read_time_sum) AS m_blk_read_time_sum, SUM(m_blk_write_time_sum) AS m_blk_write_time_sum, SUM(m_cpu_user_time_sum) AS m_cpu_user_time_sum, SUM(m_cpu_sys_time_sum) AS m_cpu_sys_time_sum, SUM(m_plans_calls_sum) AS m_plans_calls_sum, SUM(m_plans_calls_cnt) AS m_plans_calls_cnt, SUM(m_wal_records_sum) AS m_wal_records_sum, SUM(m_wal_records_cnt) AS m_wal_records_cnt, SUM(m_wal_fpi_sum) AS m_wal_fpi_sum, SUM(m_wal_fpi_cnt) AS m_wal_fpi_cnt, SUM(m_wal_bytes_sum) as m_wal_bytes_sum, SUM(m_wal_bytes_cnt) as m_wal_bytes_cnt, SUM(m_plan_time_cnt) AS m_plan_time_cnt, SUM(m_plan_time_sum) AS m_plan_time_sum, MIN(m_plan_time_min) AS m_plan_time_min, MAX(m_plan_time_max) AS m_plan_time_max, any(top_queryid) as top_queryid, any(top_query) as top_query FROM metrics WHERE period_start >= 1702487601 AND period_start <= 1702530801 AND environment IN ( 'PROD' ) WITH TOTALS; ), Stack trace (when copying this message, always include the lines below):
0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
1. DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
2. DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87c11b in /usr/bin/clickhouse
3. DB::TCPHandler::sendProgress() @ 0x00000000131156a2 in /usr/bin/clickhouse
4. DB::TCPHandler::runImpl() @ 0x000000001310f262 in /usr/bin/clickhouse
5. DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
6. Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
7. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
8. Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
9. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
10. ? @ 0x00007f1dccf9f812 in ?
11. ? @ 0x00007f1dccf3f314 in ?
2023.12.14 05:15:15.169211 [ 18968 ] {30f2ce28-1247-4d36-9ae8-e5a9d1e7a680} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:45910). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
1. DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
2. DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87c11b in /usr/bin/clickhouse
3. DB::TCPHandler::sendProgress() @ 0x00000000131156a2 in /usr/bin/clickhouse
4. DB::TCPHandler::runImpl() @ 0x000000001310f262 in /usr/bin/clickhouse
5. DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
6. Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
7. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
8. Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
9. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
10. ? @ 0x00007f1dccf9f812 in ?
11. ? @ 0x00007f1dccf3f314 in ?
2023.12.14 05:15:15.169211 [ 18968 ] {30f2ce28-1247-4d36-9ae8-e5a9d1e7a680} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket (127.0.0.1:9000 -> 127.0.0.1:45910). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c604bf7 in /usr/bin/clickhouse
1. DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c87c410 in /usr/bin/clickhouse
2. DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c87c11b in /usr/bin/clickhouse
3. DB::TCPHandler::sendProgress() @ 0x00000000131156a2 in /usr/bin/clickhouse
4. DB::TCPHandler::runImpl() @ 0x000000001310f262 in /usr/bin/clickhouse
5. DB::TCPHandler::run() @ 0x000000001311e839 in /usr/bin/clickhouse
6. Poco::Net::TCPServerConnection::start() @ 0x0000000015b104d4 in /usr/bin/clickhouse
7. Poco::Net::TCPServerDispatcher::run() @ 0x0000000015b116d1 in /usr/bin/clickhouse
8. Poco::PooledThread::run() @ 0x0000000015c47f07 in /usr/bin/clickhouse
9. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000015c461dc in /usr/bin/clickhouse
10. ? @ 0x00007f1dccf9f812 in ?
11. ? @ 0x00007f1dccf3f314 in ?
2023.12.14 05:15:15.169404 [ 18968 ] {30f2ce28-1247-4d36-9ae8-e5a9d1e7a680} <Warning> TCPHandler: Client has gone away.
2023.12.14 05:15:15.169404 [ 18968 ] {30f2ce28-1247-4d36-9ae8-e5a9d1e7a680} <Warning> TCPHandler: Client has gone away.