Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save patsevanton/18dd67515593fd948dc22e1125fdee6c to your computer and use it in GitHub Desktop.
Save patsevanton/18dd67515593fd948dc22e1125fdee6c to your computer and use it in GitHub Desktop.
2020.08.03 08:52:38.862539 [ 3679 ] {} <Trace> HTTPHandler-factory: HTTP Request for HTTPHandler-factory. Method: POST, Address: 172.26.10.108:54868, User-Agent: Vector/0.9.2 (v0.9.2 x86_64-unknown-linux-musl 2020-06-09), Length: 476, Content Type: application/x-ndjson, Transfer Encoding: identity
2020.08.03 08:52:38.862893 [ 3679 ] {} <Trace> DynamicQueryHandler: Request URI: /?query=INSERT+INTO+%22vector%22.%22logs%22+FORMAT+JSONEachRow
2020.08.03 08:52:38.863226 [ 3679 ] {0f8ee387-9f8e-4e95-9ed2-12dcc3821fca} <Debug> executeQuery: (from 172.26.10.108:54868) INSERT INTO "vector"."logs" FORMAT JSONEachRow
2020.08.03 08:52:38.863421 [ 3679 ] {0f8ee387-9f8e-4e95-9ed2-12dcc3821fca} <Trace> ContextAccess (default): Access granted: INSERT(node_name, timestamp, server_name, user_id, request_full, request_user_agent, request_http_host, request_uri, request_scheme, request_method, request_length, request_time, request_referrer, response_status, response_body_bytes_sent, response_content_type, remote_addr, remote_port, remote_user, remote_geoip_city_name, remote_geoip_country_iso_code, remote_geoip_country_name, remote_geoip_continent_code, remote_geoip_continent_name, remote_geoip_region_iso_code, remote_geoip_region_name, remote_geoip_location_latitude, remote_geoip_location_longitude, upstream_addr, upstream_port, upstream_bytes_received, upstream_bytes_sent, upstream_cache_status, upstream_connect_time, upstream_header_time, upstream_response_length, upstream_response_time, upstream_status, upstream_content_type) ON vector.logs
2020.08.03 08:52:38.865427 [ 3679 ] {0f8ee387-9f8e-4e95-9ed2-12dcc3821fca} <Error> executeQuery: Code: 47, e.displayText() = DB::Exception: Missing columns: 'HIT' while processing query: 'SELECT toStartOfHour(timestamp) AS timestamp, domainWithoutWWW(domain(lowerUTF8(request_http_host))) AS domain, sumIf(response_body_bytes_sent, upstream_cache_status = HIT) AS cached, sumIf(response_body_bytes_sent, upstream_cache_status != HIT) AS uncached, sum(response_body_bytes_sent) AS total FROM vector.logs WHERE (IPv4StringToNum(domain) = 0) AND (domain != '') GROUP BY domain, timestamp ORDER BY (domain, timestamp) ASC', required columns: 'request_http_host' 'response_body_bytes_sent' 'timestamp' 'upstream_cache_status' 'HIT', source columns: 'upstream_content_type' 'upstream_response_length' 'upstream_header_time' 'upstream_connect_time' 'upstream_cache_status' 'upstream_bytes_sent' 'upstream_status' 'upstream_port' 'remote_geoip_location_longitude' 'remote_geoip_region_name' 'remote_geoip_continent_name' 'upstream_response_time' 'remote_geoip_country_name' 'remote_addr' 'remote_geoip_city_name' 'remote_port' 'response_content_type' 'request_user_agent' 'response_body_bytes_sent' 'remote_geoip_region_iso_code' 'response_status' 'remote_geoip_country_iso_code' 'request_referrer' 'node_name' 'upstream_addr' 'server_name' 'request_scheme' 'request_length' 'remote_geoip_continent_code' 'request_uri' 'request_time' 'request_method' 'upstream_bytes_received' 'request_http_host' 'remote_user' 'request_full' 'timestamp' 'remote_geoip_location_latitude' 'user_id' (version 20.5.3.27 (official build)) (from 172.26.10.108:54868) (in query: INSERT INTO "vector"."logs" FORMAT JSONEachRow ), Stack trace (when copying this message, always include the lines below):
@patsevanton
Copy link
Author

patsevanton commented Aug 3, 2020

2020.08.03 08:52:38.862539 [ 3679 ] {} HTTPHandler-factory: HTTP
Request for HTTPHandler-factory. Method: POST, Address: 172.26.10.108:54868,
User-Agent: Vector/0.9.2 (v0.9.2 x86_64-unknown-linux-musl 2020-06-09), Length:
476, Content Type: application/x-ndjson, Transfer Encoding: identity

2020.08.03 08:52:38.862893 [ 3679 ] {} DynamicQueryHandler: Request
URI: /?query=INSERT+INTO+%22vector%22.%22logs%22+FORMAT+JSONEachRow

2020.08.03 08:52:38.863226 [ 3679 ] {0f8ee387-9f8e-4e95-9ed2-12dcc3821fca}
executeQuery: (from 172.26.10.108:54868) INSERT INTO "vector"."logs"
FORMAT JSONEachRow

2020.08.03 08:52:38.863421 [ 3679 ] {0f8ee387-9f8e-4e95-9ed2-12dcc3821fca}
ContextAccess (default): Access granted: INSERT(node_name, timestamp,
server_name, user_id, request_full, request_user_agent, request_http_host,
request_uri, request_scheme, request_method, request_length, request_time,
request_referrer, response_status, response_body_bytes_sent,
response_content_type, remote_addr, remote_port, remote_user,
remote_geoip_city_name, remote_geoip_country_iso_code,
remote_geoip_country_name, remote_geoip_continent_code,
remote_geoip_continent_name, remote_geoip_region_iso_code,
remote_geoip_region_name, remote_geoip_location_latitude,
remote_geoip_location_longitude, upstream_addr, upstream_port,
upstream_bytes_received, upstream_bytes_sent, upstream_cache_status,
upstream_connect_time, upstream_header_time, upstream_response_length,
upstream_response_time, upstream_status, upstream_content_type) ON vector.logs

2020.08.03 08:52:38.865427 [ 3679 ] {0f8ee387-9f8e-4e95-9ed2-12dcc3821fca}
executeQuery: Code: 47, e.displayText() = DB::Exception: Missing
columns: 'HIT' while processing query: 'SELECT toStartOfHour(timestamp) AS
timestamp, domainWithoutWWW(domain(lowerUTF8(request_http_host))) AS domain,
sumIf(response_body_bytes_sent, upstream_cache_status = HIT) AS cached,
sumIf(response_body_bytes_sent, upstream_cache_status != HIT) AS uncached,
sum(response_body_bytes_sent) AS total FROM vector.logs WHERE
(IPv4StringToNum(domain) = 0) AND (domain != '') GROUP BY domain, timestamp
ORDER BY (domain, timestamp) ASC', required columns: 'request_http_host'
'response_body_bytes_sent' 'timestamp' 'upstream_cache_status' 'HIT', source
columns: 'upstream_content_type' 'upstream_response_length'
'upstream_header_time' 'upstream_connect_time' 'upstream_cache_status'
'upstream_bytes_sent' 'upstream_status' 'upstream_port'
'remote_geoip_location_longitude' 'remote_geoip_region_name'
'remote_geoip_continent_name' 'upstream_response_time'
'remote_geoip_country_name' 'remote_addr' 'remote_geoip_city_name'
'remote_port' 'response_content_type' 'request_user_agent'
'response_body_bytes_sent' 'remote_geoip_region_iso_code' 'response_status'
'remote_geoip_country_iso_code' 'request_referrer' 'node_name' 'upstream_addr'
'server_name' 'request_scheme' 'request_length' 'remote_geoip_continent_code'
'request_uri' 'request_time' 'request_method' 'upstream_bytes_received'
'request_http_host' 'remote_user' 'request_full' 'timestamp'
'remote_geoip_location_latitude' 'user_id' (version 20.5.3.27 (official build))
(from 172.26.10.108:54868) (in query: INSERT INTO "vector"."logs" FORMAT
JSONEachRow ), Stack trace (when copying this message, always include the lines
below):

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment