metrics reported from the peer

peermetrics.txt

The Datomic Pro peer can create the following CloudWatch metrics:


-----------------------------------PEER METRICS


|-------------------------------+------------+---------------+-----------------------------------------------------------------------------+
| Metric                        | Units      | Statistic     | Description                                                                 |
|-------------------------------+------------+---------------+-----------------------------------------------------------------------------+
| AvailableMB                   | MB         | minimum       | unused RAM on peer   *                                                       |
| dbAddFulltextMsec             | msec       | min, avg, max | Time to add batch of fulltext attributes to index                           |
| LogIngestBytes                | bytes      | sum           | Sum of bytes ingested by peer process                                       |
| LogIngestMsec                 | msec       | min, avg, max | time to ingest log by peer                                                  |
| ObjectCache                   | count      | average       | object cache hit ratio, from 0 (no hits) to 1 (all hits)                    |
| ObjectCache                   | count      | sum           | total number of requests to object cache                                    |
| PeerAcceptNewMsec             | msec       | min, avg, max | Time for the peer to accept a new index                                    |
| PeerFulltextBatch             | count      | min, avg, max | Attributes with fulltext in the current batch                               |
| PodGetMsec                    | msec       | min, avg, max | ??? *                                                                        |
| StorageGetBytes               | bytes      | sum           | total number of bytes retrieved from storage                                |
| StorageGetMsec                | msec       | min, avg, max | Time to retrieve bytes from storage                                         |
|-------------------------------+------------+---------------+-----------------------------------------------------------------------------+---|


-------------Currently shown metrics:


|-------------------------------+------------+---------------+-----------------------------------------------------------------------------+
| Metric                        | Units      | Statistic     | Description                                                                 |
|-------------------------------+------------+---------------+-----------------------------------------------------------------------------+
| Alarm                         | count      | sum           | a problem has occurred (see alarms table below)                             |
| AvailableMB                   | MB         | minimum       | unused RAM on transactor                                                    |
| ClusterCreateFS               | msec       | maximum       | time to create a "file system" in the storage                               |
| CreateEntireIndexMsec         | msec       | maximum       | time to create index, reported at end of indexing job                       |
| CreateFulltextIndexMsec       | msec       | maximum       | time to create fulltext portion of index                                    |
| Datoms                        | count      | maximum       | number of unique datoms in the index                                        |
| HeartbeatMsec                 | msec       | avg           | Time spacing of heartbeats written by active transactor                     |
| HeartbeatMsec                 | msec       | samples       | Number of heartbeats written by active transactor                           |
| HeartbeatMsec                 | msec       | maximum       | Longest spacing between heartbeats written by active transactor             |
| HeartMonitorMsec              | msec       | min, avg, max | Time spacing of heartbeats observed by standby transactor                   |
| IndexDatoms                   | count      | maximum       | number of datoms stored by the index, all sorts                             |
| IndexSegments                 | count      | maximum       | total number of segments in the index                                       |
| IndexWrites                   | count      | sum           | number of segments written by indexing job, reported at end                 |
| LogIngestBytes                | bytes      | maximum       | in-memory size of log when a database size                                  |
| LogIngestMsec                 | msec       | maximum       | time to play log back when a database start                                 |
| Memcache                      | count      | average       | memcache hit ratio, from 0 (no hits) to 1 (all hits)                        |
| Memcache                      | count      | sum           | total number of cache hits for memcache                                     |
| Memcache                      | count      | samples       | total number of requests to memcache                                        |
| MemoryIndexMB                 | MB         | maximum       | MB of RAM consumed by memory index                                          |
| ObjectCache                   | count      | average       | object cache hit ratio, from 0 (no hits) to 1 (all hits)                   |
| ObjectCache                   | count      | sum           | total number of requests to object cache                                    |
| ReaderMemcachedPutMusec       | \micro{}sec | min, avg, max | distribution of successful memcache put latencies when reading from storage |
| ReaderMemcachedPutFailedMusec | \micro{}sec | min, avg, max | distribution of failed memcache put latencies when reading from storage     |
| RemotePeers                   | count      | maximum       | number of remote peers connected                                            |
| StorageBackoff                | msec       | maximum       | worst case time spent in backoff/retry around calls to storage              |
| StorageBackoff                | msec       | samples       | number of times a storage operation was retried                             |
| Storage{Get,Put}Bytes         | bytes      | sum           | throughput of storage operations                                            |
| Storage{Get,Put}Bytes         | bytes      | samples       | count of storage operations                                                 |
| Storage{Get,Put}Msec          | msec       | min, avg, max | distribution of storage latencies                                           |
| TransactionBytes              | bytes      | sum           | volume of transaction data to log, peers                                    |
| TransactionBytes              | bytes      | samples       | number of transactions                                                      |
| TransactionBytes              | bytes      | min, avg, max | distribution of transaction sizes                                           |
| TransactionMsec               | msec       | min, avg, max | distribution of transaction latencies                                       |
| WriterMemcachedPutMusec       | \micro{}sec  | min, avg, max | distribution of successful memcache put latencies when writing to storage   |
| WriterMemcachedPutFailedMusec | \micro{}sec | min, avg, max | distribution of failed memcache put latencies when writing to storage       |
|-------------------------------+------------+---------------+-----------------------------------------------------------------------------+---|