jennifer-errors
Count the errors of a JENNIFER domain's instances by error type over a period, as the error table of the console's daily system statistics does. Use it to scope an anomaly found with jennifer-metrics: which instances and which kinds of error (SQL, external call, out of memory, slow response…) rose, then find the transactions with jennifer-xview. Compare the suspect period with an earlier one of the same length to tell new errors from usual ones.
- One row per instance and error type that occurred; types with no error are not returned.
- Agent lifecycle events (AGENT_START, AGENT_STOP, AGENT_RECONNECT, AGENT_SHUTDOWN) are counted as error types too: they show restarts.
- Periods up to 31 days.
Error types: SERVICE_EXCEPTION, SERVICE_ERROR, METHOD_EXCEPTION, SQL_EXCEPTION, SQL_TOOMANY_FETCH, DB_CONNECTION_FAIL, DB_CONNECTION_UNCLOSED, DB_STATEMENT_UNCLOSED, DB_RESULTSET_UNCLOSED, DB_UN_COMMIT_ROLLBACK, DB_CONNECTION_ILLEGAL_ACCESS, DEADLOCK, EXTERNALCALL_EXCEPTION, HTTP_IO_EXCEPTION, SOCKET_EXCEPTION, HTTP_404_ERROR, OUT_OF_MEMORY, PLC_REJECTED, RECURSIVE_CALL, REPETITIVE_CALL, BAD_RESPONSE_TIME_APPLICATION, BAD_RESPONSE_TIME_SQL, BAD_RESPONSE_TIME_EXTERNAL_CALL, BATCH_EXCEPTION, THREAD_KILL_MANUAL, THREAD_KILL_AUTO, NOT_ENOUGH_DISK_SPACE, AGENT_START, AGENT_STOP, AGENT_RECONNECT, AGENT_SHUTDOWN, USER_DEFINED_WARNING, USER_DEFINED_FATAL, USER_DEFINED_LEAK, COMPILE_ERROR, PARSE_ERROR, NATIVE_CRITICAL_ERROR, PHP_WARNING
- profile=VALUE
- Optional. Name of the JENNIFER console connect profile (type jennifer-apm-console). Every such profile you are granted is used when omitted. With domain_id, which is an id of one console, exactly one profile must be used: name it when you are granted several.
- domain_id=VALUE
- Required. e.g. 1000. jennifer-instances lists them.
- instance_ids=VALUE
- Optional. e.g. 75553,75554. Comma separated instance ids (OID) from jennifer-instances. Every instance that reported in the period is counted when omitted.
- error_types=VALUE
- Optional. e.g. SQL_EXCEPTION,SERVICE_EXCEPTION. Comma separated error type names from the list in the description. Every type the console's statistics screen counts when omitted.
- duration=VALUE
- Optional. e.g. 10m for the last 10 minutes. Recent period up to now, in s(second), m(minute), h(hour), d(day) units. The last hour when no period is given. At most 31 days. Errors are counted over the period.
- from=VALUE
- Optional. Start of the period, yyyyMMddHHmmss. Omitted digits are padded with zero. Overrides duration.
- to=VALUE
- Optional. End of the period, yyyyMMddHHmmss. Omitted digits are padded with zero. Now when omitted.
- limit=VALUE
- Optional. e.g. 1000. Maximum rows, 10000 by default.
Output fields
| Field | Type | Name | Description |
|---|---|---|---|
| profile | String | Connect profile | e.g. jennifer-prod |
| domain_id | Integer | Domain ID | e.g. 1000 |
| domain_name | String | Domain name | e.g. siem-mon |
| instance_id | Long | Instance ID | e.g. 75553. Null when the console names an instance that was not asked for by id. |
| instance_name | String | Instance name | e.g. siem-mon-data-1 |
| error_type | Integer | Error type code | e.g. 1020. The console's code of the type; null for a type without a name in the list. |
| error_type_name | String | Error type | e.g. SQL_EXCEPTION |
| count | Long | Count | e.g. 12. Errors of the type in the period. |
Usage
Most frequent errors of the last hour:
Errors of the day by type:
jennifer-errors domain_id=1000 duration=1d | stats sum(count) as errors by error_type_name | sort -errors
An hour against the same hour a day before (errors that rose):
jennifer-errors domain_id=1000 from=20261027090000 to=20261027100000 | stats sum(count) as count by instance_name, error_type_name | join type=left instance_name, error_type_name [ jennifer-errors domain_id=1000 from=20261026090000 to=20261026100000 | stats sum(count) as before_count by instance_name, error_type_name ] | eval before_count = nvl(before_count, 0), increase = count - before_count | sort limit=20 -increase
Database errors of two instances: