Monitoring metrics reference

Aborted Transactions

Count of Kafka aborted transactions

Kafka Writer

count (long)

since application started

continuously

0

Accepted

Number of events accepted by a target

Target adapters

count (long)

since application started

continuously

1000

Accepted Rate

Rate of events accepted by a target

Target adapters

events/sec (float)

recent interval

every monitoring snapshot

150.5

Access Token Retrieval Time

Access Token Retrieval Time

OAuth-based adapters

string

most recent occurrence

on each token retrieval

Thu Oct 05 14:30:00 PDT 2023

Actual Name of Current File

Actual name of the file that is being currently read from/written to

File adapters

string

current state

on change

data_20231005.csv

Actual Name Of Last File Read

Real name of the file that was read before moving to a new file

File readers

string

most recent file

on each file transition

data_2023-10-04.csv

Actual Name of the last cloud objects metadata fetched

Real name of the last cloud objects metadata fetched

S3 / Cloud readers

string

most recent object

on each object read

data/export_2023-10-05.csv

Adapter Basic

Adapters brief event type

All adapters

string

current state

on each event

INSERT

Adapter Detail

Adapters detailed event type

All adapters

string

current state

on each event

INSERT into dbo.Orders

API Statistics

Number of times an API request has been made

Cluster

string

since application started

on each API call

{"GET":150,"POST":75,"PUT":25}

Application Error Count

Number of application errors (Salesforce Writer)

Salesforce Writer

count (long)

since application started

continuously

0

Application Error Count

Number of application errors (ServiceNow Writer)

ServiceNow Writer

count (long)

since application started

continuously

0

Application Error Count

Number of application errors

Target adapters

count (long)

since application started

continuously

0

Archive Log Reading Status

Archive Log Reading files, SCN, Sequence information

Oracle Reader

string

current state

on change

{"file":"arch1_12345.dbf","scn":12345678,"seq":42}

Authorization Failures Count

Authorization Failures Count

All adapters

count (long)

since application started

continuously

0

Average Event Size

Average size of an event

All components

bytes (ratio)

since application started

every monitoring snapshot

512

Average Latency

Avg latency between Kafka send and ack

Kafka Writer

millisecs (ratio)

recent interval

every monitoring snapshot

45.2

Average Latency of all responses till now

Average latency of all responses till now

Cluster

millisecs (ratio)

since application started

every monitoring snapshot

45.2

Average Messages per Transaction

Average messages per transaction

Kafka Writer

count (float)

recent interval

every monitoring snapshot

10.5

Average number of messages from Collection per second

Average number of messages from collection per second

MongoDB Reader

events/sec (string)

recent interval

every monitoring snapshot

250.5

Average Rate

Avg rate at which Kafka data are published

Kafka Writer

msgs/sec (float)

recent interval

every monitoring snapshot

500

Average RMI Response Time

Avg time for RMI response

Cluster

millisecs (long)

recent interval

every monitoring snapshot

15

Average Time Spent for IO

Average time spent for IO

File adapters

millisecond (ratio)

recent interval

every monitoring snapshot

125

Average Time to Assemble

Average time to assemble

All components

millisecs (ratio)

recent interval

every monitoring snapshot

20.3

Average Transaction Accumulation Time

Average accumulation time per transaction

Kafka Writer

millisecs (float)

recent interval

every monitoring snapshot

150

Average Transaction Size In Bytes

Average transaction size in bytes

Kafka Writer

bytes (float)

recent interval

every monitoring snapshot

2048

Average upload time

Average file upload time

File adapters

millisecond (ratio)

recent interval

every monitoring snapshot

350

Avg Time Between Sends

Avg time between two Kafka send calls

Kafka Writer

secs (ratio)

recent interval

every monitoring snapshot

0.5

Avg Time Between Sends

Avg time between two API send calls

Target adapters

millisecs (double)

recent interval

every monitoring snapshot

120.5

Backpressure Age

Time since backpressure started

All components

seconds (double)

current moment

continuously

0

Buffer Memory in Bytes

Current buffer memory in bytes

Kafka Writer

bytes (string)

current state

continuously

1245213

Buffered Messages Size In Bytes

Buffered pending bytes

Kafka Writer

bytes (long)

current state

continuously

1245213

Bytes Discarded

Bytes discarded

Source adapters

bytes (long)

since application started

continuously

0

Bytes Processed

Bytes processed

Source adapters

bytes (long)

since application started

continuously

10485760

Cache Created

Cache created time

Cache

time (long)

most recent occurrence

on cache creation

Thu Oct 05 14:30:00 PDT 2023

Cache Refresh

Cache refresh time

Cache

time (long)

most recent occurrence

on each cache refresh

Thu Oct 05 14:35:00 PDT 2023

Cache Size

Number of events held in cache

Cache

count (long)

current state

continuously

500

Catalog evolution duration

Time taken for catalog evolution in offline mode

Application

timespan (long)

most recent occurrence

on each catalog evolution

00m:05s:123ms

CDC Operation

CDC operations

CDC sources

string

current state

on each operation

{"No of Deletes":0,"No of DDLs":0,"No of PKUpdates":0,"No of Updates":0,"No of Inserts":1000}

Checkpoint Summary

A text summary of the checkpoint for this component

Application

string

current state

on each checkpoint

{"type":"NORMAL","time":"Thu Oct 05 14:30:00 PDT 2023","duration":250}

Cloud objects statistics

Cloud objects statistics

S3 / Cloud readers

count (string)

current state

every monitoring snapshot

{"processed":10,"pending":2,"failed":0}

Cluster Name

Name of cluster

Cluster

string

static

on startup

Striim

Collection Information

Read status of all the collections in JSON format

MongoDB Reader

string

current state

every monitoring snapshot

{"myCollection":{"status":"Completed","rowsRead":1000}}

Comments

Any useful notes about a component

All components

string

current state

on change

Commit Lag

Commit lag

Target adapters

string

current state

every monitoring snapshot

150

Connection Retry Information

Connection retry information

All adapters

string

current state

on each retry

{"attempt":2,"nextRetryIn":"30s","lastError":"Connection refused"}

Continuous Generator Data Object

Continuous generator data object

ContinuousGenerator

string

current state

on each event

{"type":"random","eventsGenerated":10000}

Cores

Number of cores

Server

count (integer)

static

on startup

8

Count of cloud objects metadata from last fetch

Number of cloud object metadata from last fetch

S3 / Cloud readers

count (long)

most recent fetch

on each fetch

10

CPU Rate

Average CPU time out of the previous total time

Server

% (float)

recent interval

every monitoring snapshot

0.1

CPU Rate Per Core (%)

The average CPU rate for each core

Server

% (double)

recent interval

every monitoring snapshot

10

CPU Rate Per Node

The average CPU rate for each node

Server

rate/node (float)

recent interval

every monitoring snapshot

10

Cumulative Events Processed by Batch Partial Record Policy

Cumulative events processed by Batch Partial Record Policy

Batch targets

count (string)

since application started

continuously

500

Cumulative Queries Executed by Batch Partial Record Policy

Cumulative queries executed by Batch Partial Record Policy

Batch targets

count (string)

since application started

continuously

100

Cumulative Time Spent for Batch Partial Record Policy Execution

Cumulative time spent for Batch Partial Record Policy execution

Batch targets

count (string)

since application started

continuously

2500

Cumulative Time Spent for Batch Partial Record Policy Queries Execution

Cumulative time spent for Batch Partial Record Policy queries execution

Batch targets

count (string)

since application started

continuously

1200

Current Batch Information

Status of current batch execution for each adapter instance in JSON format

Batch targets

MetricInfo

current state

on each batch

{"batchId":42,"status":"RUNNING","eventsProcessed":500}

Current Batch Partial Record Policy Details

PRP batch information (current batch)

Batch targets

string

current state

on each batch

{"batchId":42,"eventsBuffered":8,"status":"PROCESSING"}

Current Block Count

Current block being read

CDC sources

count (long)

current state

continuously

1024

Current checkpoint information of an application

Contains information of current recorded checkpoint like time, duration and type

Application

string

current state

on each checkpoint

{"type":"NORMAL","time":"Thu Oct 05 14:30:00 PDT 2023","duration":250}

Current Filename

Name of the file that is being currently read from/written to

File adapters

string

current state

on change

export_2023-10-05.csv

Current Hostname

Name of the host that is being currently read from

CDC sources

string

current state

on change

db-server-01

Current processing Backup file

Current processing backup file

SQL Server Reader

string

current state

on change

backup_2023-10-05.bak

Current Record Count

Current record in the block

CDC sources

count (long)

current state

continuously

512

Current SCN Range

Current SCN range

Oracle Reader

string

current state

continuously

12345678:12350000

Database Write Information

Read/write status of all the databases in JSON format

Database targets

string

current state

every monitoring snapshot

{"myDB":{"status":"Completed","rowsWritten":1000}}

DDL Information

DDL action information in JSON format

CDC sources

string

most recent DDL

on each DDL

{"operation":"ALTER TABLE","table":"dbo.Orders","time":"Thu Oct 05 14:30:00 PDT 2023"}

DDL Information

Read status of last DDL statement

CDC sources

string

most recent DDL

on each DDL

{"status":"Completed","ddl":"ALTER TABLE dbo.Orders ADD col1 INT"}

DDL Topic Information

DDL topic information in JSON format

Kafka Writer

string

current state

on change

{"topic":"striim-ddl","partitions":3}

DDLs Executed

Number of DDLs executed

CDC sources

count (long)

since application started

on each DDL

3

Discarded Event Count

Discarded event count

All adapters

count (long)

since application started

continuously

0

Discarded Open Transactions

Discarded open transactions

CDC sources

string

current state

on change

txn-1001,txn-1002

Discarded Records

Discarded records

All adapters

count (long)

since application started

continuously

0

Disk Free Space

Summary of free space on all local disks

Server

string

current state

every monitoring snapshot

/data: 250 GB free of 500 GB

Docs waiting to be processed

Number of docs fetched from DB and waiting to be processed

MongoDB Reader

count (long)

current state

continuously

5

Dynamic switch information

Dynamic switch information

PostgreSQL Reader

string

current state

on change

{"slot":"striim_slot","mode":"STREAMING"}

Elapsed Time

Time interval between start and end process

All components

millisecs (long)

most recent operation

on each operation

1250

Elasticsearch Cluster Storage Free

Free bytes in Elasticsearch

Elasticsearch Writer

bytes (long)

current state

every monitoring snapshot

107374182400

Elasticsearch Cluster Storage Total

Total Elasticsearch bytes

Elasticsearch Writer

bytes (long)

current state

every monitoring snapshot

107374182400

Elasticsearch Docs

Elasticsearch docs

Elasticsearch Writer

count (long)

since application started

continuously

50000

Elasticsearch Docs Rate

Elasticsearch docs rate

Elasticsearch Writer

docs/sec (float)

recent interval

every monitoring snapshot

150.5

Elasticsearch Fetch Rate

Elasticsearch fetch rate

Elasticsearch Writer

fetches/sec (float)

recent interval

every monitoring snapshot

25.3

Elasticsearch Fetches

Elasticsearch fetches

Elasticsearch Writer

count (long)

since application started

continuously

1000

Elasticsearch Free Space

Free space available to Elasticsearch

Elasticsearch Writer

string

current state

every monitoring snapshot

100 GB

Elasticsearch Hot Threads

Description of Elasticsearch hot threads

Elasticsearch Writer

string

current state

every monitoring snapshot

Hot threads at Thu Oct 05 14:30:00 PDT 2023

Elasticsearch Queries

Elasticsearch queries

Elasticsearch Writer

count (long)

since application started

continuously

5000

Elasticsearch Query Rate

Elasticsearch query rate

Elasticsearch Writer

queries/sec (float)

recent interval

every monitoring snapshot

50.5

Elasticsearch Receive Throughput

Elasticsearch RX bytes

Elasticsearch Writer

bytes (long)

since application started

continuously

10485760

Elasticsearch Size Bytes

Elasticsearch bytes size

Elasticsearch Writer

bytes (long)

current state

every monitoring snapshot

5368709120

Elasticsearch Size Bytes Rate

Elasticsearch bytes rate

Elasticsearch Writer

bytes/sec (float)

recent interval

every monitoring snapshot

1024.5

Elasticsearch Transmit Throughput

Elasticsearch transaction bytes

Elasticsearch Writer

bytes (long)

since application started

continuously

10485760

End-to-End Lag (LEE)

End-to-End Lag (LEE)

Platform monitor

seconds (LeeMonitorMetrics)

current state

every monitoring snapshot

0.5

EOF Status

Indicates whether the current file being read has reached EOF or not

File readers

boolean

current state

on change

0

Events ack'ed by assembler

Events ack'ed by assembler

All components

count (long)

current state

continuously

5

Events Buffered in Batch Partial Record Policy

Events buffered in Batch Partial Record Policy

Batch targets

count (string)

current state

continuously

12

Events Emitted

Number of events emitted so far

All components

count (long)

since application started

continuously

10000

Exceptions Ignored

Number of exceptions ignored

All adapters

count (long)

since application started

continuously

0

External I/O Latency

Time duration to complete I/O

File adapters

timespan (long)

most recent I/O

on each I/O

00m:00s:125ms

Fabric Mirror Table Metrics

Read/write status of all the tables mirrored in Fabric

Fabric Mirror

string

current state

every monitoring snapshot

{"dbo.Orders":{"rowsMirrored":1000,"status":"Synced"}}

First recorded checkpoint information of an application

Contains information of first recorded checkpoint like time, duration and type

Application

string

first checkpoint

on first checkpoint

{"type":"NORMAL","time":"Thu Oct 05 08:00:00 PDT 2023","duration":310}

Free Memory

Free memory

Server

bytes (long)

current state

every monitoring snapshot

1712128

Free Memory (%)

Free memory % out of total

Server

% (double)

current state

every monitoring snapshot

45.2

Full Name

Full name

All components

string

static

on startup

MyNamespace.MyApp

High Water Mark

High water mark

CDC sources

string

current state

on change

12345678

I/O Latency (in millisecs)

Time taken for a Salesforce API call in milliseconds

Salesforce Reader

millisecs (long)

most recent API call

on each API call

350

Ignorable Error Count

Number of ignorable errors (Salesforce Writer)

Salesforce Writer

count (long)

since application started

continuously

0

Ignorable Error Count

Number of ignorable errors (ServiceNow Writer)

ServiceNow Writer

count (long)

since application started

continuously

0

Ignorable Error Count

Number of ignorable errors

Target adapters

count (long)

since application started

continuously

0

Ignored Tables List

List of ignored tables in FDL

CDC sources

string

current state

on change

SYS.AUD$,SYS.FGA_LOG$

Individual Operation Count

Individual operation count

CDC sources

string

current state

every monitoring snapshot

{"INSERT":800,"UPDATE":150,"DELETE":50}

Input

Total number of events input into a component since it started

All components

count (long)

since application started

continuously

1000

Input Rate

Recent rate of events input into a component

All components

events/sec (float)

recent interval

every monitoring snapshot

150.5

Kafka Brokers

List of Kafka brokers

Kafka

string

current state

on change

kafka-broker-1:9092,kafka-broker-2:9092

Kafka Bytes

Number of Kafka bytes

Kafka

bytes (long)

since application started

continuously

10485760

Kafka Consumer Msg Rate

Messages read per sec

Kafka Reader

events/sec (float)

recent interval

every monitoring snapshot

150.5

Kafka Consumer Rate

Read bytes rate

Kafka Reader

MB/sec (float)

recent interval

every monitoring snapshot

1.5

Kafka Messages

Number of Kafka messages

Kafka

count (long)

since application started

continuously

10000

Kafka Messages Rate

Kafka messages rate

Kafka

msgs/sec (float)

recent interval

every monitoring snapshot

500

Kafka Producer ID(s)

Kafka producer client ID

Kafka Writer

string

current state

on change

striim-producer-1

Kafka Reader Partitions

List of partitions for KafkaReader

Kafka Reader

string

current state

every monitoring snapshot

[0,1,2]

Kafka Reader Partitions Lag

List of lag in each partition in KafkaReader

Kafka Reader

string

current state

every monitoring snapshot

{"0":0,"1":5,"2":2}

Kafka Transactional ID(s)

Kafka transactional ID

Kafka Writer

string

current state

on change

striim-txn-1

Kafka Write Rate

Kafka bytes rate

Kafka Writer

bytes/sec (float)

recent interval

every monitoring snapshot

1024.5

Lag Rate

Lag rate

Platform monitor

milliseconds (ratio)

recent interval

every monitoring snapshot

25.3

Lag Rate JSON Formatted

The LAG report formatted in JavaScript Object Notation

Platform monitor

string

current state

every monitoring snapshot

{"sourceLag":250,"targetLag":125,"unit":"ms"}

Lag Report

Lag record

Platform monitor

string

current state

every monitoring snapshot

Source lag: 250ms, Target lag: 125ms

Largest transaction details

Largest transaction details

CDC sources

string

current state

on change

{"txnId":"txn-5001","ops":5000,"size":10485760}

Last Backup file processed

Last backup file processed

SQL Server Reader

string

most recent backup

on each backup file

backup_2023-10-04.bak

Last Batch Information

Last batch information in JSON format

Batch targets

string

most recent batch

on each batch completion

{"batchId":41,"eventsProcessed":1000,"duration":1500,"status":"Success"}

Last Batch Partial Record Policy Details

PRP batch information (last batch)

Batch targets

string

most recent batch

on each batch completion

{"batchId":41,"eventsProcessed":250,"duration":1500}

Last Checkpoint Age

Time since the source restart position moved last

Application

seconds (double)

current moment

continuously

5

Last Checkpointed Position

Value of last checkpointed position

Source adapters

string

most recent checkpoint

on each checkpoint

binlog.000001:1234

Last Commit Latency

Last commit latency

Target adapters

long

most recent commit

on each commit

45

Last Commit Time

Last commit executed time

Target adapters

time (long)

most recent commit

on each commit

Thu Oct 05 14:30:00 PDT 2023

Last Downloaded File

Name of the last downloaded file

S3 Reader

string

most recent download

on each download

export_2023-10-05.csv

Last Event Position

Position of last event emitted by source

Source adapters

string

most recent event

on each event

binlog.000001:1234

Last Event Read Age

Time since the last event read from source

Source adapters

seconds (double)

current moment

continuously

2.5

Last Event Write Age

Time since the last event written to target

Target adapters

seconds (double)

current moment

continuously

1.5

Last Event's Modified Time

Latest datetime covered by the Salesforce API

Salesforce Reader

string

most recent event

on each event

2023-10-05T14:30:00.000Z

Last File Read

Name of the file that was read before moving to a new file

File readers

string

most recent file

on each file transition

data_2023-10-04.csv

Last File Read Time

Time at which last file was read before moving to a new file

File readers

time (long)

most recent file

on each file transition

Thu Oct 05 14:30:00 PDT 2023

Last I/O Size

Size of the last upload in bytes

File adapters

bytes (long)

most recent I/O

on each I/O

1048576

Last I/O Time

Timestamp of last I/O

File adapters

time (long)

most recent I/O

on each I/O

Thu Oct 05 14:30:00 PDT 2023

Last known connection failure

Last detected connection failure

All adapters

time (long)

most recent failure

on each failure

Thu Oct 05 14:30:00 PDT 2023

Last known overloaded exception received

Last detected Cassandra overload

Cassandra Writer

time (long)

most recent occurrence

on each overload

Thu Oct 05 14:30:00 PDT 2023

Last loop detected transaction ID

Last loop detected transaction ID

CDC sources

string

most recent detection

on each loop detection

txn-123456

Last Merge Time

Duration of last merge

Merge-capable targets

timespan (long)

most recent merge

on each merge

00m:30s:250ms

Last Observed Audit Trail Position

Last observed audit trail position

CDC sources

string

most recent event

on each event

12345678

Last Observed Audit Trail Timestamp

Last observed audit trail timestamp

CDC sources

time (long)

most recent event

on each event

Thu Oct 05 14:30:00 PDT 2023

Last observed batch mining duration (MINE mode)

Last observed batch mining duration (MINE mode)

SQL Server Reader

string

most recent batch

on each batch

00m:05s:250ms

Last observed batch mining time (MINE mode)

Last observed batch mining time (MINE mode)

SQL Server Reader

string

most recent batch

on each batch

Thu Oct 05 14:30:00 PDT 2023

Last Observed Discarded Record Table

Last observed discarded record table

SQL Server Reader

string

most recent discard

on each discard

dbo.Orders

Last observed message id

Last observed message id

Message queue adapters

string

most recent message

on each message

msg-id-12345

Last observed message id in previous commit

Last observed message id in previous commit

Message queue adapters

string

most recent previous commit

on each commit

msg-id-12344

Last observed message id time

Last observed message id time

Message queue adapters

string

most recent message

on each message

45204.6041666667

Last Observed MINE query execution duration

Last observed MINE query execution duration

SQL Server Reader

string

most recent query

on each query

00m:00s:350ms

Last Observed MINE query execution time

Last observed MINE query execution time

SQL Server Reader

string

most recent query

on each query

Thu Oct 05 14:30:00 PDT 2023

Last Observed Operation LSN

Last observed operation LSN

SQL Server Reader

string

most recent event

on each event

0000001A:000000F5:0001

Last Observed Operation LSN For Discarded Record

Last observed operation LSN for discarded record

SQL Server Reader

string

most recent discard

on each discard

0000001A:000000F5:0001

Last Observed Timestamp

Last observed timestamp

SQL Server Reader

string

most recent event

on each event

45204.6041666667

Last Observed Timestamp For Discarded Record

Last observed timestamp for discarded record

SQL Server Reader

string

most recent discard

on each discard

45204.6041666667

Last Read File Offset

Last read offset of the current file being read from the beginning

File readers

offset bytes (long)

current state

continuously

1048576

Last ReplayId

Last ReplayId

Salesforce Reader

string

most recent event

on each event

-1

Last Requested Replication Slot Flush LSN

Replication slot will be flushed till the LSN

PostgreSQL Reader

string

most recent flush

on each flush

0/1A2B3C4D

Last Requested Replication Slot Flush time

Last flush time

PostgreSQL Reader

time (long)

most recent flush

on each flush

Thu Oct 05 14:30:00 PDT 2023

Last Restart Abend Details

Latest restart abend record position

GoldenGate Reader

string

most recent abend

on each restart abend

{"position":"binlog.000001:1234","time":"Thu Oct 05 14:30:00 PDT 2023"}

Last Retry Attempt Timestamp

Last retry attempt timestamp

All adapters

time (long)

most recent retry

on each retry

Thu Oct 05 14:30:00 PDT 2023

Last Rolled-Over Filename

Name of the last rolled over file that was written

File writers

string

most recent rollover

on each rollover

output_2023-10-04.csv

Last Rolled-Over Time

Time at which last written file was rolled over

File writers

time (long)

most recent rollover

on each rollover

Thu Oct 05 14:30:00 PDT 2023

Last Send Timestamp

Last send timestamp

Target adapters

time (long)

most recent send

on each send

Thu Oct 05 14:30:00 PDT 2023

Last successful connection try time

Last successful connection try time

All adapters

time (long)

most recent reconnect

on each reconnect

Thu Oct 05 14:31:00 PDT 2023

Last Transaction Information

Last transaction information in JSON format

CDC sources

string

most recent transaction

on each transaction

{"txnId":"txn-9999","ops":500,"commitTime":"Thu Oct 05 14:30:00 PDT 2023"}

Last Uploaded Filename

Name of the last uploaded file

S3 / Cloud writers

string

most recent upload

on each upload

export_2023-10-05.parquet

Last uploaded Foldername

Name of the folder to which last file was uploaded

S3 / Cloud writers

string

most recent upload

on each upload

s3://my-bucket/exports/2023/10/05/

Latest Activity

Time of last known activity

All components

time (long)

most recent activity

on each activity

Thu Oct 05 14:30:00 PDT 2023

Latest Covered date

Latest datetime covered by the Salesforce API

Salesforce Reader

string

most recent query

on each query

2023-10-05T14:30:00.000Z

Latest Successful Message Id.

Latest successful message ID

JMS adapters

string

most recent message

on each successful message

msg-id-12345

Local Hits

Total cache lookup hits

Cache

count (long)

since application started

continuously

5000

Local Hits Rate

Local hits rate

Cache

hits/sec (float)

recent interval

every monitoring snapshot

150.5

Local Misses

Total cache lookup misses

Cache

count (long)

since application started

continuously

250

Local Misses Rate

Local miss rate

Cache

misses/sec (float)

recent interval

every monitoring snapshot

5.5

Log Error

Log error

All components

string

most recent error

on each error

Connection timed out to db-server-01:1521

Log Errors

Number of log errors

All components

count (long)

since application started

on each error

0

Log Warning

Log warning

All components

string

most recent warning

on each warning

Slow query detected: 350ms

Log Warnings

Number of log warnings

All components

count (long)

since application started

on each warning

5

Logminer Start Duration

Time taken by LogMiner to start

Oracle Reader

timespan (long)

most recent start

on each LogMiner start

00m:05s:250ms

Longest transaction details

Longest transaction details

CDC sources

string

current state

every monitoring snapshot

{"txnId":"txn-1001","duration":"00m:30s:500ms","ops":150}

Lookups

Number of lookups

Cache

count (long)

since application started

continuously

10000

Lookups Rate

Recent rate of cache lookups

Cache

lookups/sec (float)

recent interval

every monitoring snapshot

250.5

LSN Processed

LSN of last event in the last commit

PostgreSQL Reader

string

most recent commit

on each commit

0/1A2B3C4D

MAC Address

MAC address of physical hardware

Server

string

static

on startup

00:1A:2B:3C:4D:5E

Max concurrent open transactions

Total number of max concurrent open transactions

CDC sources

count (long)

since application started

continuously

10

Max Event Size

Maximum size of events that is seen

All components

bytes (long)

since application started

continuously

65536

Max LEE from all sources

Maximum LEE from all sources

Platform monitor

seconds (double)

current state

every monitoring snapshot

1.5

Max Time Between Sends

Max time between two Kafka send calls

Kafka Writer

timespan (long)

since application started

on each send

00m:01s:500ms

Max Time to Assemble

Max time to assemble

All components

millisecs (long)

since application started

continuously

150

Max Transaction Size In Bytes

Maximum transaction size in bytes

Kafka Writer

bytes (long)

since application started

on each transaction

10485760

Maximum Latency

Max latency between Kafka send and ack

Kafka Writer

millisecs (long)

since application started

on each send/ack

250

Maximum Memory

Maximum memory

Server

bytes (long)

current state

on startup/change

1712128

Maximum Response Latency till now

Max response latency

Cluster

millisecs (string)

since application started

on each response

350

Maximum RMI Response Time

Max response time by RMI call

Cluster

millisecs (long)

since application started

on each RMI call

350

Memory Usage Apply Session

Apply session memory usage

Oracle Reader

% (double)

current state

every monitoring snapshot

45.2

Memory Usage Capture Session

Capture session memory usage

Oracle Reader

% (double)

current state

every monitoring snapshot

32.8

Memory Usage LogMiner Session

LogMiner session memory usage

Oracle Reader

% (double)

current state

every monitoring snapshot

25.6

Memory Usage Streams Pool

Streams pool memory usage

Oracle Reader

% (double)

current state

every monitoring snapshot

18.4

Metrics for the last minute

Live metrics of Sentinel in JSON

Sentinel Writer

string

last minute

every minute

{"eventsProcessed":9000,"errors":0,"avgLatency":45.2}

Monitor Processing Time

Time to process last batch of monitoring data

Platform monitor

timespan (long)

most recent snapshot

every monitoring snapshot

00m:00s:150ms

Name

Name

All components

string

static

on startup

MyApp

Name of CPU Thread

CPU time of thread

Server

string

current state

every monitoring snapshot

wa-thread-1: 5.2%

Name of the last cloud objects metadata fetched

Name of the last cloud objects metadata fetched

S3 / Cloud readers

string

most recent object

on each object read

data/export_2023-10-05.csv

Name Prefix

Name prefix

All components

string

static

on startup

MyNamespace

Network Failures Count

Network failures count

All adapters

count (long)

since application started

continuously

0

Next Query Time

Next Salesforce API call will be at

Salesforce Reader

string

next scheduled query

on each query

2023-10-05T14:35:00.000Z

No of JMS messages committed

No of JMS messages committed during a transaction

JMS adapters

count (long)

since application started

on each commit

1000

No of JMS messages ignored

No of JMS messages ignored

JMS adapters

count (long)

since application started

continuously

0

No of Kafka messages sent

No of Kafka messages sent

Kafka Writer

count (long)

since application started

continuously

10000

No of Parsers

No of parsers

CDC sources

count (long)

current state

on change

4

No of PRP Events in Batch Partial Record Policy Buffer

No of PRP events in Batch Partial Record Policy buffer

Batch targets

count (string)

current state

continuously

8

No of Restart Abend Encountered

No of restart abend operations encountered so far

GoldenGate Reader

count (long)

since application started

on each restart abend

0

NO-OP Operations

NO-OP operations in JSON format

All components

string

current state

every monitoring snapshot

{}

No.of events accepted per interval

Number of events accepted by a target per time period

Target adapters

count (long)

per monitoring interval

every monitoring snapshot

25

Num of S3 objects in last poll

Number of files downloaded since last poll

S3 Reader

count (long)

last poll

on each poll

5

Number of Access Tokens

Number of access tokens

OAuth-based adapters

count (long)

current state

continuously

2

Number Of Discarded Record

Number of discarded records

SQL Server Reader

string

since application started

continuously

0

Number of Events in Queue Currently

Number of events in queue currently

All components

count (long)

current state

continuously

150

Number of events seen per monitor snapshot interval

Events per time period

All components

count (long)

per monitoring interval

every monitoring snapshot

25

Number of late checkpoints injected

Number of late checkpoints injected

Application

count (long)

since application started

on each late checkpoint

0

Number of late checkpoints recorded

Number of late checkpoints recorded

Application

count (long)

since application started

on each late checkpoint

0

Number of LogRecords mined (MINE mode)

Number of LogRecords mined (MINE mode)

SQL Server Reader

string

since application started

continuously

1000000

Number of LogRecords read

Number of LogRecords read

SQL Server Reader

string

since application started

continuously

1000000

Number of messages in last commit

Number of messages in last commit

Message queue adapters

count (long)

most recent commit

on each commit

500

Number of normal checkpoints injected

Number of normal checkpoints injected

Application

count (long)

since application started

on each checkpoint

10

Number of normal checkpoints recorded

Number of normal checkpoints recorded

Application

count (long)

since application started

on each checkpoint

10

Number of Retries

Number of retries

All adapters

count (long)

since application started

continuously

2

Number of Times throttled

Number of times throttled

All adapters

count (long)

since application started

continuously

2

Object Write Information

Write status of all the objects in JSON format

Database targets

string

current state

every monitoring snapshot

{"myObject":{"rowsWritten":1000,"status":"Success"}}

Observed binlog name and offset

The binlog file name and the offset of the latest transaction captured

MySQL Reader

string

most recent event

on each event

binlog.000001:1234

Observed binlog read time

The time when the latest event was captured by the adapter

MySQL Reader

string

most recent event

on each event

45204.6041666667

Observed operation timestamp

The operation timestamp of the latest transaction captured

MySQL Reader

string

most recent event

on each event

45204.6041666667

Oldest Open Transactions

Longest open transactions

CDC sources

string

current state

every monitoring snapshot

{"txnId":"txn-1001","openFor":"00m:30s:500ms","ops":150}

Open transactions high water mark by count

Open transactions high water mark by count

CDC sources

string

since application started

on change

50

Open transactions in cache

Transactions in cache (with operations of interest)

CDC sources

count (long)

current state

continuously

3

Operations in the Cache

Total number of operations in cache

CDC sources

count (long)

current state

continuously

1000

Optimized Read Range

OCSM mining range

Oracle Reader

string

current state

every monitoring snapshot

12345678:12346000

Oracle Reader Current SCN

Oracle DB current SCN

Oracle Reader

string

current state

continuously

12345678

Oracle Reader Last SCN

Last observed LCR-SCN

Oracle Reader

string

most recent event

on each event

12345678

Oracle Reader Last Timestamp

Last observed LCR-timestamp

Oracle Reader

time (long)

most recent event

on each event

Thu Oct 05 14:30:00 PDT 2023

Oracle Reader Thread Specific Last SCN

Last observed LCR-SCN per thread

Oracle Reader

string

most recent event per thread

on each event

{"1":12345678,"2":12345650}

Output

Total events output from a component

All components

count (long)

since application started

continuously

1000

Output Rate

Recent rate of events output from a component

All components

events/sec (float)

recent interval

every monitoring snapshot

150.5

Packets Discarded

Packets discarded

All adapters

count (long)

since application started

continuously

0

Packets Processed

Packets processed

All adapters

count (long)

since application started

continuously

10000

Parallel threads information

Thread information

CDC sources

string

current state

every monitoring snapshot

{"thread-1":{"status":"RUNNING","eventsProcessed":500},"thread-2":{"status":"RUNNING","eventsProcessed":500}}

PartialRecordPolicy

PRP information

Batch targets

string

current state

on change

{"policy":"SKIP","tablesAffected":["dbo.Orders"]}

Partitions

Number of partitions

Kafka

count (long)

current state

on change

3

Percentage of Memory Used

Percent of memory used out of total memory

Server

percent (float)

current state

every monitoring snapshot

54.8

Previous checkpoint information of an application

Contains information of previous recorded checkpoint like time, duration and type

Application

string

previous checkpoint

on each checkpoint

{"type":"NORMAL","time":"Thu Oct 05 14:25:00 PDT 2023","duration":235}

Previously Queried TimeFrame

Timeframe queried by the Salesforce API in previous call

Salesforce Reader

string

most recent query

on each query

2023-10-05T14:25:00Z to 2023-10-05T14:30:00Z

Processed

Total events processed by a component since it started

All components

count (long)

since application started

continuously

1000

Processed Rate

Processed rate

All components

events/sec (float)

recent interval

every monitoring snapshot

150.5

Queued Batches Size In Bytes

Queued batches size in bytes

Batch targets

bytes (long)

current state

continuously

524288

Range Head

Range head

CDC sources

long

current state

continuously

12350

Range Tail

Range tail

CDC sources

long

current state

continuously

12345

Rate

Throughput of events

All components

events/sec (float)

recent interval

every monitoring snapshot

150.5

Read Lag

Read lag

CDC sources

millisecs (long)

current state

every monitoring snapshot

250

Read Status

Read status

Database targets

MetricInfo

current state

every monitoring snapshot

{"TotalRows":1000,"schemaGenerationStatus":"Pending","dataReadStatus":"Completed","RowsRead":1000}

Read Timestamp

Timestamp of the last record that Striim read from the source

Source adapters

time (long)

most recent event

on each event

Thu Oct 05 14:30:00 PDT 2023

Reader Information

Reader statistics in JSON format

Database sources

string

current state

every monitoring snapshot

{"rowsRead":1000,"bytesRead":10485760,"status":"RUNNING"}

Received

Received

All components

count (long)

since application started

continuously

1000

Received Rate

Received rate

All components

events/sec (float)

recent interval

every monitoring snapshot

150.5

Recent Access Token Retrieval Time

Last time the refresh token gets refreshed

OAuth-based adapters

time (long)

most recent token refresh

on each token refresh

Thu Oct 05 14:30:00 PDT 2023

Record Position

Record position

Source adapters

string

most recent event

on each event

binlog.000001:1234

Recovery Status

Recovery status

Application

string

current state

on change

Completed

Redo Switch Count

Redo switch count

Oracle Reader

string

since application started

on each redo switch

5

Remote Hits

Number of remote hits

Cache

count (long)

since application started

continuously

250

Remote Hits Rate

Remote hits rate

Cache

hits/sec (float)

recent interval

every monitoring snapshot

5.5

Remote Misses

Number of remote misses

Cache

count (long)

since application started

continuously

10

Remote Misses Rate

Remote miss rate

Cache

misses/sec (float)

recent interval

every monitoring snapshot

0.5

Replication Slot I/O status

Replication slot I/O status

PostgreSQL Reader

string

current state

every monitoring snapshot

45204.6041666667

RMI Calls

Number of RMI calls

Cluster

count (integer)

since application started

on each RMI call

50

Row Count

Row count

All components

count (long)

since application started

continuously

1000

Schema Evolution Status

Schema evolution status

Application

string

current state

on change

Success

Sent Bytes Rate

Sent bytes rate

Kafka Writer

MB/sec (float)

recent interval

every monitoring snapshot

1.5

Skipped Files list

Skipped files list

File readers

string

current state

on change

corrupt_file.csv,empty_file.csv

Source Freshness

Difference between current time and read timestamp

Source adapters

timespan (long)

current state

continuously

00m:05s:123ms

Source Input

Source input

Source adapters

count (long)

since application started

continuously

1000

Source Rate

Source rate

Source adapters

events/sec (float)

recent interval

every monitoring snapshot

150.5

StartSCN

Start SCN

Oracle Reader

string

startup state

on startup

12345678

Status Change

Current status

All components

string

current state

on change

RUNNING

Status Change

Change in status

All components

string

current state

on change

RUNNING

Status of checkpoint

Status of checkpoint

Application

string

current state

on change

RUNNING

Stream Full

If stream is full

All components

boolean

current state

on change

0

Successful Transactions

Count of Kafka successful transactions

Kafka Writer

count (long)

since application started

continuously

1000

Table Information

Read/write status of all the tables in JSON format

Database targets

string

current state

every monitoring snapshot

{"No of Deletes":0,"No of DDLs":0,"No of PKUpdates":0,"No of Updates":0,"No of Inserts":1000}

Table Write Information

Write status of the tables in JSON format

Database targets

MetricInfo

current state

every monitoring snapshot

{"dbo.Orders":{"rowsWritten":1000,"status":"Success"}}

Target Acked

Number of events acked by an adapter to a target

Target adapters

count (long)

since application started

continuously

1000

Target Commit Position

Commit position

Target adapters

string

most recent commit

on each commit

binlog.000001:1234

Target Freshness

Difference between current time and write timestamp

Target adapters

timespan (long)

current state

continuously

00m:05s:123ms

Target Output

Target output

Target adapters

count (long)

since application started

continuously

1000

Target Rate

Target rate

Target adapters

events/sec (float)

recent interval

every monitoring snapshot

150.5

Time at which last late checkpoint was recorded

Time at which last late checkpoint was recorded

Application

time (long)

most recent late checkpoint

on each late checkpoint

Thu Oct 05 14:30:00 PDT 2023

Time at which last normal checkpoint was recorded

Time at which last normal checkpoint was recorded

Application

time (long)

most recent checkpoint

on each checkpoint

Thu Oct 05 14:30:00 PDT 2023

Time of last successful merge

Time of last successful merge

Merge-capable targets

time (long)

most recent merge

on each merge

Thu Oct 05 14:30:00 PDT 2023

Time taken for last checkpoint

Approximate time taken to compute or record a normal checkpoint

Application

timespan (long)

most recent checkpoint

on each checkpoint

00m:00s:250ms

Time taken for last file download

Time taken for last file download

S3 Reader

timespan (long)

most recent download

on each download

00m:02s:350ms

Time taken for last late checkpoint

Approximate time taken to compute or record a late checkpoint

Application

timespan (long)

most recent late checkpoint

on each late checkpoint

00m:00s:500ms

Time taken for Merge

Time taken for merge

Merge-capable targets

timespan (long)

most recent merge

on each merge

00m:30s:250ms

Timestamp

Timestamp of some data

All components

time (long)

most recent event

on each event

Thu Oct 05 14:30:00 PDT 2023

Token is Expiring

Connection profile refresh token is expiring

OAuth-based adapters

boolean

current state

on change

0

Top Open Transactions (# of Ops)

Top open transactions

CDC sources

string

current state

every monitoring snapshot

[{"txnId":"txn-1001","ops":500},{"txnId":"txn-1002","ops":300}]

Topic Information

Topic information in JSON format

Kafka

string

current state

on change

{"topic":"my-topic","partitions":3,"replication":2}

Topic-Partition Info

Topic-partition info

Kafka

MetricInfo

current state

every monitoring snapshot

{"my-topic-0":{"lag":0,"offset":5000},"my-topic-1":{"lag":5,"offset":4995}}

Total Active Connections

Total Active Connections

EventHub

count (long)

current state

continuously

3

Total Cosmos Request Rate Too Large Exceptions

Total Cosmos request rate too large exceptions

CosmosDB Writer

count (long)

since application started

continuously

0

Total Cosmos Request Units Usage

Total Cosmos request units usage

CosmosDB Writer

count (float)

since application started

continuously

250.5

Total Events entered the queue

Total events entered the queue

All components

count (long)

since application started

continuously

50000

Total Events In Current File

Total number of events written in current file

File writers

count (long)

current file

continuously

5000

Total Events In Last Commit

Total events in last commit

Target adapters

count (long)

most recent commit

on each commit

500

Total Events In Last I/O

Total events in last I/O

File adapters

count (long)

most recent I/O

on each I/O

1000

Total Events In Last Upload

Total number of events in last upload

S3 / Cloud writers

count (long)

most recent upload

on each upload

5000

Total Events In Previous File

Total number of events written in previous rolled over file

File writers

count (long)

previous file

on each file rollover

10000

Total Kafka Msgs Read

Total messages read from a topic

Kafka Reader

count (long)

since application started

continuously

50000

Total Kafka Send Calls

Total number of Kafka send calls

Kafka Writer

count (long)

since application started

continuously

10000

Total Kinesis Send Calls

Total number of Kinesis send calls

Kinesis Writer

count (long)

since application started

continuously

10000

Total Logminer Records read

Total LogMiner records read

Oracle Reader

string

since application started

continuously

1000000

Total Loop Detected Operations Dropped

Total loop detected operations dropped

CDC sources

count (long)

since application started

continuously

0

Total Loop Detected Transactions Dropped

Total loop detected transactions dropped

CDC sources

count (long)

since application started

continuously

0

Total Memory

Total memory

Server

bytes (long)

current state

on startup/change

1712128

Total no of events in last merge

Total no of events in last merge

Merge-capable targets

count (long)

most recent merge

on each merge

10000

Total No Of Records Retried

Total no of records retried

Target adapters

count (long)

since application started

continuously

0

Total No Of Records Sent

Total no of records sent

Target adapters

count (long)

since application started

continuously

10000

Total num of Downloaded S3 Objects

Number of files downloaded

S3 Reader

count (long)

since application started

on each download

25

Total Number EventHub Request Sent

Total number of EventHub requests sent

EventHub Writer

count (long)

since application started

continuously

10000

Total number of Overloaded Exceptions received

Total number of overloaded exceptions received

Cassandra Writer

string

since application started

continuously

3

Total number of Reconnects

Total number of reconnects

All adapters

count (long)

since application started

continuously

2

Total time spent on throttling

Total time spent on throttling

All adapters

timespan (long)

since application started

continuously

00m:00s:500ms

Trail Recovery Status

Trail recovery status

GoldenGate Reader

string

current state

on change

Completed

Transactions spilling to disk

Transactions spilling to disk

CDC sources

boolean

current state

on change

0

Transactions with no DML operations

Transactions in cache (with no operations of interest)

CDC sources

count (long)

current state

continuously

15

Uptime

Up time

Server

timespan (long)

since application started

continuously

1h:30m:05s:123ms

Version

Version

Server

string

static

on startup

4.2.0.2

Wactions Created

Number of wactions created

Wactions

count (long)

since application started

continuously

1000

Wactions Created Rate

Creation rate of wactions

Wactions

wactions/sec (float)

recent interval

every monitoring snapshot

150.5

Window Size

Size of window

Windows / CQ

count (long)

current state

continuously

500

Write Bytes

Write bytes rate

Target adapters

MB/sec (float)

recent interval

every monitoring snapshot

1.5

Write Timestamp

Timestamp of the last record written to target

Target adapters

time (long)

most recent write

on each write

Thu Oct 05 14:30:00 PDT 2023