Amazon Kinesis Integration

Amazon Kinesis

Version: AWS Log Forwarder v1.0.10 and above

Amazon Kinesis Data Analytics is a managed service used to process and analyze streaming data using Java, SQL, or Scala. The service quickly authors and runs the Java, SQL, or Scala code against streaming sources to perform the time series analytics, feed real-time dashboards, and create real-time metrics.

Netsurion monitors events from Amazon Kinesis by parsing the AWS CloudTrail logs for Kinesis. Dashboards and reports in Netsurion allow you to monitor overall actions triggered related to Kinesis so that you are informed about its activities. It will trigger alerts whenever an action that is critical to the application is carried out, like stopping operation or deletion of app configuration or the application itself.

For a new instance, integrate the AWS instance to Netsurion using the Netsurion integrator AWS Lambda function, which will in turn deliver logs to Netsurion from Amazon Web Services. For an already-integrated AWS instance, make sure to update to AWS Log Forwarder to v1.0.10 or above.

Once configured to deliver events to Netsurion Manager, the alerts, dashboards, and reports can be configured into Netsurion.

Some of the Data Source Integrations available in Netsurion are listed below.

Alerts

Type	Name	Description
Security	Amazon Kinesis - Application deleted	This alert is triggered when a Kinesis Analytics application is deleted.
Security	Amazon Kinesis - Stream retention period decreased	This alert is triggered when the retention period of data records is decreased for a Kinesis data stream.
Security	Amazon Kinesis - Data stream deleted	This alert is triggered when a data stream is deleted in Kinesis.
Security	Amazon Kinesis - Delivery stream deleted	This alert is triggered when a delivery stream is deleted in Kinesis.
Security	Amazon Kinesis - Data stream encryption disabled	This alert is triggered when the server-side encryption is disabled for a Kinesis stream.
Operations	Amazon Kinesis - Data preprocessor deleted	This alert is triggered when a data pre-processing function is removed from the configuration settings of a Kinesis analytics application.
Operations	Amazon Kinesis - SQL I/O configuration deletion	This alert is triggered when an output stream or a reference output data source is deleted.
Operations	Amazon Kinesis - Application stopped	This alert is triggered when a Kinesis Analytics application is stopped.
Operations	Amazon Kinesis - Stream enhanced metrics disabled	This alert is triggered when the enhanced monitoring for a Kinesis stream is disabled.
Operations	Amazon Kinesis - Stream shard count updated	This alert is triggered when the shard count for a particular Kinesis data stream is updated.

Reports

Type	Name	Description
Operations	Amazon Kinesis - Analytic application modifications	This report gives the details of all actions carried out in relation to the Kinesis analytics service. It gives information about the action name, the time it was initiated, and by whom, among some other details related to the application and the user.
Operations	Amazon Kinesis - Data stream activities	This report gives the details of all actions related to data streams in Kinesis, which includes information like stream name, the action initiated against it, the timestamp for the action, and the user information for the same.

Documentation

The configuration details are consistent with Netsurion version 9.3X and later, and ETS AWS LogForwarder v1.0.10 and above.

Download Integration Guide and How-to Guide for more information and to configuration instructions.