Optic Data Lake (ODL)

Connect Optic Data Lake to ZigiOps. Retention profile imports for AppDynamics, Datadog, Dynatrace, New Relic, and SolarWinds, plus connected system configuration.

What is Optic Data Lake integration in ZigiOps?

Optic Data Lake (ODL) is a data management and analytics platform used to store, retain, and query large volumes of metrics and topology data from enterprise monitoring tools.

ZigiOps enables secure, API-based integration between Optic Data Lake and monitoring, APM, and infrastructure management platforms. Using ZigiOps, metrics, topology, and performance data from tools such as AppDynamics, Datadog, Dynatrace, New Relic, and SolarWinds can be ingested into ODL for long-term retention and analytics.

With ZigiOps, Optic Data Lake can:

  • Receive and store metrics and topology data from multiple monitoring platforms

  • Support retention profile-based data management for raw, hourly, and daily aggregations

  • Provide a centralized analytics layer for cross-platform operational data

  • Enable historical trend analysis and capacity planning across hybrid environments

The integration is fully customizable and does not require custom scripts or plugins.

Which Optic Data Lake versions are supported?

Please note that using a supported version is mandatory.

Product
Supported Deployment Types
Supported Versions

Optic Data Lake

All

All

Are there any environmental prerequisites for Optic Data Lake?

Confirm the prerequisites of the corresponding integration template before continuing, as some templates may not require all environmental prerequisites.

Before configuring the ZigiOps connected system, the appropriate retention profiles and datasets must be imported into Vertica for each monitoring tool you plan to integrate. Download the Optic Data Lake datasets and retention profiles from:

https://download.zigiwave.com/zigiops/opticdl/opticdl_datasets_ret_profiles_v1_2024-01-16.zip

Follow the OPTIC DL documentation for the import procedure (Product: OPTIC Data Lake, Service: OPTICDL Open Data Ingestion Administration API V3).

AppDynamics retention profiles and datasets

Unzip the archive and locate the AppDynamics_ret_prof folder. Import the following retention profiles:

  • appdynamics_retention_raw.json

  • appdynamics_retention_hourly.json

  • appdynamics_retention_daily.json

Import the following datasets:

  • AppDynamics_application_set: appdynamics_application_task_flow.json and associated raw/1h/1d files

  • AppDynamics_node_set: appdynamics_node_task_flow.json and associated raw/1h/1d files

Datadog retention profiles and datasets

Locate the DataDog_ret_profiles folder and import:

  • datadog_retention_raw.json

  • datadog_retention_hourly.json

  • datadog_retention_daily.json

  • DataDog_host_set: datadog_host_task_flow.json and associated raw/1h/1d files

Dynatrace retention profiles and datasets

Locate the Dynatrace_ret_profiles folder and import:

  • dynatrace_retention_raw.json

  • dynatrace_retention_hourly.json

  • dynatrace_retention_daily.json

Import the following datasets: Dynatrace_app_bowser_set, Dynatrace_app_user_type_set, Dynatrace_disk_set, Dynatrace_host_set, Dynatrace_network_set, Dynatrace_service_set (each with corresponding task_flow.json and raw/1h/1d files).

New Relic retention profiles and datasets

Locate the NewRelic_ret_prof folder and import:

  • newrelic_retention_raw.json

  • newrelic_retention_hourly.json

  • newrelic_retention_daily.json

  • NewRelic_app_set and NewRelic_host_set with corresponding task_flow.json and raw/1h/1d files

SolarWinds retention profiles and datasets

Locate the Solarwinds_ret_profiles folder and import:

  • solarwinds_retention_raw.json

  • solarwinds_retention_hourly.json

  • solarwinds_retention_daily.json

Import the following datasets: Solarwinds_cluster_set, Solarwinds_esxi_set, Solarwinds_host_set, Solarwinds_vm_set (each with corresponding task_flow.json and raw/1h/1d files).

How do I connect Optic Data Lake to ZigiOps?

Optic Data Lake - Connected System Configuration

Follow the steps below to add your Optic Data Lake instance as a connected system.

  1. Log into your ZigiOps instance.

  2. Navigate to: Connected Systems > Add New System > Optic DL

  3. Configure the following parameters:

  • URL - Input the URL of your Optic DL instance. For example, https://opticdl.example.com

  • Username - The username ZigiOps uses to authenticate and obtain a token from the OPTIC DL API.

  • Password - The password ZigiOps uses to authenticate against the OPTIC DL API.

  • Tenant Name - The name of the Micro Focus OPTIC DL tenant.

  • Proxy Settings - Enables the usage of a proxy server.

  1. Examine the settings and if they are correct, click the Save button to store the system.

  2. Once saved, Optic Data Lake becomes available for use in ZigiOps integration templates.

What are the most common Optic Data Lake integration use cases?

Use case 1: Metrics ingestion from APM tools

ZigiOps forwards application and host metrics from tools like AppDynamics, New Relic, and Dynatrace into ODL, where they are stored according to defined retention profiles for reporting and trend analysis.

Use case 2: Topology data storage from monitoring platforms

Infrastructure topology data from SolarWinds and other monitoring tools can be ingested into ODL via ZigiOps, providing a persistent, queryable record of the infrastructure landscape over time.

Use case 3: Centralized long-term data retention for multi-tool environments

Organizations running multiple monitoring platforms can use ZigiOps to funnel all operational data into ODL under a consistent retention schema, enabling cross-platform analytics without custom ETL pipelines.

What integration templates are available for Optic Data Lake?

ZigiOps integration templates for Optic Data Lake are available depending on the paired monitoring system.

Please contact [email protected] for detailed template availability. Templates are documented individually in the Integration Catalog.

Summary

The Optic Data Lake integration in ZigiOps enables:

  • Secure, token-based API connectivity

  • Support for all ODL deployment types

  • Metrics and topology data ingestion from AppDynamics, Datadog, Dynatrace, New Relic, and SolarWinds

  • Retention profile-based data management in Vertica

  • Optional proxy configuration

  • Fully customizable data forwarding workflows

ZigiOps allows Optic Data Lake to serve as a centralized data retention layer for enterprise monitoring ecosystems without requiring custom development.

Last updated

Was this helpful?