# Optic Data Lake (ODL) ### What is Optic Data Lake integration in ZigiOps? Optic Data Lake (ODL) is a data management and analytics platform used to store, retain, and query large volumes of metrics and topology data from enterprise monitoring tools. ZigiOps enables secure, API-based integration between Optic Data Lake and monitoring, APM, and infrastructure management platforms. Using ZigiOps, metrics, topology, and performance data from tools such as AppDynamics, Datadog, Dynatrace, New Relic, and SolarWinds can be ingested into ODL for long-term retention and analytics. With ZigiOps, Optic Data Lake can: * Receive and store metrics and topology data from multiple monitoring platforms * Support retention profile-based data management for raw, hourly, and daily aggregations * Provide a centralized analytics layer for cross-platform operational data * Enable historical trend analysis and capacity planning across hybrid environments The integration is fully customizable and does not require custom scripts or plugins. ### Which Optic Data Lake versions are supported? Please note that using a supported version is mandatory. | Product | Supported Deployment Types | Supported Versions | | --------------- | -------------------------- | ------------------ | | Optic Data Lake | All | All | ### Are there any environmental prerequisites for Optic Data Lake? {% hint style="info" %} Confirm the prerequisites of the corresponding integration template before continuing, as some templates may not require all environmental prerequisites. {% endhint %} Before configuring the ZigiOps connected system, the appropriate retention profiles and datasets must be imported into Vertica for each monitoring tool you plan to integrate. Download the Optic Data Lake datasets and retention profiles from: `https://download.zigiwave.com/zigiops/opticdl/opticdl_datasets_ret_profiles_v1_2024-01-16.zip` Follow the OPTIC DL documentation for the import procedure (Product: OPTIC Data Lake, Service: OPTICDL Open Data Ingestion Administration API V3). #### AppDynamics retention profiles and datasets Unzip the archive and locate the `AppDynamics_ret_prof` folder. Import the following retention profiles: * `appdynamics_retention_raw.json` * `appdynamics_retention_hourly.json` * `appdynamics_retention_daily.json` Import the following datasets: * **AppDynamics\_application\_set:** `appdynamics_application_task_flow.json` and associated raw/1h/1d files * **AppDynamics\_node\_set:** `appdynamics_node_task_flow.json` and associated raw/1h/1d files #### Datadog retention profiles and datasets Locate the `DataDog_ret_profiles` folder and import: * `datadog_retention_raw.json` * `datadog_retention_hourly.json` * `datadog_retention_daily.json` * **DataDog\_host\_set:** `datadog_host_task_flow.json` and associated raw/1h/1d files #### Dynatrace retention profiles and datasets Locate the `Dynatrace_ret_profiles` folder and import: * `dynatrace_retention_raw.json` * `dynatrace_retention_hourly.json` * `dynatrace_retention_daily.json` Import the following datasets: `Dynatrace_app_bowser_set`, `Dynatrace_app_user_type_set`, `Dynatrace_disk_set`, `Dynatrace_host_set`, `Dynatrace_network_set`, `Dynatrace_service_set` (each with corresponding `task_flow.json` and raw/1h/1d files). #### New Relic retention profiles and datasets Locate the `NewRelic_ret_prof` folder and import: * `newrelic_retention_raw.json` * `newrelic_retention_hourly.json` * `newrelic_retention_daily.json` * **NewRelic\_app\_set** and **NewRelic\_host\_set** with corresponding `task_flow.json` and raw/1h/1d files #### SolarWinds retention profiles and datasets Locate the `Solarwinds_ret_profiles` folder and import: * `solarwinds_retention_raw.json` * `solarwinds_retention_hourly.json` * `solarwinds_retention_daily.json` Import the following datasets: `Solarwinds_cluster_set`, `Solarwinds_esxi_set`, `Solarwinds_host_set`, `Solarwinds_vm_set` (each with corresponding `task_flow.json` and raw/1h/1d files). ### How do I connect Optic Data Lake to ZigiOps? #### Optic Data Lake - Connected System Configuration Follow the steps below to add your Optic Data Lake instance as a connected system. 1. Log into your ZigiOps instance. 2. Navigate to: **Connected Systems > Add New System > Optic DL** 3. Configure the following parameters: * **URL** - Input the URL of your Optic DL instance. For example, `https://opticdl.example.com` * **Username** - The username ZigiOps uses to authenticate and obtain a token from the OPTIC DL API. * **Password** - The password ZigiOps uses to authenticate against the OPTIC DL API. * **Tenant Name** - The name of the Micro Focus OPTIC DL tenant. * **Proxy Settings** - Enables the usage of a proxy server. 4. Examine the settings and if they are correct, click the **Save** button to store the system. 5. Once saved, Optic Data Lake becomes available for use in ZigiOps integration templates. ### What are the most common Optic Data Lake integration use cases? #### Use case 1: Metrics ingestion from APM tools ZigiOps forwards application and host metrics from tools like AppDynamics, New Relic, and Dynatrace into ODL, where they are stored according to defined retention profiles for reporting and trend analysis. #### Use case 2: Topology data storage from monitoring platforms Infrastructure topology data from SolarWinds and other monitoring tools can be ingested into ODL via ZigiOps, providing a persistent, queryable record of the infrastructure landscape over time. #### Use case 3: Centralized long-term data retention for multi-tool environments Organizations running multiple monitoring platforms can use ZigiOps to funnel all operational data into ODL under a consistent retention schema, enabling cross-platform analytics without custom ETL pipelines. ### What integration templates are available for Optic Data Lake? ZigiOps integration templates for Optic Data Lake are available depending on the paired monitoring system. Please contact for detailed template availability. Templates are documented individually in the Integration Catalog. ### Summary The Optic Data Lake integration in ZigiOps enables: * Secure, token-based API connectivity * Support for all ODL deployment types * Metrics and topology data ingestion from AppDynamics, Datadog, Dynatrace, New Relic, and SolarWinds * Retention profile-based data management in Vertica * Optional proxy configuration * Fully customizable data forwarding workflows ZigiOps allows Optic Data Lake to serve as a centralized data retention layer for enterprise monitoring ecosystems without requiring custom development. --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.zigiwave.com/available-systems/optic-data-lake-odl.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.