Skip to content

aviciot/informatica_insight_portal

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

17 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ“Š Informatica Insights Portal

🧭 Overview

The Informatica Insights Portal is a lightweight web dashboard that provides a clear view of Informatica metadata and performance statistics.

πŸ” Key Features

  • Browse folders, workflows, sessions, and DB connections
  • Visualize dependencies between Informatica components
  • Analyze performance of workflows and sessions (with ML-based insights)
  • Identify bottlenecks and anomalies in execution
  • Fast, low-impact access

The portal pulls metadata and execution stats once from the production database and caches them locally, minimizing impact on the production Informatica environment.

Built for developers, analysts, and admins who need visibility into Informatica processes and performance.


πŸ“˜ Documentation

Full documentation available at:
πŸ‘‰ https://aviciot.github.io/informatica_insight_portal/


πŸ”‘ Key Features

πŸ” 1. Authentication & Role-Based Access

  • Admin and user roles with permission control - allowing fine-grained restrictions to sections or operations based on user roles.

βš™οΈ 2. YAML-Based Configuration

  • Centralized settings via config.yaml
  • Environment and database configuration management

πŸ—ƒοΈ 3. Informatica Metadata Exploration

  • View folders, workflows, sessions, command tasks, and connections
  • Search and filter processes by keyword or metadata

🌳 4. Workflow Hierarchy Visualization

  • Interactive tree view of:
    • Folders β†’ Workflows β†’ Sessions β†’ Scripts
    • Command Tasks
    • Connections
    • Table Dependencies
  • Trace all processes related to a specific database or connection

🧩 5. Session & Command Task Insights

  • Display of session execution data
  • Insight into command task usage and linkages
  • Identify broken or missing connections

πŸ“ˆ 6. Performance Insights

  • Visualize workflow and session execution durations
  • Spot long-running or abnormal tasks
  • Filter by date range, workflow, or session type
  • Useful for performance tuning and troubleshooting

⚑ High-Performance Architecture

The portal is designed for speed and low impact on production systems.

All relevant Informatica metadata and execution statistics is cached in an internal database , allowing the app to:

  • Minimize direct queries to the Informatica repository
  • Operate independently from the production environment
  • Deliver fast performance even for large datasets

This approach ensures a smooth, responsive user experience while preserving system stability.

Note ,This is the very first release β€” focused on foundational features for metadata visibility, performance monitoring, and system understanding. More to come....


πŸ’‘ Example Use Case

β€œFind all workflows connected to Database X and detect any sessions that consistently run over 30 minutes.”


πŸ› οΈ Additional Functionalities

  • Search by Connection or Table Name
  • Compare Workflow Definitions (Planned)
  • Admin Panel for cache reset and config control
  • Export to CSV (Planned)

πŸ“¦ Tech Stack

  • Python
  • SQLAlchemy
  • SQLite / PostgreSQL /Oracle
  • YAML for configuration

πŸ“· Screenshots

Explore the key features of the Informatica Insights Portal through the following screenshots.


πŸ“Š Informatica Insights & Workflow Explorer

Home Page

alt text

Full visibility into Informatica components: workflows, sessions, connections, and command tasks.

πŸ“‹ Tabular View

Flat table showing all components in a workflow β€” sessions, commands, dependencies, and more.
Workflow Table View

🌲 JSON Tree View

Visual representation of workflow structure:
Workflows β†’ Sessions β†’ Commands β†’ Connections β†’ Related Tables
Workflow JSON View

*DB details and commands(if any) image


πŸ—ƒοΈ Database & Tables usage insight

πŸ”Ž Find proccesses by Host / Connection

Find all processes interacting with a specific database or connection.
DB Related Processes

πŸ“Œ Find processess by Table Name

Search workflows by referenced table name (source/target/attribute match).
Table Related Processes

πŸ—ƒοΈ Manage Insight Data Sources

Connect to Informatica metadata via DB connection or tnsnames.ora/odbc.ini.
Insight DB Sources

πŸ“‚ View Insight Internal Tables

Explore the structure of the internal SQLite/PostgreSQL Insight DB.
Insight DB Tables


πŸ“ˆ Performance Analytics

Visualize workflow and session execution trends over time. Useful for identifying long-running tasks and performance issues.

Compare Average Runtime of Multiple Workflows image

Analyze workflow execution trends, overlaps, and anomalies.

image

Longest & Shortest Workflow Runs image

With the workflow in context - Session Stats
image

Zoom in on specific run date and see all sessions run information as date, duration error and erros message image

πŸ“ˆ ML based Analysis ...(wip)

Workflow trends image

Daily & Hourly Trends image

HeatMap For the selected workflow, see how average runtime varies by day and hour image

Anomalous Insights for Workflow in context image

Sessions Runtime Anomalies for the workflow in context - user allow to exclude specific session,worklet image

Overlap impact - in many case , some workflow shows bad performance as they impacted while running in parallel to other workflow(WIP)


βš™οΈ Admin Panel

Manage users, roles, and track login activity from the built-in admin panel.

πŸ”‘ Manage Users

Admin Panel

πŸ‘₯ Manage Roles

Manage Roles

πŸ“Š Login History

Track when users accessed the portal.
Login History

For development purpose , the app allows bypassing the logging screen and security .


πŸ”§ Configuration Management

YAML-based config editor and internal database tools.

πŸ“ Live Config Editor

Edit config.yaml directly from the UI.
Live Config Editor


πŸ“¬ Contact

For questions or contributions, please contact aviciot@gmail.com

About

The Informatica Insights Portal is a WebUI-python-based application designed to provide a structured view of Informatica performance , workflows explorer , connections and many more

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors