Chaitanya Sistla

OpenObserve platform and integrations

• Built and managed cloud-native data source integrations across AWS, Azure, and GCP to onboard customer telemetry into OpenObserve.
• Achieved SOC 2 Type II and ISO 27001 compliance for OpenObserve by implementing continuous control monitoring and formal risk assessments.
• Engineered CloudFormation templates for AWS GovCloud, enabling compliant log and metrics ingestion for federal and defense customers.
• Created Datadog to OpenObserve dashboard migration tooling to accelerate customer transitions off legacy observability stacks.
• Built and maintained a library of prebuilt OpenObserve dashboards covering common infrastructure and application monitoring use cases.
• Developed and maintained the full OpenObserve Terraform provider, enabling infrastructure-as-code deployment and configuration management for customers.
  

Customer engineering and technical wins

• Served as an early solutions architect at OpenObserve, driving technical wins across enterprise POC engagements.
• Led Fortune 500 customer POCs handling over 50TB-100TB/day ingestion volume, designing and tuning cluster configurations end to end.
• Onboarded and supported customers across EKS, AKS, OKE, DOKS, and on-premises bare metal, building Kubernetes vclusters per environment.
• Implemented advanced traffic management and service mesh architectures using Istio for microservices.
• Optimized container orchestration by configuring Horizontal Pod Autoscaling (HPA) and Cluster Autoscaler for cost efficiency.
• Standardized Docker image lifecycle management, focusing on security vulnerabilities and optimized layer caching.
• Built robust observability stacks using OpenTelemetry, Prometheus, and Grafana to monitor cluster health and performance.
• Engineered automated backup and disaster recovery strategies for stateful workloads running on Kubernetes.
• Implemented fine-grained Kubernetes RBAC and Network Policies to secure inter-pod communication and access.
• Streamlined application deployments using Helm charts and GitOps methodologies (ArgoCD or Flux).
• Resolved complex performance bottlenecks within the container runtime and networking layers.
• Configured centralized logging and distributed tracing to enhance debugging capabilities across distributed systems.
• Designed multi-region Kubernetes deployments to ensure global availability and low-latency user experiences.
• Engineered modular Terraform libraries to automate the provisioning of compliant, production-ready cloud environments.
• Eliminated manual "ClickOps" workflows by implementing end-to-end CI/CD pipelines for infrastructure deployment.
• Automated cloud governance and policy enforcement using Sentinel or OPA (Open Policy Agent) within IaC workflows.
• Developed Python-based automation tools to handle complex resource lifecycle management and self-service provisioning.
• Implemented automated drift detection to ensure cloud environments remain synchronized with version-controlled code.
• Built and maintained scalable ArgoCD/GitHub Actions pipelines to accelerate the software development life cycle (SDLC).
• Optimized resource delivery times by 60% through the creation of self-service infrastructure portals for developers.
• Integrated security scanning (SAST/DAST) directly into the infrastructure automation pipeline for proactive compliance.
• Managed complex state files and backend configurations for multi-cloud environments using Terraform Enterprise.
• Standardized environment parity (Dev, QA, Prod) through rigorous IaC-driven configuration management.
• Reduced human error and configuration drift by enforcing a 100% "Code-Only" infrastructure policy.
• Leveraged cloud-native automation (Azure DevOps/GCP Cloud Build) to orchestrate complex multi-tier deployments.

• Architected enterprise-grade cloud landing zones specifically optimized for Databricks and Snowflake integration.
• Designed unified IAM and RBAC frameworks to manage cross-platform access for SQL Server and MySQL instances.
• Implemented automated data governance guardrails to ensure MongoDB clusters meet SOC2 and GDPR compliance.
• Developed standardized Terraform modules for the rapid, compliant deployment of Databricks workspaces.
• Engineered private networking architectures (Private Link/Service Endpoints) for secure connectivity to Snowflake.
• Collaborated with data teams to define "Golden Patterns" for database provisioning and lifecycle management.
• Streamlined the onboarding of business units onto central data platforms through automated self-service portals.
• Integrated cloud-native secret management (Azure Key Vault/GCP KMS) for database credential rotation.
• Designed multi-region data redundancy strategies for mission-critical SQL Server and MySQL workloads.
• Established data sovereignty policies within the cloud platform to control geographic data residency.
• Automated the auditing of data access logs across diverse platforms using centralized logging solutions.
• Led the architectural review of hybrid-cloud data integrations to ensure low-latency performance.
• Automated the full-stack deployment of MongoDB Atlas clusters using Infrastructure as Code (IaC).
• Developed CI/CD pipelines to manage Snowflake warehouse configurations and user permissioning as code.
• Engineered automated scaling logic for MySQL and SQL Server to handle peak load periods dynamically.
• Built self-healing infrastructure for containerized MongoDB instances running on Kubernetes.
• Automated the "Right-Sizing" of Databricks clusters to balance performance requirements with cost efficiency.
• Created reusable Helm charts for deploying high-availability MySQL clusters in cloud-native environments.
• Integrated database schema migration tools into standard application deployment pipelines.
• Implemented automated "Snapshot and Restore" workflows for SQL Server to support disaster recovery.
• Developed Python scripts to automate the archival of cold data from MongoDB to low-cost cloud storage.
• Managed the lifecycle of Snowflake storage integrations through version-controlled Terraform code.
• Automated the provisioning of isolated "Sandbox" data environments for development and testing.
• Engineered health-check and auto-recovery scripts for distributed data platforms to ensure 99.9% uptime.

• Architected and deployed enterprise-scale cloud enablement frameworks on AWS/Azure/GCP to streamline organizational cloud adoption.
• Established reusable architectural patterns and cloud standards to ensure consistency across diverse engineering departments.
• Led the strategic migration of legacy workloads to cloud-native architectures, reducing operational overhead by 30%.
• Designed multi-account/project structures focusing on IAM hierarchy, networking, and centralized resource management.
• Partnered with cross-functional leadership to define the long-term cloud roadmap and governance strategy.
• Developed a "Cloud Center of Excellence" (CCoE) model to provide technical guidance and best practices to product teams.
• Operationalized cloud platforms to support high-availability requirements and enterprise-grade SLA targets.
• Spearheaded the integration of cloud-native application patterns to modernize monolithic service architectures.
• Evaluated and piloted emerging cloud technologies to maintain a competitive and scalable infrastructure stack.
• Authored comprehensive technical documentation and whitepapers for cloud governance and architectural standards.
• Mentored senior engineering staff on cloud-native design principles and strategic platform engineering.
• Facilitated stakeholder alignment sessions to bridge the gap between technical execution and business objectives.
• Driven cloud cost optimization initiatives, resulting in a 25% reduction in monthly cloud spend without sacrificing performance.
• Implemented automated resource scheduling and "right-sizing" logic to eliminate waste in non-production environments.
• Developed comprehensive dashboards for real-time monitoring of cloud spend and resource utilization across teams.
• Led Incident Response and Root Cause Analysis (RCA) for complex platform-level outages, improving MTTR.
• Established Performance Tuning benchmarks for cloud-native services to ensure optimal latency and throughput.
• Managed enterprise-level cloud agreements and reserved instance portfolios to maximize ROI.
• Implemented automated "guardrails" to prevent unauthorized or expensive resource provisioning in real-time.
• Conducted regular architectural reviews (Well-Architected Framework) to identify and mitigate operational risks.
• Enhanced platform reliability by implementing Site Reliability Engineering (SRE) principles and SLIs/SLOs.
• Streamlined the cloud onboarding process for new business units, reducing "time-to-cloud" from weeks to days.
• Leveraged native cloud security tools (Azure Security Center/GCP Security Command Center) to maintain a robust posture.
• Directed the decommission of underutilized legacy resources through automated lifecycle management policies.

• Architected the integration between cloud-native data lakes and Snowflake for seamless data sharing.
• Engineered high-throughput data ingestion pipelines using Managed Kafka/PubSub to feed MongoDB clusters.
• Designed secure "Data Bridge" architectures to sync on-premises SQL Server data with cloud environments.
• Facilitated the integration of Databricks with cloud-native identity providers for seamless SSO.
• Implemented secure VPC peering and Private Link connectivity for third-party SaaS data platforms.
• Developed automated ETL triggers between cloud storage (S3/GCS/ADLS) and Snowflake tables.
• Managed the networking complexity of multi-cloud data strategies involving MySQL and MongoDB.
• Configured service-to-service authentication for application workloads accessing Databricks APIs.
• Optimized the data egress costs associated with large-scale data movements between cloud regions.
• Architected event-driven architectures to update MongoDB collections based on cloud infrastructure events.
• Streamlined the connectivity between BI tools and cloud-hosted SQL Server instances.
• Designed robust API layers to abstract complex data queries for internal engineering teams.

• Managed and utilized Cloudera-based Hadoop distributions (CDH and CDP), including HBase, Spark, Hive, and Kafka, demonstrating hands-on expertise in complex data environments and big data processing.
• Achieved a 20% increase in system efficiency through meticulous performance tuning strategies on Cloudera, leading to a 25% reduction in critical task processing time across multiple Hadoop clusters.
• Integrated certificate management solutions with existing IT infrastructure for automated certificate procurement and lifecycle management, enhancing security and compliance within Cloudera environments.
• Configured HashiCorp Vault for dynamic secret generation, utilizing IAM policies for secure and controlled access to sensitive information, enhancing data security in Cloudera platforms.
• Employed service discovery and configuration tools for implementing a microservices architecture with secure communication, enhancing application scalability and reliability within Cloudera-based infrastructures.
• Collaborated with development teams to optimize slow-performing jobs and queries on Cloudera services, resulting in a 30% improvement in system responsiveness. Implemented robust security measures, including Kerberos authentication and diverse TLS levels, reducing vulnerabilities in Hadoop clusters.
• Automated 70% of routine tasks using customized scripts, enabling staff to focus on critical tasks. Leveraged configuration management tools to reduce errors and streamline the deployment process across Cloudera environments.
• Successfully managed a 300-node Cloudera Hadoop cluster with improved performance and stability. Configured environments across Cloudera and GCP, enhancing system adaptability and resilience.
• Implemented comprehensive identity and access management controls for data security, resulting in a significant reduction in unauthorized access and ensuring compliance with security standards.
• Automated snapshot processes and managed data replication across multiple regions, improving system stability and data transfer efficiency within Cloudera environments.
• Proficient in employing Apache Spark on Cloudera for data integration and large-scale processing, contributing to advanced data solutions and analytics capabilities.
• Extensive experience in using JSON for data serialization and communication in Cloudera-based web services and RESTful APIs.
• Proficient in building and deploying microservices in Docker containers on Cloudera, using containerization services and orchestration tools for scalable and efficient application management.
• Skilled in deploying and managing microservices on Kubernetes, with experience in setting up clusters, managing pods, and ensuring high availability and scalability within Cloudera environments.
• Configured environments across Cloudera and other cloud platforms, enhancing system adaptability and performance through advanced configuration management techniques.
• Deployed and managed Apache Kafka on AWS, ensuring high throughput and low latency for streaming data applications.
• Implemented Aerospike databases on AWS, optimizing performance and scalability for real-time data processing needs.
• Managed Elasticsearch clusters on AWS, enabling efficient data search and analysis capabilities across large datasets.

• Enforced encryption-at-rest and in-transit for all SQL Server and MySQL cloud deployments.
• Implemented Column-Level Security (CLS) and Row-Level Security (RLS) policies within Snowflake.
• Designed automated compliance scanning for MongoDB configurations to detect misconfigurations.
• Established Private Link access for Databricks to ensure data never traverses the public internet.
• Managed database firewall rules and network security groups through centralized IaC policies.
• Architected multi-tenant isolation models for shared Snowflake and Databricks environments.
• Integrated third-party security tools (e.g., Prisma Cloud) to monitor the data platform perimeter.
• Implemented just-in-time (JIT) access for database administrators to reduce the attack surface.
• Automated the rotation of service principal keys used by Databricks for cloud storage access.
• Conducted regular vulnerability assessments on containerized database images and runtimes.
• Ensured adherence to HIPAA/FINRA standards for data platforms handling sensitive information.
• Developed automated reporting for data access patterns to satisfy internal audit requirements.

• Demonstrated proficiency in managing Mysql and NoSQL databases, executing range of operations including Replace, Insert, Delete, Update, and Create. Applied techniques such as discretization and binning for data manipulation and implemented robust data wrangling methodologies , including data cleaning, transformation, merging, and reshaping of data frames.
• Spearheaded Data Lineage working group, prioritizing and scoping essential efforts to establish comprehensive front-to-back physical lineage from source to upstream systems for Investment Banking and Wealth Management business functions. Documented data lineage, table, and column names, data definitions, and valid values, providing vital insights and data governance metrics to stakeholders and executives .
• Conducted thorough data analysis on real-time and historical data, including comprehensive Data Profiling and Mining activities . Utilized SQLALCHEMY for effective collaboration with Mysql database. Created and delivered insightful Dashboard/Stories leveraging Tableau (Lumera) and Excel, facilitating comprehensive data visualization to present current impacts and growth trends effectively.