Srikanth Padmanabhan

• Aligned business objectives with technical requirements through close collaboration with product owners providing insights based on available data sources.
• Mentored junior engineers on best practices in data engineering, fostering a culture of continuous learning and improvement within the team.
• Identified areas for improvement within existing ETL frameworks to maximize efficiency without sacrificing accuracy or integrity of results produced during transformations applied on ingested datasets.
• Ensured compliance with relevant regulations related to data storage, privacy, security, and transmission standards by staying updated on legal developments impacting the industry.
• Implemented monitoring systems to proactively identify potential bottlenecks in the data pipeline, ensuring optimal performance at all times.

Technical Details:

• As a Lead Engineer, performed the onboarding of Applications from Teradata to Google Cloud
  Bigquery improving ETL workload and saving the onprem cost.
• Implemented Merchant and Consumer Batch data processing solutions using Bigquery, Dataproc and Airflow, with total of 5 years of Bigquery experience.
• Implemented Marketing campaign Experimentation initiative (backend solution) using Python, Cloud Dataproc and Bigquery.
• Implemented Near real time data ingestion and processing jobs using Cloud Pubsub, Cloud Dataflow and Bigquery for real time analytics for invoicing transactions.
• Designed and Developed Hive Optimization framework as part of Innovation completely in Python, which generates an automated report of Performance Tuning Settings to be applied to the
  batch users.
• For near real time implementation, I also did a POC on GCP Databricks, Apache Flink using Google Kubernetes Engine.

• Strong expertise with Teradata Analytics Ecosystem and tools & utilities including the latest Teradata Vantage Software product and its Data Science functions , and Teradata Querygrid 2.09 for data movement between Teradata and Teradata/Hadoop
• Hands-on Experience with Python for various data science related projects, time series modeling, development of NLP chatbot, ML algorithm for privacy metadata classification, database log segmentation using Unsupervised Machine Learning
• Hands-on Experience developing Big Data Pipelines using NiFi + Kafka + Spark + MongoDB + Python Dash for real time Dashboard visualization
• Worked on converting XML Data structures to Data Frames and storing the data to Teradata, a project using Python handling 3500+ volumes of XML Files to processed in a day
• Developed Python program for extracting the key derivatives from Teradata logs to classify the database usage of the Teradata Users in an effort to manage and reclaim space by classifying the data into Hot, warm and cold storage. (Capacity Planning)
• Developed shell scripts to automate the reconcilation between 2 Teradata systems both at the table and column level dynamically using BTEQ and Shell Scripting
• Worked on the Python scripting for extracting data from cloudera API and publishing the real time cloudera logs to Oracle dashboards during cloudera upgrade
• Assessed data modeling and statistics to integrate high-level business processes with data rules.
• Designed Teradata Applications including Tables (fact, dimension tables), Views, Join Indexes and Stored Procedures as part of Project Initiatives.
• Assisted Users with improving the performance of the Teradata SQL including implementing efficient secondary/ join indexes, stats collection management for joins.

• Teradata and Unix Developer.
• Unit and System Testing of Teradata SQLs.
• Automation of BTEQ/ Teradata SQLs using UNIX
• Participated in design and planning exercises for future software rollouts.
• Updated technical documentation, product specifications and technical training materials.

• Teradata and Unix Developer.
• Development of Teradata Stored Procedures for Application maintenance.
• Unit and System Testing of Teradata SQLs.
• Automation of BTEQ/ Teradata SQLs using UNIX
• Participated in design and planning exercises for future software rollouts.
• Updated technical documentation, product specifications and technical training materials.

Teradata and Unix Developer.
Development of Teradata Stored Procedures for Application maintenance.
Unit and System Testing of Teradata SQLs.
Automation of BTEQ/ Teradata SQLs using UNIX
Participated in design and planning exercises for future software rollouts.
Updated technical documentation, product specifications and technical training materials.

Teradata and Unix Developer.
Development of Teradata Stored Procedures for Application maintenance.
Unit and System Testing of Teradata SQLs.
Automation of BTEQ/ Teradata SQLs using UNIX
Participated in design and planning exercises for future software rollouts.
Updated technical documentation, product specifications and technical training materials.