Summary
Overview
Work History
Education
Skills
Accomplishments
Interests
Generic
Srikanth Padmanabhan

Srikanth Padmanabhan

Lead Big Data/ Cloud Data Engineer
Chennai

Summary

To seek and maintain full-time position that offers professional challenges utilizing interpersonal skills, excellent time management and problem-solving skills. Organized and dependable candidate successful at managing multiple priorities with a positive attitude. Willingness to take on added responsibilities to meet team goals.

Overview

14
14
years of professional experience
4
4
years of post-secondary education
1
1
Language

Work History

Lead Data Engineer

PayPal
Chennai
09.2020 - Current
  • As a Lead Engineer, performed the onboarding of Applications from Teradata to Google Cloud Bigquery improving ETL workload and saving the onprem cost.
  • 3+ years of development experience on Bigquery
  • 3+ years of experience on Google Cloud Platform Data Engineering Services (Dataproc, Composer)
  • 1 year of experience on Google Cloud Functions
  • Development of Marketing project completely from scratch using Google Bigquery, Python and Cloud Dataflow
  • As part of Innovation Use Case at PayPal, participated in the Design and Development of Slack Bot using Python, Google DialogFlow and Google Cloud Functions (with Triggers based on Pubsub Messages)
  • As part of Hackathon, developed an online Machine Learning incremental learning framework using Kafka Python, Scikit Learn and Plotly Dash for users, to feed the inputs, get the predictions and train the model in real time for lower re-call scores.
  • Designed and Developed Hive Optimization framework as part of Innovation completely in Python, which generates an automated report of Performance Tuning Settings to be applied to the batch users.
  • Documented the technical standards, design of table and schema layouts for fact and dimension tables, troubleshooting mechanisms as part of Teradata to Bigquery migration.
  • Working on FastAPI framework for translating Natural Language Form Feed to Bigquery SQL translation using Python, FastAPI, Cloud DataFlow, BigTable and Bigquery.
  • POCs at PayPal Projects - explored and learnt Snowflake/Redshift, AWS Glue
  • Did the POC in GCP Databricks for migrating Jupyter Notebooks to Databricks for running Spark Batch workloads.
  • Contributed to internal activities for overall process improvements, efficiencies and innovation.

Analyst

Bank of America
Chennai
08.2016 - 08.2020
  • Strong expertise with Teradata Analytics Ecosystem and tools & utilities including the latest Teradata Vantage Software product and its Data Science functions , and Teradata Querygrid 2.09 for data movement between Teradata and Teradata/Hadoop
  • Hands-on Experience with Python for various data science related projects, time series modeling, development of NLP chatbot, ML algorithm for privacy metadata classification, database log segmentation using Unsupervised Machine Learning
  • Hands-on Experience developing Big Data Pipelines using NiFi + Kafka + Spark + MongoDB + Python Dash for real time Dashboard visualization
  • Worked on converting XML Data structures to Data Frames and storing the data to Teradata, a project using Python handling 3500+ volumes of XML Files to processed in a day
  • Developed Python program for extracting the key derivatives from Teradata logs to classify the database usage of the Teradata Users in an effort to manage and reclaim space by classifying the data into Hot, warm and cold storage. (Capacity Planning)
  • Developed shell scripts to automate the reconcilation between 2 Teradata systems both at the table and column level dynamically using BTEQ and Shell Scripting
  • Worked on the Python scripting for extracting data from cloudera API and publishing the real time cloudera logs to Oracle dashboards during cloudera upgrade
  • Assessed data modeling and statistics to integrate high-level business processes with data rules.
  • Designed Teradata Applications including Tables (fact, dimension tables), Views, Join Indexes and Stored Procedures as part of Project Initiatives.
  • Assisted Users with improving the performance of the Teradata SQL including implementing efficient secondary/ join indexes, stats collection management for joins.

Application Designer

CSC
Chennai
08.2015 - 08.2016
  • Teradata and Unix Developer.
  • Unit and System Testing of Teradata SQLs.
  • Automation of BTEQ/ Teradata SQLs using UNIX
  • Participated in design and planning exercises for future software rollouts.
  • Updated technical documentation, product specifications and technical training materials.

Senior Consultant

Capgemini
Bangalore
11.2014 - 08.2015
  • Teradata and Unix Developer.
  • Development of Teradata Stored Procedures for Application maintenance.
  • Unit and System Testing of Teradata SQLs.
  • Automation of BTEQ/ Teradata SQLs using UNIX
  • Participated in design and planning exercises for future software rollouts.
  • Updated technical documentation, product specifications and technical training materials.

Senior Software Engineer

Wipro Technologies
09.2012 - 11.2014

Teradata and Unix Developer.
Development of Teradata Stored Procedures for Application maintenance.
Unit and System Testing of Teradata SQLs.
Automation of BTEQ/ Teradata SQLs using UNIX
Participated in design and planning exercises for future software rollouts.
Updated technical documentation, product specifications and technical training materials.

Programmer Analyst

Cognizant Technologies Solutions
11.2009 - 09.2012

Teradata and Unix Developer.
Development of Teradata Stored Procedures for Application maintenance.
Unit and System Testing of Teradata SQLs.
Automation of BTEQ/ Teradata SQLs using UNIX
Participated in design and planning exercises for future software rollouts.
Updated technical documentation, product specifications and technical training materials.

Education

B. Tech - Chemical Engineering

St. Josephs College of Engineering
Chennai
05.2005 - 04.2009

Skills

    Python

undefined

Accomplishments

    Patents Submitted

    1. Artificial Intelligence Adaptive Optimizer(s) inside RDBMS

    2. Teradata Query Performance Optimization Intelligence Tool

Interests

Cycling

Terrace Gardening

Srikanth PadmanabhanLead Big Data/ Cloud Data Engineer