Summary
Overview
Work History
Education
Skills
Work Availability
Certification
Timeline
OperationsManager
Ayyappa Pillai

Ayyappa Pillai

Englewood

Summary

Experienced Data Engineer developing Enterprise level Data Lake and Data model for Reporting and Business analysis, over 18 years of experience as ETL and BI developer delivered various Data Warehouse & Business Intelligence projects.
Build more than 300 plus Data reports for Business-critical system and process, Developed report to understand the Spend and Travel expenses worth Billions of dollars, Improve Inventory and Manufacturing process and Sales related reporting for opportunities.
Consistently reward and recognized for the efforts by all.

Overview

1
1
Certification
6
6
years of post-secondary education
18
18
years of professional experience

Work History

Senior Big Data Engineer

Hitachi Vantara
2019-01 - Current
  • Implementation and over viewing Data ingestion to Build Enterprise Data Lake on AWS Cloud.
  • Designing and implementation of ETL Data ingestion/ Data extraction using Streamset Tool
  • Building Table and View in AWS Athena, Business Reporting tables in Redshift
  • Maintenance and Administration of Denodo Application server on AWS Cloud, building Infrastructure and Automation to maintain servers on cloud.
  • Building Infrastructure and Automation to maintain Denodo servers on cloud using AWS Cloud Formation.
  • Defining security policies for Server and Data security.
  • Implementation of Data Streaming and Processing Framework using AWS Kinesis and Python
  • Designing and implementation of ETL process.
  • Creating Automation using AWS Batch and Lambda, Python for process Alerts and Incidents automation.
  • Build Job in Airflow to automates Daily Task.
  • Build Power BI report and maintain Power BI infrastructure, helping Departments to analyze data, helping finding Gaps in data.
  • Created Report to analyze spend detail running in Billions of Dollars, Exposed data quality issues & helped develop reports to automate cleanup efforts which led to increase in potential revenue streams by approximately ~$1M USD Monthly
  • Perform Unit and System Testing of Report.
  • Creating CI/CD pipeline for Power BI Report deployment and AWS Infrastructure Code Deployment
  • Using Jira for tracking and Development Process.

AWS and ETL Developer

Synechron Inc.
2017-03 - 2019-01

Client: ASURION CORP (Mobile Insurance Co.), Nashville, USA

Role : AWS and ETL Developer (Onsite Nashville)

Description: Working from Onshore for Development and Implementation of AWS Cloud Data Lake and Datamart.

Responsibilities :

  • Implementation and over viewing Data ingestion in to AWS Data Lake and Datamart.
  • Implementation of Data Streaming and Processing Framework using AWS Kinesis and Python
  • Designing and Developing Tables, View in AWS Redshift and Hive.
  • Designing and implementation of ETL process using SSIS/Informatica and Python.
  • Designing of Base table and View in Denodo Data Virtualization Layer for Business Reporting and process.
  • Designing of API in Denodo for use by Other Business process and online Dashboard.
  • Building Store procedure, Table and View on AWS Aurora for Various Business process.
  • Automation of Business Processes using Python
  • Documentation of Report Requirement and Development Processes.
  • Using Jira for tracking and updating Report Development Processes.
  • Following Guidelines/Best practices set as per Client for report development.
  • Perform Unit and System Testing of Report.
  • Business Communication with Client.

Lead BI DataWarehousing and Reporting

Synechron Techologies Pvt Ltd
2008-03 - 2017-02

Client: ASURION CORP (Mobile Insurance Co.), Nashville, USA

Description: Working from Offshore for Development and maintenance of existing Datamart and Reporting solutions .

Responsibilities :

  • Doing requirement analysis and System study.
  • Implementation and over viewing Data ingestion in to AWS Data Lake for AWS Billing.
  • Designing and Developing Tables,View in AWS Redshift and Hive.
  • Designing and Developing of Datamaodels/Datamart and Cubes.
  • Designing and Developing ETL process using SSIS for Datamart.
  • Designing of Base table and View in Denodo Data Virtualization Layer for Business Reporting and process.
  • Development of SSRS report as per Business Requirement.
  • Writing Store Procedure in SQL SERVER 2000 for use with Crystal Report.
  • Documentation of Report Requirement and Development Process.
  • Using Jira for tracking and updating Report Development Process.
  • Perform Unit and System Testing of Report.
  • Business Communication with Client

Crystal Reports Designer

KPIT GBS
2007-03 - 2008-03
  • · Working as Report design engineer in Technical Support Team of Business Object Co. Assisting Business object co American Client base.
  • · Excellent co-ordination with Development Team, Support Team and Clients.
  • · To work with Business Objects products including Crystal Reports, Infoview, Universe Designer.
  • · Issues related to migrations from previous versions.
  • · To provide training to new hires.
  • · Technical and Process Documentation for future.
  • · Mentoring New Engineers in their work.

ERP Implementer Engineer

Udyog Software Ltd.
2000-09 - 2005-05
  • Report Designing, Software Implementation and Customization Experience .
  • Vast experience in Functional ERP Implementation, System Analysis, User Trainings and Gap Study .
  • Innovative solutions from Concept through Implementation phases, in order to meet client requirement.
  • Good experience in Domains like Manufacturing, Inventory Management, Order Management, Excise & Import-Export Documentation etc.
  • Have good Database experience on Oracle, SQL Server 2000 and FoxPro.
  • Providing Support to clients 24x7 Via Email, Telephone or Onsite.
  • Technical Support on various DOS and Windows Technologies.
  • Report designing using Crystal Reports & VFP Report Designer .
  • Strong experience in Software Support and handling of Support Team.

Providing Technical Support to 19 Branches including Dealers Branches.

Education

Post Graduate Diploma in Computer Application - Computer Application

University Of Pune
2003-06 - 2005-10

Bachelor of Commerce

University Of Mumbai
1996-06 - 1999-10

Skills

    AWS Cloud Services EC2, S3, Lambda, Batch, Athena, Glue, Redshift, CI/CD

Python, SQL

ETL Data ingestion (SSIS, Informatica, Streamsets)

Data Warehousing and Modelling, Data Virtualization in Denodo

Power BI, SSRS, Crystal Reports

Hive, Presto

Technical Support

Work Availability

monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Certification

AWS Solution Architect Associate

2020-03

Timeline

AWS Solution Architect Associate

2020-03

Senior Big Data Engineer

Hitachi Vantara
2019-01 - Current

AWS and ETL Developer

Synechron Inc.
2017-03 - 2019-01

Lead BI DataWarehousing and Reporting

Synechron Techologies Pvt Ltd
2008-03 - 2017-02

Crystal Reports Designer

KPIT GBS
2007-03 - 2008-03

Post Graduate Diploma in Computer Application - Computer Application

University Of Pune
2003-06 - 2005-10

ERP Implementer Engineer

Udyog Software Ltd.
2000-09 - 2005-05

Bachelor of Commerce

University Of Mumbai
1996-06 - 1999-10
Ayyappa Pillai