Narendra T

• Projects
• Migrated Impala scripts, Scala code and SSIS packages into Azure Databricks using Pyspark and the output of those L2 tables connected to PowerBI and make sure the visuals match with existing reports
• Migrated Certificate Monitor Project from VM to Databricks
• Developed daily table check project for checking which tables are updated
• Primary Suction project–It is a part of converter section within OSF2.It makes sure flue gasses are extracted to limit the harm to Environment
• Secondary suction project -It is a part of converter section within OSF2
• It is to capture flue gasses that escaped the primary suction installation
• Experience in migrating Impala SQL scripts to Azure SQL in Databricks and connecting Azure SQL tables to Power BI:
• Migrating existing Impala SQL scripts to Azure SQL in Databricks
• Ensuring the output of Azure SQL tables matches the existing report.

● Migrating a Certificate Monitor project from a virtual machine (VM) to

Azure Databricks using PySpark:

è Utilizing PySpark for developing and executing data processing

tasks within Azure Databricks.

● Development of a daily table check project for the Product Quality

Analytics Team using PySpark:

è Building a project that performs regular checks on tables to

ensure data quality.

è Using PySpark for implementing the data validation and

quality checks.

● Development of the Primary Suction Project to limit harm to the

environment by extracting flue gases:

è Contributing to the development of a project aimed at extracting

flue gases to minimize environmental impact.

è Implementing relevant technologies and techniques to achieve

the project's goals.

● Implementation of PySpark code on Databricks for transformation in

staging and master layers:

è Developing and executing PySpark code within Azure Databricks.

è Performing data transformation tasks within the staging

and master layers of the data pipeline.

● Developing Spark applications using Python in Azure Databricks:

è Creating Spark applications using Python as the programming

language.

è Leveraging the capabilities of Azure Databricks for data

processing and analysis.

• Connected Azure SQL tables to Power BI and ensured report consistency:
• Established connectivity between Azure SQL tables and
• Power BI, enabling real-time data visualization and analysis
• Ensured that the Power BI reports matched the existing reports, maintaining consistency in data presentation and insights
• Created validation scripts for L2 tables to ensure data consistency:
• Developed validation scripts to compare data in Azure L2 tables with a Power BI template
• Ensured that the data in Azure L2 tables aligned with the expected values, maintaining data accuracy and reliability
• Wrote data into Azure SQL server using Azure Databricks
• Created workflows in Databricks for scheduling and data processing:
• Developed workflows and jobs within Databricks to automate and schedule data processing tasks
• Orchestrated the execution of data pipelines, ensuring timely and efficient data processing and transformation.

• Expertise in Automation testing for standalone application
• Expertise in using Agile Testing Methodology
• Well-versed in defect tracking and bug reporting using Rally
• Actively involved in daily stand-up and kick-off meetings.