Senior Data Architect

  

Dharmendra Kumar                                 Senior Data Engineer                                 Hitachi Solutions Contact & Email: drathore586@gmail.com: 7073885799 LinkedIn:https://www.linkedin.com/in/dharmendrarathore GitHub:  https://github.com/Drathore0007 Background   Data Solution Architect/Engineer in Hitachi Solutions Data and Analytics practice Team, I have 7+ years of consulting experience in designing and developing Business Intelligence and Big Data Solutions with Data Integration, Data Warehousing, Data Models and Visualizations by using Cloud platforms such as Microsoft Azure and Amazon AWS Technologies stakes. I have good exposure to Designing & Implementing end-to-end Data Savvy solutions and have been working with customers around the globe with Agile Methodology for delivering business solutions.   Key Skills   • Data Warehousing & Marts • BI Modeling & Architecture • Cloud Data Analytics   • Advance Analytics and ETL • Visualizations & Reporting • Data modeling and schema Designing • Big Data & Hadoop

Skills Technical & Functional

 

TECHNICAL SKILLS

FUNCTIONAL SKILLS

·          ETL and Analysis Tools – Azure ML, Azure DevOps, Azure Synapse. Azure DevOps, Azure Data Factory, Power BI, Azure Data Bricks and Microsoft SSIS, Python, Apache Spark ·          Programming language: - PySpark, Python, Scala, H-SQL (Hive), T-SQL and PL-SQL ·          Storage: Azure blob, Azure ADLA and File storage, HDFS, SFTP, FTP ·          RDBMS: Microsoft SQL Server, Oracle, EXASOL, Hive, MySQL, PostgreSQL ·          No SQL: Mongo DB, Casandra, HBase and Couch DB. ·          Other Tools: Anaconda, Jupyter Notebooks, HUE, Cloudera, Microsoft VS code, Microsoft Visual Studio

·          Critical Thinking & Problem-Solving ·          Effective Communicator ·          Strategic thinking ·          Team Coordinator ·          Solution Architecture design ·          Motivated and Organized ·          Team Player

Functional Expertise:

·          Responsible for gathering business requirements for new development and implementing the solutions with a clear understanding of IT capabilities, processes, and Agile Delivery methodologies

·          Engagement leadership to identify, assess, and utilize technology that meets the needs of the business and present IT investment and delivery roadmaps and actionable insights to the executive ranks in a large company environment

 

Experience

Hitachi Solutions: Solution Architect\Engineer May 2022 – to Date As a Data Solution Architect, My role is to communicate and gather new enhancements for existing systems and recommendations for performing upgrades in the system for optimization and Getting better ROI We provide support on Data Engineering and Azure cloud solutions to different customers. Working with different clients on developing and designing Data analytics platforms in various domains like e-commerce, Healthcare, Resource Management etc.     Data Solution Architect\Engineer: ·          Creating and enhancing Data architecture solutions for clients over the North American region. ·          Creating logical and Physical data model architecture for clients on the Azure cloud ·          Designing Data models and Data marts for customers using Azure SQL server, Synapses and Delta Lake ·          Gathering  business requirements and creating RPFs for Data solutions ·          Designing and developing cloud ETL solutions for different Analytics platforms like Azure, AWS and Microsoft BI Suits. ·          Interacting with Team and business to maintain smooth development cycles by following Agile development methodology. ·          Designing & developing a robust ADF and Databricks data pipeline in Azure to perform quick Data ingestion processes from various sources like RDS, APIs, S3, Blog, Synapse DB, Flat files etc. ·          Optimizing and enhancing data solutions by following best practices for development. ·          Creating Execution and Modernization plans for data solution systems. ·          Preparing documentation for Business and maintaining support for the process

Ernst & Young: Senior Data Engineer Feb 2021 – May 2022 As a Lead Data Analyst, my role is to communicate and gather new enhancements for an existing system. We provide support on data analysis and cloud warehousing solutions to different customers. Working with different clients on developing and designing Data analytics platforms in various domains like e-commerce, Healthcare, Resource Management etc.     Senior Data Engineer: ·          Creating and enhancing Data architecture solutions for clients all over the globe. ·          Creating logical and Physical data model architecture ·          Designing Data models and Data marts for customer ·          Gathering business requirements and creating RPFs for Data solutions ·          Designing and developing cloud ETL solutions for different Analytics platforms like Azure, AWS and Microsoft BI Suits. ·          Interacting with Team and business to maintain smooth development cycles by following Agile development methodology. ·          Designing & developing a robust data pipeline in Azure ADF, AWS Glue (spark) to perform quick Data ingestion processes from various sources like RDS, APIs, S3, Blog, Synapse DB, Flat files etc. ·          Optimizing and enhancing data solutions by following best practices for development. ·          Creating Execution and Modernization plans for data solution systems. ·          Preparing documentation for Business and maintaining support for the process

 

Smart ERP Solutions: Data Engineer June 2017 – Feb 2021 As a BI/ Data Engineer at Smart ERP Solutions, my role was to help our customers unlock the value from their data whether that be by helping them implement designing and developing Data Solutions for different business requirements using BI stacks like Microsoft, Oracle and AWS.     BI / Data Engineer: • Analyzing and documenting the current Environment and gathering system details • Working closely with BA and Lead to gather business requirements and helping in designing process flow for new Solutions • Creating Solution implementation plans and RFPs with Lead • Designing & developing robust data Solutions on top of on-premise and Cloud platforms. • Performing Cost estimation and Development plans • Creating a business data layer for reporting consumption for applications • Working team on developing and implementing BI/ Data Solutions for the customers • Preparing documentation for Business and maintaining support for the process   Forks Technology Solutions: Intern Jun 2016 – Nov 2016 As per my role and responsibility, I was working with the team and developing and implementing the IoT project for the customer on a smart home system.   Trainee IOT Engineer: • Developing embedded system solutions on IoT technology which can be used in daily life. • implementing IoT solutions for customers on embedded system • preparing automation codes and circuit board for the system • Preparing documentation for the project and maintaining codes for the process

Projects Experience   Hitachi Solutions– BI Data Architect Solutions Aug 2020 - Jan 2021 Working for various clients to develop & enhance their Data solutions for small and large scale to handle vast amounts of data and create insights by using modern data platforms. Experience in developing full data solutions build on top of the Azure Data Lake, Synapse, Azure Data Factory, Data Bricks and Power BI. as my role, help our customers unlock the value from their data that be by helping them implement designing and developing a Data warehouse and BI semantic layer for reports and Dashboard.    Data Solution Architect Solutions • • Gather business requirements from stakeholders for BI solution • Designing and Implementing optimal Data architecture for solution • Working with customers to evaluate subscription costs and creating manage group, subscription and resource groups. • Working with the team on implementing the solution, creating logical data models and an initial architectural diagram for implementing the solution • Finding out adequate Saas & Paas software services and license requirements for the solutions • Creating physical Data models and ETL pipelines for data load on Azure cloud solutions • Designing reports and dashboards with Power BI and migrating reports in new Power BI services • Find reports performance matrix and help team to optimize data models and slow-running DAX.     Noora Emea Project – BI Data Savvy Solutions Aug 2020 - Jan 2021 The client was using Microsoft on cloud stack technologies for BI solution and we worked with the client on developing Azure Synapse Data warehouse. A full solution was built on top of the Azure Data Lake, Synapse, Azure Data Factory, Data Bricks and Power BI as my role, help our customers unlock the value from their data that be by helping them implement designing and developing a Data warehouse and BI semantic layer for reports and Dashboard.   Sr. Data Engineer: • • Gather business requirements from stakeholders for BI solution • Designing and Implementing optimal Data models for solution • Working with the team on implementing the solution, creating logical data models and an initial architectural diagram for implementing the solution • Finding out hardware and license requirements for the solutions • Creating physical Data models and ETL pipelines for data load on Azure cloud solutions • Designing reports and dashboards with Power BI and migrating reports in new Power BI services • Find reports performance matrix and help team to optimize data models and slow-running DAX.       Boehringer Ingelheim – Database Migration Project Aug 2020 - Jan 2021 The client was using Microsoft on-premise stack technologies for Business solutions and wanted to Minimize the server maintenance and support-related impacts. The requirement was to build a data mart for business applications where businesses can utilize sales and promotion campaign analytics to increase business revenue.   Data Engineer: • Analyzing and documenting current ER diagrams and ETL process and Source system details gathering • Working closely with the architect to gather business requirements for logical data models and helping in designing process flow for new Data mart and Data models • DWH schema designing and mapping file relations with different source system • Create Physical data models with architect and business analyst • Helping developer on creating Database objects and their relationships • Designing & developing a robust data pipeline in AWS Glue (spark) to perform quick Data ingestion processes from various sources like RDS, APIs, and Flat files. • Creating a business data layer for reporting consumption for applications • Preparing documentation for Business and maintaining support for the process   Test Equity – Azure Migration Apr 2020 - Oct 2020 The client has all the Business reports and business data models (cubes) on Cognos, as Cognos support was being terminated and the client wanted to leverage the benefits of cloud technologies. So, the requirement was to replicate and migrate all reports and data models in Azure (Microsoft platform). We helped in replicating the business model in Azure analytics, reporting in Power BI and designing the ETL process for data ingestions. This helps customers to reduce maintenance and support costs with better performance and quick business insights in the business.     Data Engineer: • Gathering current environment information and details of reports, models and ETL Flow and working with businesses to gather new development requirements for Data models and Reports • Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to perform Data ingestion from different sources like Azure SQL, APIs, Blob storage to Azure SQL Data warehouse, write backwards • Preparing data models for Visualization teams using Azure analytics and Power BI services • Designing reports and dashboards with Power BI and migrating existing Excel and Cognos reports to new Power BI services • Find reports performance matrix and help team to optimize data models and slow-running DAX.

Boehringer Ingelheim – Development and Support on Microsoft ETL Platform May 2018 - Jan 2021 The client was using Microsoft on-premise stack technologies for Business solutions. we were supporting daily business activity and developing new enhancements in the application. Development and support were provided to customers to add new features as per business requirements for sales and promotion campaign analytics to increase the business revenue.   ETL and DWH Developer: • Gather business requirements and design process flow for new enhancement in the application • Designing an ELT model to extract data from the source system and analyze it with the help of advanced analytics tools to provide fruitful insights into data for better business decisions. • Performing Various transformations on staging tables for data cleaning, validations • Developing Schema and process flow for the project. • Analyzing Current data schema and documenting all ETL processes. • Performing testing and optimization for Developed ETLs to ensure the highest level of quality is obtained • Working with Businesses to get new enhancement and requirement-gathering • Developing Business reports and Business data layer for reporting

 

Education

 

Global Institute of Technology, Jaipur (India)

Bachelor of Technology (B.Tech)

2012 - 2016

 

Certifications

 

Microsoft AI Fundamentals
Microsoft Azure Solution Architect
Microsoft Azure Data Engineer	Oct 2022
Microsoft Data Analyst	June 2021
Azure Data Fundamentals	April 2021
Azure Cloud Fundamentals	May 2021
Oracle Autonomous Database Cloud 2019 Specialist, Oracle	Apr  2020
Microsoft Certified Solution Associate: BI Reporting, Microsoft	Jun  2020
Exasol Advanced Analytics Expert, Exasol	Apr  2019
Exasol Performance Expert, Exasol	Apr  2020

Languages

 

English	Proficient (C)
Hindi	Proficient (C)