GCP Data Engineer
EXL · Hyderabad, Telangana · Full-time
Core Technologies
• DBT (Data Build Tool)
• Google BigQuery
• SQL
• Python
• PySpark
• Git
GCP Services
• BigQuery
• Cloud Storage
• Dataproc
• Cloud Composer (Airflow)
• Dataflow
• IAM
SAS Technologies
• SAS Base
• SAS Enterprise Guide
• PROC SQL
• SAS Macros
• SAS Data Sets
Data Engineering
• ETL / ELT Development
• Data Warehousing
• Data Pipeline Design
• Performance Optimization
• Data Validation & Reconciliation
Data Modeling
• Star Schema
• Snowflake Schema
• Dimensional Modeling
• Source-to-Target Mapping
SAS Migration & Modernization
• Analyze existing SAS datasets, ETL jobs, PROC SQL code, and SAS macros.
• Convert SAS transformation logic into DBT models and cloud-native data pipelines.
• Support migration of historical and incremental data from SAS platforms to GCP.
• Participate in migration assessments, code conversion, and reconciliation activities.
Data Engineering & Development
• Design and develop scalable ELT pipelines using DBT and BigQuery.
• Build and optimize data ingestion, transformation, and aggregation processes.
• Develop reusable and modular DBT models following best practices.
• Implement performance tuning for SQL and BigQuery workloads.
• Create and maintain data lineage and metadata documentation.
Data Quality & Reconciliation
• Design and implement data quality validation frameworks.
• Perform source-to-target reconciliation between SAS and GCP platforms.
• Investigate and resolve data inconsistencies and migration issues.
• Support automated testing and monitoring of data pipelines.
Cloud Platform Development
• Build and manage solutions using:
• BigQuery
• Cloud Storage
• Dataproc
• Cloud Composer (Airflow)
• Dataflow
• Support data security, access controls, and governance requirements.
Collaboration & Delivery
• Work closely with Data Architects, Business Analysts, Data Modelers, and QA teams.
• Participate in design reviews and sprint planning sessions.
• Estimate effort and provide technical input during project planning.
• Mentor junior engineers and enforce engineering best practices.
Graduate in Computer Science, Data Science, or related field. 4-6 years of experience in data engineering or related field.