Senior Data Engineer

• Medical and Dental Insurance
• Great Benefits
• With Night Differential

Job Description

The Senior Data Engineer is responsible in designing, developing, and deploying scalable data solutions that support critical business operations and analytics.

Key Responsibilities

• Develop, maintain, and optimize API integrations for data ingestion and delivery across a variety of platforms and services.
• Utilize Azure DevOps to automate deployment and testing of data solutions.
• Manage and enhance our Databricks environment, including cluster management, job scheduling, and Delta Lake operations.
• Build and maintain scalable ETL/ELT pipelines using PySpark, Python & SQL, and cloud-native tools.
• Collaborate with data scientists, analysts, and other engineers to ensure data quality, availability, and governance.
• Monitor data workflows, troubleshoot issues, and optimize performance across systems.
• Implement security, logging, and auditing standards aligned with organizational policies.

Requirements

• Proven experience in API development and integration, ideally with RESTful APIs.
• Strong knowledge of Azure DevOps, including pipelines, release management, and infrastructure-as-code (ARM/Bicep/Terraform is a plus).
• Hands-on experience with Databricks (or similar data cloud solutions), including notebook development, Delta Lake, and workspace management.
• Proficiency in Python, SQL, and Spark
• Solid understanding of cloud data architecture (preferably Azure Data Lake, Azure Data Factory, Azure Synapse).
• Familiarity with data modeling, data governance, and data lineage concepts.
• Excellent problem-solving skills and ability to work independently or as part of a team.
• Strong communication skills to interact with both technical and non-technical stakeholders.
• Documentation of code and datasets

Preferred Qualifications

• Experience with event-driven architectures (e.g., Azure Event Grid, Service Bus).
• Knowledge of Microsoft PowerPlatforms solutions such as dataverse and sharepoint
• Azure certifications (e.g., DP-203, AZ-400) are a plus.

Other Benefits and Perks

• Paid training
• 10% Night differential pay
• HMO coverage at day 1
• Monthly Team Engagement Activities
• Twice a year team building activity
• Starbucks Monday (last Monday of the month)
• Lunch Wednesday (3rd Wednesday of the month)
• Monthly Loyalty Bonus effective 1st Year Anniversary
• Milestone Bonus (3rd, 5th, 10th year anniversary)
• 15 leave credits per year (Usable upon regularization)
• Additional two leave credits at 1 year and another every 2 years thereafter.