Data Engineer

5 days, 16 hours ago
Contract
Junior
Software Development
PartnerOne

PartnerOne

PartnerOne specializes in enterprise software solutions that manage extensive data environments through hyper automation, virtualized cloud storage, artificial intelligence, and metadata analytics, serving many of the world's largest corporations.

Media
51-250

Description

  • Design and build ETL pipelines using Microsoft Fabric tools or equivalent technologies.
  • Write optimized SQL queries and transformations for data ingestion from source systems.
  • Apply data quality rules and validation logic throughout pipeline stages.
  • Implement incremental loads and manage refresh schedules to improve performance.
  • Define and maintain data quality checks at ingestion, transformation, and output stages.
  • Validate pipeline outputs against business logic and source system expectations.
  • Identify, document, and escalate data quality issues with root cause analysis.
  • Build and maintain data transformations using Power Query, SQL, or Python as appropriate.
  • Develop dimensional models and aggregation logic aligned with analytics requirements.
  • Troubleshoot pipeline failures and performance issues, and coordinate resolution with IT/Engineering.

Requirements

  • Advanced SQL experience, including query optimization, window functions, performance tuning, and debugging complex transformations.
  • Proficiency with Microsoft Fabric, including Dataflow Gen2, Notebooks, and Lakehouse, or equivalent ETL tools such as Python, dbt, Talend, or Informatica.
  • Strong understanding of relational database design and dimensional modeling.
  • Experience with Power Query / M for complex data shaping, merging, error handling, and transformation logic.
  • Experience with Python or a similar scripting language for data manipulation and pipeline automation.
  • Basic Git/version control knowledge for collaborating on code and tracking changes.
  • Experience with data quality and testing frameworks, including unit tests, assertions, and validation rules.
  • Ability to interpret business requirements and design efficient data solutions.
  • Mortgage or lending domain familiarity is preferred, with willingness to learn the domain required.
  • Ability to work within defined standards and escalate architectural questions to a lead.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer III-6245

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer III to support remote enterprise data engineering work focused on scalable data architectures, ETL pipelines, and data-driven decision-making for business operations.

2 days, 16 hours ago

Databricks Solution Architect

Unison Group Technology consulting

Senior Consultant – Databricks at a Singapore-based consulting engagement, responsible for delivering and optimizing Lakehouse data and AI solutions for enterprise customers.

AWS Azure CI/CD Databricks GCP Git Hugging Face LLM Machine Learning MLflow MLOps Prometheus Python Scala Splunk Terraform
4 days, 15 hours ago

(Senior) Data Engineer - Freelance

Netguru 251-1K Internet Software & Services

Netguru is hiring a freelance Data Engineer to support long-term, full-time remote work on data projects for major digital commerce clients across the European Union.

Apache Spark AWS Bash CI/CD Python Scala
4 days, 16 hours ago

Principal Engineer - Microsoft Fabric (Contract)

FE fundinfo 1K-5K Capital Markets

FE fundinfo is seeking a Principal Engineer to own and evolve a greenfield Microsoft Fabric enterprise data platform that supports reporting, analytics, governance, and self-service data consumption across the business.

Databricks Power BI
5 days, 15 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers