Senior Fabric Data Engineer

1 hour, 38 minutes ago
Contract
Senior
Software Development
Spirit Omega

Spirit Omega

Spirit Omega (formerly Spirit Staffing & Consulting) is an Indigenous-Women owned business, committed to providing quality service and professional staff for temporary, contract or direct-hire roles. We have qualified Placement Specialists who conduct intense evaluations and reference checks to ensure complete client satisfaction, and our extensive database includes experienced technical and administrative employees. Our successful team is honored to be the recipient of numerous business awards. Spirit Omega currently operates out of Calgary, AB but places contractors and employees all across Canada! We have established partnerships across Canada to service national contracts and our new partnership has enabled international expansion. We also have an Industrial Labour and Safety Training Divison, Fast Labour Solutions, which was created in 2000 to provide Industrial Staffing Services including non-skilled and skilled tradespeople. Follow our industrial and safety training division @Fast Labour Solutions!

human resources
11-50
Founded 1998

Description

  • Design and implement data solutions using Microsoft Fabric components such as OneLake, Fabric Pipelines, Lakehouse, Warehouse, and Notebooks.
  • Build and optimize scalable ingestion and transformation pipelines with PySpark, Python, and SQL.
  • Migrate and harmonize data from Saba, Cura, and related enterprise systems.
  • Develop API-driven and scheduled workflows to ingest data from internal and external sources.
  • Implement business rules for learning history, certifications, compliance, skills, and learner profile data.
  • Build curated, analytics-ready datasets for dashboards, reporting, and downstream integrations.
  • Perform SQL development and tuning for reporting and operational consumption.
  • Implement data quality checks, reconciliations, monitoring, exception handling, and audit logging.
  • Enforce secure access controls using Azure AD, RBAC, managed identities, and secure connectivity patterns.
  • Support CI/CD, code promotion, release management, and operational monitoring in an Agile environment.

Requirements

  • 7+ years of experience in data engineering and enterprise data integration.
  • Strong hands-on experience with Microsoft Fabric and related Azure data services.
  • Strong experience with PySpark, SparkSQL, Python, and SQL/T-SQL.
  • Experience building ingestion and transformation pipelines from APIs, files, databases, and third-party platforms.
  • Experience with curated data layers, data modeling, and analytics-ready datasets.
  • Experience tuning data pipelines for scale, resiliency, and cost optimization.
  • Working knowledge of security, access controls, and data governance practices.
  • Experience with Azure DevOps and Git-based deployment automation.
  • Strong analytical, troubleshooting, and communication skills.
  • Experience with learning, HR, or talent data domains preferred.
  • Familiarity with ADF, Synapse, Databricks, Azure Functions, or Logic Apps preferred.
  • Exposure to AI tools such as GitHub Copilot and Claude preferred.
  • Experience with data governance tooling such as Purview preferred.
  • Exposure to AI/ML-ready data preparation and feature engineering practices preferred.
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.
  • Ability to work independently and proactively in a fast-paced delivery environment.
  • Comfortable operating in remote or hybrid teams with cross-functional coordination.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer

CodeRoad 51-250 Internet Software & Services

Coderoad is hiring a Data Engineer to build and improve cloud-based data pipelines and analytics infrastructure for real-world software projects.

Apache Spark Databricks GCP MySQL Python Scala
1 day ago

Data Engineer (6278)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a remote Data Engineer to build and maintain scalable data infrastructure for AI product analytics and topline metrics across product surfaces.

AWS Azure GCP Generative AI Machine Learning Python Snowflake SQL
3 days ago

Sr. Data Engineer

Teachable 51-250 Internet Software & Services

Teachable is hiring a Senior Data Engineering leader to guide data architecture and pipelines for a remote Brazil-based team supporting company-wide decision-making across engineering, product, finance, and business functions.

Apache Airflow AWS dbt Kafka Terraform
1 week ago

Data Engineer (Snowflake & GCP)

Coderio 51-250 Internet Software & Services

Coderio is hiring a Data Engineer to join its data engineering team and lead the design and optimization of cloud-native data pipelines connecting Snowflake and Google Cloud Platform.

GCP Python Snowflake
1 week, 6 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers