Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services

Description

  • Architect and build scalable data pipelines and infrastructure for AI and product systems.
  • Design and maintain data ingestion, transformation, and storage architectures.
  • Develop and manage batch and real-time data pipelines.
  • Build and optimize vector search, retrieval, and machine-learning data workflows.
  • Ensure data reliability, security, governance, and quality across the platform.
  • Collaborate with AI and backend engineers on training, inference, and product features.
  • Implement monitoring, observability, and data-quality frameworks.
  • Optimize large-scale datasets and query-system performance.
  • Define technical architecture, engineering standards, culture, and hiring practices as the founding data hire.
  • Partner with founders and product leadership to inform product decisions with data capabilities.

Requirements

  • 7+ years of professional experience, primarily in dedicated data engineering roles.
  • Strong experience designing data pipelines and distributed data systems.
  • Experience with relational databases, preferably PostgreSQL; MySQL or similar is acceptable.
  • Experience with NoSQL and vector databases.
  • Strong Python programming experience.
  • Experience building scalable backend systems and designing data models and storage architectures.
  • Ability to make and justify architectural decisions.
  • Strong understanding of data-processing performance and optimization.
  • Experience with Apache Spark, Apache Airflow, Kafka, Elasticsearch, or OpenSearch is highly desirable.
  • Experience with PostgreSQL, MongoDB, Qdrant, Milvus, pgvector, Pandas, or Polars is highly desirable.
  • Experience with AI or machine-learning platforms, stream processing, event-driven architectures, cloud infrastructure, or early-stage startups is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer

Coderio 51-250 Internet Software & Services

Coderio is seeking a Senior Data Engineer to build and optimize scalable data platforms that process high-volume financial and transactional data for international clients.

Apache Airflow Apache Spark AWS CI/CD Databricks dbt Docker GCP Git GitHub Actions GitLab CI Java Kafka Microservices Python Scala Snowflake SQL Terraform
8 hours, 59 minutes ago

CDP Data Engineer

Bounteous 1K-5K Internet Software & Services

Bounteous is seeking a CDP Engineer to configure and operate Adobe Real-Time CDP and Adobe Experience Platform for a large telecommunications client, enabling reliable ingestion, identity resolution, profile creation, segmentation, and activation.

AWS Azure GCP JavaScript Python Segment Snowflake SQL
8 hours, 59 minutes ago

Senior Data Engineer (Snowflake) - 6 months FTC

Massive Rocket 51-250 Media

Massive Rocket is seeking a Senior Data Engineer to design and optimise Snowflake-based customer data foundations that support CRM, personalisation, audience activation, and scalable digital engagement for clients.

dbt Segment Snowflake SQL
2 days, 9 hours ago

Data Engineer

CodeRoad 51-250 Internet Software & Services

Coderoad is hiring a Data Engineer to build and improve cloud-based data pipelines and analytics infrastructure for real-world software projects.

Apache Spark Databricks GCP MySQL Python Scala
1 week, 3 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers