Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services

Description

  • Architect and build scalable data pipelines and infrastructure for AI and product systems.
  • Design and maintain data ingestion, transformation, and storage architectures.
  • Develop and manage batch and real-time data pipelines.
  • Build and optimize vector search, retrieval, and machine-learning data workflows.
  • Ensure data reliability, security, governance, and quality across the platform.
  • Collaborate with AI and backend engineers on training, inference, and product features.
  • Implement monitoring, observability, and data-quality frameworks.
  • Optimize large-scale datasets and query-system performance.
  • Define technical architecture, engineering standards, culture, and hiring practices as the founding data hire.
  • Partner with founders and product leadership to inform product decisions with data capabilities.

Requirements

  • 7+ years of professional experience, primarily in dedicated data engineering roles.
  • Strong experience designing data pipelines and distributed data systems.
  • Experience with relational databases, preferably PostgreSQL; MySQL or similar is acceptable.
  • Experience with NoSQL and vector databases.
  • Strong Python programming experience.
  • Experience building scalable backend systems and designing data models and storage architectures.
  • Ability to make and justify architectural decisions.
  • Strong understanding of data-processing performance and optimization.
  • Experience with Apache Spark, Apache Airflow, Kafka, Elasticsearch, or OpenSearch is highly desirable.
  • Experience with PostgreSQL, MongoDB, Qdrant, Milvus, pgvector, Pandas, or Polars is highly desirable.
  • Experience with AI or machine-learning platforms, stream processing, event-driven architectures, cloud infrastructure, or early-stage startups is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineering Tech Lead - freelance

Lingaro 5K-10K IT Services

Lead a data engineering team in delivering scalable, secure, and efficient data solutions while advising customers and coordinating project execution across stakeholders.

Azure CI/CD Python Scala SQL
13 hours, 34 minutes ago

Senior Data Engineer (IICS & Redshift) (Independent Contractor)

CompassX Group 11-50 Internet Software & Services

CompassX is seeking an experienced independent data engineer for a short-term project supporting a client’s data integration, warehousing, and reporting initiatives in a pharmaceutical environment.

AWS Power BI Python SQL
13 hours, 34 minutes ago

Azure Data Engineer - freelance

Lingaro 5K-10K IT Services

Azure Data Engineers will design and implement scalable data pipelines, warehousing solutions, and ETL workflows using Azure and Databricks to process and deliver reliable data.

Agile Apache Spark Azure Databricks JIRA Python SQL
2 days, 13 hours ago

Data Engineer IV (6324)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a remote Data Engineer IV to develop, maintain, and optimize scalable data systems and ETL workflows supporting critical business initiatives.

Python
2 days, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers