Senior Data Engineer - Remote Job at Duobridge Talent Solution, United States

  • Duobridge Talent Solution
  • United States

Job Description

Job Summary:

We are looking for a Senior Data Engineer with strong Python and data engineering experience to build scalable data platforms and pipelines using Azure, Databricks, and Snowflake .

Key Responsibilities:
  • Design and develop scalable ETL/ELT data pipelines.
  • Build data ingestion frameworks using Python, APIs, and distributed processing .
  • Develop Databricks pipelines using PySpark and Delta Lake .
  • Work with Snowflake, Azure Data Factory, ADLS Gen2, and Azure Synapse .
  • Design Medallion Architecture, CDC, data models, and data quality frameworks.
  • Develop REST/GraphQL API integrations with authentication, retry, and error handling.
  • Optimize pipeline performance, reliability, and cloud costs.
  • Support batch, real-time, and event-driven data processing.
  • Collaborate with AI engineers, architects, product teams, and business stakeholders.
Required Skills:
  • 5+ years of Data Engineering experience.
  • Strong Python and Advanced SQL skills.
  • Hands-on experience with Databricks, PySpark, Delta Lake, and Snowflake .
  • Strong knowledge of Azure Data Factory, ADLS Gen2, and Azure Synapse .
  • Experience with REST/GraphQL APIs, OAuth2/JWT, and API integrations.
  • Knowledge of data architecture, CDC, Medallion Architecture, and dimensional modeling.
  • Experience with Git and CI/CD .
Good to Have:

Airflow, dbt, Kafka, Terraform, Azure OpenAI, and AI/ML data pipelines.

#J-18808-Ljbffr

Job Tags

Similar Jobs

Spirit AeroSystems

Aerospace Manufacturing Engineering Intern Job at Spirit AeroSystems

 ...AeroSystems, Inc. in Tulsa, OK invites students to join our Summer 2027 Manufacturing Engineering Internship.You will work with mentors to develop and improve manufacturing methods for aerospace structures and gain hands-on experience in tooling, processes, and production... 

Ensono

Senior Sales Executive Job at Ensono

 ...leading, large-scale provider of mainframe and infrastructure services serving mid-tier to large enterprise and government clients. The Gartner Group says that, "Ensono is one of the top three mainframe services providers and a top ten provider of data center outsourcing... 

Uline Shipping Supplies

EDI Integration Analyst Job at Uline Shipping Supplies

EDI Integration AnalystCorporate Headquarters12575 Uline Drive, Pleasant Prairie, WI 53158Do you enjoy making systems work together seamlessly? Are collaboration and customer service some of your strengths? Then you belong at Uline! As an EDI Integration Analyst, youll... 

Association for Facilities Engineering

Weekend Dairy Farm Assistant: Feed, Clean & Upkeep Job at Association for Facilities Engineering

 ...The Association for Facilities Engineering in Saint Cloud, Minnesota, is looking for an assistant at a custom dairy heifer boarding facility. This role includes maintaining clean pens and feeding animals, as well as pressure washing, sanitization, and facilities upkeep... 

HDR

Geotechnical Engineer Job at HDR

 ...support economic vitality, public safety, sustainable and resilient communities and quality of life. We bring together planners, engineers, architects, construction management staff, environmental, strategic communications, economists, management consultants and specialists...