Senior Data Engineer Job at New York Technology Partners, Houston, TX

eXdlS3lJWXdKMEpDbzk0MVN6N0t3OVhaK2c9PQ==
  • New York Technology Partners
  • Houston, TX

Job Description

We are seeking a Senior Data Engineer to support the advancement of data governance and data management capabilities within a modern Databricks Lakehouse environment. This is a hands-on engineering role focused on building, automating, and operationalizing scalable data solutions using code and AI-driven approaches.

This role is ideal for someone who enjoys turning frameworks into real, production-ready systems that improve data quality, trust, and accessibility across the organization.

**Remote but requires someone willing to come onsite 2 times per month (Houston, TX)**

Key Responsibilities

  • Implement data governance and data management solutions within Databricks, including Unity Catalog, access controls, metadata, and data quality frameworks
  • Translate governance frameworks into scalable, production-ready engineering solutions
  • Build and optimize advanced data pipelines using Databricks, DBT, and Kafka
  • Develop reusable templates, automation, and standardized patterns to enable broader adoption across teams
  • Design and implement AI/GenAI-enabled solutions (e.g., metadata enrichment, automated data quality checks, intelligent workflows)
  • Monitor and report on data quality and governance health using SQL and reporting tools such as Power BI
  • Collaborate with engineering, architecture, and business stakeholders to drive adoption and maturity of data practices
  • Troubleshoot, optimize, and performance-tune data pipelines and streaming systems

Required Qualifications

  • Strong experience as a Data Engineer or Software Engineer in a production environment
  • Hands-on experience with Databricks, including Unity Catalog
  • Experience building and optimizing data pipelines using tools such as DBT and Kafka
  • Strong SQL skills and experience working with large-scale data systems
  • Experience with data governance concepts, including metadata management, access control, and data quality frameworks
  • Experience with performance tuning in Databricks and/or Kafka environments
  • Familiarity with AWS or similar cloud platforms
  • Strong communication skills with the ability to work directly with stakeholders and drive initiatives independently

Job Tags

Remote work

Similar Jobs

Loyola University Maryland

HVAC Mechanic Job at Loyola University Maryland

 ...Unless explicitly stated otherwise in the job description or job advertisement, Loyola University Maryland does not sponsor employment visas for this position. University Description Loyola University Maryland, located in the vibrant city of Baltimore, is a... 

Campbell County Health

REGISTERED NURSE | Pediatric Clinic Job at Campbell County Health

 ...REGISTERED NURSE | Pediatric Clinic ABOUT CAMPBELL COUNTY HEALTH Campbell County Health (CCH) is more than just a hospitalwe are a comprehensive healthcare system serving northeast Wyoming. Our organization includes Campbell County Memorial Hospital, a 90-bed... 

Applebee's Grill + Bar - Baxter

Restaurant Cook - Urgently Hiring Job at Applebee's Grill + Bar - Baxter

 ...Bar Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below. - Baxter is looking for a Restaurant Cook to join our team in Baxter, MN. This position is full time or part time. The restaurant cook... 

USAA

Financial Analyst Lead Job at USAA

 ...: Why USAA? At USAA, our mission is to empower our members to achieve financial security through highly competitive products, exceptional service and trusted advice. We seek to be the #1 choice for the military community and their families. Embrace a fulfilling... 

MAJIK Enterprises International Inc.

Delivery Specialist - Bonus Eligible + Growth Opportunities Job at MAJIK Enterprises International Inc.

Description:Ahora contratando! Se habla espaol 4x Best Places to Work in PA (20222025) Looking for more than just a job? At Majik, youll build real relationships, earn bonuses, and grow your career. No rent-to-own experience? No problem we train you. ...