Lead Data Engineer Job at Harnham, Houston, TX

bkpWT1NINGNLSWRSZVJDcDl2U1liSVA0S2c9PQ==
  • Harnham
  • Houston, TX

Job Description

Title: Lead Data Engineer

Location: Houston, TX 77077 - Onsite 4 days per week.

Overview of Role:

As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering, data analytics, and data integration.

Company Description:

Our client manages a large portfolio of companies and has a large focus on upholding integrity and being held accountable to the highest ethical standards. They are committed to fostering a culture of open communication, teamwork, and personal development.

Role Description:

  • Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
  • Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
  • Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
  • Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
  • Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.

Skills and Experience:

  • Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
  • Extensive background and experience in ETL/ELT pipelining.
  • 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
  • Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
  • Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
  • ML model deployment experience is a plus!
  • Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.

Benefits:

  • Health, Dental, and Vision Insurance
  • 15+ Days of PTO Annually
  • Educational Assistance available
  • Annual bonus (20%)
  • 401(k) Matching Program

Please note: Candidates must be authorized to work in the United States to be considered at this time.

Job Tags

Similar Jobs

Aramark

Catering Services Worker - Roche Diagnostics - Cafes Job at Aramark

The Catering Services Worker supports the event operations team in running successful catering orders and events within the location. The Catering Services Worker supports and carries out event set up, transporting equipment, food, or other supplies to the event location...

Crisis Connections

Veterans Outreach and Training Specialist Job at Crisis Connections

Job Title: Veterans Outreach and Training Specialist Type: Full-Time/Non-exempt Schedule: Mon - Fri 9 am - 5 pm; 37.5 hours per week Reports to: Director of Essential Services Payrate: $31.04/hr. + $1/hr. language differential for bilingual English/Spanish...

Tailored Management

Senior Product Manager Job at Tailored Management

 ...Role Overview: Client restaurants offer unique dining experiences and contribute to the overall store experience through partnerships...  ...in Business, Computer Science, or a related field. MBA or graduate degree is a plus. &##128640; Join a dynamic team as a... 

QUANTEAM - North America (RAINBOW PARTNERS Group)

AML & BSA Senior Consultant Job at QUANTEAM - North America (RAINBOW PARTNERS Group)

 ...As the founding entity of RAINBOW PARTNERS, Quanteam is a consulting firm specializing in the fields of Banking, Finance, and Financial Services. Guided by our core values of closeness, teamwork, diversity, and excellence, our team of 1,000 expert consultants, representing... 

Darwill

Marketing Intern Job at Darwill

 ...Summer Marketing Intern Location: 1 Tower Lane, Suite 1920, Oakbrook Terrace, IL 60181 Schedule: Tuesday and Wednesday in office About the Job: Ready to turn your passion for marketing into real-world experience this summer? At Darwill, we dont just...