Lead Data Engineer Job at Harnham, Houston, TX

bkpWT1NINGNLSWRSZVJDcDl2U1liSVA0S2c9PQ==
  • Harnham
  • Houston, TX

Job Description

Title: Lead Data Engineer

Location: Houston, TX 77077 - Onsite 4 days per week.

Overview of Role:

As Lead Data Engineer, you will be responsible for helping to scale, implement, and architect new AI/ML initiatives at the enterprise level. This role is part of a brand new team as our client's business grows. This role is a combination of systems engineering, data analytics, and data integration.

Company Description:

Our client manages a large portfolio of companies and has a large focus on upholding integrity and being held accountable to the highest ethical standards. They are committed to fostering a culture of open communication, teamwork, and personal development.

Role Description:

  • Design and implement scalable, reliable data pipelines using technologies like Apache Spark, Hadoop, and Kafka.
  • Leverage AWS or Azure services (e.g., EC2, RDS, S3, Lambda, Azure Data Lake) for efficient data handling and processing.
  • Develop and optimize data models and storage solutions (SQL, NoSQL, Data Lakes) to ensure data quality and accessibility for operational and analytical applications.
  • Automate data workflows with ETL tools and frameworks (e.g., Apache Airflow, Talend) for efficient data integration and timely availability.
  • Collaborate with data scientists, providing the necessary infrastructure and tools for complex analytical models, using Python or R.
  • Ensure data governance and security compliance, implementing best practices in encryption, masking, and access controls within a cloud environment.

Skills and Experience:

  • Bachelor's degree in Computer Science, MIS, or equivalent education/experience.
  • Extensive background and experience in ETL/ELT pipelining.
  • 3+ years of big data technology (Hadoop, Spark, Kafka), as well as cloud services (AWS preferred, Azure, GCP) in a storage/processing capacity.
  • Experience with cloud computing environments (AWS, Azure, GCP) and Data/ML platforms (Databricks, Spark).
  • Relational database management system Software (RDBMS) experience - e.g. PostGreSQL
  • ML model deployment experience is a plus!
  • Nice to have certifications: AWS Certified Solutions Architect, Azure Data Engineer Associate, Databricks Certified Associate Developer for Apache Spark.

Benefits:

  • Health, Dental, and Vision Insurance
  • 15+ Days of PTO Annually
  • Educational Assistance available
  • Annual bonus (20%)
  • 401(k) Matching Program

Please note: Candidates must be authorized to work in the United States to be considered at this time.

Job Tags

Similar Jobs

AO Globe Life - Chance Peters

100% Remote: Entry Level Client Services Representative Job at AO Globe Life - Chance Peters

 ...What are you looking for? A work-from-home opportunity? Grow with the company? Helping others? High standards of integrity? Great pay? Are you passionate about making a positive impact on the lives of others? Look no further! Were seeking dedicated individuals... 

NORY, Inc.

Digital Marketing Specialist / Part-Time (Virtual, NYC Education & Parenting Market) Job at NORY, Inc.

 ...camp atmosphere: Instagram: bit.ly/noryi Summer Camp Video: bit.ly/noryvideo1 The Role: We are seeking a Part-Time Digital Marketing Strategist with a deep understanding of the NYC parenting and education market. This role is ideal for a proactive,... 

SSI Electronics, Inc.

Printing Production Assistant Job at SSI Electronics, Inc.

 ...Manufacturing company in the Rockford/Belmont area is looking for a full-time Printing Production Assistant. Job Summary: We are seeking a well-rounded individual to assist with various press room tasks, including inspecting printed graphics and circuits, assisting... 

Conestoga Oral Surgery

Dental Assistant Job at Conestoga Oral Surgery

 ...Dental Assistant Lancaster, PA Are you an early-career Dental Assistant with your RHS certification and a passion for learning in...  ...required; graduation from a dental assisting program or prior dental office experience is a strong plus. Tech-Savvy: Comfortable using... 

Techtronic Industries - TTI

Field Sales & Marketing Representative Job at Techtronic Industries - TTI

 ...future promotional opportunities. Ability to work nights and weekends Weekends will be required at different points throughout the...  ...for this position is $24.04 and $25.96/hour equating to a Target Annual Salary of $50,000 - $54,000 Sales Contests and Incentives...