Job Description
Sr Data engineers with GCP
Bentonville, AR or Sunnyvale, CA (Day 1 onsite)
Long Term
Responsibilities:
As a Senior Data Engineer, you will
• Design and develop big data applications using the latest open source technologies.
• Desired working in offshore model and Managed outcome
• Develop logical and physical data models for big data platforms.
• Automate workflows using Apache Airflow.
• Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
• Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
• Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
• Mentor junior engineers on the team
• Lead daily standups and design reviews
• Groom and prioritize backlog using JIRA
• Act as the point of contact for your assigned business domain
Must Have Skills –
Data Engineering: 8+ Years
Scala : 8+ Years
Spark: 5+ Years
GCP: 3+ Years
Data modelling: 5+ Years
Domain Experience: Retail Preferred
GCP Experience
• 4+ years of recent GCP experience
• Experience building data pipelines in GCP
• GCP Dataproc, GCS & BIGQuery experience
• 12+ years of hands-on experience with developing data warehouse solutions and data products.
• 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required
• 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
• Experience with programming languages: Python, Java, Scala, etc.
• Experience with scripting languages: Perl, Shell, etc.
• Practice working with, processing, and managing large data sets (multi TB/PB scale).
• Exposure to test driven development and automated testing frameworks.
• Background in Scrum/Agile development methodologies.
• Capable of delivering on multiple competing priorities with little supervision.
• Excellent verbal and written communication skills.
• Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following:
• Gitflow
• Atlassian products – BitBucket, JIRA, Confluence etc.
• Continuous Integration tools such as Bamboo, Jenkins, or TFS
...Assistant Law Firm: Top 20 Ranked Globally Size: 4,000 Employees Location: New York, NY (Midtown) Onsite Schedule: Hybrid Target Salary: $70,000 - $125,000 with OT and Bonus as additional compensation Job Description: As a Legal Assistant, your duties...
Pinnacle Solutions is looking for a passionate and motivated Game Developer to join our virtual development team.+ The ideal candidate has a foundational understanding of programming and game design principles, and a strong desire to learn and grow in a collaborative,...
REQUIRED EXPERIENCE: 2 years of experience as barber or stylist Must be able to fade and do Hot shaves Must be dependable SOME OF THE BENEFITS OF THE POSITION INCLUDE: A full/part-time schedule Great tips Guaranteed commissions and bonuses Access...
Seeking a Global Merchandising Planner (Inventory Analyst) for a large clothing company out of California! This will be a 6 month assignment on W2 - hybrid position About the Job Key lead on the Global Merchandise Planning team focusing on Business Analytics ...
...Tenet-AZ Region is seeking a Registered Nurse (RN) ED - Emergency Department for a nursing job in Phoenix, Arizona. Job Description... ...: Level II EQ Only: A minimum of two years of current Level III NICU experience including neonatal ventilator. PREFERRED EXPERIENCE...