Data engineer Job at ESolutions, Inc., Mountain View, CA

cGdjMUVqNU9LNTBrcTZCVWduRHM3Nkp1N2c9PQ==
  • ESolutions, Inc.
  • Mountain View, CA

Job Description

Role : AWS Data Engineer

Location : Mountain view CA Fully onsite

Must have : AWS , Terraform , Spark , python

JD :

The team will be working in one of the following areas:

Multi-cloud data exploration

Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Starburst, Privacera, and Databricks) and Intuit services (LDAP, data decryption)

Testing user flows for data analysis, processing, and visualization with Python Spark notebooks and SQL running on distributed compute to join data between AWS S3 and Google Cloud Platform BigQuery

Developing data pipelines in Python Spark or SQL to push structured enterprise tool telemetry to our data lake

Fine-grained access control for data exploration

Terraform infrastructure-as-code for managing AWS infrastructure and deep integration between enterprise tools (Databricks and Privacera)

Evaluating Databricks capabilities to sync Hive, Glue, and Unity Catalogs

Evaluating Privacera capabilities or building new capabilities (AWS Lambda with Python) to sync Intuit access policies with Unity Catalog

Testing user flows for data analysis, processing, and visualization with Python Spark notebooks on distributed compute or Databricks' serverless SQL runtime

Responsibilities

Develop and implement operational capabilities, tools, and processes that enable highly available, scalable, and reliable customer experiences

Resolve defects/bugs during QA testing, pre-production, production, and post-release patches

Work cross-functionally with various Intuit teams including: product management, analysts, data scientists, and data infrastructure

Work with external enterprise support engineers from Databricks, Starburst, and Privacera to resolve integration questions and issues

Experience with Agile Development, SCRUM, or Extreme Programming methodologies

Qualifications

8+ year's experience designing and developing web, software, or mobile applications.

3+ year's experience building and operating cloud infrastructure solutions.

BS/MS in computer science or equivalent work experience.

Expertise with any of the following Object Oriented Languages (OOD): Java/J2EE, C#, VB.NET, Python, or sometimes C++. Java and Python preferred.

Expertise with AWS (IAM, VPC), Spark, and Terraform are preferred. Expertise with Databricks is a strong bonus.

Expertise with the entire Software Development Life Cycle (SDLC), including: system design, code review, unit/integration/performance testing, build and deploy automation

Operational excellence: minimizes costs and maximizes uptime

Excellent communication skills: demonstrated ability to explain complex technical topics in an engaging way to both technical and non-technical audiences, both written and verbally


AWS Data engineer1AWSN/AC2C,W-2,1099,C2H,Part Time,Full Time,Other,Intern,Seasonal,Contract,Permanent Full Time,Contract Only,Hourly,Salaried,Full Time W2,SubCon/C2C,SOLUTIONS,Contract to Perm,Sub-conUnited States

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Report this job
  • Dice Id: 10211255
  • Position Id: 2024-201407

Job Tags

Hourly pay, Permanent employment, Full time, Contract work, Part time, Work experience placement,

Similar Jobs

Labor Finders

LOW VOLTAGE TECHNICIAN Job at Labor Finders

 ...A Low Voltage Technician, or Low Voltage Electrician, wires various types of electronics systems that operate with low voltage. Their duties include installing and connecting various types of wires and cables, explaining to clients how to use the systems and troubleshooting... 

Geekymindz

Business Analyst - AMD , location - 1401 E Broad St Richmond, VA 23219 Job at Geekymindz

Work Arrangement - Hybrid Short Description- In office at VDOT - 1401 East Broad Street, Richmond, VA - at least 3 days per week. Long term position for a year or longer. Business Analyst with IT Technical Writing Experience Full Job Description - In office...

ABB

Sr. Field Service Technician Job at ABB

Sr. Field Service Technician At ABB, we are dedicated to addressing global challenges. Our core values: care, courage, curiosity, and collaboration - combined with a focus on diversity, inclusion, and equal opportunities - are key drivers in our aim to empower everyone...

JED Concepts

Administrative Business Partner Job at JED Concepts

We are looking for an Administrative Business Partner that understands how to keep high-paced startup businesses running smoothly....  ...booking, and creating itineraries in advance of domestic and international trips, own and manage ad hoc projects as needed, and carry out... 

Dwight School

Online Middle School Design Teacher - Part Time Job at Dwight School

 ...Role: Part-Time Middle School Design Teacher Start Date: July 2025 Position Overview Dwight Global Online School, which was recently named the #2 best online...  ...for disabled people or people with long-term health conditions. If you would like us to do anything...