Big Data Infrastructure Engineer(EKS/Databricks) Job at Insight Global, Glendale, CA

MVBlV2gwY21tV3hSdDJndER5UVBWVXNSOVE9PQ==
  • Insight Global
  • Glendale, CA

Job Description

Job Description The Ad Infrastructure team is looking for a seasoned Data Software Engineer to help build and scale our data processing platforms. Project Outline: Moving Data from AWS/EKS(Kubernetes) into Databricks platform. What Youll Do: - Design, build, and maintain infrastructure automation and tooling that enables developers to deploy and operate cloud-native applications. - Implement best practices for secure, scalable, and cost-efficient cloud operations across AWS. - Contribute to and maintain a robust library of shared Terraform modules and infrastructure-as-code standards. - Participate in root cause analyses (RCAs) and postmortems to continuously improve reliability and operational practices. - Support container orchestration and workload scaling on Kubernetes (EKS) for Spark and Flink jobs. - Collaborate with development teams to ensure seamless onboarding and operational support for infrastructure tooling and platforms. - Participate in on-call rotations and own uptime and reliability of key systems. - Drive adoption of DevOps practices, including CI/CD workflows, observability, and incident management We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form ( . The EEOC "Know Your Rights" Poster is available here ( . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: . Skills and Requirements - 7 plus years of experience in infrastructure engineering, DevOps, or cloud-native software engineering. - 4 plus years of hands-on experience with Kubernetes, preferably on Amazon EKS. - 3 plus years of experience with Python or Go for infrastructure automation. - 3 plus years working with data processing frameworks such as Apache Airflow, Spark, or Flink. - 2 plus years designing and operating Databricks environments at scale on AWS, including performance tuning and securing workloads. - Expertise in AWS services (EC2, S3, IAM, VPC, etc.), infrastructure automation, and Terraform. - Experience with container technologies (Docker) and CI/CD tools like Spinnaker. - Strong communication skills and a collaborative mindset for working across engineering teams. - Hybrid to a local Disney hub: Glendale, SF, Seattle, - AWS Certifications (e.g., Solutions Architect, DevOps Engineer). - Familiarity with all three: Airflow, Spark, and Flink. - Experience operating service mesh technologies like Istio. - Experience running Spark or Flink workloads on Databricks. null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Job Tags

Local area,

Similar Jobs

Lensa

HR Generalist - Recruiter Job at Lensa

 ...meeting our hiring requirements to include assess staffing needs, and coordinate with external staffing agencies as necessary to fulfill hiring requirements. Maintain...  ...resources, including our Lean Academy and online university (where you can get certificates and specializations... 

Allied Universal

Security Guard Construction - PT Job at Allied Universal

Allied Universal, North America's leading security and facility services company, offers rewarding careers that provide you a sense of purpose. While working in a dynamic, welcoming, and collaborative workplace, you will be part of a team that contributes to a culture... 

Stone Creek Furniture

Stone Creek Furniture seeking immediate full time experienced cabinet makers and installers Job at Stone Creek Furniture

Stone Creek Furniture is seeking immediate full time, experienced cabinet makers and installers. $20-$26/HR DOE Stone Creek Furniture is Arizona"s largest custom manufacturer of fine wood furniture and kitchen cabinets. Established over 30 years ago, Stone Creek is well... 

Ginas Tech Jobs

Systems Engineer, TS/SCI with a Full Scope Polygraph Security Clearance is Required Job at Ginas Tech Jobs

 ...Systems Engineer, TS/SCI with a Full Scope Polygraph Security Clearance is Required, Annapolis Junction, MD The System Engineer will serve as part of a highly technical team that is focused on the development and operational support of customer tools. The team works... 

Into City Prep

Investment Banking Associate MBA Internship - New York Job at Into City Prep

 ...Investment Banking Intern Seeking a hardworking MBA passionate about investment banking. You may get involved withanalysingmarkets, creating complex financialmodels, producing prospectusesand performing valuations. Responsibilities and Duties ~ Conduct market...