Big Data Devops Engineer

Santa Clara, CA, Atlanta, GA, Austin, TX, Boulder, CO, Boston, MA, US

We are seeking a strong Big Data DevOps who is motivated, result oriented and dedicated individuals with strong analytical skills who work effectively under pressure with minimal supervision to be responsible for the quality of a highly scalable and distributed platform. You will be working as a key member of this collaborative team with a group of experts recognized around the world. This is an excellent opportunity to play a role as a key contributor in creating the next generation of network-centric distributed and scalable architectures and bringing modern Big Data tools to Apple Clouds, adopting open-source solutions.

Details on the technical stack:

- Hadoop / S3-compatible blob storage for datasets

- Hive Metastore for metadata management

- Kerberos / LDAP as authentication / authorization

- Trino as SQL query engine

- Java as the main language of Metastore / Trino customization

- Spark / Scala for batch and streaming job

- Kubernetes as a target reference deployment platform

Requirements:

- 5 years of DevOps experience in BigData World

- Spark and Scala, experience in writing Spark streaming jobs

- Experience of querying RDBMS e.g. Postgres, Oracle

- Good level of Java ecosystem knowledge and ability to write effectively working code (examples: plugins for Hive Metastore and Trino, Oracle -> HDFS ingestion Spark jobs, etc...)

- Hands-on experience with modern cloud platforms deployment automation solutions

- Excellent communication skills and readiness to provide high-level support and supervise/coordinate the teams on the customer side

- At least basic knowledge of Kubernetes

Nice to have:

Mon-mandatory, but be ready to learn:

- Git and Gradle expertise

- Kerberos

- Apache Parquet / Iceberg

- Grafana

- Helm

- Splunk

- Declarative approaches in CI/CD

- Apache Superset and Python

NB:
Placement and Staffing Agencies need not apply. We do not work with C2C at this time.

Applicants with CPT and OPT visas are welcome to apply.

About Us:

Grid Dynamics is a leading provider of technology consulting, agile co-creation, scalable engineering and data science services for Fortune 1000 corporations undergoing digital transformation.

We work in close collaboration with our clients on digital transformation initiatives that span strategy consulting, early prototypes and enterprise-scale delivery of new digital platforms. We help organizations become more agile and create innovative digital products and experiences using deep expertise in emerging technology, top global engineering talent, lean software development practices, and high-performance product culture.

To learn more about Grid Dynamics, visit www.griddynamics.com, or follow us on Twitter @GridDynamics.

Apply

Don’t see the right opportunity?

Grid Dynamics is an equal opportunity employer. We are committed to creating an inclusive environment for all employees during their employment and for all candidates during the application process.

All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on, age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. All employment is decided on the basis of qualifications, merit, and business need.

Grid Dynamics Privacy Policy and E-verify

Get in touch

We'd love to hear from you. Please provide us with your preferred contact method so we can be sure to reach you.

Please follow up to email alerts if you would like to receive information related to press releases, investors relations, and regulatory filings.