Big Data Engineer

Guadalajara, Mexico
Apply
We are looking for an enthusiastic and technology-proficient Big Data Engineer, who is eager to participate in design and implementation of a top-notch Big Data solution to be deployed at massive scale.

Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world.

Responsibilities: 

- Responsible for the implementation and ongoing administration of Hadoop infrastructure initiatives.
- Working with data delivery teams to set up new Hadoop users.
- This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Kafka, Spark and MapReduce  access for the new users.
- Cluster maintenance as well as creation and removal of nodes using Hadoop Management Admin tools.
- Sound knowledge in Ranger, Nifi, Kafka, Atlas, Hive, Storm, pig, spark, Elastic Search, Solr, Kyvos, Hbase etc and other - bigdata tools.
- Performance tuning of Hadoop clusters and Hadoop Map Reduce routines.
- Screen Hadoop cluster job performances and capacity planning
- Monitor Hadoop cluster connectivity and security
- Manage and review Hadoop log files, File system management and monitoring
- HDFS support and maintenance

Requirements:

-Expert in Hadoop administration with knowledge of Hortonworks/Cloudera or Mapr Bigdata management tools
-Expert in implementing and troubleshooting hive, spark, pig, storm, Kafka, Nifi, Atlas, Kyvos, Elastic Search, Solr, Splunk, HBase applications.
-Python programming



About us:

Grid Dynamics is a leading provider of technology consulting, agile co-creation, scalable engineering and data science services for Fortune 500 corporations undergoing digital transformation. 

We work in close collaboration with our clients on digital transformation initiatives that span strategy consulting, early prototypes and enterprise-scale delivery of new digital platforms. We help organizations become more agile and create innovative digital products and experiences using deep expertise in emerging technology, top global engineering talent, lean software development practices, and high-performance product culture. 

Headquartered in Silicon Valley with over 1,300 technologists located in engineering delivery centers throughout the US, Central and Eastern Europe, Grid Dynamics has architected and delivered some of the most extensive digital transformation programs in the retail, technology and financial sectors to help its clients win market share, shorten time to market and reduce costs of digital operations on a massive scale.

To learn more about Grid Dynamics, visit www.griddynamics.com, or follow us on Twitter @GridDynamics.

Apply

Get in touch

We'd love to hear from you. Please provide us with your preferred contact method so we can be sure to reach you.

Please follow up to email alerts if you would like to receive information related to press releases, investors relations, and regulatory filings.