Lead Hadoop Developer

Yahoo

Worldwide
Full-time
Software Development
python
java
node.js

Description

It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you’re looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business—and the world. Want in?

We build, improve, and maintain one of the highest scaling platforms in the world. Our amazing team of Engineers work on next generation Big Data Platforms that transform how users connect with each other every single day. Yahoo's Big Data Platform drives some of the most demanding applications in the industry. The system handles billions of requests a day and runs on some of the largest Hadoop clusters ever built! 50,000 nodes strong and several multi-thousand node clusters bring scalable computing to a whole new level. We work on problems that cover a wide spectrum - from web services to operating systems and networking layers. Our biggest challenges ahead are designing cloud native big data platforms.

Responsibilities:

Responsibilities will include understanding all aspects of our big data platforms and engineering ownership in one or more of the following open source projects: Hadoop, Storm, Presto, Flink, or Hbase. This includes possible research and new feature work, particularly related to supporting cloud native big data use cases. You will also own improvements on existing code, debugging and investigation of user issues, participation in code reviews, designing and shipping the product. Contribute to standard methodologies and culture of the team. Participate in agile development with weekly sprints, planning & estimating work, daily standup, & retrospectives.

Qualifications:

B.S. or higher in Computer Science or equivalent work experience

7+ years experience in software development and deployment on public cloud platforms such as AWS

Experience with OOP: Java, C#, or similar

Experience with Apache Hadoop, Storm, Presto, Flink, or Hbase preferably on public cloud platforms

Experience working with large distributed systems and data

Deep understanding of the fundamentals including Data Structures, Algorithms, OS and Networking.

Strong skills in system & application architecture

Strong design and implementation skills in Java or C++. Experience with large-scale production code development is a plus.

Ability to conduct research that is justified and guided by business opportunities.

Working knowledge of scripting languages such as PHP, Perl, Python, and/or Ruby

Familiar with HTTP and TCP/IP protocol

Linux/Unix knowledge necessary

Knowledge of JVM internals and its performance tuning.

Excellent verbal, written, and communication/presentation skills

Excellent debugging/testing skills, and excellent analytical and problem solving skills

Experience with continuous integration (CI) frameworks such as Jenkins and Hudson

Experience with SCRUM or similar agile methodology

Knowledge of accessibility preferred

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion (www.yahooinc.com/diversity/) page to learn more.

US Only: Please be aware that Yahoo requires all employees entering a U.S. Yahoo office and/or attending a company event (including client events) are required to be vaccinated for COVID-19. This position will require the successful candidate to obtain and show proof of a vaccination to enter a U.S. Yahoo office and/or attending a company event (including client events). Yahoo is an equal opportunity employer, and will provide reasonable accommodation to those individuals who are unable to be vaccinated consistent with federal, state, and local law.

Currently work for Yahoo? Please apply on our internal career site.

Job Summary

Job ID:1303
Company:Yahoo
Location:Worldwide
Job Type:Full-time
Primary Tag:Software Development

To claim this job, send an email to admin@remoteng.com from your work email with the job ID.

More Details


Website:

http://www.yahooinc.com

Job Posted:

3 years ago