Software Engineer, Data Acquisition

Google is seeking a Software Engineer for Data Acquisition in San Jose to help design and operate scalable data pipelines and curate ML-ready training data. The role emphasizes refining crawl scheduling, building signals to guide intelligent crawl decisions, and elevating the quality and usefulness of acquired data.

Location: San Jose, CA (onsite)

Salary: USD 147,000 - 211,000 per year

Responsibilities

• Improve the crawl scheduling infrastructure.
• Develop signals to understand the web and customer data interests to enable intelligent crawl decisions and web data targeting.
• Improve the quality of acquired data by increasing relevance and reducing low-quality content such as spam.

Requirements

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience coding in C++ and Python.
• 2 years of experience with algorithms.
• 2 years of experience with distributed processing.
• 2 years of experience with Flume.

Technologies

• C++
• Python
• Flume

About the Job

Google's software engineers develop the next generation of technologies that shape how billions of users connect, explore, and interact with information and one another. The work involves handling information at massive scale and extends far beyond web search. Engineers come from diverse backgrounds, contributing across areas such as information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, and natural language processing.