HireFT
Browse JobsHow it worksPricingSuccess Stories
    Back to jobs
    PE

    Perplexity

    Software

    Member of Technical Staff (Search Crawler Analyst)

    Belgrade, SerbiaHybridFull-timePosted 1mo ago
    All Perplexity jobs

    Job description

    The internet is vast, containing trillions of URLs. Perplexity’s crawling and storage system is complex and has multiple stages (URL discovery, crawling, parsing, indexing). Each stage offers many opportunities for improvement and room for intricate bugs. You’ll work at the intersection of data analysis and engineering — designing metrics, building data pipelines, and improving the quality of our search and answer systems.

    Responsibilities

    • Find and diagnose quality issues in our crawling pipeline

    • Train small models that optimize particular aspects of the pipeline (e.g. parsing quality)

    • Build datasets for model training, including LLM-as-a-judge labeling pipelines

    • Improve page selection algorithms for indexing

    • Design and analyze experiments to validate improvements

    Qualifications

    • 4+ years of experience as a data analyst, ML engineer, or in a related role

    • Strong coding skills: you should be able to write production-grade code at the level of a mid-level backend engineer

    • Experience designing metrics from scratch

    • Experience training ML models that shipped to production with measurable metric improvements

    Nice to have

    • Direct experience working on web crawling or indexing pipelines

    Job details are sourced from the employer's original posting.

    Open job posting
    PE

    About the company

    Perplexity

    Perplexity is an AI-powered answer engine that helps users discover and synthesize information. It aims to revolutionize the way people search and interact online by providing direct answers and explanations powered by AI.

    View all Perplexity jobs
    Industry
    Software
    Founded
    2022
    Open roles
    141

    Interested in this role?

    Apply with HireFT

    Free to start — no card required.

    Your fit

    How well do you match?

    Sign in to see how your résumé lines up with this role.