- 3+ years of building distributed crawlers running in production
- Strong Python (Scrapy / Playwright) or Node.js (Puppeteer / Crawlee)
- Behavioral simulation: human-like mouse trajectories, realistic timing, scroll and click patterns, bypassing behavioral biometrics
- Security research mindset: monitoring target sites for changes, change detection, proactive updates of bypass logic
- Experience with proxy infrastructure: residential, mobile, ISP, and rotating proxies
- Reverse engineering of private APIs via mitmproxy, Charles, or Burp
- Scaling crawlers on distributed queues: Redis, Kafka or SQS
- Active use of LLMs and an experimental mindset — you try every available tool until the result is there
- Proactivity: you notice useful data and bring it yourself, without a detailed specification
- English sufficient for daily work in an international team
Preferred
- Direct experience with Mercado Livre, Amazon, Shopee or TikTok Shop
- Public GitHub: marketplace crawlers, or contributions to Scrapy, Playwright, curl-impersonate, undetected-chromedriver
- Experience with anti-detect browsers and stealth tooling: Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, tls-client
- Experience running a project end-to-end or managing other engineers
JoomPulse is an AI analytics tool for Mercado Livre and Shopee sellers, providing insights into the most profitable products and fastest-growing categories — helping sellers boost their profits with data-driven decisions.
JoomPulse is one of the key businesses of Joom Group, an international tech-centric group of e-commerce companies that was founded in 2016 in Latvia. Joom Group also includes the following businesses: Joom, a global cross-border marketplace; JoomPro, the first and only end-to-end cross-border B2B marketplace; and Onfy, a pharmaceutical marketplace in Germany. Joom Group has offices in Latvia, China, Germany, and Brazil, with its headquarters in Lisbon, Portugal. We work as one international team, sharing knowledge and collaborating across countries, businesses and products.
We are looking for an experienced Senior Data Acquisition Engineer who will own the data acquisition pipelines behind JoomPulse analytics. Marketplaces keep raising their anti-bot defences, so this is a role about solving problems that have no ready answers yet — hands-on, experimental, and with full freedom in tooling.
Responsibilities
- Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee
- Build and maintain distributed crawlers running in production
- Monitor target marketplaces for changes, detect them early and update bypass logic proactively
- Reverse engineer private APIs to get data faster and more reliably than through HTML
- Keep crawlers scalable and observable: distributed queues, success-rate monitoring, alerting on anti-bot regressions
- Investigate pipeline failures caused by new anti-bot checks and restore the data flow
- Use LLMs and any other tooling to research and solve problems that have no ready answers
- Spot data that can be useful for the product and bring these insights to the team
- Compensation package: base salary and performance-based bonuses
- Office-first: flexible hours with the possibility to work remotely 52 days per year, and 22 days of paid annual leave
- Care & Wellbeing: health insurance (including dental care) for employees and their children, daily meal allowance, and 100% paid sick leave
- AI-first approach: licenses and access to a wide range of AI tools
- Team & Growth: collaboration with colleagues across Portugal, Brazil, Latvia and China, with opportunities for promotions, professional training, and English courses
- Community & Engagement: annual team-building activities, knowledge-sharing workshops, and a strong sense of teamwork
Before applying for the above position, please review our Candidate Privacy Notice here: https://legal.joom.com/recruitment/Joom_Unipessoal_LDA_Job_Applicant_Privacy_Notice.pdf
By responding to the vacancy, you acknowledge that you have read our Privacy Notice.
