Ruby Engineer - Web Scraping (Remote)

Ruby Engineer (Web Scraping) We are looking for engineers with deep technical skills in browser automation, CDP internals, anti-bot evasion, concurrency, or infrastructure. If you're not sure you fit but you're a strong problem solver, apply anyway. About SearchApi SearchApi is a real-time SERP API delivering structured data from 100+ search engines and sources, including Google Search, Google Shopping, Google Jobs, Bing, Baidu, YouTube, Amazon, and many more. We power production workloads for Fortune 500 companies and fast-moving startups who need reliable search data at scale. We're a lean, profitable, bootstrapped team. No VC pressure, no bloat. Just engineers shipping real products to real customers. 🎯 Why Join Us? Real Impact: Small team, massive scale. Your code runs in production serving billions of requests, powering tools you've probably used.
100+ APIs: Google, Bing, Baidu, YouTube, Amazon, and growing.
Open Source First: LangChain, HayStack, Flowise, LangFlow, Dify integrations.
Fortune 500 Customers: Our API powers production workloads, not just pilots and experiments.
Bootstrapped and Profitable: We answer to customers, not investors.
We are searching for grinders who take ownership and move fast. At SearchApi, you shape the direction, make decisions, talk to customers, ship, and communicate progress. This is a full-stack role in every sense. You're part of building the product, not a cog in a machine. 🛡️ SearchApi Values We do everything the Rails Way. If you don't like DHH's style, this may not be the place for you.
We embrace the one person framework.
We hire Managers of One. We trust you to figure it out.
Open Source contributor.
Remote-only. Async-first. Results-driven.
Transparency. No politics.
💻 Tech Stack Ruby on Rails 8.1
Ruby 3.4
Hotwire (Stimulus.JS + Turbo)
TailwindCSS (TailwindUI components)
PostgreSQL
Redis
Sidekiq
Terraform + AWS
We use Cursor, Claude, ChatGPT, Intercom, GitHub, Chrome Developer Tools, and Slack daily. We ship multiple times a day with CI/CD. 🤖 You Control AI, AI Doesn't Control You We ship faster because we use AI tools aggressively. Cursor and Claude. But you own the output. If you can't evaluate what AI produces, you're not ready for this role. 💪 What You'll Do To get a sense of what we ship, check out the SearchApi changelog. Here's what you'll do: Fix broken parsers under time pressure.
Add new elements to existing search engines.
Build and ship new search engine integrations.
Reverse engineer website protections and anti-bot systems.
Debug browser automation issues (CDP, fingerprinting, evasion).
Create and improve documentation pages.
Develop landing pages and admin dashboard features.
Review PRs and help test.
Talk to customers directly. Help them figure things out, brainstorm solutions, identify what's missing. Learn the APIs and websites we scrape yourself so you can actually help.
Rotate on customer support. Everyone does it, including senior engineers.
Proactively update customers on progress and ship what they need.
For Senior Engineers Improve browser automation and debug performance at scale.
Optimize concurrency: fibers, ractors, threads.
Handle complex challenges: TLS fingerprinting, JA3, WebRTC, CDP internals.
Improve API monitoring: logging, real-time analytics, anomaly detection.
Architect and build new systems from scratch.
Lead technical decisions and mentor engineers.
Eventually, you choose what to work on as you develop product intuition. 🔥 The Hard Parts This role is not for everyone. Here's what makes it hard: Things break without warning. Search engines change layouts, anti-bot systems evolve, proxies fail. You'll debug production issues under pressure.
No hand-holding. We don't assign tasks or write detailed specs. You identify problems and fix them.
Customer-facing. You'll rotate on support. You'll talk to customers. You'll ship what they need and tell them when it's done.
Small team, big scope. There's no on