ai newsDi., 27. Okt.
EilmeldungAustralia warns of 'unprecedented' AI threat

Pull Indian tech and AI-startup job data from employer career pages, in one API call

If you build a job board, run recruiting outreach or track hiring as a market signal, sooner or later you need the same thing: a clean, structured list of open roles. The usual approach is to scrape LinkedIn or Naukri, and that means logins, proxies, CAPTCHAs and reposted listings. There is a simpl

dev.toDienstag 09:21 · 27.10.3 Min. Lesezeit
Bild: dev.to

If you build a job board, run recruiting outreach or track hiring as a market signal, sooner or later you need the same thing: a clean, structured list of open roles. The usual approach is to scrape LinkedIn or Naukri, and that means logins, proxies, CAPTCHAs and reposted listings.

There is a simpler source. Most product companies host their careers page on an applicant tracking system (ATS) such as Greenhouse, Lever, Ashby or SmartRecruiters. Those vendors publish public JSON job-board feeds, so that companies can embed their openings on any site. No login is required.

I built two Apify actors on top of those feeds:

This post shows how to call them, what you get back, what it costs and where they fall short.

India Tech Jobs Scraper has a built-in directory of 57 employers that hire in India. The Store page lists names such as Stripe, Databricks, Okta, MongoDB, Zscaler, Swiggy, CRED, Meesho, Freshworks, Groww, Sarvam AI and InMobi. Every job is tagged isIndia and indiaCity, and the actor normalises spellings like Bangalore/Bengaluru and Gurgaon/Gurugram. In my test run on 27 Oct 2026 it returned 1,431 live India jobs from 61 company boards in 51 seconds.

AI & Startup Jobs Scraper has a directory of 144 companies, each tagged by sector: ai, fintech, devtools, security, crypto, health, autonomy_space_defense and consumer_gaming. It includes OpenAI, Anthropic, Perplexity, ElevenLabs, Cursor (Anysphere), Stripe, Databricks and SpaceX. A full run on 27 Oct 2026 returned 23,192 jobs from 144 boards (Greenhouse 16,881, Ashby 5,506, Lever 805), and 4,303 of them were remote.

Both actors also accept any other company that runs on one of the four supported ATSs. You can pass a careers URL ( https://jobs.lever.co/meesho ), an ats:slug pair ( greenhouse:stripe ) or a bare slug.

This input uses fields from the India actor's input schema:

{ "useIndiaDirectory": true, "companies": [ "https://jobs.lever.co/meesho", "greenhouse:stripe" ], "indiaOnly": true, "includeGlobalRemote": false, "cities": [ "Bengaluru", "Bangalore" ], "keywords": [ "data", "machine learning" ], "excludeKeywords": [ "intern" ], "remoteOnly": false, "postedWithinDays": 7, "includeDescription": false, "maxItems": 500 } Enter fullscreen mode Exit fullscreen mode Here is what the fields do:

This input uses fields from the AI & Startup actor's schema:

{ "useDirectory": true, "sectors": [ "ai" ], "companies": [], "locations": [ "San Francisco", "Remote" ], "keywords": [ "engineer" ], "excludeKeywords": [ "intern", "manager" ], "remoteOnly": false, "postedWithinDays": 14, "includeDescription": false, "maxItems": 2000 } Enter fullscreen mode Exit fullscreen mode If you leave sectors empty, the actor scans all 144 directory companies. locations keeps any job whose location string contains one of your values, such as "London", "United States" or "India".

Both actors return the same flat schema, one row per job:

{ "ats": "ashby", "companySlug": "atlan", "company": "Atlan", "jobId": "20fe5046-b287-40f6-990f-842ad75526e5", "title": "Staff Software Engineer - Infrastructure (AI Native)", "location": "India", "allLocations": [ "India" ], "department": "Engineering", "team": "Engineering", "employmentType": "FullTime", "workplaceType": "Remote", "postedAt": "2026-10-23T14:44:45.243000+00:00", "updatedAt": null, "jobUrl": "https://jobs.ashbyhq.com/atlan/20fe5046-b287-40f6-990f-842ad75526e5", "applyUrl": "https://jobs.ashbyhq.com/atlan/20fe5046-b287-40f6-990f-842ad75526e5/application", "salary": null, "descriptionText": null, "isIndia": true, "indiaCity": null, "isRemote": true, "scrapedAt": "2026-10-27T07:26:28.940092+00:00" } Enter fullscreen mode Exit fullscreen mode The AI & Startup actor adds a sectors array to each row. You can export results as JSON, CSV or Excel from the Apify console, or send them on to Google Sheets, Zapier, Make or a webhook.

That gives you a fresh feed for a job board or newsletter. It also gives you a time series of hiring by company, team and city, which is useful for hiring-intent signals or for analyst work.

Both actors use Apify's pay-per-event model:

If a company you need is missing from a directory, add its careers URL to companies, or tell me and I'll consider adding it.

Disclosure: I built and maintain both actors, and I earn the per-job fee above. (Nidhi, @RealNidhibhai, GitHub Nidhi-bhai )

Quelle: dev.to (dev.to). Original öffnen