| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | AA | AB | AC | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Timestamp | What is your role? | Which country are you from? | What is your age group? | How would you rate your web scraping expertise level? | How many years have you worked in web scraping? | Which programming languages do you use for web scraping? | Which development tools do you use for web scraping? | If you use proxies for web scraping, which providers do you prefer? | What type of proxy do you use? | From which country or region do the IPs you use for web scraping originate? | Do you scrape dynamic websites which need JavaScript rendering? | If you use web scraping API, which one do you use? | How important for you is ethics in web scraping? | Do you care about ethics in sourcing IPs for web scraping? | If you make money from web scraping, how you do it? | What is the size of the organization you work for? | Do you hold a higher education degree? | How many hours per week do you spend on web scraping development? | How much money do you make from web scraping (salary or revenue) per year in USD? | What kind of data or websites do you scrape? | How challenging do you find the websites you scrape? | What are your sources of information about web scraping? | ||||||
2 | 0 | Web scraper | United States of America | 11 - 18 | Intermediate | I don't work in web scraping | Python | Selenium;Scrapy | Other | United States of America | Sometimes (less than 50%) | I don't | 3 | 2 | I don't | Just me | No | <= 5 hours | I don't make any money on web scraping | All kinds of data;Social media;Public Government Data | 3 | r/WebScraping subreddit;StackOverflow;Blog posts | |||||||
3 | 1 | Web scraper;Software Developer;Freelancer;Hobbyist Scraper | United States of America | 25 - 34 | Advanced | 6 - 10 years | Python;JavaScript;PHP | Selenium;Puppeteer;Playwright;Beautiful Soup;Wget;cURL | Custom build | Datacenter;Residential | United States of America;India;China;Germany | Mostly (50% - 90%) | I don't | 1 | 1 | I'm employed as a software engineer doing web scraping;I develop scrapers and sell the code as a freelancer;I sell scraped data;I build my own products based on scraped data | 101 - 1000 people | No | 6 - 20 hours | $100,000 - $200,000 | All kinds of data;Social media;SERP;E-commerce;Job postings;Hotels;Customer reviews;Online ads;Products;Grocery;Prices;Deals, special offers, discounts;Cargo tracking;Public Government Data | r/WebScraping subreddit;StackOverflow;YouTube;Blog posts;Medium | |||||||
4 | 2 | Web scraper;Software Developer | United States of America | 25 - 34 | Intermediate | 1- 2 years | JavaScript | Selenium;Puppeteer | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting;United States of America | Always or almost always (90% or more) | I don't | 3 | 3 | I build my own products based on scraped data | Just me | Yes, unrelated field | 6 - 20 hours | $10,000 - $30,000 | Social media;Job postings;Public Government Data | 3 | StackOverflow;YouTube | ||||||
5 | 3 | Software Developer | United States of America | 35 - 44 | Advanced | I don't work in web scraping | PHP | Custom | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | I don't | 3 | 3 | I don't | Just me | No | <= 5 hours | I don't make any money on web scraping | E-commerce | 4 | StackOverflow | ||||||
6 | 4 | Web scraper;Software Developer;Business owner;Freelancer | Canada | 25 - 34 | Advanced | 6 - 10 years | JavaScript;PHP | Selenium;Custom | I don't use proxies | Datacenter;Residential;Mobile | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 4 | 6 | I'm employed as a software engineer doing web scraping;I build my own products based on scraped data | 2 - 5 people | Yes, related field | 6 - 20 hours | $50,000 - $100,000 | All kinds of data | 3 | StackOverflow;Blog posts | ||||||
7 | 5 | Software Developer | Brazil | 25 - 34 | Advanced | 3 - 5 years | Python;JavaScript;Java;Go | Selenium;Puppeteer;Playwright | Custom build | Residential | United States of America;Brazil | Always or almost always (90% or more) | I don't | 6 | 6 | I'm employed as a software engineer doing web scraping | 21 - 50 people | Yes, related field | 21 - 40 hours | $1,000 - $10,000 | E-commerce;Shoes / sneakers;Hotels;Prices;Deals, special offers, discounts | 6 | Blog posts;Discord;Medium | ||||||
8 | 6 | Software Developer | United Kingdom | 35 - 44 | Intermediate | 1- 2 years | PHP | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 2 | 4 | I'm employed as a software engineer doing web scraping | 101 - 1000 people | Yes, related field | <= 5 hours | I don't make any money on web scraping | E-commerce;Products | 3 | ||||||||
9 | 7 | Web scraper;Software Developer;Freelancer | Sweden | 55 - 64 | Intermediate | 1- 2 years | PHP | Custom | I don't use proxies | I don't use proxies | United States of America;Sweden | No | I don't | 5 | 5 | I build my own products based on scraped data | Just me | No | <= 5 hours | $1,000 - $10,000 | Social media;Medical;Other | 2 | |||||||
10 | 8 | Web scraper;Software Developer | Germany | 25 - 34 | Intermediate | < 1 year | Python | Playwright;Custom | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 6 | I'm employed as a software engineer doing web scraping | 21 - 50 people | Yes, unrelated field | 6 - 20 hours | I don't make any money on web scraping | All kinds of data;E-commerce | 2 | r/WebScraping subreddit;StackOverflow;Blog posts;Discord | ||||||
11 | 9 | Web scraper;Software Developer | Poland | 25 - 34 | Advanced | 3 - 5 years | Python | Playwright | Custom build | Mobile | I don't care, I don't use geotargeting | Sometimes (less than 50%) | Scraping Fish | 6 | 6 | I don't | 2 - 5 people | Yes, related field | <= 5 hours | $10,000 - $30,000 | All kinds of data | 5 | r/WebScraping subreddit;StackOverflow;YouTube | ||||||
12 | 10 | Freelancer | Germany | 25 - 34 | Intermediate | I don't work in web scraping | Python;Java | Selenium | I don't use proxies | I don't use proxies | Germany | Always or almost always (90% or more) | I don't | 1 | 1 | I build my own products based on scraped data | Just me | Yes, related field | <= 5 hours | $30,000 - $50,000 | Sports | 3 | |||||||
13 | 11 | Web scraper;Software Developer;Business owner | Brazil | 25 - 34 | Intermediate | 3 - 5 years | JavaScript;Go | Puppeteer | I don't use proxies | I don't use proxies | Brazil | Sometimes (less than 50%) | I don't | 3 | 4 | I'm employed as a software engineer doing web scraping;I sell scraped data;I build my own products based on scraped data | 2 - 5 people | Yes, related field | 21 - 40 hours | $30,000 - $50,000 | Social media;E-commerce;Public Government Data | 5 | |||||||
14 | 12 | Software Developer | Slovakia | 25 - 34 | Advanced | I don't work in web scraping | PHP | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 6 | I don't | 21 - 50 people | Yes, related field | <= 5 hours | I don't make any money on web scraping | Products | 1 | StackOverflow | ||||||
15 | 13 | Software Developer | Turkiye | 35 - 44 | Intermediate | 1- 2 years | Go;Rust | Selenium;Scrapy | Oxylabs;Froxy;SmartProxy;BrightData;Custom build | Datacenter;Residential;Mobile | Turkey | Always or almost always (90% or more) | Scraping Fish;ScrapingBee;ScrapingAnt;ScrapFly;ScrapeOps;ScraperAPI;ZenRows | 6 | 6 | I'm employed as a software engineer doing web scraping;I develop scrapers and sell the code as a freelancer;I build my own products based on scraped data | 51 - 100 people | Yes, related field | 21 - 40 hours | I don't make any money on web scraping | All kinds of data;Social media;E-commerce;Online ads;Prices;Deals, special offers, discounts;Cargo tracking;Medical | 2 | r/WebScraping subreddit;Facebook group;StackOverflow;YouTube;Blog posts;Discord;Medium | ||||||
16 | 14 | Software Developer | Morocco | 25 - 34 | Beginner | < 1 year | Python;JavaScript;Go | Scrapy | I don't use proxies | I don't use proxies | France;Morocco | No | I don't | 5 | 5 | I'm employed as a software engineer doing web scraping | 11 - 20 people | Yes, related field | <= 5 hours | $10,000 - $30,000 | Products;Prices;Deals, special offers, discounts | 4 | StackOverflow;Blog posts;Medium | ||||||
17 | 15 | Web scraper;Software Developer;Business owner | United States of America | 25 - 34 | Intermediate | 6 - 10 years | Go | Custom build | Datacenter;Residential | United States of America | Always or almost always (90% or more) | I don't | 1 | 1 | I build my own products based on scraped data | 2 - 5 people | No | 6 - 20 hours | $30,000 - $50,000 | All kinds of data | 2 | r/WebScraping subreddit | |||||||
18 | 16 | Web scraper;Software Developer;Business owner | United States of America | 35 - 44 | Advanced | 3 - 5 years | JavaScript;PHP | Selenium | Datacenter | Colombia | Sometimes (less than 50%) | I don't | 3 | 4 | I build my own products based on scraped data | 2 - 5 people | No | 6 - 20 hours | $10,000 - $30,000 | All kinds of data | 4 | StackOverflow | |||||||
19 | 17 | Web scraper;Software Developer;Business owner | Poland | 25 - 34 | Advanced | 3 - 5 years | Python;PHP | Custom | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 4 | 4 | I don't | 11 - 20 people | Yes, related field | <= 5 hours | I don't make any money on web scraping | All kinds of data;Social media;Job postings;Products;Public Government Data | 2 | |||||||
20 | 18 | Software Developer | Lithuania | 25 - 34 | Intermediate | I don't work in web scraping | PHP | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 6 | I build my own products based on scraped data | 51 - 100 people | Yes, related field | <= 5 hours | I don't make any money on web scraping | All kinds of data | 4 | ||||||||
21 | 19 | Software Developer | United Kingdom | 35 - 44 | Advanced | 6 - 10 years | Python;JavaScript | Selenium;Scrapy;Playwright | Custom build | Datacenter | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 1 | 1 | I'm employed as a software engineer doing web scraping;I sell scraped data;I build my own products based on scraped data | 11 - 20 people | Yes, related field | 6 - 20 hours | $100,000 - $200,000 | All kinds of data | 2 | r/WebScraping subreddit;StackOverflow;Discord;Medium | ||||||
22 | 20 | Web scraper | United States of America | 25 - 34 | Intermediate | I don't work in web scraping | Python | Beautiful Soup;Requests | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 1 | 1 | I don't | Just me | Yes, unrelated field | <= 5 hours | I don't make any money on web scraping | All kinds of data | 2 | r/WebScraping subreddit;YouTube;Blog posts | ||||||
23 | 21 | Web scraper;Software Developer;Business owner | Denmark | 25 - 34 | Advanced | 1- 2 years | PHP | Puppeteer | Webshare | Datacenter | Germany | Mostly (50% - 90%) | I don't | 3 | 3 | I build my own products based on scraped data | 2 - 5 people | No | <= 5 hours | I don't make any money on web scraping | E-commerce | 3 | |||||||
24 | 22 | Web scraper;Software Developer | United States of America | 45 - 54 | Advanced | I don't work in web scraping | Python | Scrapy | Webshare | Datacenter | I don't care, I don't use geotargeting | Always or almost always (90% or more) | I don't | 3 | 3 | I don't | Just me | Yes, related field | <= 5 hours | I don't make any money on web scraping | All kinds of data | 3 | r/WebScraping subreddit | ||||||
25 | 23 | Hobbyist Scraper | United Kingdom | 55 - 64 | Beginner | 1- 2 years | Java | Jsoup | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 4 | 4 | I don't | Just me | No | <= 5 hours | I don't make any money on web scraping | Sports | 5 | r/WebScraping subreddit;StackOverflow;YouTube;Blog posts | ||||||
26 | 24 | Web scraper;Software Developer;Freelancer | United States of America | 19 - 24 | Intermediate | 1- 2 years | Python;JavaScript;TypeScript | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting;United States of America | No | I don't | 1 | 1 | I'm employed as a software engineer doing web scraping;I sell scraped data | 2 - 5 people | No | <= 5 hours | $10,000 - $30,000 | E-commerce | 2 | |||||||
27 | 25 | Web scraper | 55 - 64 | Advanced | 3 - 5 years | I don't code | No | I sell scraped data | Just me | Yes, unrelated field | I web scrape full time | > $200,000 | Other | Other | |||||||||||||||
28 | 26 | Freelancer | Chile | 25 - 34 | Intermediate | 1- 2 years | Python | Scrapy;Playwright;HTTPX;selectolax;Requests | BrightData;IPRoyal | Datacenter;Residential | I don't care, I don't use geotargeting | Mostly (50% - 90%) | ScrapeOps | 3 | 3 | I build my own products based on scraped data | 2 - 5 people | Yes, unrelated field | 21 - 40 hours | $1,000 - $10,000 | All kinds of data | 4 | StackOverflow;YouTube;Blog posts;Discord;Medium | ||||||
29 | 27 | Web scraper;Freelancer;Data scientist/analyst/engineer | India | 25 - 34 | Advanced | 3 - 5 years | Python | Selenium;Scrapy;Playwright | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting;India | Sometimes (less than 50%) | I don't | 3 | 3 | I'm employed as a software engineer doing web scraping;I sell scraped data;I build my own products based on scraped data | Just me | Yes, unrelated field | <= 5 hours | $1,000 - $10,000 | All kinds of data | 3 | YouTube;Blog posts | ||||||
30 | 28 | Web scraper;Software Developer;Business owner | Canada | 35 - 44 | Advanced | 3 - 5 years | Python;JavaScript | Selenium;Puppeteer;Crawlee | Custom build | Datacenter | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 5 | 5 | I build my own products based on scraped data | Just me | No | <= 5 hours | I don't make any money on web scraping | E-commerce;Products | 4 | StackOverflow | ||||||
31 | 29 | Web scraper | Argentina | 19 - 24 | Advanced | 1- 2 years | Python;JavaScript | Selenium;Puppeteer;Playwright | BrightData | Datacenter;Residential;Mobile | United States of America | Always or almost always (90% or more) | I don't | 1 | 1 | I'm employed as a software engineer doing web scraping | 51 - 100 people | No | I web scrape full time | $10,000 - $30,000 | E-commerce;Products;Restaurants;Grocery;Prices | 4 | |||||||
32 | 30 | Web scraper;Software Developer;Business owner;Freelancer | United States of America | 45 - 54 | Advanced | 6 - 10 years | Python | Selenium;Scrapy;Playwright | BrightData;Storm Proxies | Datacenter;Residential | United States of America | Mostly (50% - 90%) | I don't | 2 | 1 | I develop scrapers and sell the code as a freelancer;I sell scraped data | Just me | Yes, unrelated field | 6 - 20 hours | > $200,000 | E-commerce;Job postings;Hotels;Customer reviews;Products;Restaurants;Grocery;Prices;Medical;Public Government Data | 4 | Discord | ||||||
33 | 31 | Web scraper | United States of America | 35 - 44 | Advanced | 6 - 10 years | JavaScript | Puppeteer;Playwright | BrightData;IPRoyal | Residential;Mobile | United States of America | Mostly (50% - 90%) | Scraping Fish;ScrapingBee | 3 | 3 | I sell scraped data;I build my own products based on scraped data | 2 - 5 people | Yes, unrelated field | 6 - 20 hours | > $200,000 | Public Government Data | 5 | StackOverflow;YouTube;Discord | ||||||
34 | 32 | Freelancer | Nepal | 25 - 34 | Intermediate | 3 - 5 years | Python;JavaScript | Scrapy;Playwright;Crawlee | Other | Datacenter | United States of America | Mostly (50% - 90%) | Apify | 5 | 5 | I develop scrapers and sell the code as a freelancer | Just me | No | 6 - 20 hours | $10,000 - $30,000 | All kinds of data | 4 | r/WebScraping subreddit;YouTube;Blog posts;Discord | ||||||
35 | 33 | Web scraper;Freelancer | Morocco | 25 - 34 | Advanced | 3 - 5 years | Python;JavaScript | Scrapy;Playwright;HTTPC;Requests | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Always or almost always (90% or more) | I don't | 1 | 1 | I develop scrapers and sell the code as a freelancer;I sell scraped data;I build my own products based on scraped data | Just me | No | I web scrape full time | $1,000 - $10,000 | All kinds of data | 3 | YouTube | ||||||
36 | 34 | Web scraper;Other IT professional | India | 45 - 54 | Advanced | 11-20 years | I don't code | Other | I don't use proxies | I don't use proxies | Mostly (50% - 90%) | I don't | 6 | 6 | I'm employed as a software engineer doing web scraping | 11 - 20 people | Yes, unrelated field | 6 - 20 hours | $1 - $1,000 | All kinds of data | 1 | Facebook group;YouTube;Blog posts | |||||||
37 | 35 | Web scraper;Software Developer | Denmark | 25 - 34 | Advanced | 3 - 5 years | Python | Selenium | I don't use proxies | I don't use proxies | Denmark | Mostly (50% - 90%) | I don't | 3 | 1 | I sell scraped data;I build my own products based on scraped data | Just me | Yes, related field | <= 5 hours | $1,000 - $10,000 | Social media;E-commerce;Products;Prices;Deals, special offers, discounts;Public Government Data | 1 | YouTube;Blog posts | ||||||
38 | 36 | Web scraper;Software Developer | Australia | 35 - 44 | Intermediate | 6 - 10 years | Python;PHP | Selenium;Beautiful Soup | Custom build | Datacenter;Residential;Mobile | Australia | Sometimes (less than 50%) | I don't | 3 | 1 | I'm employed as a software engineer doing web scraping | 6 - 10 people | No | I don't make any money on web scraping | All kinds of data;SERP;Prices;Deals, special offers, discounts;Public Government Data | 2 | ||||||||
39 | 37 | Software Developer | Spain | 25 - 34 | Intermediate | < 1 year | C# | Playwright | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Always or almost always (90% or more) | I don't | 4 | 6 | I'm employed as a software engineer doing web scraping | 11 - 20 people | Yes, related field | <= 5 hours | $30,000 - $50,000 | SERP;E-commerce;Cargo tracking;Medical;Public Government Data | 4 | StackOverflow | ||||||
40 | 38 | Freelancer | Brazil | 35 - 44 | Intermediate | < 1 year | Python | Scrapy;Playwright | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 6 | I don't | Just me | Yes, unrelated field | <= 5 hours | I don't make any money on web scraping | E-commerce | 4 | StackOverflow;YouTube;Blog posts;Discord;Medium | ||||||
41 | 39 | Web scraper;Freelancer | United States of America | 25 - 34 | Intermediate | 1- 2 years | JavaScript | Puppeteer | Storm Proxies | Datacenter;Residential | United States of America | Sometimes (less than 50%) | ScrapingBee | 2 | 1 | I develop scrapers and sell the code as a freelancer;I sell scraped data | Just me | Yes, unrelated field | I web scrape full time | $1,000 - $10,000 | Public Government Data | 3 | YouTube | ||||||
42 | 40 | Business owner | United States of America | 25 - 34 | Intermediate | I don't work in web scraping | Python;JavaScript | Puppeteer | I don't use proxies | I don't use proxies | United States of America | Always or almost always (90% or more) | I don't | 2 | 6 | I build my own products based on scraped data | 51 - 100 people | Yes, unrelated field | <= 5 hours | $10,000 - $30,000 | Social media;SERP | 3 | |||||||
43 | 41 | Other IT professional | Poland | 25 - 34 | Intermediate | 3 - 5 years | Python | Other | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | Scraping Fish | 6 | 6 | I'm employed as a software engineer doing web scraping | 1001+ people | Yes, related field | <= 5 hours | I don't make any money on web scraping | Public Government Data | 5 | StackOverflow | ||||||
44 | 42 | Software Developer | Spain | 35 - 44 | Advanced | 6 - 10 years | Python;Go;Ruby | Selenium;Puppeteer;Playwright | Custom build | Datacenter | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 5 | 4 | I build my own products based on scraped data | 6 - 10 people | Yes, related field | <= 5 hours | $1,000 - $10,000 | E-commerce | 2 | Medium | ||||||
45 | 43 | Software Developer | United States of America | 35 - 44 | Advanced | 11-20 years | Ruby | Selenium;Other | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Always or almost always (90% or more) | I don't | 6 | 6 | I'm employed as a software engineer doing web scraping | 21 - 50 people | Yes, unrelated field | 6 - 20 hours | $100,000 - $200,000 | Other | 4 | StackOverflow;Blog posts | ||||||
46 | 44 | Software Developer | Poland | 19 - 24 | Beginner | < 1 year | Python;Rust | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 4 | I don't | Yes, related field | <= 5 hours | I don't make any money on web scraping | Social media;Online ads;Prices | 3 | StackOverflow;YouTube;Blog posts | |||||||
47 | 45 | Software Developer | Croatia | 35 - 44 | Intermediate | < 1 year | Ruby | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 3 | 2 | I'm employed as a software engineer doing web scraping | 1001+ people | No | <= 5 hours | $100,000 - $200,000 | Job postings | 4 | |||||||
48 | 46 | Other IT professional | United States of America | 25 - 34 | Advanced | 6 - 10 years | C# | Other | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 5 | 3 | I'm employed as a software engineer doing web scraping | 101 - 1000 people | No | 6 - 20 hours | $100,000 - $200,000 | Public Government Data | 4 | StackOverflow | ||||||
49 | 47 | Web scraper;Software Developer;Business owner | Norway | 25 - 34 | Advanced | 3 - 5 years | PHP | Other | Denmark;Sweden;Norway;United Kingdom | Sometimes (less than 50%) | ScrapingBee | 1 | 1 | I'm employed as a software engineer doing web scraping;I build my own products based on scraped data | 2 - 5 people | No | 6 - 20 hours | $50,000 - $100,000 | E-commerce;Products;Grocery;Prices | 2 | r/WebScraping subreddit;YouTube | ||||||||
50 | 48 | Web scraper | United States of America | 35 - 44 | Advanced | 11-20 years | Python;C# | Scrapy;Playwright | BrightData;Other | Datacenter;Residential | United States of America | Sometimes (less than 50%) | I don't | 2 | 5 | I'm employed as a software engineer doing web scraping;I sell scraped data | 101 - 1000 people | Yes, related field | 6 - 20 hours | $100,000 - $200,000 | Hotels;Customer reviews;Restaurants;Medical;Public Government Data | 2 | r/WebScraping subreddit;Discord | ||||||
51 | 49 | Web scraper;Software Developer | United States of America | 35 - 44 | Advanced | 11-20 years | Python;Ruby | Scrapy;Other | Datacenter;Residential | United States of America | Sometimes (less than 50%) | Scraping Fish;Zyte | 3 | 4 | I'm employed as a software engineer doing web scraping | 11 - 20 people | No | 6 - 20 hours | $100,000 - $200,000 | E-commerce;Products | 3 | ||||||||
52 | 50 | Web scraper;Software Developer;Business owner | India | 35 - 44 | Advanced | 6 - 10 years | Java | Scrapy;Puppeteer | I don't use proxies | I don't use proxies | India | Sometimes (less than 50%) | I don't | 2 | 2 | I'm employed as a software engineer doing web scraping;I build my own products based on scraped data | 2 - 5 people | Yes, unrelated field | I web scrape full time | $50,000 - $100,000 | Public Government Data | 2 | r/WebScraping subreddit | ||||||
53 | 51 | Web scraper;Software Developer | United States of America | 35 - 44 | Advanced | 11-20 years | Python;C# | Selenium | BrightData | Datacenter;Residential | United States of America | Mostly (50% - 90%) | I don't | 6 | 6 | I build my own products based on scraped data | Just me | No | 6 - 20 hours | All kinds of data | 3 | ||||||||
54 | 52 | Web scraper;Software Developer | United States of America | 35 - 44 | Intermediate | < 1 year | Python | Selenium;Playwright | Oxylabs | Residential | United States of America | Sometimes (less than 50%) | I don't | 3 | 4 | I don't | Just me | Yes, unrelated field | 6 - 20 hours | I don't make any money on web scraping | SERP;Products | 3 | r/WebScraping subreddit;StackOverflow;Blog posts;Medium | ||||||
55 | 53 | Web scraper;Freelancer | Nepal | 25 - 34 | Intermediate | 1- 2 years | Python | Selenium;Scrapy;Playwright | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 6 | 6 | I develop scrapers and sell the code as a freelancer | Just me | No | <= 5 hours | $1 - $1,000 | SERP;E-commerce;Job postings;Shoes / sneakers;Hotels;Customer reviews;Online ads;Products;Restaurants;Grocery;Prices;Deals, special offers, discounts;Cargo tracking;Medical;Public Government Data; | 4 | r/WebScraping subreddit;Facebook group;StackOverflow;YouTube;Blog posts;Discord;Medium | ||||||
56 | 54 | Software Developer | Czech Republic | 25 - 34 | Advanced | 1- 2 years | Python | Scrapy;Playwright | I don't use proxies | Germany | Sometimes (less than 50%) | I don't | 5 | 4 | I'm employed as a software engineer doing web scraping | 21 - 50 people | Yes, related field | 6 - 20 hours | $30,000 - $50,000 | E-commerce;Products | 3 | r/WebScraping subreddit;YouTube;Blog posts;Medium | |||||||
57 | 55 | Data scientist/analyst/engineer | Spain | 45 - 54 | Intermediate | < 1 year | Ruby | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 3 | 4 | I don't | 21 - 50 people | Yes, unrelated field | 6 - 20 hours | I don't make any money on web scraping | Hotels | 4 | r/WebScraping subreddit;StackOverflow;YouTube;Blog posts | ||||||
58 | 56 | Software Developer | Netherlands | Python;JavaScript;Rust | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | I don't | 2 | 5 | I don't | Just me | No | <= 5 hours | I don't make any money on web scraping | Products;Grocery;Real-estate postings | 2 | r/WebScraping subreddit;Google | |||||||||
59 | 57 | Data scientist/analyst/engineer | Germany | 25 - 34 | Beginner | < 1 year | Python;R | Scrapy | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 5 | 5 | I'm employed as a software engineer doing web scraping | 1001+ people | Yes, unrelated field | <= 5 hours | $1,000 - $10,000 | Online ads;Medical;Homepages | 4 | r/WebScraping subreddit;StackOverflow;Blog posts;Other | ||||||
60 | 58 | Web scraper | United Kingdom | 25 - 34 | Intermediate | 6 - 10 years | C/C++;R | I don't use proxies | I don't use proxies | United States of America;India;Canada;Germany;Singapore;Finland;United Kingdom;Nigeria | No | I don't | 1 | 1 | I sell scraped data;I build my own products based on scraped data | 2 - 5 people | Yes, unrelated field | <= 5 hours | > $200,000 | Other | 2 | ||||||||
61 | 59 | Software Developer | United States of America | 35 - 44 | Advanced | I don't work in web scraping | JavaScript;TypeScript | Puppeteer | Sometimes (less than 50%) | 4 | 5 | I build my own products based on scraped data | Just me | Yes, related field | <= 5 hours | I don't make any money on web scraping | Hotels;Public Government Data | 3 | |||||||||||
62 | 60 | Software Developer | United States of America | 55 - 64 | Intermediate | > 20 years | Ruby;Other | I don't use proxies | I don't use proxies | United States of America;Germany | Sometimes (less than 50%) | I don't | 3 | 3 | I'm employed as a software engineer doing web scraping | 1001+ people | Yes, related field | <= 5 hours | $100,000 - $200,000 | Academic | 3 | ||||||||
63 | 61 | Data scientist/analyst/engineer | Australia | 35 - 44 | Advanced | I don't work in web scraping | Python | SmartProxy | Datacenter;Residential;Mobile | I don't care, I don't use geotargeting | Sometimes (less than 50%) | 1 | 4 | I don't | Just me | Yes, unrelated field | <= 5 hours | I don't make any money on web scraping | Public Government Data;Academic | 2 | StackOverflow;Discord | ||||||||
64 | 62 | Web scraper;Software Developer | Spain | 25 - 34 | Beginner | < 1 year | JavaScript | Puppeteer | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 6 | I don't | 21 - 50 people | Yes, related field | 6 - 20 hours | I don't make any money on web scraping | All kinds of data | 4 | YouTube | |||||||
65 | 63 | Web scraper;Software Developer;Business owner | United States of America | 19 - 24 | Advanced | 3 - 5 years | Python | Selenium;Scrapy;Playwright | Custom build | Datacenter;Residential;Mobile | United States of America | Sometimes (less than 50%) | I don't | 3 | 1 | I sell scraped data;I build my own products based on scraped data | 2 - 5 people | Yes, unrelated field | 6 - 20 hours | > $200,000 | All kinds of data | 1 | YouTube;Blog posts;Medium | ||||||
66 | 64 | Software Developer | Belgium | 25 - 34 | Intermediate | I don't work in web scraping | Python;Ruby | Selenium;Other | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 5 | 6 | I don't | 11 - 20 people | Yes, related field | <= 5 hours | I don't make any money on web scraping | Customer reviews;Products;Prices | 3 | Blog posts | ||||||
67 | 65 | Web scraper | Australia | 25 - 34 | Intermediate | 1- 2 years | Python | Playwright | Custom build | Residential | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 1 | I build my own products based on scraped data | Just me | Yes, unrelated field | <= 5 hours | I don't make any money on web scraping | Prices | 5 | r/WebScraping subreddit;StackOverflow | |||||||
68 | 66 | Software Developer | Lithuania | 19 - 24 | Beginner | I don't work in web scraping | Python;JavaScript | Selenium;Puppeteer | I don't use proxies | I don't use proxies | Lithuania | Sometimes (less than 50%) | I don't | 3 | 3 | I don't;I'm employed as a software engineer doing web scraping | Just me | No | <= 5 hours | I don't make any money on web scraping | Online ads | 3 | YouTube | ||||||
69 | 67 | Software Developer | Cyprus | 35 - 44 | Advanced | I don't work in web scraping | Ruby;C/C++ | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | I don't | 1 | 1 | I don't | Just me | Yes, related field | <= 5 hours | I don't make any money on web scraping | All kinds of data | 1 | ||||||||
70 | 68 | Software Developer | Austria | 35 - 44 | Intermediate | I don't work in web scraping | Python | Selenium;Beautiful Soup | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 4 | 4 | I'm employed as a software engineer doing web scraping | 101 - 1000 people | Yes, related field | <= 5 hours | $1,000 - $10,000 | Public Government Data;Other | 3 | StackOverflow;Medium | ||||||
71 | 69 | Web scraper;Software Developer;Freelancer | Spain | 35 - 44 | Advanced | 6 - 10 years | Python | Selenium;Scrapy;Puppeteer;Playwright;Custom | BrightData | Datacenter | United States of America;China | Sometimes (less than 50%) | I don't | 2 | 4 | I'm employed as a software engineer doing web scraping;I sell scraped data;I build my own products based on scraped data | 101 - 1000 people | Yes, related field | I web scrape full time | $50,000 - $100,000 | E-commerce;Hotels;Products;Prices;Medical | 4 | |||||||
72 | 70 | Web scraper;Freelancer | France | 19 - 24 | Intermediate | 1- 2 years | Python | Other | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | Scraping Fish | 4 | 3 | I build my own products based on scraped data | Just me | Yes, unrelated field | 6 - 20 hours | $10,000 - $30,000 | Other | 5 | StackOverflow;YouTube;Blog posts;Medium;ChatGPT | |||||||
73 | 71 | Web scraper;Software Developer;Business owner;Other IT professional | Romania | 35 - 44 | Advanced | 11-20 years | JavaScript;Other | Puppeteer;Custom | Custom build | Datacenter;Residential;Mobile | United States of America;Canada;Germany;France;Romania | Mostly (50% - 90%) | Apify | 3 | 4 | I sell scraped data | Just me | Yes, related field | <= 5 hours | $1 - $1,000 | All kinds of data;Social media;E-commerce;Job postings;Hotels;Products;Restaurants;Prices;Deals, special offers, discounts;Public Government Data | 4 | Facebook group;StackOverflow;YouTube;Blog posts;Other | ||||||
74 | 72 | Software Developer | Canada | 25 - 34 | Advanced | 3 - 5 years | JavaScript;Go | Playwright | Custom build | Residential | United States of America;Canada;Germany | Always or almost always (90% or more) | I don't | 4 | 3 | I sell scraped data;I build my own products based on scraped data | Just me | Yes, related field | <= 5 hours | $50,000 - $100,000 | E-commerce;Products;Prices;Public Government Data | 2 | YouTube;Blog posts | ||||||
75 | 73 | Software Developer | India | 35 - 44 | Beginner | I don't work in web scraping | Python;JavaScript | 1 | 1 | I don't | Just me | Yes, related field | <= 5 hours | I don't make any money on web scraping | 5 | YouTube | |||||||||||||
76 | 74 | Web scraper | Finland | 35 - 44 | Beginner | < 1 year | Python | Selenium | Custom build | Residential | United States of America | Always or almost always (90% or more) | ScraperAPI | 6 | 3 | I don't | Just me | Yes, unrelated field | <= 5 hours | I don't make any money on web scraping | Stock data | 4 | StackOverflow;YouTube;ChatGPT | ||||||
77 | 75 | Web scraper;Software Developer;Business owner;Freelancer | Lithuania | 35 - 44 | Intermediate | 3 - 5 years | Python | Scrapy | BrightData | Datacenter;Residential | I don't care, I don't use geotargeting | Mostly (50% - 90%) | I don't | 2 | 4 | I develop scrapers and sell the code as a freelancer;I sell scraped data | Just me | Yes, related field | 6 - 20 hours | $10,000 - $30,000 | All kinds of data | 3 | r/WebScraping subreddit;StackOverflow;YouTube;Blog posts;Discord;Medium | ||||||
78 | 76 | Freelancer | Australia | 19 - 24 | Beginner | I don't work in web scraping | Python;JavaScript | Puppeteer | I don't use proxies | Australia | Sometimes (less than 50%) | ZenRows | 4 | 3 | I don't | Just me | No | <= 5 hours | I don't make any money on web scraping | Real estate | 4 | StackOverflow;YouTube | |||||||
79 | 77 | Software Developer | Germany | 25 - 34 | Advanced | 1- 2 years | PHP | Custom | Residential | Germany | Sometimes (less than 50%) | ScrapingBee;ZenRows | 5 | 5 | I build my own products based on scraped data | 2 - 5 people | No | 6 - 20 hours | I don't make any money on web scraping | Real estate | 5 | YouTube;Blog posts | |||||||
80 | 78 | Business owner | United States of America | 25 - 34 | Beginner | < 1 year | Python | Beautiful Soup | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | I don't | 3 | 3 | I build my own products based on scraped data | Just me | Yes, unrelated field | 6 - 20 hours | I don't make any money on web scraping | Shoes / sneakers | 3 | StackOverflow;YouTube;Blog posts;Discord | ||||||
81 | 79 | Business owner | Germany | 25 - 34 | Beginner | I don't work in web scraping | Python | HTTPX;selectolax | Custom build | Datacenter | Germany | No | I don't | 6 | 6 | I don't | Just me | No | <= 5 hours | I don't make any money on web scraping | E-commerce;Products;Prices;Deals, special offers, discounts | 3 | StackOverflow;YouTube;Blog posts;Medium | ||||||
82 | 80 | Web scraper;Software Developer;Business owner | France | 25 - 34 | Advanced | 3 - 5 years | TypeScript | axios;Puppeteer | Storm Proxies;Webshare;Other | Datacenter | I don't care, I don't use geotargeting;United States of America | Sometimes (less than 50%) | I don't | 5 | 5 | I build my own products based on scraped data | Just me | Yes, related field | I web scrape full time | I don't make any money on web scraping | All kinds of data;Social media;SERP;Job postings;Customer reviews;Online ads;Products;Restaurants;Medical;Public Government Data | 1 | |||||||
83 | 81 | Web scraper;Software Developer;Business owner;Freelancer | Advanced | > 20 years | Python;JavaScript;Java;PHP;Go;Ruby;Rust;C/C++;C# | Selenium;Scrapy;Puppeteer;Playwright;Crawlee | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | I don't | 1 | 1 | I don't;I'm employed as a software engineer doing web scraping;I develop scrapers and sell the code as a freelancer;I sell scraped data;I build my own products based on scraped data | 1001+ people | No | I web scrape full time | > $200,000 | Social media;Hotels;Customer reviews;Online ads;Restaurants;Cargo tracking;Medical;Public Government Data | 1 | Facebook group | ||||||||
84 | 82 | Software Developer | United States of America | 35 - 44 | Advanced | 6 - 10 years | Ruby | Other | Custom build | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 1 | 1 | I don't;I build my own products based on scraped data | Just me | Yes, related field | I web scrape full time | I don't make any money on web scraping | All kinds of data | 4 | |||||||
85 | 83 | Web scraper;Software Developer;Business owner | United Kingdom | 25 - 34 | Intermediate | 1- 2 years | JavaScript | Puppeteer | Datacenter;Residential | United States of America;United Kingdom | Sometimes (less than 50%) | ScrapeOps | 4 | 5 | I build my own products based on scraped data | Just me | Yes, related field | 6 - 20 hours | $50,000 - $100,000 | E-commerce | 4 | r/WebScraping subreddit;YouTube;Discord | |||||||
86 | 84 | Web scraper | Russia | 55 - 64 | Beginner | < 1 year | Python | Scrapy;Playwright | Other | Residential | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 5 | 3 | I develop scrapers and sell the code as a freelancer | Just me | Yes, unrelated field | 6 - 20 hours | $1 - $1,000 | All kinds of data | 4 | YouTube | ||||||
87 | 85 | Software Developer | Germany | 35 - 44 | Advanced | 6 - 10 years | JavaScript;Ruby | Selenium;Puppeteer | Custom build | Datacenter;Residential;Mobile | United States of America;India;Canada;Brazil;Spain;Germany;France;United Kingdom;Italy;Phillipines;Australia;New Zealand;Taiwan;South Korea;Russia | Mostly (50% - 90%) | I don't | 2 | 1 | I'm employed as a software engineer doing web scraping | 51 - 100 people | Yes, related field | 6 - 20 hours | $100,000 - $200,000 | All kinds of data | 1 | |||||||
88 | 86 | Data scientist/analyst/engineer | United States of America | 35 - 44 | Beginner | I don't work in web scraping | Python | Selenium;Scrapy;Beautiful Soup | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 4 | 4 | I don't | Just me | Yes, related field | <= 5 hours | I don't make any money on web scraping | Social media;E-commerce;Online ads;Products;Prices | 4 | StackOverflow;YouTube;Blog posts;Other | ||||||
89 | 87 | Freelancer | France | 25 - 34 | Advanced | 1- 2 years | Python | Selenium;Scrapy | I don't use proxies | I don't use proxies | United States of America;France | Sometimes (less than 50%) | I don't | 6 | 6 | I develop scrapers and sell the code as a freelancer;I sell scraped data | Just me | Yes, related field | 6 - 20 hours | $1,000 - $10,000 | All kinds of data | 4 | StackOverflow | ||||||
90 | 88 | Web scraper;Freelancer | Poland | 25 - 34 | Intermediate | < 1 year | Python | Selenium | IPRoyal | Residential | United States of America | Sometimes (less than 50%) | I don't | 3 | 3 | I sell scraped data | Just me | No | 6 - 20 hours | $1 - $1,000 | Public Government Data | 4 | YouTube;Blog posts;Other | ||||||
91 | 89 | Web scraper;Software Developer;Business owner | United States of America | 35 - 44 | Beginner | < 1 year | Python;Rust | Scrapy | Custom build | Datacenter;Residential | United States of America;Canada;Germany | Sometimes (less than 50%) | I don't | 3 | 1 | I don't | 6 - 10 people | Yes, related field | 6 - 20 hours | I don't make any money on web scraping | Social media;Medical;Public Government Data | 5 | YouTube;Other | ||||||
92 | 90 | Web scraper | United States of America | 19 - 24 | Intermediate | < 1 year | Python | Selenium;Scrapy | IPRoyal | Residential | United States of America | Always or almost always (90% or more) | I don't | 1 | 1 | I develop scrapers and sell the code as a freelancer | Just me | Yes, unrelated field | 21 - 40 hours | $50,000 - $100,000 | Job postings | 5 | ChatGPT | ||||||
93 | 91 | Software Developer | Malaysia | 35 - 44 | Beginner | I don't work in web scraping | Python | Scrapy;Beautiful Soup;Request | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | I don't | 4 | 5 | I develop scrapers and sell the code as a freelancer;I sell scraped data;I build my own products based on scraped data | Just me | No | 6 - 20 hours | I don't make any money on web scraping | Social media;E-commerce;Job postings;Hotels;Customer reviews;Products;Restaurants;Grocery;Prices;Cargo tracking;Public Government Data | 4 | StackOverflow;YouTube | ||||||
94 | 92 | Software Developer | Russia | 25 - 34 | Intermediate | < 1 year | JavaScript | Puppeteer;Playwright | I don't use proxies | I don't use proxies | Turkey | Mostly (50% - 90%) | I don't | 3 | 3 | I don't | Just me | Yes, unrelated field | 6 - 20 hours | I don't make any money on web scraping | Public Government Data | 1 | StackOverflow;YouTube;ChatGPT | ||||||
95 | 93 | Web scraper;Software Developer | United States of America | Intermediate | 3 - 5 years | Python;JavaScript | Datacenter;Residential | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 1 | 1 | I'm employed as a software engineer doing web scraping | 51 - 100 people | No | 6 - 20 hours | $100,000 - $200,000 | E-commerce;Hotels;Prices | 4 | StackOverflow;Blog posts | |||||||||
96 | 94 | Web scraper | India | 19 - 24 | Advanced | 1- 2 years | Python | Selenium;Scrapy;Playwright | Datacenter | I don't care, I don't use geotargeting | Mostly (50% - 90%) | ZenRows | 6 | 6 | I'm employed as a software engineer doing web scraping | I web scrape full time | $1 - $1,000 | All kinds of data | 2 | StackOverflow | |||||||||
97 | 95 | Business owner | Italy | 35 - 44 | Advanced | 6 - 10 years | Python | Selenium;Scrapy;Playwright | Oxylabs;SmartProxy;BrightData;Custom build | Datacenter;Residential;Mobile | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 6 | 6 | I build my own products based on scraped data | 11 - 20 people | Yes, related field | I web scrape full time | $50,000 - $100,000 | E-commerce | 4 | r/WebScraping subreddit;StackOverflow;YouTube;Blog posts;Discord;Other | ||||||
98 | 96 | Software Developer | India | 25 - 34 | Intermediate | I don't work in web scraping | Python | Selenium | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | I don't | 4 | 4 | I don't;I build my own products based on scraped data | 51 - 100 people | No | <= 5 hours | I don't make any money on web scraping | All kinds of data | 4 | StackOverflow;YouTube;Blog posts | ||||||
99 | 97 | Web scraper;Software Developer | Kazakhstan | 25 - 34 | Intermediate | 3 - 5 years | PHP | Puppeteer | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | No | ScrapingBee | 4 | 4 | I build my own products based on scraped data | Just me | Yes, related field | <= 5 hours | $1,000 - $10,000 | All kinds of data | 4 | StackOverflow;YouTube;Blog posts | ||||||
100 | 98 | Freelancer | Russia | 45 - 54 | Beginner | I don't work in web scraping | I don't code | Apify | I don't use proxies | I don't use proxies | I don't care, I don't use geotargeting | Sometimes (less than 50%) | Apify | 1 | 1 | I don't | Just me | Yes, unrelated field | <= 5 hours | I don't make any money on web scraping | Social media;Job postings;Products;Prices;Deals, special offers, discounts;Medical;Public Government Data | 6 | Blog posts;Medium;Other | ||||||