AIMultiple Proxy & Web Unblocker Benchmark Methodology in '24
AIMultiple aims to help buyers identify the right solution provider for their data collection needs.
AIMultiple’s benchmark will aim to help businesses with technical teams that need to crawl from tens of thousands of pages to millions of pages per month from domains deploying anti-scraping measures. AIMultiple will focus on residential proxies and web unblockers as a solution for such teams.
What will be the guiding principles?
AIMultiple’s benchmark methodology is designed for an objective and transparent assessment. It also explains participation requirements.
What will be benchmarked?
AIMultiple team will first try to get responses using a residential proxy service. When that service fails, the same page will be tried with the web unblocker provided by the same service provider.
Web crawling APIs will not be part of the benchmark.
How will AIMultiple perform the benchmark?
AIMultiple’s proxy benchmark aims to closely match the preferences of proxy buyers. They want a flexible, cost-effective solution. Therefore, AIMultiple will measure these metrics:
Effectiveness
It will be measured by success rate of responses on the target URL set. Target URL set will include a total of 10,000 from 6 websites in these domains:
- E-commerce
- Travel:
- HR
- Real estate
Success will be determmined by a successful response, (i.e. 200) and a page size that is close to or equal to the page size.
Speed
Average response time and distribution of response times will be measured.
Scalability
The same metrics will be tested with a fixed number of simultaneous connections.
Optional criteria
These criteria may be included in the benchmark as well:
Features
Geo-targeting can be useful to businesses targeting specific locations and testing successful geo-targeting may be part of the benchmark.
Cost
Public cost data published by the vendors will be used to calculate the cost of the benchmark. Vendor’s cost model will also be shared to help buyers compare prices of different vendors.
Customer service
Reviews on B2B review platforms will be analyzed to assess customer satisfaction.
How will the results be published?
They will be published on research.AIMultiple.com. For an example, see residential proxy benchmark.
Participants can receive their detailed URL level results as well as the average results if they decide to sponsor part of the costs of the benchmark.
Reach out to AIMultiple team via email or Linkedin if you would like to participate in the AIMultiple proxy benchmark.
If you have questions or need help in finding vendors, reach out:
Cem is the principal analyst at AIMultiple since 2017. AIMultiple informs hundreds of thousands of businesses (as per Similarweb) including 60% of Fortune 500 every month.
Cem's work has been cited by leading global publications including Business Insider, Forbes, Washington Post, global firms like Deloitte, HPE, NGOs like World Economic Forum and supranational organizations like European Commission. You can see more reputable companies and media that referenced AIMultiple.
Throughout his career, Cem served as a tech consultant, tech buyer and tech entrepreneur. He advised enterprises on their technology decisions at McKinsey & Company and Altman Solon for more than a decade. He also published a McKinsey report on digitalization.
He led technology strategy and procurement of a telco while reporting to the CEO. He has also led commercial growth of deep tech company Hypatos that reached a 7 digit annual recurring revenue and a 9 digit valuation from 0 within 2 years. Cem's work in Hypatos was covered by leading technology publications like TechCrunch and Business Insider.
Cem regularly speaks at international technology conferences. He graduated from Bogazici University as a computer engineer and holds an MBA from Columbia Business School.
Sources:
AIMultiple.com Traffic Analytics, Ranking & Audience, Similarweb.
Why Microsoft, IBM, and Google Are Ramping up Efforts on AI Ethics, Business Insider.
Microsoft invests $1 billion in OpenAI to pursue artificial intelligence that’s smarter than we are, Washington Post.
Data management barriers to AI success, Deloitte.
Empowering AI Leadership: AI C-Suite Toolkit, World Economic Forum.
Science, Research and Innovation Performance of the EU, European Commission.
Public-sector digitization: The trillion-dollar challenge, McKinsey & Company.
Hypatos gets $11.8M for a deep learning approach to document processing, TechCrunch.
We got an exclusive look at the pitch deck AI startup Hypatos used to raise $11 million, Business Insider.
To stay up-to-date on B2B tech & accelerate your enterprise:
Follow on
Comments
Your email address will not be published. All fields are required.