Read Time:

How to Evaluate an RPO Provider: 10-Point Checklist

By

The shortlist had three RPO providers on it. All three had polished decks. All three claimed global coverage. All three said they used AI. The TA head at a Bengaluru-based mid-market technology company spent six weeks evaluating them — and still chose the wrong one. The provider couldn't fill a single role in Poland or the UAE within the agreed timeframe, had no specialist agencies for the niche engineering functions she needed, and the "AI screening" turned out to be a keyword filter on a job board database.

That story is not unusual. The problem isn't that TA leaders make careless decisions. It's that most RPO evaluation frameworks were built for a simpler era — when hiring was domestic, roles were generalist, and "outsourcing recruitment" meant handing a job description to a single large agency. Today's hiring reality, especially for Indian mid-market companies expanding globally, is far more complex. You need a provider who can handle niche roles in Germany and the Philippines simultaneously, integrate with your ATS without friction, and give you real-time visibility into every open position.

This checklist gives you the 10 criteria that actually separate capable RPO providers from well-packaged ones — along with the red flags that should end an evaluation immediately.

Why Most RPO Evaluations Miss What Actually Matters

Standard RFP processes ask the wrong questions. They focus on headcount, years in business, and client logos, none of which predict whether a provider can fill a regulatory affairs specialist role in Singapore or a senior Java architect in Warsaw. The result is that providers who are good at pitching win over providers who are good at hiring.

A rigorous evaluation framework tests capability, not presentation. It probes the mechanics of how a provider sources candidates, how they screen, how they handle multi-country complexity, and what happens when they miss an SLA. The 10 criteria below are designed to surface those answers, and to give you a structured way to compare providers side by side before you sign anything.

This checklist is built specifically for TA and HR leaders at Indian companies with complex hiring needs: multi-country mandates, niche skill requirements, or both. If you're also weighing whether RPO is the right model at all, the comparison in RPO vs Agency India: Which Model Wins for Mid-Market Companies is worth reading first.

1. AI Capability: Real or Rebranded?

Every RPO provider in 2026 claims to use AI. Almost none of them mean the same thing by it. Before you accept any AI claim at face value, ask three specific questions: What does the AI actually do? What data was it trained on? And does it surface passive candidates, or only active job seekers already in a database?

Genuine AI capability in an RPO context means two things. First, intelligent vendor or agency matching, routing your job requirements to the specialist firms most likely to fill them, based on historical placement data and role-specific signals. Second, AI-powered resume screening that goes beyond keyword matching to assess genuine fitment across hundreds of role-specific criteria.

CBREX's C Map routes each role to the most relevant specialist agencies from a network of 4,000+ firms across 33 countries. Its C Screen tool, trained on 250,000+ anonymised resumes across 570+ job categories, delivers 98% screening accuracy. That's the benchmark. If a provider can't explain their AI with that level of specificity, treat the claim as marketing.

Red flag: The provider's AI only searches active job seekers on a job board database. Passive talent, the candidates who aren't actively looking but are open to the right opportunity, makes up the majority of top performers in most specialist functions. An AI that can't reach them isn't solving your hardest hiring problems. For more on this, see AI Resume Screening: How to Choose the Right Tool in 2026.

2. Specialist Agency Network Depth

The quality of an RPO provider's output is directly limited by the quality of their agency network. A provider with 50 generalist agencies will struggle to fill a pharma QA specialist role in Hungary or a fintech compliance lead in Singapore. A provider with 4,000+ specialist firms, segmented by function, industry, and geography, has a fundamentally different capability ceiling.

When evaluating network depth, don't accept aggregate numbers. Ask the provider to name the specific agencies they would activate for your most challenging open role, say, a semiconductor process engineer in South Korea or a regulatory affairs director in Germany. Ask how many of those agencies have made placements in that function and geography in the last 12 months. Ask what their average time-to-shortlist is for roles in that category.

Generalist agency panels are built for volume hiring of common roles. Specialist networks are built for the roles that actually keep TA leaders up at night. The distinction matters enormously for Indian mid-market companies hiring niche skills across multiple countries simultaneously.

Red flag: The provider can name their top five agencies but can't tell you which ones specialise in your target function or geography. A network that isn't segmented by specialism is a contact list, not a capability.

3. Geographic Coverage and Local Market Expertise

Claiming global coverage is easy. Demonstrating it is harder. For Indian companies hiring across MENA, SEA, EMEA, LATAM, and APAC, the difference between a provider who "covers" a market and one who has genuine local expertise is the difference between a filled role and a four-month vacancy.

Genuine geographic coverage means having specialist agencies with active candidate pipelines in each target market, not a single generalist firm who happens to have an office in Dubai or a LinkedIn presence in the Philippines. It means understanding local hiring norms, compensation benchmarks, and compliance requirements in each country.

To verify coverage, ask for named agencies and recent placement examples by country. Ask specifically about the markets most relevant to your hiring plan: Germany, Singapore, UAE, Poland, the Philippines, Brazil, or wherever your expansion is taking you. If the provider hesitates or gives vague answers, their coverage is likely thinner than their pitch suggests.

For Indian companies with multi-country mandates, this criterion is often the single biggest differentiator. The Global Hiring from India: The 2026 Complete Guide covers the specific challenges by region in more detail.

Red flag: The provider claims to cover 50+ countries but can only name one or two agencies per region, all of them generalists. Global coverage built on thin agency relationships will fail the moment you post a specialist role outside a major hub city.

4. Fee Structure and Pricing Transparency

How an RPO provider charges you reveals a great deal about how confident they are in their own delivery. Providers who require large upfront retainers are, in effect, asking you to fund their search before they've proven they can fill the role. Providers who work on a pay-on-hire basis are betting their revenue on successful placement.

When evaluating fee structures, probe for every layer of cost. Management fees, seat licences, ATS access fees, per-country surcharges, and invoice markups on agency fees are all common ways that headline rates understate the true cost of an RPO engagement. Ask for a fully loaded cost example based on a realistic hiring scenario, say, five roles across three countries over one quarter.

CBREX operates on a pay-on-hire model with no retainers, no seat licences, and no upfront fees. You pay when a hire is made. That structure aligns the provider's incentives directly with your outcomes. For a detailed breakdown of what recruitment fees actually look like across different models, Recruitment Agency Cost in India: What You're Really Paying is a useful reference.

Red flag: The provider is reluctant to provide a fully loaded cost breakdown or uses vague language like "management fees vary by engagement." Pricing opacity is almost always a signal that the true cost is higher than the headline rate suggests.

5. ATS Compatibility and Integration Depth

For any enterprise TA team, the applicant tracking system is the operational backbone of recruitment. An RPO provider who can't integrate cleanly with your ATS creates a parallel workflow, which means duplicate data entry, broken candidate tracking, and reporting gaps that make it impossible to measure provider performance accurately.

When evaluating ATS compatibility, go beyond "yes, we integrate." Ask which ATS platforms they natively support. Ask what data flows in both directions, can the provider push candidate profiles into your ATS, and can your ATS push job requisitions to the provider's platform? Ask whether the integration requires custom development or works out of the box.

CBREX integrates seamlessly with all major applicant tracking systems, with no requirement to switch platforms or manage a separate system. Candidates flow directly into your existing workflow. For Indian companies who have already invested in ATS infrastructure, this is a non-negotiable capability. The Talent Acquisition in India 2026: The Complete Local Guide covers ATS selection and integration considerations in the broader Indian context.

Red flag: The provider requires you to use their proprietary recruitment system as the system of record, or their integration is limited to one-way data export. Either scenario means your TA team is managing two systems instead of one.

6. SLA Accountability and Performance Metrics

An SLA that isn't contractual isn't an SLA, it's an aspiration. The difference matters when a role has been open for 10 weeks and the provider is still "working on it." Before signing any RPO agreement, get specific commitments in writing: time-to-shortlist by role type, minimum shortlist quality standards, replacement guarantees for failed hires, and escalation procedures when targets are missed.

The metrics that matter most for complex hiring are time-to-shortlist (how quickly does the provider deliver interview-ready candidates?), offer acceptance rate (are the candidates they surface actually accepting offers?), and 90-day retention (are the hires still in role three months later?). These three metrics together give you a complete picture of provider quality, not just speed, but fit and durability.

Ask the provider for their historical performance data on these metrics, segmented by role type and geography. A provider who can't produce this data either doesn't track it or doesn't want you to see it. For context on what slow time-to-hire actually costs your business, Time to Hire: The Hidden Cost of Roles Left Open puts numbers to the problem.

Red flag: The provider uses language like "we aim to deliver shortlists within X days" rather than "our SLA commits to shortlists within X days." The word "aim" is doing a lot of work in that sentence, and it won't help you when you need to hold them accountable.

7. Candidate Screening Quality and Process Rigour

The volume of CVs an RPO provider delivers is far less important than the quality. Hiring managers who spend hours reviewing unscreened or poorly matched candidates lose confidence in the process quickly, and that loss of confidence is one of the most common reasons RPO engagements fail within the first six months.

Three-stage candidate screening funnel showing AI validation and human review layers narrowing to a precise shortlist

A rigorous screening process has multiple layers. The first layer is agency pre-screening, the specialist firm that sourced the candidate should have already assessed their technical fit and motivation before submitting. The second layer is AI validation, an automated check against role-specific criteria that catches mismatches the human reviewer might miss. The third layer is stack ranking, presenting candidates in order of fit, not in order of submission.

CBREX's three-level screening process combines agency pre-screening, C Screen AI validation, and stack ranking to deliver shortlists where every candidate is genuinely interview-ready. Ask any RPO provider you're evaluating to walk you through their screening process step by step, and ask for a sample shortlist from a comparable role so you can assess quality before committing.

Red flag: The provider's screening process is described as "our team reviews all CVs before submission." That's a single layer, not a process. It also tells you nothing about the criteria being applied or how consistently they're enforced across different agencies and geographies.

8. Contract Structure and Vendor Consolidation Capability

One of the most underrated benefits of a well-structured RPO engagement is the reduction in administrative complexity. If you're currently managing 10, 15, or 20 separate agency relationships, each with its own contract, invoice format, and payment terms, the operational overhead is significant. A capable RPO provider should consolidate all of that into a single agreement and a single invoice.

For Indian companies with multi-country hiring needs, this is especially valuable. Managing separate agency contracts across Germany, Singapore, the UAE, and the Philippines, each with different legal requirements and currency considerations, is a genuine operational burden. A single-contract model that covers all geographies removes that complexity entirely.

Ask the provider specifically: does one contract cover all geographies and all agencies in your network? Is invoicing unified, or will we receive separate invoices from individual agencies? What happens if we need to add a new country or function mid-engagement?

CBREX's single contract covers 4,000+ agencies across 33 countries, with unified invoicing regardless of how many markets or agencies are activated. For TA leaders dealing with vendor sprawl, this alone is often a decisive factor. The Multi Geo Hiring: One Platform, Every Market post covers the operational mechanics in detail.

Red flag: The provider requires separate contracts or addenda for each country or agency. This defeats one of the core purposes of RPO and signals that their operational infrastructure isn't built for genuine multi-country delivery.

9. Leadership and Niche Hiring Capability

Most RPO providers are optimised for volume hiring of mid-level roles. When you need to fill a Chief Revenue Officer in the UAE, a regulatory affairs director in Germany, or a semiconductor process engineer in South Korea, the same generalist agency pool that handles your volume hiring is unlikely to deliver.

Leadership and niche hiring requires access to boutique specialist firms and independent search consultants who work specific functions and geographies at depth. It also requires a different engagement model, one that doesn't demand a large upfront retainer before a single candidate has been sourced.

Ask the provider how they handle roles above a certain seniority threshold or in highly specialised functions. Ask for specific examples of C-suite or director-level placements in your target markets. Ask whether leadership search is handled by the same team and agency pool as volume hiring, or whether there's a dedicated capability.

For more on what leadership hiring without retainer fees looks like in practice, Leadership Hiring India: The 2026 Complete Guide is a useful reference.

Red flag: The provider routes all roles, from junior analyst to Chief Financial Officer, through the same agency panel. Leadership hiring requires specialist access that generalist panels simply don't have.

10. Reporting, Visibility, and Data Ownership

Real-time pipeline visibility is not a luxury, it's a basic operational requirement for any TA leader managing multiple open roles across multiple markets. If you can only see the state of your hiring pipeline through a monthly PDF report, you're always reacting to problems that have already compounded rather than catching them early.

When evaluating reporting capability, ask what live dashboards are available and what data they show. At minimum, you should be able to see role status, agency performance by submission and conversion rate, time-to-shortlist by market, and candidate pipeline depth for each open position. Ask whether you can export data in formats compatible with your internal reporting tools.

Data ownership is a separate but equally important question. When the RPO engagement ends, who owns the candidate data that was generated? Can you export your full candidate history? Are there any restrictions on using that data with other providers? These questions are rarely asked during evaluation and frequently become points of friction at contract renewal.

Red flag: The provider offers monthly reporting only, or their dashboard is read-only with no export capability. Limited reporting access is often a sign that the provider doesn't want you to have the data you'd need to hold them accountable.

Red Flags That Signal an RPO Provider Isn't Ready for Complex Hiring

Across all 10 criteria, certain warning signs should function as immediate disqualifiers, not reasons to ask follow-up questions, but reasons to remove the provider from your shortlist. Here are the most critical ones consolidated:

  • AI claims without specifics. If the provider can't explain what their AI does, what data it was trained on, and how it handles passive candidates, the AI claim is marketing.
  • Generalist agency panels for specialist roles. A network that isn't segmented by function and geography will fail on your hardest roles.
  • Vague geographic coverage. "We cover APAC" is not the same as having specialist agencies with active pipelines in Singapore, the Philippines, and South Korea.
  • Retainer-first pricing. Providers who require upfront payment before delivering results are transferring risk to you. Pay-on-hire models align incentives correctly.
  • ATS replacement requirements. Any provider who asks you to abandon your existing ATS is adding operational complexity, not reducing it.
  • Aspirational SLAs. Commitments that use "aim," "target," or "typically" instead of contractual language are not enforceable.
  • Single-layer screening. One human review pass is not a screening process. It's a filter, and a leaky one.
  • Per-country contracts. Multi-country hiring requires a single-contract model. Anything else creates the vendor sprawl you're trying to escape.
  • No leadership hiring differentiation. Providers who handle C-suite roles the same way they handle volume hiring don't have genuine leadership search capability.
  • Monthly-only reporting. If you can't see your pipeline in real time, you can't manage it in real time.

The Hiring Platforms India: Job Boards vs. Agencies vs. AI Marketplaces post provides useful context on how different provider types stack up against these criteria across the broader market.

How CBREX Benchmarks Against This Checklist

Global network map showing CBREX connecting India to international hiring markets across MENA, SEA, Europe, and the Americas

CBREX was built specifically to address the gaps that traditional RPO providers leave open, particularly for Indian mid-market companies with complex, multi-country hiring needs. Here's how it maps to each of the 10 criteria:

  • AI capability: C Map routes roles to the most relevant specialist agencies using AI matching. C Screen delivers 98% screening accuracy trained on 250,000+ resumes across 570+ job categories.
  • Specialist agency network: 4,000+ specialist recruiting firms, segmented by function, industry, and geography, not a generalist panel.
  • Geographic coverage: 33 countries across MENA, SEA, EMEA, LATAM, APAC, Eastern Europe, Western Europe, UK, China, Japan, and Oceania, with named specialist agencies in each market.
  • Fee structure: Pay-on-hire only. No retainers, no seat licences, no upfront fees. You pay when a hire is made.
  • ATS compatibility: Seamless integration with all major applicant tracking systems. No platform switching required.
  • SLA accountability: Contractual commitments on time-to-shortlist and shortlist quality, with replacement guarantees for failed hires.
  • Screening quality: Three-level process: agency pre-screen, C Screen AI validation, and stack ranking. Every candidate is interview-ready before submission.
  • Contract structure: One contract covers all 4,000+ agencies across all 33 countries. Unified invoicing regardless of how many markets are activated.
  • Leadership and niche hiring: Curated boutique firms and independent search consultants for senior and specialist roles. No retainer fees for leadership search.
  • Reporting and visibility: Real-time pipeline dashboards with full data export capability. You own your candidate data.

If you want to see how CBREX performs against your specific hiring requirements, including the markets, functions, and seniority levels you're hiring for, the most direct next step is a live demonstration. Book a demo with the CBREX team and bring your hardest open role. That's the fastest way to test whether the platform can deliver what your current providers can't.

Alternatively, if you're still in the early stages of building your evaluation framework, you can sign up and explore the platform directly to see the agency network depth for your target markets before committing to anything.

Frequently Asked Questions

What is the difference between RPO and a staffing agency?

A staffing agency sources candidates for individual roles on a transactional basis. An RPO provider takes on a broader scope, managing the recruitment process across multiple roles, functions, or geographies, often with dedicated resources and contractual SLAs. The key distinction is accountability: a staffing agency is accountable for individual placements, while an RPO provider is accountable for the overall hiring programme. For a detailed comparison, see RPO vs Agency India: Which Model Wins for Mid-Market Companies.

How long does RPO implementation typically take?

Traditional RPO implementations can take 60 to 90 days to go live, including contract negotiation, process mapping, and system integration. AI-powered marketplace models like CBREX are significantly faster, roles can be posted and matched to specialist agencies within hours of onboarding, with no lengthy setup phase required.

Can an RPO provider handle both India and international hiring?

Yes, but only if they have genuine specialist agency coverage in both markets. Many providers are strong in India but thin on the ground internationally, or vice versa. When evaluating providers for dual-market capability, ask for specific agency names and recent placement examples in each target geography. CBREX covers India and 32 additional countries through the same single contract and platform.

What should I ask an RPO provider in the first meeting?

Five questions that cut through the pitch quickly: (1) Name the specific agencies you would activate for a niche specialist role in your target market. (2) What is your contractual SLA for time-to-shortlist on specialist roles? (3) How does your AI work, and what data was it trained on? (4) What does a fully loaded cost look like for five roles across three countries? (5) Who owns the candidate data when the engagement ends?

Is pay-on-hire RPO suitable for senior or niche roles?

Yes, and it's arguably more appropriate for senior and niche roles than retainer-based models. Pay-on-hire aligns the provider's incentives with successful placement, which is exactly what you need when the role is hard to fill and the cost of a wrong hire is high. The key is ensuring the provider has genuine specialist access for those roles, not just a generalist panel. For more on this model, How Does Pay-on-Hire Recruitment Work? FAQs covers the mechanics in detail.

How do I calculate the true cost of my current RPO or agency setup?

The true cost includes agency fees, management overhead, time-to-hire delays, failed hire replacements, and the administrative burden of managing multiple contracts and invoices. Most TA leaders significantly underestimate the last three categories. To get a clearer picture of what your current setup is actually costing you, use CBREX's hidden hiring tax calculator to assess the full picture.

The right RPO provider doesn't just fill roles faster. They give you the infrastructure to hire at scale, across functions, geographies, and seniority levels, without the administrative complexity that comes with managing it yourself. Use this checklist to find the one that can actually deliver that. If you'd like to discuss your specific hiring challenges directly, reach out to the CBREX team and start the conversation.

Table of contents

Sign up for regular updates
Get all the news delivered to your inbox.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Similar blogs

Read Time :
Managed Recruitment Services in India: 2026 Guide
A comprehensive service guide explaining what managed recruitment services actually include for India-based mid-market companies — covering how the model works end-to-end, what to expect from onboarding to first hire, how it differs from traditional agency or RPO models, and what a single-contract AI-powered approach looks like in practice. Addresses common questions around pricing, vendor coordination, SLAs, and how Indian companies across pharma, tech, and manufacturing are using it to hire specialist roles domestically and globally without retainers or admin chaos.
Read Time :
How Much Do Recruiters Charge as % of Salary?
A detailed cost guide breaking down how recruitment agencies calculate their fees as a percentage of annual salary — covering typical ranges (15–25%), what drives the percentage up or down (seniority, niche skills, geography, exclusivity), and how employers can benchmark and negotiate better rates. The blog also compares percentage-based fees against flat-fee and pay-on-hire models, helping TA leaders decide which pricing structure delivers the best cost-per-hire outcome for their specific hiring volume and role complexity.
Read Time :
Niche Skill Hiring in India: Mid-Market Guide 2026
A practical, location-specific guide for mid-market Indian companies struggling to fill hard-to-find specialist roles domestically and across borders. Covers why traditional job boards and generalist agencies fail for niche hiring, how specialist agency networks work in the Indian context, and a step-by-step framework for sourcing rare skills — from pharma QA to embedded systems engineers — without retainers or vendor chaos. Includes city-level and sector-specific sourcing tips relevant to India's hiring landscape in 2026.