DataAnnotation vs Outlier: Which Pays Better and Stays Reliable?

DataAnnotation vs Outlier at a Glance

DataAnnotation publishes explicit starting hourly pay figures on its website, whereas Outlier presents individual compensation amounts only after a worker views an assigned project. Both websites contract remote contributors to generate text prompts, rate chatbot responses, and evaluate model outputs. DataAnnotation handles contractor payouts exclusively through PayPal once a worker requests a balance withdrawal. Outlier automates worker distributions every Tuesday using direct bank deposit, PayPal, or Airtm.

DataAnnotation requires applicants to complete a core Starter Assessment that takes about an hour, but it strictly prohibits retakes if an applicant does not pass. Outlier requires an associate degree, a resume, a mobile phone number, and a LinkedIn profile, guiding applicants through an initial onboarding process lasting 30 to 90 minutes. On Trustpilot as of October 9, 2026, Outlier scored 4.1 out of 5 from 5,483 reviews and DataAnnotation scored 3.9 from 1,973. Reviews of both list stretches with no available work among the recurring complaints.

If you want a posted starting rate before you take a test, DataAnnotation gives you one. If you want a fixed weekly payday and a choice of PayPal, Airtm or ACH, Outlier gives you that. Neither FAQ prohibits working on other platforms, so many workers apply to both; read each contractor agreement before you sign it.

Pay Transparency and Hourly Earning Potential

DataAnnotation provides direct pay numbers within the FAQ section of its website, though different answers on the FAQ give different figures. On its formal pay section, the DataAnnotation FAQ states that general projects start at $25 to $50 or more per hour, while multilingual assignments start at $20 or more per hour. Coding projects start at $40 to $150 or more per hour, and specialized STEM or professional tracks in law, finance, or medicine list starting rates of $40 to $125 or more per hour. However, separate answers on that same FAQ page state that general work starts at $25 to $30 or more per hour, while coding tasks range from $50 to $100 per hour. The company notes it has distributed more than $20 million to contractors since 2020.

Outlier does not publish general platform-wide hourly compensation rates on its public pages. According to the Outlier FAQ, rates vary based on personal expertise, project complexity, and geographical location, with specific task rates presented to contributors before each project starts. Outlier contributors must evaluate compensation on a project-by-project basis rather than from an advertised starting rate.

DataAnnotation lets prospective applicants calculate baseline earnings before taking their entrance tests, assuming project volume remains available. At Outlier, you see a project's rate after onboarding, before you start that project. If you want to calculate how irregular hourly income impacts your quarterly tax obligations, test your estimated numbers with our 1099 tax calculator.

Assessment and Onboarding Requirements

The application process at DataAnnotation relies on a single-attempt entry exam. Applicants complete a core Starter Assessment that takes approximately one hour, with specialized testing modules taking between one and two hours. DataAnnotation requires a bachelor's degree or equivalent real-world experience, English fluency, and identity verification using government photo credentials and a selfie managed by Persona.

Outlier structures its entrance process around credentials, resume review, and multi-stage screening. The Outlier FAQ specifies that applicants need at least an associate degree, a current resume, an active LinkedIn profile, a mobile phone from your country of residence, and a valid government identification document. Core onboarding generally takes 30 to 90 minutes, covering initial identity checks and core skill evaluations before contributors advance to project-specific training modules.

Neither platform states on its FAQ whether contributors receive pay for the time spent completing introductory tests or qualification screenings. By contrast, Handshake AI says some of its projects pay for onboarding and others do not. Trustpilot reviewers of both DataAnnotation and Outlier describe unpaid tests, so budget that time as unpaid unless a project says otherwise.

Payout Methods and Schedules

Outlier operates on a strict, automated weekly schedule, processing payments every Tuesday for work logged between the prior Tuesday and Monday at midnight UTC. Outlier supports three payout rails: PayPal, Airtm, and direct ACH bank transfers.

DataAnnotation requires manual withdrawal requests and restricts disbursements to a single vendor. DataAnnotation sends all payments through PayPal, delivering funds within a few days after a contractor initiates a withdrawal.

For freelancers managing inconsistent cash inflows across platforms, our irregular income budgeting guide provides structured cash-flow allocation strategies.

Platform Reliability and Complaint Patterns

Both platforms exhibit common complaint patterns related to task availability and sudden loss of project access. On Trustpilot, the DataAnnotation review profile held a TrustScore of 3.9 out of 5 across 1,973 reviews as of October 9, 2026, with 21 percent of ratings at one star. Negative reviews focus on extended stretches with zero dashboard assignments, unpaid qualification tests, account balance holds during account review, repetitive identity verification prompts, and absent customer support. DataAnnotation notes in its FAQ that it cannot provide direct responses to every applicant and that subpar work can result in project removals.

Outlier held a TrustScore of 4.1 out of 5 across 5,483 reviews on its Trustpilot profile as of October 9, 2026, with 19 percent of ratings at one star. Recurring contributor complaints highlight abrupt account deactivations, sudden removal from active projects, unpaid test requirements, onboarding technical glitches, slow customer service, and delayed disbursement of pending earnings following account closures. Positive Outlier reviews praise on-time pay and flexibility, while positive DataAnnotation reviews praise flexibility and ease of use.

Outlier's operator, Scale AI, has cut contractors before. In July 2025 it laid off about 200 full-time staff and ended contracts with about 500 contractors, Outlook Business reported. In March 2024, Rest of World reported that Scale AI shut down Remotasks entirely in Kenya, Nigeria and Pakistan, citing "enhanced security protocols."

Legal Background and Corporate Ownership

The Outlier FAQ says Outlier "is a platform operated by Scale AI," and its footer reads "© 2026 Smart Ecosystems." In June 2025, Reuters reported that Meta took a 49 percent stake in Scale AI for about $14.3 billion, valuing Scale AI at around $29 billion. Scale AI CEO Alexandr Wang joined Meta, while Jason Droege assumed leadership as interim CEO.

Scale AI has faced substantial contractor legal challenges in California courts. In December 2024, workers filed McKinney v. Scale AI in San Francisco Superior Court alleging worker misclassification. A $12.5 million settlement was proposed to resolve the McKinney litigation and related California claims involving Outlier and Remotasks contractors, covering California-resident contributors between December 10, 2020, and February 28, 2026, according to ClaimDepot. The claim and exclusion deadline was September 3, 2026, with a final approval hearing scheduled for October 30, 2026. The defendants deny the allegations. Six Outlier workers also filed a federal class action, Schuster v. Scale AI, Inc., in January 2025, alleging psychological harm from writing disturbing prompts. Separately, TechCrunch reported in May 2025 that the U.S. Department of Labor had dropped its Fair Labor Standards Act investigation into Scale AI.

DataAnnotation's FAQ names no parent corporation, identifying only Persona as an external identity authentication vendor. Wikipedia says The Verge and New York Magazine linked DataAnnotation to Surge AI in 2023, but DataAnnotation's site does not confirm it. In May 2025, Clarkson Law Firm filed a misclassification class action against Surge AI in San Francisco Superior Court; the firm's page does not name DataAnnotation. Searches of federal CourtListener records reveal no federal dockets naming DataAnnotation directly.

Where Mercor Fits as an Alternative Option

Mercor is a third option, aimed at credentialed experts rather than generalists. Mercor operates as a selective talent network that pairs AI research labs with specialized domain authorities, including physicians, attorneys, and scientists. In October 2025, TechCrunch reported that Mercor raised a $350 million Series C at a $10 billion valuation. TechCrunch also reported that Mercor pays more than $1.5 million a day to more than 30,000 experts averaging over $85 an hour.

Mercor issues payments every Wednesday around 12:00 PM PST for the prior week's work, using Stripe Connect where supported and Wise for other regions. All Mercor contracts are in U.S. dollars, and payouts go only to a bank account in your own legal name. Stripe holds your first payout for 7 days. To learn more about its hiring standards and enterprise projects, read our Mercor platform review.

Scale AI filed a federal trade-secret lawsuit against Mercor and a former employee in September 2025, alleging trade-secret misappropriation. Mercor also faced data-breach class actions in early 2026 following a supply-chain cyberattack. While Mercor connects AI labs with domain experts such as scientists, doctors, and lawyers, DataAnnotation and Outlier accept generalists: DataAnnotation asks for a bachelor's degree or equivalent experience, and Outlier for at least an associate degree.

Contractor Taxes and Self-Employment Obligations

DataAnnotation calls its workers contractors, and Outlier says you work "as an independent contractor/freelancer, not as an employee." Neither FAQ describes withholding any tax, so plan to pay it yourself. In the United States, you owe self-employment tax once net self-employment earnings reach $400, according to the Internal Revenue Service. The rate is 15.3 percent: 12.4 percent for Social Security and 2.9 percent for Medicare.

Contractors must track gross earnings independently to prepare for quarterly estimated tax deadlines. PayPal says it issues a Form 1099-K for more than $20,000 and 200 transactions a year. It uses a $600 threshold in Vermont, Massachusetts, Virginia and Maryland, and more than $1,000 with 4 or more transactions in Illinois.

If you expect to owe at least $1,000 for the year, the IRS generally expects estimated payments by April 15, June 15, September 15 and January 15. Contractors can deduct ordinary and necessary business expenses, such as home office workspace allocations and equipment depreciation, to reduce net taxable profit. Review our complete guide to DataAnnotation contractor taxes to learn how to structure your quarterly filings, track allowable write-offs, and calculate your self-employment obligations.

Frequently asked questions