FirstQA Documentation

Your complete guide to Ovi AI — confidence at speed through alignment, test automation, and expert QA.

1. What is FirstQA?

FirstQA gives startups confidence at speed. Ovi AI prevents bugs by creating alignment before coding starts, generates test scenarios and automated tests, reviews every PR, and connects you with expert human QA when needed. It's your first QA hire—without the headcount.

2. How It Works

  1. 🔗 Connect Your Tools: One-time setup with GitHub, Bitbucket, Jira, or Linear
  2. 📋 Ticket Review: Ovi analyzes tickets before coding—surfacing gaps, risks, and edge cases
  3. 🧪 Test Recipe: Get actionable test scenarios engineers can run before code review
  4. 🔍 PR Review: Every pull request analyzed for bugs, risks, and test coverage
  5. 🤖 Test Automation: E2E automated tests generated and integrated into CI/CD
  6. 👥 Manual Testing: Senior QA engineers for complex flows when you need them

3. Getting Started

Option A: GitHub App (for PR Analysis)

  1. Install the GitHub App: Install FirstQA on your repository. Choose which repos to enable.
  2. Open a Pull Request: Create or update a PR in your enabled repository.
  3. Automatic Analysis: Ovi automatically analyzes your PR—bugs, risks, test scenarios, and release readiness.
  4. Request Human QA: Add a comment with /test for comprehensive manual testing.

Option B: Chrome Extension (for Ticket Analysis)

  1. Install the Extension: Add the FirstQA Chrome Extension from your account dashboard.
  2. Navigate to a Ticket: Open any Jira or Linear ticket in your browser.
  3. Click Analyze: Ovi analyzes the ticket—surfacing gaps, edge cases, risks, and test scenarios before coding starts.

4. Ovi AI - Your AI QA Engineer

Ovi creates alignment and confidence at every stage of development:

Ticket Analysis (Before Coding)

PR Analysis (During Code Review)

Test Automation

Production Readiness Scoring

🚀 9-10: Ship It!
No critical issues, ready for production
✅ 7-8: Ship with Monitoring
Minor issues, can be monitored and fixed quickly
⚠️ 5-6: Needs More Testing
Potential issues affecting some users
❌ 3-4: Block Release
Issues that could significantly impact customer experience

5. Requesting Human QA Testing

To request comprehensive manual QA testing, add a comment to your PR that starts with /test. You can include details about what you want tested, browsers/devices, and any special requirements.

Example test request comment:
/test

Please run a full manual QA on this PR. Here's what I'd like you to focus on:
- Main goal: Verify the new user onboarding flow (sign up, email verification, and first login).
- Browsers: Chrome (latest), Firefox (latest), Safari (latest).
- Devices: Desktop and mobile (iPhone 13, Pixel 6).
- Test data: Use test email addresses (e.g., test+onboarding1@myapp.com).
- What to look for:
  - Any blockers or bugs in the onboarding steps
  - Usability issues or confusing UI
  - Broken links, typos, or missing error messages
  - Accessibility issues (keyboard navigation, screen reader basics)
  - Edge cases (weak passwords, invalid emails, slow network)
- Environment: https://staging.myapp.com
- Test user: testuser / password: Test1234!

6. What Happens Next?

  1. Your test request is received by our expert QA team.
  2. Testing usually begins within 4 hours (often much faster).
  3. You'll receive comments in your PR with bug reports, usability feedback, and a final test report.

7. Understanding Reports

Bug reports and test reports are posted as comments in your PR. Here's what they look like:

Bug Report Example
### 🐞 Bug Report

Summary:
After submitting the sign-up form with a valid email and password, the app shows a "Something went wrong" error and does not create the account.

Steps to Reproduce:
1. Go to https://staging.myapp.com/signup
2. Enter a valid email and password
3. Click "Sign Up"
4. Observe the error message

Expected Result:
User account should be created and redirected to the email verification page.

Actual Result:
An error message appears: "Something went wrong. Please try again later." No account is created.
Final Test Report Example
### ✅ Final Test Report

Scope:
- Full manual QA of the new user onboarding flow
- Browsers: Chrome, Firefox, Safari (latest)
- Devices: Desktop (Mac, Windows), Mobile (iPhone 13, Pixel 6)

Summary:
All critical and high-priority issues have been fixed. The onboarding flow now works smoothly across all tested browsers and devices.

Results:
- No blockers or major bugs found
- Minor UI issues from previous round have been fixed
- Usability is good, error messages are clear
- Accessibility is improved (labels, focus order)

Recommendation:
Ready to merge! 🚀

8. Pricing Preview

Here's what we're thinking. Final pricing confirmed before launch. Early access users get special pricing.

💼 Starter

~$49/month

  • 30 PR reviews
  • 30 Ticket analyses
  • Test recipes
  • Email support
🏢 Growth

~$149/month

  • Unlimited PR reviews
  • Unlimited ticket analysis
  • Test automation (E2E)
  • Priority support
👥 Human QA

~$1,589/month

  • 40 hours/month
  • Sr. QA engineers
  • Manual & Automated testing
  • Embedded in your team
Note: Final pricing will be confirmed before launch. Get early access for special pricing and to help shape the final plans.

9. Frequently Asked Questions (FAQ)

Ticket analysis happens before coding—Ovi reviews Jira/Linear tickets to surface gaps, edge cases, and risks so engineers know exactly what to build. PR analysis happens during code review—Ovi analyzes code changes to find bugs, suggest tests, and assess release readiness.

Ovi generates E2E automated tests based on your changes and test recipes. These tests integrate into your CI/CD pipeline and run automatically. As your codebase evolves, Ovi helps maintain and update the tests.

Use Ovi AI for every ticket and PR—it's instant and catches most issues. Use human QA for complex user flows, critical releases, exploratory testing, and when you need deep domain expertise. Many teams use both: AI for speed, humans for depth.

Ovi AI analysis: Instant (within seconds)
Test automation: Generated with PR analysis, runs in your CI/CD
Human QA testing: Usually starts within 4 hours, first results within 4–24 hours

Code hosting: GitHub, Bitbucket
Project management: Jira, Linear
CI/CD: GitHub Actions, and more coming soon
Connect once, and Ovi starts working immediately.

10. Need Help or Have Questions?

If you have questions, want to give feedback, or need support, you can:

Ready for Confidence at Speed?

Join early access and help shape the future of AI-powered QA.

Get Early Access Schedule Discovery Call