Composio Logo

Composio

QA Engineer, Integrations and AI Agents

Posted 3 Days Ago
In-Office or Remote
Hiring Remotely in EST
Mid level
In-Office or Remote
Hiring Remotely in EST
Mid level
Own product quality for integrations, APIs, dashboards, and AI-agent workflows: build test plans, perform exploratory and end-to-end testing, maintain regression suites, automate high-value tests, investigate production issues, and drive defects to resolution working closely with engineers and product managers.
The summary above was generated by AI

At Composio, we are building infrastructure that allows agents to communicate with the tools you use for work including Github, Gmail, Notion, Salesforce, etc. We raised a $25M Series A from Lightspeed with angels like Guillermo Rauch (CEO of Vercel), Dharmesh Shah (CTO of Hubspot), and Gokul Rajaram. We've 3x'd our ARR this year, and our customers range from your friends in the YC batch to Wabi, Glean, Zoom and many more.

About the role

We are looking for a QA Engineer who will own hands-on product quality across Composio's integrations, APIs, dashboards, and AI-agent workflows.
You will test new features before release, uncover edge cases that automated checks miss, improve regression coverage, and work closely with engineers to drive issues through resolution. This is a practical, execution-focused role for someone who enjoys breaking complex systems, clearly documenting what went wrong, and ensuring customers receive a reliable product.
This is a globally remote position, but you must work a full schedule aligned with the Pacific Time team.

What you'll work on
  • Own feature validation: Build test plans and validate new features from requirements through production release.

  • Test integrations and APIs: Verify authentication, API behavior, permissions, webhooks, retries, pagination, rate limits, error handling, and third-party dependencies.

  • Validate end-to-end workflows: Test complete customer journeys across the dashboard, SDKs, APIs, connectors, and agent workflows.

  • Perform exploratory testing: Find edge cases, unexpected interactions, and usability issues that are not covered by standard test cases.

  • Maintain regression coverage: Build and execute reliable regression suites for high-risk and frequently used product areas.

  • Test AI-native experiences: Evaluate tool-calling agents and other non-deterministic workflows where outputs may vary between executions.

  • Improve automation: Automate repeatable API, integration, and UI test cases where automation creates meaningful release confidence.

  • Investigate production issues: Reproduce customer-reported problems using logs, network traces, API responses, and production signals.

  • Drive defects to resolution: Write clear bug reports with reproduction steps, evidence, impact, severity, and expected behavior. Verify fixes and prevent regressions.

  • Strengthen release quality: Partner with engineers and product managers to identify risks, define acceptance criteria, and make informed release decisions.

Must haves

Quality engineering
  • Strong hands-on experience testing modern web applications, APIs, or developer products.

  • Excellent exploratory testing and debugging skills.

  • Ability to turn product requirements into structured test plans and high-value test cases.

  • Experience with functional, integration, API, end-to-end, and regression testing.

  • Strong understanding of defect severity, prioritization, release risk, and quality signoff.

APIs and integrations
  • Experience testing REST APIs using tools such as Postman, Bruno, Insomnia, or equivalent.

  • Ability to reason about authentication, permissions, retries, webhooks, pagination, rate limits, asynchronous workflows, and eventual consistency.

  • Comfort using browser developer tools, logs, API payloads, and network traces to investigate failures.

  • Working knowledge of SQL and the ability to validate data when debugging an issue.

Automation
  • Ability to write or maintain automated tests using JavaScript, TypeScript, Python, or a similar language.

  • Familiarity with tools such as Playwright, Cypress, pytest, or equivalent frameworks.

  • Understanding of CI/CD pipelines, automated quality gates, flaky-test management, and regression coverage.

Ownership and communication
  • You take ownership of quality problems and drive them through resolution.

  • You write precise, reproducible bug reports and communicate risk clearly.

  • You can work independently in an ambiguous, fast-moving startup environment.

  • You collaborate effectively with engineers, product managers, support teams, and other stakeholders.

  • You are consistently available and responsive during Pacific Time working hours.

Nice to have
  • Experience testing developer tools, SDKs, workflow automation products, or integration platforms.

  • Experience with OAuth, API keys, webhooks, and third-party application integrations.

  • Familiarity with AI agents, LLM evaluation, MCP, or tool-calling systems.

  • Experience testing across multiple browsers, devices, and operating systems.

  • Exposure to observability tools and production incident investigation.

  • Experience establishing QA practices or improving quality processes at an early-stage company.

What success looks like

Within your first few months, you will understand Composio's critical customer workflows, own validation for major releases, improve regression coverage, and help the engineering team catch high-impact issues before customers encounter them. Over time, you will make our releases faster and safer by combining thoughtful manual testing, targeted automation, and strong product judgment.

Similar Jobs

20 Hours Ago
Remote or Hybrid
Senior level
Senior level
Security • Cybersecurity
Serve as a senior network security domain authority to define network engineer personas and workflows, advise product and AI teams, validate agent behaviors across firewall, cloud/SASE, policy management, compliance, vulnerability management, and troubleshooting, and help build realistic enterprise test scenarios.
Top Skills: AWSAzureCheck PointCiscoFortinetGCPPalo AltoSaseSd-WanTufin
Yesterday
Remote
USA
163K-272K Annually
Expert/Leader
163K-272K Annually
Expert/Leader
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead design, delivery and maintenance of GMP/GDP audit strategy for biologics, aseptic, small molecule and medical device areas. Plan and execute complex audits, coach auditors, analyze regulatory intelligence, drive corrective actions, support inspection readiness, and partner with PGS/PharmSci and site stakeholders to ensure compliance and continuous improvement.
Top Skills: Aseptic ManufacturingDigital HealthEu DirectiveFdaGdpGmpIchIsoMedical Device RegulationsPic/SQuality Management SystemSoftware As A Medical Device (Samd)Tga
Yesterday
In-Office or Remote
Expert/Leader
Expert/Leader
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Lead International Commercial Digital & AI portfolio and commercial-model innovation across Top16 and Cluster markets. Own portfolio governance, investment decisions, business cases, benefits tracking, partnership strategy, FIT accelerator rules, and market-sensing inputs. Drive reuse discipline, model cost visibility, go/no-go gates, and scale proven use cases while influencing senior stakeholders across a global matrix.
Top Skills: Agentic TechnologyAISpark

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account