Skip to content

Testing As A Service

Sergey Bronnikov edited this page Jan 19, 2024 · 27 revisions

Web Testing

  • percy.io - Visual testing
  • rainforestqa.com
  • testRigo.comr - Create your tests in plain English emulating end-user's way to use your application.
  • applitools.com - Automating visual software testing
  • browserstack.com — Manual and automated browser testing, free for Open Source
  • checkbot.io — Browser extension that tests if your website follows 50+ SEO, speed and security best practices. Free tier for smaller websites.
  • crossbrowsertesting.com - Manual, Visual, and Selenium Browser Testing in the cloud - free for Open Source
  • everystep-automation.com — Records and replays all steps made in a web browser and creates scripts.
  • gridlastic.com — Selenium Grid testing with free plan up to 4 simultaneous selenium nodes/10 grid starts/4,000 test minutes/month
  • percy.io - Add visual testing to any web app, static site, style guide, or component library. 10 team members, Demo app and unlimited projects, 5,000 snapshots / month.
  • saucelabs.com — Provides the world's largest automation cloud for testing web and native/hybrid mobile applications. Founded by the original creator of Selenium, Sauce Labs helps companies accelerate software development cycles, improve application quality and deploy with confidence across 450+ browser / OS platforms, including Windows, Linux, iOS, Android & Mac OS X.
  • testingbot.com — Selenium Browser and Device Testing
  • tesults.com — Test results reporting and test case management. Integrates with popular test frameworks. Open Source software developers, individuals, educators, and small teams getting started can request discounted and free offerings beyond basic free project.
  • Browserstack - Online tool which allows users to test their website from different browsers. The list of supported browsers includes Google Chrome, Internet Explorer, Opera and Safari. This even includes different browser versions as well including the beta versions as well. With Browserstack, you can test every aspect of your website like flash, CSS, Java and more.
  • CrossBrowserTesting Another one cloud platform for automated testing of web applications. Provides a wide range of browsers, systems and more.
  • Assertible - Assertible is an API and website testing service for teams and individuals. Create tests for your business logic, run them on a schedule or after deployments, and get alerted of failures as they occur.
  • Mailosaur - Allows you to automate email testing. Perform end-to-end tests on password reset, email verification and any area where you send email.
  • testim.io - Automated functional testing platform with a GUI for authoring and machine learning based self-maintenance.
  • cypress.io - Fast, easy and reliable testing for anything that runs in a browser. Cypress Test Runner is always free and open source with no restrictions and limitations. Cypress Dashboard is free for open source projects for up to 5 users.

API Testing

  • MockLab - a hosted API simulation tool built on WireMock (maintaining 100% API compatibility). It supports flexible request/response stubbing for any HTTP-based protocol, response templating with Handlebars, conditional proxying and fault injection.

Mobile Testing

  • Hive CI is a CI system built around devices. Connect your physical devices to a hive and run your tests on the same platforms as your users
  • Testmunk automates mobile app testing.

Performance and Load Testing

  • https://www.flood.io/ - load testing platform. We run open-source load testing tools in the cloud and on-premise, handling test creation and reporting in one unified environment that's easy to share with your team.
  • Lighthouse - is an open-source, automated tool for improving the quality of web pages. You can run it against any web page, public or requiring authentication. It has audits for performance, accessibility, progressive web apps, SEO and more.
  • Perfvane, the service to detect performance anomalies in your software projects.
  • BlazeMeter - A self-service performance & load testing cloud, 100% JMeter-compatible. Easily run tests of 30k, 50k, 80k or more concurrent users, on-demand!
  • BlazeMeter Sense - performance testing analytics.
  • Yandex Overload - a performance analytics service.
  • Loadsophia - is the service for storing and analysing performance test results. It supports analyzing output from Apache JMeter, Apache Benchmark and Yandex.Tank performance testing tools.
  • Sitespeed - is a set of Open Source tools that helps make your web pages faster. The coach gives you performance advice based on best practices for your site. Browsertime collects metrics and HAR files from your browser. Chrome-HAR creates a HAR file from Chrome Debugging Protocol data. PageXray converts a HAR file to a usable JSON structure that tells you more about your page. And finally sitespeed.io is the main tool that uses all the previously mentioned tools and add supports for testing multiple pages as well as adds the ability to report the metrics to a TSDB (Graphite and InfluxDB).
  • Bees with Machine Guns! - an utility for arming (creating) many bees (micro EC2 instances) to attack (load test) targets (web applications).
  • Flood.io - auto setup and results summaries/graphs of JMeter and Gatling load tests. Can easily scale to 100K+ reqs/min. Free to $399/mo.
  • Neustar Website Load Testing - tackle performance problems such as bandwidth limitations, error rates exceeding thresholds, server PU limitations and much more. Price: $80/mo.
  • Loader.io - is a free load testing service that allows you to stress test your web-apps/apis with thousands of concurrent connections. Free to 100.00$/mo.
  • Locust.io - self-hosted load testing tool written in Python, with the tests themselves written in Python code. Opensource.
  • k6.io - k6 is a developer centric open source load testing tool for testing the performance of your backend infrastructure. It’s built with Go and JavaScript to integrate well into your development workflow, so you can stay on top of performance without fuzz. Free to 100.00$/mo.
  • loadimpact.com - a SaaS performance testing solution for modern DevOps teams, built on top of the open source k6.io project. Price: $99.00+.

Static Analysis

  • sonarcloud.com - is the leading product for Continuous Code Quality online, totally free for open-source projects. It supports all major programming languages, including Java, C#, JavaScript, TypeScript, C/C++ and many more.
  • coverity.com - is a free static-analysis cloud-based service for the open source community. The tool analyzes over 3900 open-source projects and is integrated with GitHub and Travis CI. Supported languages: C, C++, C#, Java, JavaScript, PHP, Python, .Net Core, ASP.NET, Objective-C, Go, JSP, Ruby, Swift, Fortran, Scala, VB.NET, ioS, and Typescript.
  • kiuwan.com - is a software as a service (SaaS) static program analysis multi-technology software for software analytics, quality and security measurement and management. Kiuwan is one of the tools in the Open Web Application Security Project (OWASP) source code analysis tools list.
  • shellcheck.net - finds bugs in your shell scripts.

Continuous Integration

Fuzzing Testing

Code Coverage

  • codecov.io - improve your code review workflow and quality. Codecov provides highly integrated tools to group, merge, archive, and compare coverage reports. Free for open source. Plans starting at $10/user per month.
  • coveralls.io - is a web service to help you track your code coverage over time, and ensure that all your new code is fully covered.

Testcase Management

  • Kiwi TCMS - is an open source test case management system. It features bug tracker integration, fast test plan and runs search, powerful access control, test automation framework plugins and rich API layer.
  • TestRail - Modern Test Case Management Software for QA and Development Teams.

Code Review

  • reviewdog.app - Automated code review integrated with any code analysis tools
  • deepcode.ai - DeepCode alerts you about critical vulnerabilities you need to solve in your code. Don't let security bugs go to production.
  • DependaBot - Get security feedback with every git push.

Outsource Testing

Crowdsource Testing

Failure as a Service

  • Gremlin — Gremlin's Chaos Engineering tools allow you to safely, securely, and simply inject failure into your systems to find weaknesses before they cause customer-facing issues. Gremlin Free provides access to Shutdown and CPU attacks on up to 5 hosts or containers.
  • Amazon Fault Injection Simulator - chaos engineering as a service

Functional Testing

  • Symflower - automatically finds, writes, runs and analyses all relevant unit tests revealing bugs, security issues and performance problems.
  • HypoFuzz - putting smart fuzzing into the world's best testing workflow for Python.

Formal Verification

See also

Clone this wiki locally