| A | B | C | D | E | |
|---|---|---|---|---|---|
1 | API Testing Evaluation Checklist | Current Solution | API Fortress | Notes | |
2 | Category | Feature | Score 5 (great) to 1 (bad) | ||
3 | Installation & Setup | Cloud | |||
4 | On-Premises | ||||
5 | Single Setup Integrations (Slack, JIRA, etc...) | ||||
6 | Team Setup & User Roles | ||||
7 | Flexibility in Methods of Use (GUI, command-line, plugins, etc...) | ||||
8 | Test Creation | Test Generation | |||
9 | Test Editing | ||||
10 | Assertion Library | ||||
11 | Easy to Learn / Understand | ||||
12 | Ability to Create End-to-End Tests | ||||
13 | Ease of Creating End-to-End Tests | ||||
14 | Reuse Code Snippets Between Tests | ||||
15 | Universal Variables | ||||
16 | Test Creation - Scripting | Support for Custom Coding | |||
17 | Scripting Libraries | ||||
18 | Test Data Management | Data Source Driven Tests | |||
19 | Supported Data Formats | ||||
20 | Source Control Management | Integration with VCS (eg: Github) | |||
21 | Test Execution | Run Tests Against Any Environment | |||
22 | Works With Your CI/CD Platform (eg: Jenkins, Bamboo, TFS, etc...) | ||||
23 | APIs & Webhooks for Execution Flexbility | ||||
24 | Built in Scheduling | ||||
25 | Reporting | Detailed Reports with Attached Logs | |||
26 | User Friendly Reports | ||||
27 | Easy to Share | ||||
28 | Unified Dashboard for All Test Reports | ||||
29 | Support | Customer Support | |||
30 | Documentation | ||||
31 | Timeliness of Support | ||||
32 | Supported Testing Techniques | Functional | |||
33 | Integration | ||||
34 | End-to-End | ||||
35 | Performance | ||||
36 | Load Testing | ||||
37 | API Mocking / Service Virtualization | API Mocking | |||
38 | Mock Generation from API Recording | ||||
39 | Generate a Mock from a Spec (OpenAPI, WSDL, etc...) | ||||
40 | Cost | License | |||
41 | Learning Curve | ||||
42 | Migration | ||||
43 | Total: | 0 | 0 | ||
44 | |||||
45 | |||||
Loading...