Hypertest v2 Docs
HyperTest
  • Overview
    • How It Works?
  • SETUP GUIDE
    • Installation
      • Deploy HyperTest Server
      • Creating your first User
      • Adding your first service
      • Integrate SDK
        • Node.js
          • Node.js SDK with CJS
          • Node.js SDK with ESM
        • Java
    • Start a Test Run
      • CLI Login
      • Type References
      • Java
  • Interpreting Test Results
    • Test Results
    • Understanding Results Categories
    • Mock Not Found
    • AI Match Mocks
    • Accepting Changes
  • USER GUIDES
    • Node.js SDK
      • Limit memory usage
      • Supported NPM packages
      • Mock Dependencies Manually
      • Unmocking/Passing Through
      • Sampling and blocking requests
      • Manage Global Variables
      • Mocking Environment Variables
      • Tags
      • Set HTTP path patterns
      • Discard a test case(Request) while recording
      • Set Git Commit Hash
      • Code coverage based features
        • Continuous Coverage
        • Updating test coverage
        • Running post test deduplication
        • Only testing modified requests
        • Ignore differences for unmodified requests
      • Experimental flags
      • Manual Request
      • Only testing modified requests
      • Server hooks
    • Java SDK
      • Sampling and blocking requests
      • Mock Dependencies Manually
      • Tags
      • Unmocking/Passing Through
      • Code Coverage Setup and Report Generation
      • Supported Java packages
    • Build your own Docker Image
    • CLI Config
    • Ignoring Differences
      • Type References for Filter functions
  • Impact Features
    • Fast Mode
    • Code Coverage Report
    • Delete Recorded Requests
    • Inter Service Testing
  • Release History
    • Slack Integration
    • Version History
Powered by GitBook
On this page
  • 1. Passed Requests
  • 2. Failed Requests
  1. Interpreting Test Results

Understanding Results Categories

PreviousTest ResultsNextMock Not Found

Last updated 7 months ago

1. Passed Requests

These requests will have no regressions in the responses or their outbound calls.

2. Failed Requests

Requests with regressions in responses or any of its outbound calls.

2.1 Understanding a failed request

Check any failed requests to understand what Hypertest reports. It asserts for response codes, schema and data across responses and outbound call. See the example below of a data regression

  1. This is an example of Value Modified, in the path, 'newBalance'.

  2. Why did Hypertest report this problem. When the API works fine, the field newBalance gets correctly updated when someone adds $500, as seen in Expected Response. However, when the code was updated it caused an error making it debit instead of credit the same amount. When HyperTest ran the request with the same data set it caught the difference you see in newBalance.

  3. We can magnify the scope of our investigation by looking at the JSON View, which tells us the actual difference in the form of a JSON file.

2.2 Checking the Outbound call responsible

HyperTest can similarly assert the schema and data in outbound calls.

In the same example, once the NewBalance is computed the service updates it to a database like PostgreSQL here. HyperTest asserts for schema and data in the db query like it did for API response above and reports a regression like you see above.

In this example, the response of the request or it's outbound calls show no regression.