Contract Testing using gRPC Specs as Executable Contracts

By Yogesh Nikam

Share this page

Transform your gRPC API specs into executable contracts in seconds

Now you can easily leverage your gRPC APIs for contract testing, intelligent service virtualisation and backward compatibility testing, just like you would for your OpenAPI-based services. No more complex and brittle setups that involve an assortment of tools – Specmatic handles it all for you, thereby making for a one stop solution that enables a seamless DevEx. 

Streamlining Microservices Development with Contract-Driven Testing

In the evolving world of microservices, ensuring robust and reliable communication between services is no small feat. Services need to interact efficiently without introducing bottlenecks or faults that could lead to system failures. Specmatic is a powerful tool that simplifies the contract testing of gRPC services, thereby enhancing the resilience and dependability of microservice architectures.

Understanding the Architecture

Our application comprises three key components: the client, the Backend-for-Frontend (BFF) service, and the backend domain service. The glue binding these components together is the gRPC protocol, renowned for its performance and efficiency. Testing these components in isolation becomes paramount to ensure independent functionality and overall system stability.

Specmatic steps into this context to make the otherwise daunting task of contract testing straightforward and maintainable. In testing mode, Specmatic replaces the real client with a simulated client and the backend domain service with a gRPC stub, mimicking its interactions and responses.

The Power of Specmatic in Isolated Testing

In isolation testing, the aim is to test the BFF service without depending on the client or the backend domain service. This setup leverages Specmatic, which acts as a substitute for these components by emulating their behavior. By doing so, Specmatic effectively validates the interactions and ensures they comply with the defined contract.

Specmatic achieves this by generating a stub based on the API specification file of the backend domain service. This stub is a highly accurate representation, ensuring the BFF behaves correctly even in the absence of actual backend services. This results in faster and more efficient tests.

Exploring the gRPC Methods and Tests

Let’s dive deeper into the testing methodology by examining the gRPC methods and the corresponding tests. A typical RPC method such as create order expects a request containing a new order’s details and returns an order ID. Specmatic tests validate these interactions against the specified contract.

Valid Request Testing

When a valid request, adhering to all required fields and constraints, is sent to the BFF service, Specmatic ensures the response is validated correctly against the schema. If the responses conform to the expected contract, the tests pass seamlessly, confirming the service’s behavior.

Negative Scenario Testing

Specmatic also excels in testing negative scenarios, known as mutation-based testing. Consider a scenario where a request field such as count is below the minimum value defined by the contract. Specmatic expects an appropriate error response. If the service fails to handle this correctly and returns a valid response instead, Specmatic identifies the issue, flags the test, and highlights exactly where the problem lies.

This meticulous approach extends to other tests, such as missing required fields. Specmatic checks for the appropriate error handling, ensuring that every plausible negative scenario is rigorously tested.

Automated Test Generation and Execution

One of the standout features of Specmatic is its ability to auto-generate tests. Developers do not need to handcraft each test case; instead, Specmatic uses the API specifications to generate comprehensive tests covering various scenarios. This automation dramatically reduces the overhead and ensures no critical test cases are overlooked.

The Specmatic Configuration File

The real magic lies in the Specmatic configuration file, a YAML file detailing the specifications and configurations necessary for Specmatic to operate. This file specifies the specs for the BFF service and the domain services it depends on, guiding Specmatic’s test generation and stub creation processes.

Enhancing Microservices Reliability

The adoption of Specmatic in contract-driven development offers numerous benefits:

  • Early Detection of Integration Issues: By validating interactions early in the development cycle, integration issues are identified and resolved promptly.
  • Reduced Dependency on Live Services: Eliminates the need to run actual dependent services, thus simplifying the testing workflow.
  • Assurance of Compliance: Ensures all interactions adhere strictly to the agreed-upon API contracts, fostering consistency and reliability.
  • Boosted Developer Confidence: With exhaustive tests ensuring all scenarios are covered, developers gain increased confidence in the stability and resilience of the microservices.

Conclusion

Specmatic revolutionizes the way developers approach contract testing in gRPC services. Its ability to simulate clients and backend services, generate exhaustive tests, and validate interactions against strict contracts ensures that microservices can be developed, tested, and deployed with greater confidence. By maintaining API specifications centrally and automating test generation, Specmatic embodies the best practices of contract-driven development.

Getting Started

For gRPC, the setup process is just as straightforward as it is for OpenAPI. All you need are your gRPC proto files, along with a simple Specmatic configuration, and you’re good to go!

Sample gRPC projects

https://github.com/znsio/specmatic-order-bff-grpc-kotlin 
https://github.com/znsio/specmatic-order-api-grpc-kotlin 
https://github.com/znsio/specmatic-order-bff-grpc-go 

Give a star to Specmatic – https://github.com/znsio/specmatic  

Available in the Pro plan or higher

Related Posts

OpenAPI codegen docgen demo

By Naresh Jain

OpenAPI’s Broken Tooling: Roundtrip Fidelity Failure with CodeGen and DocGen​

Exploring the Strengths and Weaknesses of Automated API Development  Maintaining well-documented and reliable APIs is essential for any microservices development pipelines. At the heart of
Read More
api proxy recording thumb

By Naresh Jain

Replace Live Services with OpenAPI Mocks from Real HTTP Traffic with Specmatic Proxy

API proxy recording: Capture traffic, generate mocks, and simulate faults When you need to test how a system behaves when a downstream API misbehaves, API
Read More
GraphQL API resiliency testing

API Resiliency and Contract Testing for GraphQL

Transform your GraphQL API specs into executable contracts in seconds Now you can easily leverage your GraphQL APIs for contract testing, intelligent service virtualisation and
Read More
kafka+jms

By Hari Krishnan

Contract Testing using AsyncAPI Specs as Executable Contracts

Sample projects with AsyncAPI Sample project with Kafka & AsyncAPI: https://github.com/znsio/specmatic-order-bff-nodejs Sample project with JMS and AsyncAPI: https://github.com/znsio/specmatic-order-bff-jms Sample project with Google Pub/Sub and AsyncAPI: https://github.com/znsio/specmatic-google-pubsub-sample Available in Pro
Read More
Demonstration of the flaws in grpc

By Naresh Jain

gRPC Flaws​ – The Illusion of Safety & Frustrating DevEx in Proto3’s Type-Safe Contracts​

Understanding the Shortcomings of gRPC and How Contract Testing Can Bridge the Gap  In the ever-evolving world of API design, development, and testing, the pursuit
Read More
testing 429 responses thumbnail

By Naresh Jain

When Dependencies Timeout, Does Your API Shed Load with 429 Responses?

When Dependencies Timeout: Engineering Tests that Produce a 429 response Simulating backend slowdowns and verifying that your API returns a proper 429 response is a
Read More

By Naresh Jain

Contract Testing using OpenAPI Specs as Executable Contracts

Demonstration video showing OpenAPI specifications being leveraged as executable contracts with Specmatic
Read More
testing 202 responses thumb

By Naresh Jain

When Downstream Services Lag, Does Your API Gracefully Accept with 202 Responses?

When Downstream Services Lag: Designing Reliable APIs with 202 responses As systems get distributed, synchronous calls to downstream services become fragile. When a downstream service
Read More
mcp auto test exposed mcp servers lying

By Yogesh Nikam

Exposed: MCP Servers Are Lying About Their Schemas

Table of Contents Practical Lessons from MCP Server Testing Over the last few weeks the Specmatic team ran a focused series of MCP server testing
Read More
Google PubSub contract tests

Contract Testing Google Pub/Sub: Using AsyncAPI specs as Executable Contracts

Shift-Left the identification of integration issues in applications built with Event Driven Architecture (EDA) by leveraging AsyncAPI specs as Executable Contracts Introduction The surge in
Read More