{"id":57006,"date":"2023-05-06T09:40:20","date_gmt":"2023-05-06T04:10:20","guid":{"rendered":"https:\/\/www.tothenew.com\/blog\/?p=57006"},"modified":"2024-01-02T17:41:26","modified_gmt":"2024-01-02T12:11:26","slug":"h2-sucks-test-containers-to-rescue","status":"publish","type":"post","link":"https:\/\/www.tothenew.com\/blog\/h2-sucks-test-containers-to-rescue\/","title":{"rendered":"Say No to H2, Yes to Test-Container"},"content":{"rendered":"

Developers get confused over the priority of unit test cases and integration test cases. Though both are important, when we are building services for clients, we are on a tight schedule, so completing the development is itself a challenge, let alone writing test cases.<\/p>\n

I always strive to write test cases, irrespective of the time we have. I stress writing Integration test cases over Unit test cases in the first place. In Unit test cases, we are looking to cover a critical piece of code and mock all its surrounding logic. But in production, surrounding matters as much as that piece of code.<\/p>\n

To write Integration tests, we cannot mock repository layers, and we need some mechanism to tackle this. The in-memory H2 database has done the job for years, though very badly. We were never able to replicate the production database for our test cases.<\/p>\n

It\u2019s very common, that while writing sql queries, we may be using a lot of native MySQL syntax, which H2 may not support. Windows functions or analytical functions which are quite common is not well supported by H2. Support for latest sql features comes late in H2 database. Sometime, I tell my team, try to use standard sql functions over mysql native functions and make sure that those functions are well supported on H2 so that we covered those code snippets in test cases. This is bad. This is not on.<\/p>\n

Test Containers to the rescue.<\/strong><\/p>\n

Now we have test containers for nearly every kind of database with their latest version. So now our test database mimics the production database, and I can take full advantage of the underlying database I am using.<\/p>\n

We will now see how easy it is to set up test containers for testing in Spring Boot.<\/p>\n

Let\u2019s look into our pom.xml<\/p>\n

<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-data-jpa<\/artifactId<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-web<\/artifactId<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>com.mysql<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>mysql-connector-j<\/artifactId<\/span>><\/span>\r\n<scope<\/span>><\/span>runtime<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.projectlombok<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>lombok<\/artifactId<\/span>><\/span>\r\n<optional<\/span>><\/span>true<\/optional<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<!-- main dependencyies ----------><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-test<\/artifactId<\/span>><\/span>\r\n<scope<\/span>><\/span>test<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.testcontainers<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>junit-jupiter<\/artifactId<\/span>><\/span>\r\n<scope<\/span>><\/span>test<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.testcontainers<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>mysql<\/artifactId<\/span>><\/span>\r\n<scope<\/span>><\/span>test<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<!-- main dependencyies ----------><\/span>\r\n\r\n<!-- https:\/\/mvnrepository.com\/artifact\/org.springframework.boot\/spring-boot-starter-webflux --><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-webflux<\/artifactId<\/span>><\/span>\r\n<version<\/span>><\/span>3.0.2<\/version<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n\r\n<\/dependencies<\/span>><\/span>\r\n<dependencyManagement<\/span>><\/span>\r\n<dependencies<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.testcontainers<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>testcontainers-bom<\/artifactId<\/span>><\/span>\r\n<version<\/span>><\/span>${testcontainers.version}<\/version<\/span>><\/span>\r\n<type<\/span>><\/span>pom<\/type<\/span>><\/span>\r\n<scope<\/span>><\/span>import<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<\/dependencies<\/span>><\/span>\r\n<\/dependencyManagement<\/span>><\/span><\/pre>\n
Main dependency has been marked in comments.<\/p>\n
Now consider the\u00a0OrderEntity.java, OrderEntityRepository.java and OrderController.java class<\/strong><\/p>\n
package<\/span> org.anil.testcontainers.entity;\r\n\r\nimport<\/span> jakarta.persistence.*;\r\nimport<\/span> lombok.Getter;\r\nimport<\/span> lombok.Setter;\r\n\r\n@Entity<\/span>\r\n@Getter<\/span>\r\n@Setter<\/span>\r\n@Table(name =\"order_entity\")<\/span>\r\npublic<\/span> class<\/span> OrderEntity<\/span>{\r\n    @Id<\/span>\r\n    @GeneratedValue(strategy = GenerationType.IDENTITY)<\/span>\r\n    private<\/span> Long id;\r\n    private<\/span> String orderName;\r\n    private<\/span> Long orderType;\r\n    @Transient<\/span>\r\n    private<\/span> String orderTypeDes;\r\n}<\/span><\/pre>\n
package<\/span> org.anil.testcontainers.repository;\r\n\r\nimport<\/span> org.anil.testcontainers.entity.OrderEntity;\r\nimport<\/span> org.springframework.data.jpa.repository.JpaRepository;\r\n\r\npublic<\/span> interface<\/span> OrderEntityRepository<\/span>  extends<\/span> JpaRepository<\/span><OrderEntity,Long> {\r\n}<\/span><\/pre>\n
@RestController<\/span>\r\npublic<\/span> class<\/span> OrderController<\/span> {\r\n    @PersistenceContext<\/span>\r\n    EntityManager entityManager;\r\n\r\n    @Autowired<\/span>\r\n    OrderEntityRepository orderEntityRepository;\r\n\r\n    @PostMapping(\"\/save\")<\/span>\r\n    public<\/span> ResponseEntity<OrderEntity> saveOrderEntity<\/span>(@RequestBody<\/span> OrderEntity orderEntityDto)<\/span>{\r\n       OrderEntity<\/span> orderEntity<\/span> =<\/span> new<\/span> OrderEntity<\/span>();\r\n       orderEntity.setOrderName(orderEntityDto.getOrderName());\r\n       orderEntity.setOrderType(orderEntityDto.getOrderType());\r\n        orderEntityRepository.save(orderEntity);\r\n       return<\/span> ResponseEntity.ok(orderEntity);\r\n    }\r\n\r\n    @GetMapping(\"\/allorders\")<\/span>\r\n    public<\/span> ResponseEntity<List<OrderEntity>> saveOrderEntity<\/span>()<\/span>{\r\n        var<\/span> query<\/span>  =<\/span>entityManager.createNativeQuery(\"\"\"\r\n                    select id, \r\n                    order_name,\r\n                    order_type,\r\n                    if(order_type = '1','FullFilled','Cancelled') from order_entity ; \r\n            \"\"\"<\/span>);\r\n        \/\/ deliberately used if function which is native to mysql<\/span>\r\n        \/\/ not available in h2 db.<\/span>\r\n       var<\/span> resultList<\/span> =<\/span> (List<Object[]>) query.getResultList();\r\n       List<OrderEntity> list = new<\/span> ArrayList<\/span><>();\r\n       for<\/span>(Object[] object : resultList){\r\n           var<\/span> id<\/span> =<\/span> Long.valueOf(object[0<\/span>].toString());\r\n           var<\/span> orderName<\/span> =<\/span> object[1<\/span>].toString();\r\n           var<\/span> orderType<\/span> =<\/span> Long.valueOf(object[2<\/span>].toString());\r\n           var<\/span> orderTypeDesc<\/span> =<\/span> object[3<\/span>].toString();\r\n           OrderEntity<\/span> orderEntity<\/span> =<\/span> new<\/span> OrderEntity<\/span>();\r\n           orderEntity.setId(id);\r\n           orderEntity.setOrderTypeDes(orderTypeDesc);\r\n           orderEntity.setOrderType(orderType);\r\n           list.add(orderEntity);\r\n       }\r\n       return<\/span> ResponseEntity.ok(list);\r\n    }<\/span><\/pre>\n
We would be writing integration test cases for the above Controller\u2019s methods.<\/p>\n
In OrderControllerTest.java we will first configure our MySQL test container.<\/p>\n
@SpringBootTest(webEnvironment = SpringBootTest.WebEnvironment.RANDOM_PORT)<\/span>\r\n@AutoConfigureWebTestClient<\/span>\r\n@Testcontainers<\/span>\r\nclass<\/span> OrderControllerTest<\/span> {\r\n\r\n    static<\/span> final<\/span> MySQLContainer MY_SQL_CONTAINER;\r\n\r\n    @Autowired<\/span>\r\n    WebTestClient webTestClient;\r\n\r\n    @Autowired<\/span>\r\n    private<\/span> OrderEntityRepository  orderEntityRepository;\r\n\r\n    static<\/span> {\r\n        MY_SQL_CONTAINER = new<\/span> MySQLContainer<\/span>(\"mysql:latest\"<\/span>);\r\n        MY_SQL_CONTAINER.start();\r\n    }<\/span><\/pre>\n
We need first to annotate our Test class with @Testcontainers, and then in the static block, we have to create a new MySQLContainer with the latest MySQL Docker image. For the first time, it will pull the MySQL image with the tag \u201clatest.\u201d Docker should be installed on your system to work with containers.<\/p>\n
And then, we start the MySQL container with a start () method. When the test cases are finished, this MySQL container will be stopped and removed from Docker\u2019s list. Just like in-memory H2, the container will be up and tear down on the test exit.<\/p>\n
We need to tell Spring Boot about the properties of this database for the test container, and Spring has a nice way to do this.<\/p>\n
@DynamicPropertySource<\/span>\r\n    static<\/span> void<\/span> configureTestProperties<\/span>(DynamicPropertyRegistry registry)<\/span>{\r\n        registry.add(\"spring.datasource.url\"<\/span>,() -> MY_SQL_CONTAINER.getJdbcUrl());\r\n        registry.add(\"spring.datasource.username\"<\/span>,() -> MY_SQL_CONTAINER.getUsername());\r\n        registry.add(\"spring.datasource.password\"<\/span>,() -> MY_SQL_CONTAINER.getPassword());\r\n        registry.add(\"spring.jpa.hibernate.ddl-auto\"<\/span>,() -> \"create\"<\/span>);\r\n\r\n    }<\/span><\/pre>\n
Let\u2019s setup the BeforeEach and AfterEach for this test case.<\/p>\n
 @BeforeEach<\/span>\r\n    public<\/span> void<\/span> beforeEach<\/span>()<\/span>{\r\n        OrderEntity<\/span> orderEntity<\/span> =<\/span> new<\/span> OrderEntity<\/span>();\r\n        orderEntity.setOrderType(1L<\/span>);\r\n        orderEntity.setOrderName(\"order-1\"<\/span>);\r\n        orderEntityRepository.save(orderEntity);\r\n    }\r\n    @AfterEach<\/span>\r\n    public<\/span> void<\/span> afterEach<\/span>()<\/span>{\r\n        orderEntityRepository.deleteAll();\r\n    }<\/span><\/pre>\n
Let’s write the test case for the save method<\/p>\n
@Test<\/span>\r\n    void<\/span> saveOrderEntity<\/span>()<\/span> {\r\n        OrderEntity<\/span> orderEntity<\/span> =<\/span> new<\/span> OrderEntity<\/span>();\r\n        orderEntity.setOrderType(1L<\/span>);\r\n        orderEntity.setOrderName(\"order-2\"<\/span>);\r\n        webTestClient.post()\r\n                .uri(\"\/save\"<\/span>)\r\n                .bodyValue(orderEntity)\r\n                .exchange()\r\n                .expectHeader()\r\n                .contentType(MediaType.APPLICATION_JSON)\r\n                .expectStatus()\r\n                .is2xxSuccessful()\r\n                .expectBody(OrderEntity.class)\r\n                .consumeWith(orderentity -> Assertions.assertNotNull(orderentity.getResponseBody().getId()));\r\n    }<\/span><\/pre>\n
And now for get method<\/p>\n
  @Test<\/span>\r\n    void<\/span> getOrderEntity<\/span>()<\/span> {\r\n        webTestClient.get()\r\n                .uri(\"\/allorders\"<\/span>)\r\n                .exchange()\r\n                .expectHeader()\r\n                .contentType(MediaType.APPLICATION_JSON)\r\n                .expectStatus()\r\n                .is2xxSuccessful()\r\n                .expectBodyList(OrderEntity.class)\r\n                .consumeWith(listOfObject ->{\r\n                   var<\/span> list<\/span>  =<\/span> listOfObject.getResponseBody();\r\n                    Assertions.assertTrue(list.size() == 1<\/span>);\r\n                    Assertions.assertTrue(list.get(0<\/span>).getOrderTypeDes().equals(\"FullFilled\"<\/span>));\r\n                });\r\n    }<\/span><\/pre>\n
When we run the test cases, the MySQL image will be pulled when running for the first time, and lots of logs will be generated. Test containers have provided recommended logback.xml to get rid of verbosity.<\/p>\n
Here is the logback-test.xml that can be included in the resource folder.<\/p>\n
<configuration<\/span>><\/span>\r\n    <appender<\/span> name<\/span>=\"STDOUT\"<\/span> class<\/span>=\"ch.qos.logback.core.ConsoleAppender\"<\/span>><\/span>\r\n        <encoder<\/span>><\/span>\r\n            <pattern<\/span>><\/span>%d{HH:mm:ss.SSS} [%thread] %-5level %logger - %msg%n<\/pattern<\/span>><\/span>\r\n        <\/encoder<\/span>><\/span>\r\n    <\/appender<\/span>><\/span>\r\n\r\n    <root<\/span> level<\/span>=\"info\"<\/span>><\/span>\r\n        <appender-ref<\/span> ref<\/span>=\"STDOUT\"<\/span>\/><\/span>\r\n    <\/root<\/span>><\/span>\r\n\r\n    <logger<\/span> name<\/span>=\"org.testcontainers\"<\/span> level<\/span>=\"INFO\"<\/span>\/><\/span>\r\n    <logger<\/span> name<\/span>=\"com.github.dockerjava\"<\/span> level<\/span>=\"WARN\"<\/span>\/><\/span>\r\n    <logger<\/span> name<\/span>=\"com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.wire\"<\/span> level<\/span>=\"OFF\"<\/span>\/><\/span>\r\n<\/configuration<\/span>><\/span><\/span><\/pre>\n
We can see that the MySQL test container has started. We can see the Docker whale icon as well.<\/p>\n
\n
\n
\"\"<\/div>\n<\/div>\n<\/figure>\n
I like test containers a lot, as I write great test cases that mimic my production environment. I am quite confident when my code goes into production.<\/p>\n
Please find the code on my GitHub link: https:\/\/github.com\/anilgola90\/testcontainers<\/p>\n
Feel free to ask your questions in the comment section below.<\/p>\n
<\/div>","protected":false},"excerpt":{"rendered":"
Developers get confused over the priority of unit test cases and integration test cases. Though both are important, when we are building services for clients, we are on a tight schedule, so completing the development is itself a challenge, let alone writing test cases. I always strive to write test cases, irrespective of the time […]<\/p>\n","protected":false},"author":1520,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":136},"categories":[446],"tags":[5157,5158],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/57006"}],"collection":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/users\/1520"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/comments?post=57006"}],"version-history":[{"count":7,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/57006\/revisions"}],"predecessor-version":[{"id":59697,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/57006\/revisions\/59697"}],"wp:attachment":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/media?parent=57006"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/categories?post=57006"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/tags?post=57006"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}