{"id":57418,"date":"2023-05-22T16:41:01","date_gmt":"2023-05-22T11:11:01","guid":{"rendered":"https:\/\/www.tothenew.com\/blog\/?p=57418"},"modified":"2024-01-02T17:41:22","modified_gmt":"2024-01-02T12:11:22","slug":"embracing-virtual-threads-in-spring-boot","status":"publish","type":"post","link":"https:\/\/www.tothenew.com\/blog\/embracing-virtual-threads-in-spring-boot\/","title":{"rendered":"Embracing Virtual Threads in Spring Boot"},"content":{"rendered":"
\n
\n
\"\"<\/div>\n<\/div>\n<\/figure>\n

In this blog, we will see how we can take leverage of project loom virtual threads in spring-boot. We will also do some load testing with the help of\u00a0JMeter<\/strong> and see how response time is for both virtual threads and normal threads.<\/p>\n

Let\u2019s quickly setup our spring boot project.<\/p>\n

<?xml version=\"1.0\"<\/span> encoding=\"UTF-8\"<\/span>?><\/span>\r\n<project<\/span> xmlns<\/span>=\"http:\/\/maven.apache.org\/POM\/4.0.0\"<\/span> xmlns:xsi<\/span>=\"http:\/\/www.w3.org\/2001\/XMLSchema-instance\"<\/span>\r\nxsi:schemaLocation<\/span>=\"http:\/\/maven.apache.org\/POM\/4.0.0 https:\/\/maven.apache.org\/xsd\/maven-4.0.0.xsd\"<\/span>><\/span>\r\n<<\/span>modelVersion<\/span><\/span><\/mark>><\/span>4.0.0<\/modelVersion<\/span>><\/span>\r\n<parent<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-parent<\/artifactId<\/span>><\/span>\r\n<version<\/span>><\/span>3.1.0<\/version<\/span>><\/span>\r\n<relativePath<\/span>\/><\/span> <!-- lookup parent from repository --><\/span>\r\n<\/parent<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.anil<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>virtualthread<\/artifactId<\/span>><\/span>\r\n<version<\/span>><\/span>0.0.1-SNAPSHOT<\/version<\/span>><\/span>\r\n<name<\/span>><\/span>virtualthread<\/name<\/span>><\/span>\r\n<description<\/span>><\/span>virtualthread<\/description<\/span>><\/span>\r\n<properties<\/span>><\/span>\r\n<java.version<\/span>><\/span>20<\/java.version<\/span>><\/span>\r\n<tomcat.version<\/span>><\/span>11.0.0-M4<\/tomcat.version<\/span>><\/span>\r\n<\/properties<\/span>><\/span>\r\n<dependencies<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-data-jpa<\/artifactId<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<!-- https:\/\/mvnrepository.com\/artifact\/org.apache.commons\/commons-lang3 --><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.apache.commons<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>commons-lang3<\/artifactId<\/span>><\/span>\r\n<version<\/span>><\/span>3.12.0<\/version<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n\r\n<!-- https:\/\/mvnrepository.com\/artifact\/mysql\/mysql-connector-java --><\/span>\r\n\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>mysql<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>mysql-connector-java<\/artifactId<\/span>><\/span>\r\n<scope<\/span>><\/span>runtime<\/scope<\/span>><\/span>\r\n<version<\/span>><\/span>8.0.33<\/version<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n\r\n\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-web<\/artifactId<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-starter-test<\/artifactId<\/span>><\/span>\r\n<scope<\/span>><\/span>test<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<dependency<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.projectlombok<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>lombok<\/artifactId<\/span>><\/span>\r\n<version<\/span>><\/span>1.18.24<\/version<\/span>><\/span>\r\n<scope<\/span>><\/span>compile<\/scope<\/span>><\/span>\r\n<\/dependency<\/span>><\/span>\r\n<\/dependencies<\/span>><\/span>\r\n\r\n<build<\/span>><\/span>\r\n<plugins<\/span>><\/span>\r\n<plugin<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.springframework.boot<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>spring-boot-maven-plugin<\/artifactId<\/span>><\/span>\r\n<\/plugin<\/span>><\/span>\r\n<plugin<\/span>><\/span>\r\n<groupId<\/span>><\/span>org.apache.maven.plugins<\/groupId<\/span>><\/span>\r\n<artifactId<\/span>><\/span>maven-compiler-plugin<\/artifactId<\/span>><\/span>\r\n<configuration<\/span>><\/span>\r\n<compilerArgs<\/span>><\/span>\r\n<arg<\/span>><\/span>--enable-preview<\/arg<\/span>><\/span>\r\n<\/compilerArgs<\/span>><\/span>\r\n<source<\/span>><\/span>20<\/source<\/span>><\/span>\r\n<target<\/span>><\/span>20<\/target<\/span>><\/span>\r\n<\/configuration<\/span>><\/span>\r\n\r\n<\/plugin<\/span>><\/span>\r\n<\/plugins<\/span>><\/span>\r\n<\/build<\/span>><\/span>\r\n\r\n<\/project<\/span>><\/span>\r\n\r\n<\/pre>\n
We need to enable preview features since Project Loom is in the preview stage. We have to wait for Java 21\u2019s release for it to become a final feature.<\/p>\n
package org.anil<\/span>.virtualthread<\/span>;\r\n\r\nimport<\/span> lombok.extern<\/span>.slf4j<\/span>.Slf4j<\/span>;\r\nimport<\/span> org.springframework<\/span>.boot<\/span>.SpringApplication<\/span>;\r\nimport<\/span> org.springframework<\/span>.boot<\/span>.autoconfigure<\/span>.SpringBootApplication<\/span>;\r\nimport<\/span> org.springframework<\/span>.boot<\/span>.web<\/span>.embedded<\/span>.tomcat<\/span>.TomcatProtocolHandlerCustomizer<\/span>;\r\nimport<\/span> org.springframework<\/span>.context<\/span>.annotation<\/span>.Bean<\/span>;\r\n\r\nimport<\/span> java.util<\/span>.concurrent<\/span>.Executors<\/span>;\r\n\r\n@SpringBootApplication<\/span>\r\n@Slf4j<\/span>\r\npublic<\/span> class<\/span> VirtualthreadApplication<\/span> {\r\n\r\n    public<\/span> static<\/span> void<\/span> main<\/span>(String<\/span>[] args<\/span>) {\r\n        SpringApplication<\/span>.run<\/span>(VirtualthreadApplication<\/span>.class<\/span>, args);\r\n    }\r\n\r\n    @Bean<\/span>\r\n    public<\/span> TomcatProtocolHandlerCustomizer<\/span><?> protocolHandlerVirtualThreadExecutorCustomizer<\/span>() {\r\n        return<\/span> protocolHandler -> {\r\n            log.info<\/span>(\"Configuring \"<\/span> + protocolHandler + \" to use VirtualThreadPerTaskExecutor\"<\/span>);\r\n            protocolHandler.setExecutor<\/span>(Executors<\/span>.newVirtualThreadPerTaskExecutor<\/span>());\r\n        };\r\n    }\r\n\r\n}<\/span><\/pre>\n
As of now, we need to configure virtual thread settings for the Tomcat server. In the future, this may be taken care of in auto-configuration itself.<\/p>\n
package<\/span> org.anil.virtualthread;\r\n\r\nimport<\/span> org.apache.commons.lang3.RandomStringUtils;\r\nimport<\/span> org.apache.commons.lang3.RandomUtils;\r\nimport<\/span> org.springframework.beans.factory.annotation.Autowired;\r\nimport<\/span> org.springframework.web.bind.annotation.GetMapping;\r\nimport<\/span> org.springframework.web.bind.annotation.PostMapping;\r\nimport<\/span> org.springframework.web.bind.annotation.RestController;\r\n\r\nimport<\/span> java.util.List;\r\n\r\n@RestController<\/span>\r\npublic<\/span> class<\/span> HomeController<\/span> {\r\n\r\n    @Autowired<\/span>\r\n    ProductRepository productRepository;\r\n\r\n\r\n    @GetMapping(\"\/thread\")<\/span>\r\n    public<\/span> List<Product> checkThread<\/span>()<\/span> throws<\/span> InterruptedException {\r\n        Thread.sleep(1000<\/span>);\r\n        return<\/span> productRepository.findAll();\r\n    }\r\n\r\n\r\n    @PostMapping(\"\/save\")<\/span>\r\n    public<\/span> String saveProduct<\/span>()<\/span> throws<\/span> InterruptedException {\r\n        for<\/span>(int<\/span> i=0<\/span>; i< 1000<\/span>; i++){\r\n            Product<\/span> product<\/span> =<\/span> new<\/span> Product<\/span>();\r\n            product.setProductName(RandomStringUtils.randomAlphanumeric(5<\/span>));\r\n            product.setPrice(RandomUtils.nextLong(10<\/span>,1000<\/span>));\r\n            product.setPrice(1L<\/span>);\r\n            productRepository.save(product);\r\n        }\r\n        return<\/span> \"anil\"<\/span>;\r\n    }\r\n}<\/span><\/pre>\n
We have a\u00a0GetMapping<\/strong>\u00a0that returns all the products; we have 1000\u00a0Products<\/strong>\u00a0in our database.<\/p>\n
We have made our thread sleep for 1 second. Let\u2019s see our\u00a0Product<\/strong> entity and product repository<\/b>\u00a0as well.<\/p>\n
package<\/span> org.anil.virtualthread;\r\n\r\nimport<\/span> jakarta.persistence.Entity;\r\nimport<\/span> jakarta.persistence.GeneratedValue;\r\nimport<\/span> jakarta.persistence.GenerationType;\r\nimport<\/span> jakarta.persistence.Id;\r\nimport<\/span> lombok.Getter;\r\nimport<\/span> lombok.Setter;\r\n\r\n@Entity<\/span>\r\n@Getter<\/span>\r\n@Setter<\/span>\r\npublic<\/span> class<\/span> Product<\/span> {\r\n    @Id<\/span>\r\n    @GeneratedValue(strategy = GenerationType.IDENTITY)<\/span>\r\n    private<\/span> Long<\/span> id;\r\n    private<\/span> String productName;\r\n    private<\/span> Long<\/span> price;\r\n}<\/span><\/pre>\n
package<\/span> org.anil.virtualthread;\r\n\r\nimport<\/span> org.springframework.data.jpa.repository.JpaRepository;\r\n\r\npublic<\/span> interface<\/span> ProductRepository<\/span> extends<\/span> JpaRepository<\/span><Product,Long> {\r\n}<\/span><\/pre>\n
Let\u2019s see our application.yaml<\/p>\n
spring:<\/span>\r\n  datasource:<\/span>\r\n    driver-class-name:<\/span> com.mysql.cj.jdbc.Driver<\/span>\r\n    maxIdle:<\/span> 1<\/span>\r\n    timeBetweenEvictionRunsMillis:<\/span> 60000<\/span>\r\n    hikari:<\/span>\r\n      connection-timeout:<\/span> 60000<\/span>\r\n      maximum-pool-size:<\/span> 10<\/span>\r\n      minimum-idle:<\/span> 5<\/span>\r\n    url:<\/span> jdbc:mysql:\/\/localhost:3306\/todos<\/span>\r\n    testWhileIdle:<\/span> true<\/span>\r\n    username:<\/span> root<\/span>\r\n    password:<\/span> root1234<\/span>\r\n    validationQuery:<\/span> SELECT<\/span> 1<\/span>\r\n  flyway:<\/span>\r\n    baseline-version:<\/span> 0<\/span>\r\n    enabled:<\/span> true<\/span>\r\n    validate-on-migrate:<\/span> false<\/span>\r\n  jpa:<\/span>\r\n    database:<\/span> mysql<\/span>\r\n    generate-ddl:<\/span> true<\/span>\r\n    hibernate:<\/span>\r\n      ddl-auto:<\/span> none<\/span>\r\n      format_sql:<\/span> true<\/span>\r\n    show-sql:<\/span> true<\/span><\/span><\/pre>\n
Let\u2019s first run the application by commenting on the following line: This will run our application on normal threads.<\/p>\n
package<\/span> org.anil.virtualthread;\r\n\r\nimport<\/span> lombok.extern.slf4j.Slf4j;\r\nimport<\/span> org.springframework.boot.SpringApplication;\r\nimport<\/span> org.springframework.boot.autoconfigure.SpringBootApplication;\r\nimport<\/span> org.springframework.boot.web.embedded.tomcat.TomcatProtocolHandlerCustomizer;\r\nimport<\/span> org.springframework.context.annotation.Bean;\r\n\r\nimport<\/span> java.util.concurrent.Executors;\r\n\r\n@SpringBootApplication<\/span>\r\n@Slf4j<\/span>\r\npublic<\/span> class<\/span> VirtualthreadApplication<\/span> {\r\n\r\n    public<\/span> static<\/span> void<\/span> main<\/span>(String[] args)<\/span> {\r\n        SpringApplication.run(VirtualthreadApplication.class, args);\r\n    }\r\n\r\n\/\/    @Bean<\/span>\r\n\/\/    public TomcatProtocolHandlerCustomizer<?> protocolHandlerVirtualThreadExecutorCustomizer() {<\/span>\r\n\/\/        return protocolHandler -> {<\/span>\r\n\/\/            log.info(\"Configuring \" + protocolHandler + \" to use VirtualThreadPerTaskExecutor\");<\/span>\r\n\/\/            protocolHandler.setExecutor(Executors.newVirtualThreadPerTaskExecutor());<\/span>\r\n\/\/        };<\/span>\r\n\/\/    }<\/span>\r\n}<\/span><\/pre>\n
Now let\u2019s setup our\u00a0JMeter<\/strong>. We will have 1000 requests, which will ramp up in 3 seconds. And it will continue like this for a duration of 200 seconds. Every 3 seconds, 1000 GET (\u201c\/thread\u201d) requests will be fired. We have also added a Response Time Graph Listener.<\/p>\n
\n
\n
\"\"<\/div>\n<\/div>\n<\/figure>\n
Now let\u2019s run our test and wait for 200 seconds.<\/p>\n
\n
\n
\"\"<\/div>\n<\/div>\n<\/figure>\n
In the graph, we can see that once the entire thread pool of Tomcat is utilised, the response time shoots from 3600 ms to 5200 ms. Since then, it has remained like that only as previous threads are released.<\/p>\n
Now let\u2019s run a load test with the virtual thread feature enabled.<\/p>\n
package org.anil<\/span>.virtualthread<\/span>;\r\n\r\nimport<\/span> lombok.extern<\/span>.slf4j<\/span>.Slf4j<\/span>;\r\nimport<\/span> org.springframework<\/span>.boot<\/span>.SpringApplication<\/span>;\r\nimport<\/span> org.springframework<\/span>.boot<\/span>.autoconfigure<\/span>.SpringBootApplication<\/span>;\r\nimport<\/span> org.springframework<\/span>.boot<\/span>.web<\/span>.embedded<\/span>.tomcat<\/span>.TomcatProtocolHandlerCustomizer<\/span>;\r\nimport<\/span> org.springframework<\/span>.context<\/span>.annotation<\/span>.Bean<\/span>;\r\n\r\nimport<\/span> java.util<\/span>.concurrent<\/span>.Executors<\/span>;\r\n\r\n@SpringBootApplication<\/span>\r\n@Slf4j<\/span>\r\npublic<\/span> class<\/span> VirtualthreadApplication<\/span> {\r\n\r\n    public<\/span> static<\/span> void<\/span> main<\/span>(String<\/span>[] args<\/span>) {\r\n        SpringApplication<\/span>.run<\/span>(VirtualthreadApplication<\/span>.class<\/span>, args);\r\n    }\r\n\r\n    @Bean<\/span>\r\n    public<\/span> TomcatProtocolHandlerCustomizer<\/span><?> protocolHandlerVirtualThreadExecutorCustomizer<\/span>() {\r\n        return<\/span> protocolHandler -> {\r\n            log.info<\/span>(\"Configuring \"<\/span> + protocolHandler + \" to use VirtualThreadPerTaskExecutor\"<\/span>);\r\n            protocolHandler.setExecutor<\/span>(Executors<\/span>.newVirtualThreadPerTaskExecutor<\/span>());\r\n        };\r\n    }\r\n\r\n}<\/span><\/pre>\n
Now let\u2019s run our test and wait for 200 seconds.<\/p>\n
\n
\n
\"\"<\/div>\n<\/div>\n<\/figure>\n
Clearly, now the response time for concurrent 1000 requests is nearly just above 1000 ms and at some point, shoots up to 1400 seconds, which is far better than when we were using normal threads.<\/p>\n
Clearly, when we need to utilise the underlying CPU to the fullest, we should start embracing virtual threads in our application, and suddenly we can see that the throughput of our application has increased manifold for the same hardware.<\/p>\n
This is much better than switching to reactive programming, which means rewriting all your code, which is very hard to maintain and even harder to debug.<\/p>\n
Simply put, more users can use the application and get their response simultaneously as the first user.<\/p>\n
Looking for in-depth analysis and expert opinions? Check out our other resources<\/a> now.<\/p>\n
The original post link is https:\/\/medium.com\/@anil.java.story\/embracing-virtual-threads-in-spring-boot-4140d3b8a5a<\/a><\/p>\n
<\/div>","protected":false},"excerpt":{"rendered":"
In this blog, we will see how we can take leverage of project loom virtual threads in spring-boot. We will also do some load testing with the help of\u00a0JMeter and see how response time is for both virtual threads and normal threads. Let\u2019s quickly setup our spring boot project. <?xml version=”1.0″ encoding=”UTF-8″?> <project xmlns=”http:\/\/maven.apache.org\/POM\/4.0.0″ xmlns:xsi=”http:\/\/www.w3.org\/2001\/XMLSchema-instance” […]<\/p>\n","protected":false},"author":1520,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":58},"categories":[446],"tags":[1202,5234],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/57418"}],"collection":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/users\/1520"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/comments?post=57418"}],"version-history":[{"count":4,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/57418\/revisions"}],"predecessor-version":[{"id":59695,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/57418\/revisions\/59695"}],"wp:attachment":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/media?parent=57418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/categories?post=57418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/tags?post=57418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}