{"id":96,"date":"2024-08-27T04:00:00","date_gmt":"2024-08-27T04:00:00","guid":{"rendered":"https:\/\/imcodinggenius.com\/?p=96"},"modified":"2024-08-27T04:00:00","modified_gmt":"2024-08-27T04:00:00","slug":"sending-spring-boot-metrics-to-datadog","status":"publish","type":"post","link":"https:\/\/imcodinggenius.com\/?p=96","title":{"rendered":"Sending Spring Boot Metrics to Datadog"},"content":{"rendered":"

Hello and welcome to the next article in which we will briefly discuss Datadog and Micrometer, but what\u2019s more important- we will learn how to send Spring Boot metrics<\/strong> to Datadog in practice<\/strong>.<\/p>\n

Moreover, we will take a quick look into the Spring Boot Actuator and how it can help us, so, to let\u2019s not waste our time and let\u2019s get to work! <\/p>\n

Video Tutorial<\/h2>\n

If you prefer video content<\/strong>, then check out my video:<\/p>\n

\n

<\/span><\/p>\n

<\/div>\n

<\/p>\n<\/div>\n

If you find this content useful, please leave a subscription<\/strong> <\/p>\n

Datadog<\/h2>\n

If you came here directly, then I bet you already know what Datadog<\/a> is and what purpose it will serve in your project.<\/p>\n

However, for those who hear about it for the first time, let me give you a really short intro.<\/p>\n

Long story short- Datadog is an integrated platform for monitoring & security<\/strong>. It provides tools for monitoring applications, databases, distributed tracing, logs management, and many many more. In other words, makes all the things that are not so cool, but necessary in production-ready environments, a bit less painful <\/p>\n

However, what is the most important for us today- it provides tools to collect metrics<\/strong> from our applications so that later we can make use of them.<\/p>\n

But, what are they? <\/p>\n

What Are Metrics? <\/h2>\n

According to the Datadog documentation:<\/p>\n

Metrics are numerical values that can track anything about your environment over time.<\/p>\n

And I must admit- I love this definition for its completeness in its simplicity.<\/p>\n

Because basically, metric<\/strong> is everything in our system that we can assign a number to and track. From Garbage Collector stats, JVM memory, CPU, and request latency, to the average cart size. Literally everything.<\/p>\n

And in this tutorial, we will see how to send metrics collected automatically<\/strong> by our Spring Boot app to DataDog.<\/p>\n

Create New Project<\/h2>\n

As the first step, let\u2019s navigate to the Spring Initializr page<\/a>, select the following and import the project to our IDE:<\/p>\n

\n<\/div>\n

Apart from versions and metadata, we can see that we added two dependencies: Spring Web<\/strong> and Spring Boot Actuator.<\/strong> <\/p>\n

The first one is quite obvious, but in terms of metrics Spring Boot Actuator provides dependency management and auto-configuration for Micrometer<\/strong> \u2013 a vendor-neutral application observability facade. <\/p>\n

With that, Spring Boot takes care of configuring MeterRegistry and the only thing we need to do is to add the micrometer-registry-{system} dependency to the build.gradle.kts :<\/p>\n

implementation(«io.micrometer:micrometer-registry-datadog»)<\/p>\n

Note:<\/strong> we could achieve exactly the same using the Spring Initializr page and searching for the Datadog dependency, but I wanted to emphasize the fact, that other vendors, like Elastic, or OpenTelemetry can be added in the same manner. <\/p>\n

Verify and Expose Metrics Endpoint<\/h2>\n

After we import our project, let\u2019s run it, and let\u2019s take a look at the endpoints exposed by default by Spring Boot Actuator: <\/p>\n

curl —location —request GET ‘http:\/\/localhost:8080\/actuator’ <\/p>\n

As a result, we should see the following: <\/p>\n

{
\n «_links»: {
\n «self»: {
\n «href»: «http:\/\/localhost:8080\/actuator»,
\n «templated»: false
\n },
\n «health»: {
\n «href»: «http:\/\/localhost:8080\/actuator\/health»,
\n «templated»: false
\n },
\n «health-path»: {
\n «href»: «http:\/\/localhost:8080\/actuator\/health\/{*path}»,
\n «templated»: true
\n }
\n }
\n}<\/p>\n

And the first lesson is that the metrics endpoint is not exposed by default.<\/strong><\/p>\n

So to change that, let\u2019s navigate to the application.yaml and add the following:<\/p>\n

management:
\n endpoints:
\n web:
\n exposure:
\n include: metrics, health<\/p>\n

After that, let\u2019s rerun the application. <\/p>\n

As a result, this time, we should see that two new endpoints are present: <\/p>\n

{
\n «_links»: {
\n «self»: {
\n «href»: «http:\/\/localhost:8080\/actuator»,
\n «templated»: false
\n },
\n «health»: {
\n «href»: «http:\/\/localhost:8080\/actuator\/health»,
\n «templated»: false
\n },
\n «health-path»: {
\n «href»: «http:\/\/localhost:8080\/actuator\/health\/{*path}»,
\n «templated»: true
\n },
\n «metrics-requiredMetricName»: {
\n «href»: «http:\/\/localhost:8080\/actuator\/metrics\/{requiredMetricName}»,
\n «templated»: true
\n },
\n «metrics»: {
\n «href»: «http:\/\/localhost:8080\/actuator\/metrics»,
\n «templated»: false
\n }
\n }
\n}<\/p>\n

The last one- \/actuator\/metrics\u2013 simply displays a list of available meter names<\/strong>, and when we invoke it, we should see the following JSON response: <\/p>\n

{
\n «names»: [
\n «application.ready.time»,
\n «application.started.time»,
\n «disk.free»,
\n «disk.total»,
\n «executor.active»,
\n «executor.completed»,
\n «executor.pool.core»,
\n «executor.pool.max»,
\n «executor.pool.size»,
\n «executor.queue.remaining»,
\n «executor.queued»,
\n «http.server.requests»,
\n «http.server.requests.active»,
\n «jvm.buffer.count»,
\n «jvm.buffer.memory.used»,
\n «jvm.buffer.total.capacity»,
\n «jvm.classes.loaded»,
\n «jvm.classes.unloaded»,
\n «jvm.compilation.time»,
\n «jvm.gc.concurrent.phase.time»,
\n «jvm.gc.live.data.size»,
\n «jvm.gc.max.data.size»,
\n «jvm.gc.memory.allocated»,
\n «jvm.gc.memory.promoted»,
\n «jvm.gc.overhead»,
\n «jvm.gc.pause»,
\n «jvm.info»,
\n «jvm.memory.committed»,
\n «jvm.memory.max»,
\n «jvm.memory.usage.after.gc»,
\n «jvm.memory.used»,
\n «jvm.threads.daemon»,
\n «jvm.threads.live»,
\n «jvm.threads.peak»,
\n «jvm.threads.started»,
\n «jvm.threads.states»,
\n «logback.events»,
\n «process.cpu.time»,
\n «process.cpu.usage»,
\n «process.start.time»,
\n «process.uptime»,
\n «system.cpu.count»,
\n «system.cpu.usage»,
\n «tomcat.sessions.active.current»,
\n «tomcat.sessions.active.max»,
\n «tomcat.sessions.alive.max»,
\n «tomcat.sessions.created»,
\n «tomcat.sessions.expired»,
\n «tomcat.sessions.rejected»
\n ]
\n}<\/p>\n

In simple words, this is the list of all metrics collected at this point by our Spring Boot application. And yes- we will be able to export them to Datadog. <\/p>\n

Nevertheless, let\u2019s verify what the second endpoint- \/actuator\/metrics\/{requiredMetricName}\u2013 does.<\/p>\n

To do that, let\u2019s make a GET request and specify any metric name:<\/p>\n

curl —location —request GET ‘http:\/\/localhost:8080\/actuator\/metrics\/process.cpu.usage’<\/p>\n

This time, the endpoint will return metric details along with the current value<\/strong>:<\/p>\n

{
\n «name»: «process.cpu.usage»,
\n «description»: «The «recent cpu usage» for the Java Virtual Machine process»,
\n «measurements»: [
\n {
\n «statistic»: «VALUE»,
\n «value»: 0.038209510879134205
\n }
\n ],
\n «availableTags»: []
\n}<\/p>\n

Create Datadog Account<\/h2>\n

Excellent! At this point, we are sure that our Spring Boot app collects metrics, so it\u2019s time to proceed with the Datadog part. <\/p>\n

If you haven\u2019t done it yet, then let\u2019s create a trial account together. <\/p>\n

Let\u2019s navigate to the https:\/\/www.datadoghq.com\/<\/a> and click the \u201cFree trial\u201d button:<\/p>\n

\n<\/div>\n

Following, let\u2019s fill out the signup form: <\/p>\n

\n<\/div>\n

And with that done, when we confirm our e-mail address, we will land on this page: <\/p>\n

As we can see, the above page contains a bunch of guides on how to set up the agent. <\/p>\n

And although we are not interested in any of those, this page has one, valuable information for us- the API key<\/strong>. <\/p>\n

Note:<\/strong> I think that readers of this blog are well aware of that, but for my own peace of mind- API keys are vulnerable data, so you must be cautious<\/strong> with them! <\/p>\n

At this point, please copy this value and we will use it in the proceeding steps. <\/p>\n

Configure App To Send Metrics<\/h2>\n

When we have our Datadog account ready, we can finally configure our app. <\/p>\n

API Key<\/h3>\n

Firstly, let\u2019s get back to our Spring Boot project and update the application.yaml :<\/p>\n

management:
\n endpoints:
\n web:
\n exposure:
\n include: metrics, health
\n datadog:
\n metrics:
\n export:
\n api-key: YOUR_KEY_VALUE<\/p>\n

Of course, we must replace the YOUR_KEY_VALUE with the actual API key. <\/p>\n

Update Datadog URI <\/h3>\n

If you are using Datadog US (the option you could select when signing up), then that\u2019s pretty much it and you can restart the application.<\/p>\n

By default, metrics are sent to the Datadog US site (api.datadoghq.com). If your Datadog project is hosted on one of the other sites, or you need to send metrics through a proxy, configure the URI accordingly.<\/p>\n

So given the above, if we use another region, then we need to add one more line: <\/p>\n

management:
\n endpoints:
\n web:
\n exposure:
\n include: metrics, health
\n datadog:
\n metrics:
\n export:
\n api-key: YOUR_KEY_VALUE
\n uri: https:\/\/api.datadoghq.eu<\/p>\n

Update Metrics Upload Interval<\/h3>\n

Following, let\u2019s see how easily we can update the interval, in which data are sent to Datadog: <\/p>\n

management:
\n endpoints:
\n web:
\n exposure:
\n include: metrics, health
\n datadog:
\n metrics:
\n export:
\n api-key: YOUR_KEY_VALUE
\n uri: https:\/\/api.datadoghq.eu
\n step: 10s<\/p>\n

The default value is 30 seconds<\/strong>. And to change that, the only thing we need to do is to add the step value. <\/p>\n

Set Spring Logging Level to DEBUG<\/h3>\n

As the last thing, which technically is not directly related to sending metrics, I would like to add the following to the root of our application.yaml file: <\/p>\n

logging:
\n level:
\n root: DEBUG<\/p>\n

This way we set the logging level in our Spring Boot application to DEBUG. <\/p>\n

Why? It will be useful in a moment when we will be testing our implementation. <\/p>\n

Testing <\/h2>\n

With all of that done, we can finally verify that everything is working properly. <\/p>\n

Verify Spring Boot Sends Data to Datadog<\/h3>\n

Firstly, let\u2019s rerun our application and take a look at the logs.<\/p>\n

If we see the following: <\/p>\n

i.m.datadog.DatadogMeterRegistry : successfully sent 78 metrics to datadog<\/p>\n

Then data are successfully sent to the Datadog API. <\/p>\n

Let\u2019s leave it running for some time (like 2 minutes, or something), so that we have actual data later to work with <\/p>\n

Review Metrics in Datadog <\/h2>\n

After that time, the only thing left is to take a look at metrics in Datadog. <\/p>\n

If we haven\u2019t closed the Datadog \u201cAgent Setup\u201d page, then it should automatically close and redirect us to the dashboard. <\/p>\n

However, if that didn\u2019t happen, then no worries, we can simply navigate to the metrics summary page<\/a>: <\/p>\n

\n<\/div>\n

On this page, we can see all the metrics that have been gathered so far. Long story short, this page contains meta-information about metrics themselves, like tags, etc. <\/p>\n

I strongly recommend you spend here some time and figure out different options. <\/p>\n

And if we would like to take a look at the actual values, then let\u2019s navigate to the metrics explorer<\/a>: <\/p>\n

\n<\/div>\n

I know, the image is quite small (the \u201cOpen Image in New Tab\u201d option will help here ). However, the only thing we need to do here is to specify the metric name in the left upper part and the period we would like to view in the right upper part. <\/p>\n

After that, we will see the above chart. <\/p>\n

And basically, that\u2019s how metrics work with Spring Boot and Datadog, but please don\u2019t close this article yet, I wanted to show you two, interesting things that may be useful to you in real life. <\/p>\n

Sending Custom Tags <\/h2>\n

Tags<\/strong> are nothing else, than additional metadata you can send with metrics. <\/p>\n

Why are they useful? Well, thanks to them we can later differentiate different metrics. For example, we can send a tag with the application name, so that later we will group metrics by microservices, or environment value, like dev, staging, or prod. <\/p>\n

In Spring Boot, we have several ways to achieve that. And probably the easiest way is to (again) update the application.yaml:<\/p>\n

management:
\n endpoints:
\n web:
\n exposure:
\n include: metrics, health
\n datadog:
\n metrics:
\n export:
\n api-key: YOUR_KEY_VALUE
\n uri: https:\/\/api.datadoghq.eu
\n step: 10s
\n metrics:
\n tags:
\n application: «my-app-one»<\/p>\n

As we can see, we can add a custom tag by using metrics.tags and specifying that as a key-value pair. In our case- the application tag has the my-app-one value. <\/p>\n

This approach is not only straightforward but also quite flexible. We could always put a placeholder for the environment variable instead of the hardcoded value. <\/p>\n

Anyway, when we rerun our application and let Spring send some metrics to the Datadog, we will see that from now on we can filter values using the \u201cfrom\u201d field:<\/strong><\/p>\n

Again, the \u201cOpen Image in New Tab\u201d may be helpful here <\/p>\n

Turn Off Metrics Export<\/h2>\n

As the last thing, let\u2019s take a look at how we can instruct our Spring app to stop sending metrics to Datadog<\/strong>.<\/p>\n

Again, let\u2019s navigate to the application.yaml file and set the enabled flag to false: <\/p>\n

management:
\n endpoints:
\n web:
\n exposure:
\n include: metrics, health
\n datadog:
\n metrics:
\n export:
\n enabled: false
\n api-key: YOURE_KEY_VALUE
\n uri: https:\/\/api.datadoghq.eu
\n step: 10s<\/p>\n

Of course, we can use an environment variable placeholder (like ${DATADOG_ENABLED}) and turn on\/off export in different environments. <\/p>\n

Summary <\/h2>\n

That\u2019s all for this tutorial on how to send Spring Boot metrics to Datadog<\/strong>. <\/p>\n

As always, you can find the source code in this GitHub repository<\/a>.<\/p>\n

Have a great day and don\u2019t forget to leave a comment<\/strong>! <\/p>\n

The post Sending Spring Boot Metrics to Datadog<\/a> appeared first on Codersee | Kotlin, Ktor, Spring<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

Hello and welcome to the next article in which we will briefly discuss Datadog and Micrometer, but what\u2019s more important- we will learn how to send Spring Boot metrics to Datadog in practice. Moreover, we will take a quick look into the Spring Boot Actuator and how it can help … <\/p>\n

Read More<\/a><\/div>\n","protected":false},"author":1,"featured_media":97,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-96","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/posts\/96"}],"collection":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=96"}],"version-history":[{"count":0,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/posts\/96\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/media\/97"}],"wp:attachment":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=96"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=96"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=96"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}