{"id":129,"date":"2024-09-17T05:00:00","date_gmt":"2024-09-17T05:00:00","guid":{"rendered":"https:\/\/imcodinggenius.com\/?p=129"},"modified":"2024-09-17T05:00:00","modified_gmt":"2024-09-17T05:00:00","slug":"spring-boot-with-kotlin-aws-s3-and-s3template","status":"publish","type":"post","link":"https:\/\/imcodinggenius.com\/?p=129","title":{"rendered":"Spring Boot with Kotlin, AWS S3, and S3Template"},"content":{"rendered":"

Welcome to the second article<\/strong> in a series dedicated to integrating a Spring Boot Kotlin app with AWS S3 <\/strong>Object Storage, in which we will learn how to make our lives easier with S3Template<\/strong>. <\/p>\n

Of course, I highly encourage you to take a look at other articles in this series, too: <\/p>\n

Spring Boot with AWS S3, S3Client and Kotlin<\/a><\/p>\n

What is S3Template? <\/h2>\n

Before we get our hands dirty with the code, let\u2019s take a second to understand better with S3Template is and how it can make our lives easier when integrating a Spring Boot app with S3. <\/p>\n

Let me quote the S3Template documentation here: <\/p>\n

Higher level abstraction over S3Client providing methods for the most common use cases.<\/p>\n

So, if you have already worked with, or you have seen my previous article with S3Client, then you saw that simple operations require some boilerplate. And that is exactly what S3Template solves. <\/p>\n

And as a note from my end, I just wanted to note S3Template handles only some subset of S3Client operations, so in our projects those two will rather coexist, instead of being each others alternatives. <\/p>\n

AWS S3Template Operations<\/h2>\n

With all of that said, let\u2019s get to work. <\/p>\n

Let\u2019s add the controller package and BucketController class to it. We will use it to expose a bunch of endpoints triggering various operations on S3 buckets and files. <\/p>\n

When it comes to the operations- we will use the same ones as in the previous article, and as the last one, I will show you how to serialize and deserialize objects with AWS S3 and S3Template.<\/strong><\/p>\n

List All Buckets<\/h3>\n

Although the S3Template does not expose any method that would help us with this task, I wanted to mention it as we discussed it in the previous tutorial. <\/p>\n

Additionally, this is a great example of S3Client and S3Template co-existence: <\/p>\n

@RestController
\n@RequestMapping(«\/buckets»)
\nclass BucketController(
\n private val s3Template: S3Template,
\n private val s3Client: S3Client,
\n) {<\/p>\n

@GetMapping
\n fun listBuckets(): List<String> {
\n val response = s3Client.listBuckets()<\/p>\n

return response.buckets()
\n .mapIndexed { index, bucket ->
\n «Bucket #${index + 1}: ${bucket.name()}»
\n }
\n }
\n}<\/p>\n

As we can see, not too much S3Template could improve here, so I bet this is the reason why it was not introduced. <\/p>\n

New S3 Bucket<\/h3>\n

Nextly, let\u2019s take a look at how we can create a brand new bucket: <\/p>\n

@PostMapping
\nfun createBucket(@RequestBody request: BucketRequest) {
\n s3Template.createBucket(request.bucketName)
\n}<\/p>\n

data class BucketRequest(val bucketName: String)<\/p>\n

As we can see, no additional request classes- the only thing we need is the bucket name. <\/p>\n

Of course, let\u2019s rerun our application and verify if everything is working: <\/p>\n

curl —location —request POST ‘http:\/\/localhost:8080\/buckets’
\n—header ‘Content-Type: application\/json’
\n—data-raw ‘{
\n «bucketName»: «codersee-awesome-bucket»
\n}’<\/p>\n

As a result, we should get 200 OK without a response body. <\/p>\n

Upload File to S3 Bucket<\/h3>\n

Nextly, let\u2019s take a look at how to upload a new file to S3. <\/p>\n

We have a few options, among which the store function is the easiest: <\/p>\n

@PostMapping(«\/{bucketName}\/objects»)
\nfun createObject(@PathVariable bucketName: String, @RequestBody request: ObjectRequest) {
\n s3Template.store(bucketName, request.objectName, request.content)
\n}<\/p>\n

data class ObjectRequest(val objectName: String, val content: String)<\/p>\n

As we can see, this function takes three arguments: <\/p>\n

the bucket name, <\/p>\n

filename,<\/p>\n

and the content to upload (to be specific Object object) <\/p>\n

Alternatively, we could use the upload function, which allows us to send InputStream instance and metadata: <\/p>\n

@Override
\npublic S3Resource upload(
\n String bucketName,
\n String key,
\n InputStream inputStream,
\n @Nullable ObjectMetadata objectMetadata
\n) <\/p>\n

Lastly, let\u2019s verify that everything is fine with the following curl: <\/p>\n

curl —location —request POST ‘http:\/\/localhost:8080\/buckets\/codersee-awesome-bucket\/objects’
\n—header ‘Content-Type: application\/json’
\n—data-raw ‘{
\n «objectName»: «file-example.txt»,
\n «content»: «My file content»
\n}’<\/p>\n

If everything worked, then a new file should be present in our bucket <\/p>\n

List Files From The Bucket<\/h3>\n

Nextly, let\u2019s see how we can list the bucket content with S3Template<\/em>: <\/p>\n

@GetMapping(«\/{bucketName}\/objects»)
\nfun listObjects(@PathVariable bucketName: String): List<String> =
\n s3Template.listObjects(bucketName, «»)
\n .map { s3Resource -> s3Resource.filename }<\/p>\n

We can clearly see that this is not rocket science <\/p>\n

Nevertheless, it is worth mentioning that this time we get the S3Resource instance and instead of the key() we use it getFilename method. <\/p>\n

And just like previously, let\u2019s see the endpoint in action: <\/p>\n

curl —location —request POST ‘http:\/\/localhost:8080\/buckets\/codersee-awesome-bucket\/objects’
\n—header ‘Content-Type: application\/json’
\n—data-raw ‘{
\n «objectName»: «file-example.txt»,
\n «content»: «My file content»
\n}’<\/p>\n

# Response status: 200 OK
\n# Response body:
\n[
\n «file-example.txt»
\n]<\/p>\n

Download a File<\/h3>\n

So what about fetching files from the S3 bucket? <\/p>\n

With S3Template<\/em>, it\u2019s a piece of cake: <\/p>\n

@GetMapping(«\/{bucketName}\/objects\/{objectName}»)
\nfun getObject(@PathVariable bucketName: String, @PathVariable objectName: String): String =
\n s3Template.download(bucketName, objectName).getContentAsString(UTF_8)<\/p>\n

We specify the bucket name and the object name, and as a result, we get the S3Resource that exposes a bunch of methods. Among others, the getContentAsString that is pretty descriptive <\/p>\n

Similarly, let\u2019s hit the endpoint: <\/p>\n

curl —location —request GET ‘http:\/\/localhost:8080\/buckets\/codersee-awesome-bucket\/objects\/file-example.txt’<\/p>\n

# Response status: 200 OK
\n# Response body:
\n«My file content»<\/p>\n

Delete the Bucket<\/h3>\n

Last before least, let\u2019s take a look at how we can get rid of the bucket: <\/p>\n

@DeleteMapping(«\/{bucketName}»)
\nfun deleteBucket(@PathVariable bucketName: String) {
\n s3Template.listObjects(bucketName, «»)
\n .forEach { s3Template.deleteObject(bucketName, it.filename) }<\/p>\n

s3Template.deleteBucket(bucketName)
\n}<\/p>\n

And just like in the previous article- we must ensure the bucket does not contain any objects. <\/p>\n

To do so, we list out objects by specifying the bucket name and objects prefix (as we don\u2019t have any, we pass an empty String). Then, for each object, we use its key to delete it. And lastly, we simply invoke the deleteBucket by passing the name of a bucket to delete. <\/p>\n

Of course, let\u2019s verify this logic, too: <\/p>\n

curl —location —request DELETE ‘http:\/\/localhost:8080\/buckets\/codersee-awesome-bucket’<\/p>\n

If we run this command and the S3 bucket exists, then we should see 200 OK and our bucket will disappear. <\/p>\n

Serialize\/Deserialize objects <\/h3>\n

As the last thing, let\u2019s take a look at how easily we can persist objects using the combination of store and read functions: <\/p>\n

@PostMapping(«\/{bucketName}\/objects»)
\nfun createExampleObject(@PathVariable bucketName: String): Example {
\n val example = Example(id = UUID.randomUUID(), name = «Some name»)<\/p>\n

s3Template.store(bucketName, «example.json», example)<\/p>\n

return s3Template.read(bucketName, «example.json», Example::class.java)
\n}<\/p>\n

data class Example(val id: UUID, val name: String)<\/p>\n

As we can see, we made a small update to our POST \/{bucketName}\/objects endpoint logic. <\/p>\n

Basically, the first part is exactly the same, we use the store again to push the file to the bucket. <\/p>\n

Nevertheless, instead of the download we saw previously, we use the read function that uses the S3ObjectConverter that will automatically deserialize the JSON into the Example class instance. <\/p>\n

And for the last time, let\u2019s hit our API: <\/p>\n

curl —location —request POST ‘http:\/\/localhost:8080\/buckets\/codersee-awesome-bucket\/objects’
\n—data-raw »<\/p>\n

# Response status: 200 OK
\n# Response body:
\n{
\n «id»: «3eacd8a3-48b2-4756-86db-e4c9f4e291da»,
\n «name»: «Some name»
\n}<\/p>\n

And as we can see, the output confirms that everything is working fine. <\/p>\n

Summary<\/p>\n

And that\u2019s all for this article on how to make our lives easier in Spring Boot with S3Template. <\/p>\n

I hope you enjoyed it, and again wanted to invite you to take a look at other content of this series: <\/p>\n

Spring Boot with AWS S3, S3Client and Kotlin<\/a><\/p>\n

Lastly, just wanted to show that you can find the source code in this GitHub repository<\/a> and that you can join my newsletter<\/a> to stay up-to-date with Kotlin on the backend. <\/p>\n

The post Spring Boot with Kotlin, AWS S3, and S3Template<\/a> appeared first on Codersee | Kotlin, Ktor, Spring<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

Welcome to the second article in a series dedicated to integrating a Spring Boot Kotlin app with AWS S3 Object Storage, in which we will learn how to make our lives easier with S3Template. Of course, I highly encourage you to take a look at other articles in this series, … <\/p>\n

Read More<\/a><\/div>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-129","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/posts\/129"}],"collection":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=129"}],"version-history":[{"count":0,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=\/wp\/v2\/posts\/129\/revisions"}],"wp:attachment":[{"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=129"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=129"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/imcodinggenius.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=129"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}