Scalable and Serverless Data Ingestion with OCI Functions

In this article, we will leverage OCI’s capabilities to the fullest, embracing the following principles:

• Scalability
• Resilience
• Flexibility
• Security
• Automation

The “loadfileintoadw” project is located in the same GitHub repository used so far to discuss OCI Function fn-examples .

This example will help you understand how to integrate multiple OCI services and make the most of the cloud provider.

We will simulate a series of weather stations that will write a CSV file with sampling data (temperature, humidity, etc.). The sensor will automatically upload the file to an Object Storage bucket.

Processing will be automatically invoked through a Function that, in this case, converts the file format from CSV to JSON and natively saves it to a serverless Autonomous Database.

The IaC code has been developed to perform the entire deployment, from infrastructure to function. Therefore, within the project folder, simply execute the command to create everything:

terraform apply

If you are not familiar with Terraform, we recommend checking theofficial documentation and our tutorial and video