How to create a pipeline in azure blob storage when any file got uploaded in a folder in azure storage .NET core

Question

0.00/5 (No votes)

See more:

I'm new to this stuff, In my project, I did logging for bot framework in .net core, Whenever a conversation happens between user and bot, a new folder will be created which consists of JSON files (which consists of all data related to that), I want to fetch that JSON in .net core or I want to get updated (maybe thru a pipeline) whenever a new JSON file is created(when the conversation happens).
and how can I access that JSON file which is in azure storage from .net core
Any ideas are welcome.

What I have tried:

I didn't understand how to get updated whenever a new JSON file will be created (when a new conversation happens between user and bot).

Posted 12-Oct-20 4:23am

Member 14962256

Updated 15-Oct-20 20:26pm

Add a Solution

Comments

[no name] 12-Oct-20 13:34pm

Start with a FileWatcher background process. Or queue something when a folder is created. There is no "quick answer".

Member 14962256 12-Oct-20 15:22pm

Can it watch the file/directory which is in azure blob storage?
I think, it only watches a file or a directory in my system for changes and triggers events when changes occur. Please confirm.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

lmoelleb · Answer 1 · 2020-10-15T20:26:00

There are a couple of options.
Reacting to Azure Blob storage events | Microsoft Docs[^]

An Azure Logic App could also trigger and for example queue an event on a storage queue or event bus:
Connect to Azure Blob Storage - Azure Logic Apps | Microsoft Docs[^]

Or you could do polling yourself to look for new data.

There is a lot to balance (speed, cost, complexity) and unfortunately not a single "best solution for everything", so you need to dig in and find an acceptable solution for you.

Be careful when Microsoft states you only pay for what you use. As developer, this typically makes us think "I only pay if something happens", but in the Microsoft world, it might be a fixed monthly cost for just having the ability to run something - unfortunately I never found a fast way to tell the two apart without extensive reading.