Logic App to push data from Cosmosdb into CRM and perform an update

Question

I have created a logic app with the goal of pulling data from a container within cosmosdb (with a query), looping over the results and then pushing this data into CRM (or Common Data Service). When the data is pushed to CRM, an ID will be generated. I wish to then update cosmosdb with this new ID. Here is what I have so far:

This next step is querying for the data within our cosmosdb database and selecting all IDS with a length that is greater than 15. (This tells us that the ID is not yet within the CRM database)

Then we loop over the results and push this into CRM (Dynamics365 or the Common Data Service)

Dilemma: The first part of this process appears to be correct, however, I want to make sure that I am on the right track with this. Furthermore, once the data is successfully pushed to CRM, CRM automatically generates an ID for each record. How would I then update cosmosDB with the newly generated IDs?

Any suggestion is appreciated
Thanks

Mark Brown · Answer

I see a red flag in your approach here with this query with length(c.id) > 15. This is not something I would do. I don't know how big your database is going to be but generally not very performant to do high volumes of cross partition queries, especially if the database is going to keep growing.
Cosmos DB already provides an awesome streaming capability so rather than doing this in a batch I would use Change Feed and use that to accomplish whatever your doing here in your Logic App. This will likely give you better control of the process and likely allow you to get the id back out of your CRM app to insert back into Cosmos DB.
Because you will be writing back to Cosmos DB, you will need a flag to ignore the update in Change Feed when the item is updated.

Logic App to push data from Cosmosdb into CRM and perform an update

One Answer

Add your own answers!

Related Questions

Use virtual function to calculate area for different shapes C++

Update a with react

Euclidean distance of all pandas rows to single row

Condition not executed properly when using getchar()

Different result with online compiler and visual code

recursive function debug asserion failed

SQL Grant Execute On Object where do I put GO?

Split string by comma unless followed by a space or a ‘+’

Why is df.info().to_csv(‘File_name.csv’) returning error?

Get values of cells in dataframe column quickly

Parsing XML values in Javascript

split sequences

when checkbox checked value true, display text not displayed

Not using GROUP BY but getting Invalid in the select list because it is not contained in either an aggregate function or the GROUP BY clause

Create combinations of numbers and get a count of distinct combinations using Python

Can someone please tell me where am I wrong in this python code?

.net core 2.0 logging inside Kubernetes pod console

XML vs JSON vs SQLite for only reading data

HTML drop zone file upload not working when dragging in files

How to upgrade my postgres in docker container while maintaining my data? 10.3 to latest 10.x or to 12.x

Ask a Question