Quantcast
Channel: All Developer posts
Viewing all articles
Browse latest Browse all 48564

Using Data Factory Nested Array JSON Path

$
0
0

Evening,

 

I'm new to data factory and I'm trying to data in json from my blob to my sql table; but I've hit a snag when it comes to the nested arrays. I'm able to have the pipeline work without them, but once I add them, error. I feel the json path for the nested arrays aren't appropriate but I'm not sure of the solution.

 

I have worked out that it is an issue with the nested arrays in the json file (https://1drv.ms/u/s!At8Q-ZbRnAj8hjWvXpDZ4qUVNu6G).

 

When I delete the none nested arrays from the json file it copies perfectly to my sql table. After including one nested array in my json file I receive the sql error 4815 (https://gyazo.com/b380edabfb4eae277fcb43b18c27d9bd ). I have increased the varchar length of the newly added columns and I’m still receiving the error. The error has everything to do with how the nested columns are being expanded/handled/mapped.

 

This before I expand the array (https://gyazo.com/88fe22014f7858bfcccf6ba40cab3dd7& https://gyazo.com/cbe4f94b264620f16cf38f663836892a ).

 

Once I expand the array using the data factory “expand array” link next to the “inclusive_tax” column (https://gyazo.com/a90f49d9385966d9e83f40eadc463c0f& https://gyazo.com/6611ad6cddc65fca840beeda5903d21a ). From “name” is the expanded nested array aspect. I feel the column to the right is the issue as the json path isn’t correct and does not properly represent that it was expanded from a nested array.

 

Here is the schema of the json file (https://gyazo.com/7272bcf76e73bf791b4ae6714bf04084& https://gyazo.com/5b380895196a6ede0f2ed18de5847d18& https://gyazo.com/00cea844b25a4946d6548c7aca52f7d4 ).

Here is the schema mapping of the json file to my sql table (https://gyazo.com/4c1437231a030bbfa91863633412e4a6) All of the type’s are appropriate and I think accommodative.

 

When I run the data factory copy activity I receive the error (https://gyazo.com/b380edabfb4eae277fcb43b18c27d9bd) and I’m not sure how to solve it. I believe it has everything to do with how the json path of the expanded nested arrays.


Viewing all articles
Browse latest Browse all 48564


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>