Error when trying to create pipeline "Could not load resource 'Consolidation_OneEntity'. Please ensure no mistakes in the JSON and that referenced resources exist."

[alexwiley]

Hello,

Following Setup.md at Step 5, I'm able to create all of the Synapse resources and load/save/publish the integration datasets and data flow, however when I try to create a pipeline in the same steps I receive the error above. The same self-referencing error occurs for all three pipelines, and there does not seem to be any additional information that can help me troubleshoot. Any advice or direction on how to resolve is appreciated.

[trimline-gaiustemple]

@alexwiley I encountered this too. From memory the issue is with Azure not the JSON provided by the repo. You will need to raise this with Azure support.

A workaround is to remove the step named SparkTableConditions(if memory serves) from the JSON when pasting it in, saving, and then creating this step manually in the graphical user interface whilst checking the JSON being generated is matching the JSON provided by this repo.

[alexwiley]

Thank you @trimline-gaiustemple removing that step allowed me to create the pipeline and I will work on the next steps. I appreciate the fast response and insight into this issue!

[lktraser]

I'm having the same issue but I am anything but an azure synapse expert so I'm having a lot of trouble recreating the pipeline step from the json. It would be great if we could get a fix for this issue.

[lktraser]

Okay this is actually a different issue:

If the CreateParquetTable notebook is imported and published first the pipeline can actually be imported without any issues. This should just be more clear in the docs.