"StatusCode":"DFExecutorUserError",
"Message":"Job failed due to reason: at Join 'sampleParquetazureJOIN1': None.get",
"Details":"java.util.NoSuchElementException: None.get\n\tat scala.None$.get(Option.scala:347)\n\tat scala.None$.get(Option.scala:345)\n\tat com.microsoft.dataflow.transformers.JoinPlanner$$anonfun$joinType$2.apply(Join.scala:42)\n\tat com.microsoft.dataflow.transformers.JoinPlanner$$anonfun$joinType$2.apply(Join.scala:42)\n\tat scala.util.Success$$anonfun$map$1.apply(Try.scala:237)\n\tat scala.util.Try$.apply(Try.scala:192)\n\tat scala.util.Success.map(Try.scala:237)\n\tat com.microsoft.dataflow.transformers.JoinPlanner$.joinType(Join.scala:42)\n\tat com.microsoft.dataflow.transformers.BaseJoinPlanner$$anonfun$logicalPlan$2$$anonfun$apply$11$$anonfun$apply$12.apply(BaseJoin.scala:317)\n\tat com.microsoft.dataflow.transformers.BaseJoinPlanner$$anonfun$logicalPlan$2$$anonfun$apply$11$$anonfun$apply$12.apply(BaseJoin.scala:306)\n\tat scala.util.Success.flatMap(Try.scala:231)\n\tat com.microsoft.dataflow.transformers.BaseJoinPlanner$$anonfun$logicalPlan$2$$anonfun$apply$11.apply(BaseJoin.scala:306)\n\tat com.microsoft.dataflow.transformers.BaseJoinP"
Hi
KaranKampassi-5180
, Thank you for posting query in Microsoft Q&A Platform.
Above error usually occurring when join condition in transformation not met or when there is a mismatch in the data types of the columns being joined. You can try to check the join condition and the data types of the columns being joined to resolve the issue.
The files or data which are getting used in debug execution and normal execution are same? If not, try with same files or data and see.
Also, kindly make sure you publish changes and then only trigger. Because trigger runs always takes only published changes.
Hope this helps. Please let me know it goes or if any further queries.
Please consider hitting
Accept Answer
button. Accepted answers help community as well.
Hey Maheer ! Yers I am taking the same files and ts running successfully in debug mode.
When dataflow is created from api it fails in execution but when I do any random change and publish it from azure itself then it works.
I then compared the json property and there was no change.
