Unable to turn on debug for ADFv2 Mapping Data Flow - azure-data-factory

Today, I'm not able to turn on debug on my ADFv2 mapping data flow. I'm getting the error below:
I already tried creating a new IR set to auto resolve and also set to same region as my ADFv2 - still no good.
Failed to setup debug session. Error: No connection is available to service this operation: SETEX dfProd_dataflowdebugsession26a9d381-5924-4c1f-b36f-cf41e2eab60e_f96ba068-97be-478a-8ed6-012a7ec58d80; IOCP: (Busy=0,Free=100,Min=50,Max=100), WORKER: (Busy=7,Free=93,Min=50,Max=100), Local-CPU: n/a

Congratulations that your error solved now.
I think maybe it's caused by the cache. Refresh the Data Factory and try again.
You tried again today and it worked.
I post this as the answer to make others know the error is gone.

What Azure Region is this factory in?

Related

Azure Data Factory CICD error: The document creation or update failed because of invalid reference

All, when running a build pipeline using Azure Devops with ARM template, the process is consistently failing when trying to deploy a dataset or a reference to a dataset with this error:
ARM Template deployment: Resource Group scope (AzureResourceManagerTemplateDeployment)
BadRequest: The document creation or update failed because of invalid reference 'dataset_1'.
I've tried renaming the dataset and also recreating it to see if that would help.
I then deleted the dataset_1.json file from the repo and still get the same message so it's some reference to this dataset and not the dataset itself I think. I've looked through all the other files for references to this but they all look fine.
Any ideas on how to troubleshoot this?
thanks
try this
Looks like you have created 'myTestLinkedService' linked service, tested connection but haven't published it yet and trying to reference that linked service in the new dataset that you are trying to create using Powershell.
In order to reference any data factory entity from Powershell, please make sure those entities are published first. Please try publishing the linked service first from the portal and then try to run your Powershell script to create the new dataset/actvitiy.
I think I found the issue. When I went into the detailed logs I found that in addition to this error there was an error message about an invalid SQL connection string, so I though it may be related since the dataset in question uses Azure SQL database linked service.
I adjusted the connection string and this seems to have solved the issue.

InfluxQL Data source connection error "xxxxxx...." Database not found

I'm using Grafana Cloud and Influxdb Cloud - free version
I'm trying to connect to Influxdb via Grafana (Influxdb) plugin
When creating connection it says - Connection successful but when I use it in panel or in query it doesn't work and throws error "Database not found"
I dropped the connection several times and recreated but same issue...
I particularly wanted to try the InfluxQL so that I can leveral my TSQL skills... so the drill
Appreciate the help...
Panel Error: Database not found
Here's how I resolved it ... Link
I first setup InfluxQL and then autheticated it via GitBash.
Tick is to use Token with the token key...
Hope this helps someone

Invalid permissions after setting gcloud caching use_kaniko?

I encountered a strange permissions error while building Docker images on the cloud. I switched to another machine, installed Gcloud, did gcloud init and everything worked again.
However, I noticed while building images, it took much longer because I didn't enable kaniko cache (which I figured out from this post: gcloud rebuilds complete container but Dockerfile is the same, only the script has changed)
After enabling this feature, I tried to rebuild my last image and bam, the same error message:
Status: Downloaded newer image for gcr.io/kaniko-project/executor:latest
gcr.io/kaniko-project/executor:latest
error checking push permissions --
make sure you entered the correct tag name, and that you are authenticated correctly, and try again:
checking push permission for "eu.gcr.io/pipeline/tree-par": creating push check transport for eu.gcr.io failed:
GET https://eu.gcr.io/v2/token?scope=repository%3pipeline%2Ftree-par%3Apush%2Cpull&service=eu.gcr.io:
UNAUTHORIZED: You don't have the needed permissions to perform this operation, and you may have invalid credentials.
To authenticate your request, follow the steps in: https://cloud.google.com/container-registry/docs/advanced-authentication
ERROR
ERROR: build step 0 "gcr.io/kaniko-project/executor:latest" failed: step exited with non-zero status: 1
-------------------------------------------------------------------------------------------------------------------------------
ERROR: (gcloud.builds.submit) build bad4a9a4-054d-4ad7-991d-e5aeae039b7c completed with status "FAILURE"
Anyone any idea why this failed upon enabling the Kaniko cache? I hate to not use it because when it still worked, it really decreased the time it took to create docker images.
It seems that the issue comes from Kaniko's end.
Three days ago, on version v0.21.0, they added this fix:
Fix: GCR credential helper check does not respect DOCKER_CONFIG environment variable
Even after this release, 1 day later, this issue was reported where users saw a very similar Error message:
"[...] You don't have the needed permissions to perform this operation, and you may have invalid credentials[...] "
This was already fixed yesterday with the release of the v0.22.0 version. The suggested workaround is to execute the following command:
gcr.io/kaniko-project/executor:v0.22.0
I would suggest use that command instead of executor:latest to "force" the use of the v0.22.0 version.
I hope this is helpful! :)

Could not initialize class com.ibm.ws.ffdc.FFDCFilter. DSRA0010E: SQL State = 28P01, Error Code = 0

Can I get assistance with the error codes coming from eclipse when I try to deploy enterprise application on websphere. I followed craig st jean, I also face another problem with configuration i.e websphere data sources using postgresql. i am using a windows machine, 64bit arch. the error codes are the topic of this question. i hope this question can be seen as relevant, since not much solutions exist for the first issue concerning com.ibm.ws.ffdc.FFDCFilter, thus if one doesn't overcome the first, how can one press on and attempt to solve the second. thanks.
Webspere logs
The test connection operation failed for data source AppDb on server server1 at node Lenovo-PCNode01 with the following exception: java.sql.SQLException: FATAL: password authentication failed for user "listmanagerremote" DSRA0010E: SQL State = 28P01, Error Code = 0. View JVM logs for further details.
I have fixed the issues with deployment in the eclipse neon IDE. I think it is either as a result of the installation of the IBM WebSphere Application Server Traditional v8.0x Developer tools for Neon, and IBM jre.
Eclipse console final message
00000063 CompositionUn A WSVR0191I: Composition unit WebSphere:cuname=ListManager in BLA WebSphere:blaname=ListManager started.
Postgre documents the 28P01 SQL State as an invalid password:
"28P01 INVALID PASSWORD invalid_password"
https://www.postgresql.org/docs/9.0/static/errcodes-appendix.html
Check your data source configuration to ensure that you have specified the correct password, or if using an authentication alias for your data source, confirm that the authentication data configuration contains the correct password, and that you have configured the data source and/or resource reference to use that authentication data.

Graph API - Azure AD B2C - throws error - Application with identifier not found

I was following the below link to setup the Azure AD B2C- with Graph API setup
https://azure.microsoft.com/en-in/documentation/articles/active-directory-b2c-devquickstarts-graph-dotnet/
I was able to proceed with powershell command settings, but when I try with the application, when it executes the below code,
authContext.AcquireToken("https://graph.windows.net", credential);
getting error like below, what is wrong with this ?
AADSTS70001: Application with identifier '33d8d9ba-8c07-462a-8936-23387ddb4x5e'
was not found in the directory abc.onmicrosoft.com
Trace ID: b858d725-fbaa-4a39-8da1-84ef2a82a0a9
Correlation ID: da7c254e-a10e-4df6-9965-215685447e74
Timestamp: 2016-03-29 06:40:23Z
How to resolve this. Any inputs appreciated.
Thanks for your comments, finally found the problem.
by executing the below command, found the application was not created.
Get-MsolServicePrincipal -AppPrincipalId 33d8d9ba-8c07-462a-8936-23387ddb4x5e.
I recreated the application and tried, things seems working.
I had an similar issue, this also got resolved
Error - Connect-MsolService : Your credentials could not be authenticated. Try again
If you have any problem creating the application on powershell, follow the solution provided in this below issue.
Several Azure AD. New-MsolServicePrincipal : Access Denied