Kubernetes Cronjobs leave the pod behind in Not Ready State after getting Completed - kubernetes

Recently all the cronjobs on my GKE cluster started showing some weird behaviour. With all the configurations remaining same for the cronjobs, out of nowhere, now my cronjobs are getting triggered, executed & completed but the Pod is left behind in a Not Ready state. I've been using successfulJobsHistoryLimit and failedJobsHistoryLimit as 0. Also, tried concurrencyPolicy: "Replace" and spec.ttlSecondsAfterFinished: 1 but still nothing changed. I want to get rid of these as there are some crons running at every 5 minutes and so, generating huge list of not ready completed pods here when I run kubectl get pods
NAME READY STATUS RESTARTS AGE
my-cron-27711665-gjdk4 0/1 Completed 0 46m
Here's the cronjob.yaml file:
apiVersion: batch/v1beta1
kind: CronJob
metadata:
  name: my-cron
spec:
  schedule: "0 */1 * * *"
  successfulJobsHistoryLimit: 0
  failedJobsHistoryLimit: 0
  jobTemplate:
    spec:
      template:
        spec:
          imagePullSecrets:
          - name: cronjob-secret
          containers:
          - name: my-cron
            image: kubernetes_cronjob_new:dev
            command: ["/bin/bash","-c"]
            args:
              - po1=$(kubectl get pods  | awk '/mybackend/ {printf($1);exit}');
                kubectl exec -i $po1 -- python manage.py run_cron my_cron False;
                exit 0;
          restartPolicy: OnFailure
Currently working on Kubernetes Version: 1.22
Can anyone help me here? How to get rid of these or why this started happening all of sudden?

Related

Check if a file or directory has a specific alternative data stream attached to it?

I am writing a function or a commandlet (I want to call it Set-Metadata) that will allow me to attach metadata information to directories and files. Its for a file manager columns that expect ADS data
I am currently stuck on the logic part.
Before I write any metadata to a file via its NTFS ADS I would first like to check if the file has a specific stream so that I don't overwrite anything and instead append text to the stream.
function Set-MetaData(
    [Parameter(Mandatory=$true, ValueFromPipeline=$true)]
    [string]
    $Path,
    [Alias("C", "Cat")] #Replace Column Content
    [String]$Category,
    [Alias("PC", "PCat")] #Prefix to the content in  Column
    [String]$PCategory,
    [Alias("SC", "SCat")] #Suffix to the content in  Column
   
    [String]$SCategory){
        process {
        Switch ($PSBoundParameters.Keys){
            'Category'{
            }'PCategory'{
            }'SCategory'{
                if(...) #file has a stream called "multitags.txt"
                # Add-Content -Path $Path -Stream  multitags.txt -Value $Category
    }}
}
I have taken the liberty to cross post this question on other forums as well.
Any help would be greatly appreciated!

How can I use Argo Workflow to execute Spark Application and save the Spark execution result to Minio

I want to execute the Spark program from Workflow and store the results on Minio. What do I do?
Here is an example Pi that I executed using workflow choreography
apiVersion: argoproj.io/v1alpha1
kind: Workflow
...
      manifest: |
        apiVersion: "sparkoperator.k8s.io/v1beta2"
        kind: SparkApplication
        metadata:
          name: spark-pi
          namespace: spark
        spec:
          type: Scala
          mode: cluster
          image: "gcr.io/spark-operator/spark:v3.1.1"
          nodeSelector:
            kubernetes.io/hostname: node01
          imagePullPolicy: Never
          mainClass: org.apache.spark.examples.SparkPi
          mainApplicationFile: "local:///opt/spark/examples/jars/spark-examples_2.12-3.1.1.jar"
...
          driver:
...         
executor:
...
  - name: sparkling-operator
    dag:
      tasks:
      - name: SparkGroupBY
        template: spark-groupby

How can we split a column with multiple values separated by "space" delimiter into multiple rows in Qlik using any logic

I have one requirements as below. Suppose I have a column with below values
rowno          Column
1                MS Teams slack skype
2                 slack
3                 skype
I want to split the first row as below 
rowno          Column
1              MS Teams
1              slack
1              skype
2              slack
3              skype
How I can not use sub field function since it will split MS Teams to MS ,Teams. Instead can I use wildmatch? Please suggest how I can achieve this in Qlik Sense?
I'd probably do it in 2 parts... first to replace the MS Teams value with MS_Teams and then do the subfield. You could add another part to get rid of the _ at the end.
Table:
Load
rowno,
subfield(Column_clean,' ') as Column;
Load
rowno,
replace(Column,'MS Teams','MS_Teams') as Column_clean
from source;

Unable to update content in xml tag using XML::Twig

I am unable to update content in xml tag using xml Twig module.
Here is my xml file :-
<?xml version="1.0"?>
<test customerProprietary="false">
  <classes>
    <class name="new" />
  </classes>
  <chars>
    <log>false</log>
  </chars>
</test>
Code snippet:-
my $twig = XML::Twig->new(
     pretty_print => 'indented',
     twig_handlers => {
             log => sub {
                             if ($_->text eq 'true'){
                               exit;
                             }
                             else{
                               print $_->text;
                               subp4open($xmlfile);
                               $_->set_text( 'true' );
                               exit;
                            }
}
);
$twig->parsefile($script_path);
$twig->print_to_file($script_path);
i have to update <log>false</log> to <log>true</log>. Am i missing something here?
That's because exit exits the program, so print_to_file is never reached. Remove the exits. You can replace them with returns, but they aren't needed.
When I run into these sorts of things, I like to put a statement like say "This far" to see that I've made it to a particular part of the code:
say "About to parse file";
$twig->parsefile($script_path);
say "About to print file";
$twig->print_to_file($script_path);
In your handler, there are some things that you can improve. Since you don't want to do anything in the case that the value is already true, don't even think about that case:
log => sub {
if ($_->text ne 'true'){
print $_->text;
subp4open($xmlfile);
$_->set_text( 'true' );
}
},
I might be inclined to always update the value if you want them all to be true. I don't care what it was before as long as I get what I want at the end (although this way tweak your source control a bit):
log => sub { $_->set_text( 'true' ) },
Also, I might consider doing any Perforce magic outside of the twig handler. Get the lock on the file before you give it to Twig. If you can't get that lock, you might as well not process it. Then, remember to release it later. If you do all of those operations close together, you're less likely to forget a step.

Callbacks not rendered as native Facebook messages?

According to this scenario.
Used to test it using sample message - text. And it works fine.
I should implement that by using buttons (callbacks).
The real problem is :
Sample text :
context.Activity.Id
"mid.$cAAOmNGtaSJ9i1_f223cprKylFOpb"
on button click (callback) :
context.Activity.Id
"9Yw5TAcq1qr"
This is the code i used to post human support button :
msg.AttachmentLayout = AttachmentLayoutTypes.Carousel;
                    msg.Attachments = new List<Attachment>();
 
                    ThumbnailCard thumbnailCard2 = new ThumbnailCard()
                    {
                        Buttons = new List<CardAction>
                        {
                                new CardAction ()
                            {
                                Value = "Method_Support",
                                Type = "postBack",
                                Title = "Human Support"
 
                            },
                        },
                    };
                    msg.Attachments.Add(thumbnailCard2.ToAttachment());
                    await context.PostAsync(msg);
It returns activity.Id : 9Yw5TAcq1qr - as i already mentioned. I can't use that id to query Facebook graph api.
What's the best way to handle scenario like this ?
Is it possible to render all incoming messages as native Facebook (sample-text) messages ?
Is it possible to make call to graph api using callback's activity.id ?
Following my previous answer about how to link the Activity from botFramework to the messages in Conversation in Facebook's Graph API, I had a look to your problem.
Analysis
From my point of view, there is a strange thing in this Activity.Id value because on Facebook's side, all messages have the same id format, even for callbacks.
Here is a capture of 2 messages (1st one is the latest one) from Facebook Graph API:
{
"data": [{
"messages": {
"data": [
{
"id": "m_mid.$cAAC3Jml0RcBi2JK3Clcp01uu8FFe",
"message": "Human support"
},
{
"id": "m_mid.$cAAC3Jml0RcBi2I5bXlcp0kScM7af",
"message": ""
}
]
},
"id": "t_mid.$..."
}]
}
Message with empty text is a ThumbnailCard with a CardAction inside (type = postback, Value = Method_HumanSupport)
Human support is what is sent on the click on the CardAction
What is surprising is that on the bot side, for those 2 messages we have the following values for Activity.Id:
For "id": "m_mid.$cAAC3Jml0RcBi2I5bXlcp0kScM7af" (my Thumbnail) => mid.$cAAC3Jml0RcBi2I5bXlcp0kScM7af, so it's matching
For "id": "m_mid.$cAAC3Jml0RcBi2JK3Clcp01uu8FFe" (the callback) => DWhE2C0VO79, no match at all
For information my ThumbnailCard is made like the OP said:
var msg = context.MakeMessage();
msg.AttachmentLayout = AttachmentLayoutTypes.Carousel;
msg.Attachments = new List<Attachment>();
msg.Text = "updates & support";
ThumbnailCard thumbnailCard2 = new ThumbnailCard()
{
Buttons = new List<CardAction>
{
new CardAction ()
{
Value = "Method_HumanSupport",
Type = "postBack",
Title = "Human support"
}
}
};
I will add a question on Bot Framework GitHub Project.
Edit: issue logged: https://github.com/Microsoft/BotBuilder/issues/2950
Workaround
There are several workaround that will depend on your global use cases: you could try to log the Activity.Id of a "normal" message in the discussion and use this value later when your callback is clicked, or you can also try to change your flow to avoid making this kind of link between Bot Framework and Facebook Graph API.