Add retry to acl endpoint for config update

[mploski]

it seems there is a bug in the splunk terraform provider for config creation, that after config is created it doesn't propagate immediately and correspoding acl update returns 404 ( acl doesnt exist)

terragrunt apply

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create

Terraform will perform the following actions:

  # splunk_configs_conf.aws_ta_example will be created
  + resource "splunk_configs_conf" "aws_ta_example" {
      + id        = (known after apply)
      + name      = "aws_config_rule/myconfig2"
      + variables = {
          + "custom_key" = "value"
          + "disabled"   = "false"
        }

      + acl {
          + app              = "Splunk_TA_aws"
          + can_change_perms = (known after apply)
          + can_share_app    = (known after apply)
          + can_share_global = (known after apply)
          + can_share_user   = (known after apply)
          + can_write        = (known after apply)
          + owner            = "nobody"
          + read             = (known after apply)
          + removable        = (known after apply)
          + sharing          = (known after apply)
          + write            = (known after apply)
        }
    }

Plan: 1 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

splunk_configs_conf.aws_ta_example: Creating...
╷
│ Error: GET failed for endpoint servicesNS/nobody/Splunk_TA_aws/configs/conf-aws_config_rule/myconfig2/acl: 404 Not Found: {"messages":[{"type":"ERROR","text":"Could not find object id=myconfig2"}]}
│ 
│   with splunk_configs_conf.aws_ta_example,
│   on splunkbase_apps.tf line 15, in resource "splunk_configs_conf" "aws_ta_example":
│   15: resource "splunk_configs_conf" "aws_ta_example" {
│ 
╵
ERRO[0008] terraform invocation failed in /Users/mploski/splunk/skynet-apps-cyberdyne/terraform/stg/core/skynet-agile-staging  error=[/Users/mploski/splunk/skynet-apps-cyberdyne/terraform/stg/core/skynet-agile-staging] exit status 1
ERRO[0008] 1 error occurred:
        * [/Users/mploski/splunk/skynet-apps-cyberdyne/terraform/stg/core/skynet-agile-staging] exit status 1
 

---
➜ git:(feature/configure-splunkbase-app) ✗ terragrunt apply

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
  + create

Terraform will perform the following actions:

  # splunk_configs_conf.aws_ta_example will be created
  + resource "splunk_configs_conf" "aws_ta_example" {
      + id        = (known after apply)
      + name      = "aws_config_rule/myconfig2"
      + variables = {
          + "custom_key" = "value"
          + "disabled"   = "false"
        }

      + acl {
          + app              = "Splunk_TA_aws"
          + can_change_perms = (known after apply)
          + can_share_app    = (known after apply)
          + can_share_global = (known after apply)
          + can_share_user   = (known after apply)
          + can_write        = (known after apply)
          + owner            = "nobody"
          + read             = (known after apply)
          + removable        = (known after apply)
          + sharing          = (known after apply)
          + write            = (known after apply)
        }
    }

Plan: 1 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

splunk_configs_conf.aws_ta_example: Creating...
╷
│ Error: 409 Conflict: {"messages":[{"type":"ERROR","text":"An object with name=myconfig2 already exists"}]}
│ 
│   with splunk_configs_conf.aws_ta_example,
│   on splunkbase_apps.tf line 15, in resource "splunk_configs_conf" "aws_ta_example":
│   15: resource "splunk_configs_conf" "aws_ta_example" {
│ 


# cat aws_config_rule.conf 
[myweblogs]
CHARSET = UTF-8
SHOULD_LINEMERGE = false

[myconfig2]
custom_key = value
disabled = false