Skip to content

[aws] Add mandatory tags to system test terraform (backport #20698) - #20973

Merged
brijesh-elastic merged 2 commits into
elastic:backport-aws-6.xfrom
brijesh-elastic:backport-aws-6.x-system-test-mandatory-tags
Sep 8, 2026
Merged

brijesh-elastic merged 2 commits into
elastic:backport-aws-6.xfrom
brijesh-elastic:backport-aws-6.x-system-test-mandatory-tags

Conversation

@brijesh-elastic

Copy link
Copy Markdown
Contributor

What

Backport of #20698 to backport-aws-6.x. Adds the four mandatory Elastic tags
(division, org, team, project) to the provider default_tags block of
the 12 packages/aws Terraform deploy configs that were missing them:

  • apigateway_logs, cloudfront_logs, cloudtrail, ec2_logs, elb_logs,
    emr_logs, firewall_logs, redshift, route53_resolver_logs, s3access,
    vpcflow, waf

Why

The SCP on the observability-ci account now
denies resource creation unless those four tags are present in the create
request
. On backport-aws-6.x the configs only set CI metadata
(environment, repo, branch, build, created_date), so system tests fail
at deploy time with an unhealthy Terraform deployer:

#20698 fixed this on main and explicitly called out that the active
backport-aws-* branches "run the same system tests against the same account
and will keep failing until this is backported." This PR is that backport.

Changes

Testing

  • From packages/aws, on a supported 8.x stack (e.g. elastic-package stack up -d --version 8.19.4):
    elastic-package test system --data-streams cloudtrail -v (and other AWS data streams) now provision cleanly instead of failing with the SCP AccessDenied.

Related

The observability-ci account SCP now denies resource creation without
the division/org/team/project tags, breaking the 11 SQS-based data
stream system tests and redshift.

(cherry picked from commit ecadef5)
@brijesh-elastic brijesh-elastic self-assigned this Aug 31, 2026
@brijesh-elastic
brijesh-elastic requested review from a team as code owners August 31, 2026 13:28
@brijesh-elastic brijesh-elastic added Integration:aws AWS Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] Team:obs-ds-hosted-services Observability Hosted Services team [elastic/obs-ds-hosted-services] Team:SDE-Crest Crest developers on the Security Integrations team [elastic/sit-crest-contractors] labels Aug 31, 2026
@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

@teresaromero
teresaromero requested a review from a team as a code owner September 2, 2026 13:32
@vera-review-bot

Copy link
Copy Markdown

🟢 Reviewed the latest commits 0a8c759 — nothing new beyond already posted comments.

A new commit triggers another review — at most once every 15 minutes. I skip the PR while it's approved or has merge conflicts.

🤖 AI-Generated Review | Vera Review Bot - v0.3.0 | 📚 Knowledge base: integration-skills

⚠️ Automated review — verify suggestions before applying.

@teresaromero

Copy link
Copy Markdown
Contributor

/test

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

✅ Package owners are in sync with main.

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

🚀 Benchmarks report

Package aws 👍(9) 💚(5) 💔(8)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
guardduty 1865.67 949.67 -916 (-49.1%) 💔
s3access 6060.61 5128.21 -932.4 (-15.38%) 💔
vpcflow 7751.94 6289.31 -1462.63 (-18.87%) 💔
waf 8771.93 6944.44 -1827.49 (-20.83%) 💔
cloudtrail 3322.26 1721.17 -1601.09 (-48.19%) 💔
ec2_logs 90909.09 47619.05 -43290.04 (-47.62%) 💔
elb_logs 903.34 557.41 -345.93 (-38.29%) 💔
emr_logs 37037.04 27027.03 -10010.01 (-27.03%) 💔

To see the full report comment with /test benchmark fullreport

@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

💚 Build Succeeded

History

cc @brijesh-elastic

@mrodm mrodm left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mergify

mergify Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Tick the box to add this pull request to the merge queue (same as @mergifyio queue).

  • Queue this pull request

@brijesh-elastic
brijesh-elastic merged commit 0a059d1 into elastic:backport-aws-6.x Sep 8, 2026
8 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Integration:aws AWS Team:obs-ds-hosted-services Observability Hosted Services team [elastic/obs-ds-hosted-services] Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] Team:SDE-Crest Crest developers on the Security Integrations team [elastic/sit-crest-contractors] Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants