Skip to content

Commit 96db7b8

Browse files
AlphayeeeetAlphayeeeet
authored
Remove event.original removal processors (integrations aws to azure) (elastic#10888)
Delete the remove event.original processors from the pipelines because as of 8.11 the Fleet final pipeline now does this automatically when the `preserve_original_event` tag is not present in the event. This bumps the minimum version to at least 8.11.0 because it depends on the Fleet final pipeline changes. Relates elastic#10072
1 parent d1df0c5 commit 96db7b8

53 files changed

Lines changed: 66 additions & 189 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎packages/aws/changelog.yml‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,9 @@
11
# newer versions go on top
2+
- version: "2.25.0"
3+
changes:
4+
- description: "Allow @custom pipeline access to event.original without setting preserve_original_event."
5+
type: enhancement
6+
link: https://github.com/elastic/integrations/pull/10888
27
- version: "2.24.1"
38
changes:
49
- description: Fixed and refactored AWS cloudfront log parsing.

‎packages/aws/data_stream/apigateway_logs/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -81,11 +81,6 @@ processors:
8181
field: aws.apigateway.status
8282
type: long
8383
ignore_missing: true
84-
- remove:
85-
field: event.original
86-
if: "ctx?.tags == null || !(ctx.tags.contains('preserve_original_event'))"
87-
ignore_failure: true
88-
ignore_missing: true
8984
- date:
9085
field: aws.apigateway.request_time
9186
target_field: "aws.apigateway.request_time"

‎packages/aws/data_stream/cloudfront_logs/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -434,13 +434,6 @@ processors:
434434
- remove:
435435
field: _tmp
436436
ignore_missing: true
437-
- remove:
438-
field: event.original
439-
if: ctx.tags == null || !ctx.tags.contains('preserve_original_event')
440-
ignore_failure: true
441-
ignore_missing: true
442-
443-
444437
on_failure:
445438
- set:
446439
field: event.kind

‎packages/aws/data_stream/cloudtrail/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -779,11 +779,6 @@ processors:
779779
- remove:
780780
field: json
781781
ignore_missing: true
782-
- remove:
783-
field: event.original
784-
if: "ctx?.tags == null || !(ctx.tags.contains('preserve_original_event'))"
785-
ignore_failure: true
786-
ignore_missing: true
787782
on_failure:
788783
- set:
789784
field: error.message

‎packages/aws/data_stream/ec2_logs/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -30,11 +30,6 @@ processors:
3030
field:
3131
- _tmp
3232
ignore_missing: true
33-
- remove:
34-
field: event.original
35-
if: "ctx?.tags == null || !(ctx.tags.contains('preserve_original_event'))"
36-
ignore_failure: true
37-
ignore_missing: true
3833
on_failure:
3934
- set:
4035
field: 'error.message'

‎packages/aws/data_stream/elb_logs/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -221,11 +221,6 @@ processors:
221221
field:
222222
- _tmp
223223
ignore_missing: true
224-
- remove:
225-
field: event.original
226-
if: "ctx?.tags == null || !(ctx.tags.contains('preserve_original_event'))"
227-
ignore_failure: true
228-
ignore_missing: true
229224
on_failure:
230225
- set:
231226
field: 'error.message'

‎packages/aws/data_stream/emr_logs/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -51,11 +51,6 @@ processors:
5151
return false;
5252
}
5353
drop(ctx);
54-
- remove:
55-
field: event.original
56-
if: "ctx?.tags == null || !(ctx.tags.contains('preserve_original_event'))"
57-
ignore_failure: true
58-
ignore_missing: true
5954
on_failure:
6055
- set:
6156
field: 'error.message'

‎packages/aws/data_stream/firewall_logs/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -387,11 +387,6 @@ processors:
387387
- remove:
388388
field: json
389389
ignore_missing: true
390-
- remove:
391-
field: event.original
392-
if: 'ctx?.tags == null || !(ctx.tags.contains("preserve_original_event"))'
393-
ignore_failure: true
394-
ignore_missing: true
395390
on_failure:
396391
- set:
397392
field: error.message

‎packages/aws/data_stream/guardduty/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2451,10 +2451,6 @@ processors:
24512451
- _ingest._value.file.path
24522452
- _ingest._value.hash
24532453
ignore_missing: true
2454-
- remove:
2455-
field: event.original
2456-
if: ctx.tags == null || !(ctx.tags.contains('preserve_original_event'))
2457-
ignore_missing: true
24582454
- script:
24592455
description: Drops null/empty values recursively.
24602456
lang: painless

‎packages/aws/data_stream/inspector/elasticsearch/ingest_pipeline/default.yml‎

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -701,10 +701,6 @@ processors:
701701
- _ingest._value.version
702702
if: ctx.tags == null || !(ctx.tags.contains('preserve_duplicate_custom_fields'))
703703
ignore_missing: true
704-
- remove:
705-
field: event.original
706-
if: ctx.tags == null || !(ctx.tags.contains('preserve_original_event'))
707-
ignore_missing: true
708704
- script:
709705
description: Drops null/empty values recursively.
710706
lang: painless

0 commit comments

Comments
 (0)