Processors
Processors are components within an OpenSearch Data Prepper pipeline that enable you to filter, transform, and enrich events using your desired format before publishing records to the sink component. If no processor is defined in the pipeline configuration, then the events are published in the format specified by the source component. You can incorporate multiple processors within a single pipeline, and they are executed sequentially as defined in the pipeline.
Prior to Data Prepper 1.3, these components were named preppers. In Data Prepper 1.3, the term prepper was deprecated in favor of processor. In Data Prepper 2.0, the term prepper was removed.
Mutate event processors
Use mutate event processors to modify events in OpenSearch Data Prepper. The following processors are available.
| Processor | Description |
|---|---|
add_entries | Add entries to an event. |
convert_entry_type | Convert value types in an event. |
copy_values | Copy values within an event. |
delete_entries | Delete entries from an event. |
list_to_map | Convert a list of objects from an event, where each object contains a key field, into a map of target keys. |
map_to_list | Convert a map of objects from an event, where each object contains a key field, into a list of target keys. |
rename_keys | Rename keys in an event. |
select_entries | Select entries from an event. |
Mutate string processors
Use mutate string processors to modify the contents or format of string values. The following processors are available.
| Processor | Description |
|---|---|
substitute_string | Replace part of a string with a specified value using a regular expression. |
split_string | Split a string into a list using a specified delimiter. |
uppercase_string | Convert a string to uppercase. |
lowercase_string | Convert a string to lowercase. |
trim_string | Remove leading and trailing white space from a string. |
Related articles
- Add entries
- Aggregate
- Anomaly detector
- AWS Lambda
- Convert entry type
- Copy values
- CSV
- Date
- Decompress
- Delay
- Delete entries
- Dissect
- Drop events
- Flatten
- Geo IP
- Grok
- Key-value
- List to map
- Lowercase string
- Map to list
- ML inference
- Obfuscate
- OTel metrics
- OTel trace
- OTel trace group
- Parse Ion
- Parse JSON
- Parse XML
- Rename keys
- Select entries
- Service map
- Split event
- Split string
- String converter
- Substitute string
- Trace peer forwarder
- Translate
- Trim string
- Truncate
- Uppercase string
- User agent
- Write JSON