AvroToIon

Convert an Avro file into ION with configurable error handling.

yaml
type: "io.kestra.plugin.serdes.avro.AvroToIon"

Examples

Convert an Avro file to the Amazon Ion format.

yaml
id: avro_to_ion
namespace: company.team
tasks:
  - id: http_download
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/avro/products.avro
  - id: to_ion
    type: io.kestra.plugin.serdes.avro.AvroToIon
    from: "{{ outputs.http_download.uri }}"
    onBadLines: WARN

Properties

from *string

Source file URI

Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.

onBadLines string

Default ERROR

Possible Values

ERRORWARNSKIP

How to handle bad records (e.g., null values in non-nullable fields or type mismatches).

Outputs

uri string

Format uri

URI of the output Ion file

Metrics

records counter

Number of records converted

​Avro​To​Ion

AvroToIon