Paquet Plugin

The plugin provides the ability to create Parquet files.

Installation

Example 1. build.gradle
implementation(group: 'org.vividus', name: 'vividus-plugin-parquet', version: '0.4.16')

Properties

Property Name Acceptable values Default Description

expression.csv-to-parquet.csv-format

DEFAULT

Specifies the format of a CSV file to create a Parquet file from.

Expressions

The expression parameters marked with bold are mandatory.

convertCsvToParquetFile

Creates temporary Parquet file, writes CSV data records to the file using Avro schema and returns its path.

#{convertCsvToParquetFile($csv-resource-path, $avro-schema-resource-path)}

  • $csv-resource-path - The path to a resource containig CSV data.

  • $avro-schema-resource-path - The path to a resource containig Avro schema.

Example 2. Initialize a variable with a path to a Parquet file
When I initialize the scenario variable `parquet-path` with value `#{convertCsvToParquetFile(data/pets.csv, data/pets-schema.avsc)}`