Paquet Plugin

The plugin provides the ability to create Parquet files.

Installation

Example 1. build.gradle

implementation(group: 'org.vividus', name: 'vividus-plugin-parquet', version: '0.5.0')

Property Name Acceptable values Default Description

Property Name	Acceptable values	Default	Description
`expression.csv-to-parquet.csv-format`	DEFAULT EXCEL INFORMIX_UNLOAD INFORMIX_UNLOAD_CSV MYSQL RFC4180 ORACLE POSTGRESQL_CSV POSTGRESQL_TEXT TDF	DEFAULT	Specifies the format of a CSV file to create a Parquet file from.

expression.csv-to-parquet.csv-format

Specifies the format of a CSV file to create a Parquet file from.

The expression parameters marked with bold are mandatory.

Creates temporary Parquet file, writes CSV data records to the file using Avro schema and returns its path.

#{convertCsvToParquetFile($csv-resource-path, $avro-schema-resource-path)}

$csv-resource-path - The path to a resource containig CSV data.
$avro-schema-resource-path - The path to a resource containig Avro schema.

Example 2. Initialize a variable with a path to a Parquet file

Given I initialize scenario variable `parquet-path` with value `#{convertCsvToParquetFile(data/pets.csv, data/pets-schema.avsc)}`