Parse nested values

Rebuild JSON text from the name and value rows of JSON Parse

Split JSON text into name and value rows for downstream processing

Parse XML text into individual fields

123 functions, 67 of them aliases: array_append, array_sort, flatten, array_distance, string_to_array, …

Index into struct fields and list elements

6 functions, 1 of them aliases: map, map_keys, map_values, map_entries, map_extract, …

3 functions, 1 of them aliases: named_struct, row, struct

Read and write columns holding arrays, lists and structs

2 functions: union_extract, union_tag

Expand the fields of a struct into individual columns

Encode several fields of a row as an XML fragment in a new string column

Decode an Avro record column into separate typed fields

Encode chosen fields into a single Avro record column

Convert EDIFACT message text to generic XML

Insert XML fragments from one stream into a target XML document from another

Transform XML files with an XSL stylesheet into XML, HTML or text

Apply an XSL stylesheet to XML held in a field or file

Serialise FlowFile attributes as a CSV line, written to an attribute or to content

Serialise FlowFile attributes as a JSON object, written to an attribute or to content

Evaluate JsonPath expressions against JSON content; results go to attributes or replace content

Evaluate XPath expressions against XML content; results go to attributes or replace content

Evaluate XQuery expressions against XML content; results go to attributes or replace content

Extract the headers of an email into FlowFile attributes

Extract the segments and fields of an HL7 message into FlowFile attributes

Flatten a nested JSON document into single-level keys joined by a separator

Transform JSON content with a JSLT transformation

Restructure JSON content with a Jolt transform specification

Apply a Jolt specification to each record of a FlowFile

Parse NetFlow v5 bytes into attributes or JSON content

Parse an RFC 5424 or RFC 3164 syslog message into attributes

Parse an RFC 5424 syslog message, including structured data, into attributes

Apply an XSLT stylesheet to XML content

Extract values from a JSON field by JsonPath into new typed fields

Extract new columns from a JSON string column

Lift the fields inside structs to top-level fields

Parse a string column holding JSON into a struct or array column

Simplify nested columns that are in the DynamoDB JSON structure

Parse a string field that holds formatted data, such as JSON, into a struct

Flatten nested objects to top-level fields and generate join keys for array objects

Flatten nested columns that are in the DynamoDB JSON structure

20 functions: array, at, contains, distinct, except, …

10 functions: contains, empty, first, intersection, join, …

4 functions: associate, keyValues, mapAssociation, reassociate, …

Parse string columns that hold JSON, delimited text or XML

Turn complex-typed columns into plain strings

Emit an expression extracting the host from a URL string

Emit an expression extracting one query parameter value from a URL string

Emit an expression extracting the path, without query parameters, from a URL string

3 macros: array_append, array_concat, array_construct

Extract the hostname from a URL column

Extract a named query parameter from a URL column

Extract the page path from a URL column

The functions documented on the Array Functions page

The functions documented on the List Functions page

The functions documented on the Map Functions page

The functions documented on the Nested Functions page

The functions documented on the Struct Functions page

The functions documented on the Union Functions page

distinct elements of a list

length of a list

boolean column: does the list contain a value

element of a list by index

flatten nested JSON into columns

extract host, family, netmask or broadcast from IP or CIDR text

extract a value by JSON path

merge JSON objects

parse JSON text

serialise a value to JSON text

extract scheme, host, port, path, query or fragment from a URL by regex

transform a JSON column with a jq program

Build a JSON object from table values

Pull the values at given JSON paths into columns

Delete, replace or rename a JSON property, or reformat the JSON (paid editions only)

Turn a JSON object into a table

Turn XML into a table

Decode x-www-form-urlencoded form submissions into fields

Apply XSLT stylesheets to an XML file on disk; the in-memory table is untouched

Build an array value from a list of expressions

Test whether every element of a boolean array is true

Test whether any element of a boolean array is true

Join two or more arrays end to end

Test whether an array holds a given value

Reduce an array to its unique elements

Keep the array elements for which a lambda is true

Remove one level of nesting from an array of arrays

Get the array element at a given index

Keep the elements two arrays have in common

Count the elements of an array

Apply a lambda to every element of an array

Largest element of each array

Mean of the elements of each array

Smallest element of each array

Most frequent element of each array

Find the index of a value within an array

Drop every occurrence of a value from an array

Repeat the elements of an array a given number of times

Take a start-to-stop slice of an array

Sort the elements of an array

Join the strings of an array into one string with a separator

Sum of the elements of each array

Combine two arrays, keeping the distinct elements

Zip arrays element by element into an array of structs

Extract the authority from a URL

Extract the file part from a URL

Extract the fragment from a URL

Extract the host from a URL

Extract the path from a URL

Extract the protocol from a URL

Extract the query string, or one named parameter of it, from a URL

Extract the user info from a URL

Get a value from a JSON object by key, or from a JSON array by index

Build a map from an array of keys and an array of values

Test whether a map has a given key

Look up a map value by key, with a default when the key is absent

Keys of a map as an array

Count the keys of a map

Combine two maps into one; on a shared key the value from the first map is kept

Values of a map as an array

Build a struct column from named expressions

Extract one named field from a struct value

Convert a JSON value into an array of JSON values

Convert a JSON value into a map from string keys to JSON values

Extract a JSON boolean as a native boolean

Extract a JSON number as a native 64-bit float

Extract a JSON number as a native 64-bit integer

Extract a JSON string as a native string

Build one XML element per row from column values, with custom name and attributes

Collect several columns into one list or set column

Build one JSON object per row from selected columns

Combine several JSON columns into one JSON column

Compute a JSON patch describing the difference between two JSON columns

Extract values from a JSON column by JSONPath queries into new columns

Extract JSON values using JSONPath queries supplied in a second table

Combine the JSON values of all rows into a single JSON value

Apply a JSON patch or merge patch to a JSON column

Flatten a JSON column into columns by inferring its structure

Convert JSON values to XML documents

Pack probability columns, or one-hot a string column, into a probability-distribution cell

Parse string values into JSON values

Parse string values into XML values

Convert selected columns into a single JSON value, row-wise or column-wise

Merge several XML columns into one XML column

Combine the XML cells of a column into a single XML value

Convert XML values to JSON values

Run XPath queries on an XML column into new columns

Apply XSLT stylesheets to the cells of an XML column

10 functions: join, sort, reverse, uniques, zip

2 functions: jsonize, parseJson

12 functions: parseHtml, parseXml, select, htmlAttr, htmlText

1 function: parseUri

Encode several fields into an XML fragment

Convert an Edifact message to XML to ease extraction

Decode an incoming HBase key and result object into fields through a mapping

Join a stream of XML tags into a target XML string

Transform an XML stream with an XSL stylesheet

Pack the columns of each row into one struct value, giving a Series

Spread the fields of struct columns into separate columns

29 expressions: get, contains, sort, unique, sum and others; work on the elements of fixed-size array values

44 expressions: get, contains, eval, set_union, explode and others; work on the elements of list values

2 expressions: json_decode, json_path_match; parse JSON text into typed values, or pull one JSONPath match

7 expressions: field, unnest, rename_fields, with_fields, json_encode and others; read and edit struct fields

12 functions: ARRAY_AGG, ARRAY_CONTAINS, ARRAY_GET, ARRAY_LENGTH, ARRAY_LOWER and others; SQL array functions

Join several columns row by row into one fixed-size array column

Join several columns row by row into one list column

Flatten nested, already-decoded JSON records into a flat table

Collect several columns into a list column, one element per expression

Pack several columns into one struct column

40 functions: BinaryFormat.Record, BinaryFormat.List, Binary.Decompress, Binary.FromText, Binary.ToText

Serialise a value to JSON as binary in a given text encoding

71 functions: List.Transform, List.Select, List.Sum, List.Distinct, List.Generate

23 functions: Record.Field, Record.ToTable, Record.FromList, Record.TransformFields, Geography.FromWellKnownText

Merge several columns into one record-valued column keyed by the source column names

Spread the fields of a record-valued column into separate columns

Build a table from a list of column value lists, with optional names or types

Turn a list into a table, splitting each item into columns with a splitter function

Turn a list of records into a table, one row per record

Build a table from a list of row value lists, with optional column names or types

Wrap any value or list of values as a single-column table

Return the table as a list of lists, one inner list per column

Collapse each row to one value with a combiner function and return the list

Return the table as a list of records, one per row

Return the table as a list of lists, one inner list per row

4 functions: Uri.Parts, Uri.BuildQueryString, Uri.Combine, Uri.EscapeDataString

Build nested JSON documents from the rows of a table

URL-decode the values of selected columns

URL-encode the values of selected columns

Extract the main text blocks from an HTML document, skipping short boilerplate

Extract values from a document into metadata by string match, regex, XPath or index

Add columns extracted from a text column by XPath, JSONPath, regex or string matching

Convert an HTML document into well-formed XML

Flatten JSON documents into table rows and columns

Convert a JSON document to XML

Transform an XML document with an XSLT stylesheet

Transform JSON input into JSON output with a DSQL query

Convert an EDIFACT message file to XML by EDIFACT version and family

Parse a column of Dynamic type into standard output columns

Extract values from a JSON column by JSONPath or XPath queries

Extract values from an XML column into the output schema

Serialise rows into Avro binaries for components that need serialised input

Combine input columns into one output column of Dynamic type

Build a JSON field from the columns of the incoming rows

Build an XML structure from the input columns and write it into a field

Serialise the columns of each row into one XML string or byte array column

Map and route XML documents between inputs and outputs, optionally joined with flat data

Transform an XML file into an output file with an XSL stylesheet

Extract key-value pairs from text into an Object column

Extract fields from a URL query string

Extract key-value pairs from a string column into an Object column

Build an Object or Array column from the names and values of several columns

Convert columns into an Object or Array column

22 functions: ARRAYCONCAT, ARRAYSTOMAP, ARRAYZIP, KEYS, LISTSUM; array and Object manipulation

Unpack keys of an Object or elements of an Array into new columns

Extract elements of an Object or Array into columns

Add column extracting elements by a CSS selector

Add column for a named XML attribute

Remove expanded child columns and restore the parent column

Contract current column's expansion to a given depth

Remove all expanded child columns and restore their parents

Contract all expansions to a given depth

From Columns Sheet, contract selected columns into one grouped column

Open the children of current XML element as a table

Expand current column of lists or dicts into one column per key, one level

Expand current column of lists or dicts to a given depth

Expand all visible columns of lists or dicts one level

Expand all visible columns of lists or dicts to a given depth