JSONPATHARRAYDEFAULTEMPTY

Extracts an array from jsonField based on 'jsonPath', the result type is inferred based on JSON value. Returns empty array for null or parsing error. This function can only be used in an ingestion transformation function.
Signature
JSONPATHARRAYDEFAULTEMPTY(jsonField, 'jsonPath')
Arguments
Description
jsonField
An Identifier/Expression contains JSON documents.
'jsonPath'
Follows JsonPath Syntax to read values from JSON documents.
'jsonPath'` is a literal. Pinot uses single quotes to distinguish them from identifiers.

You can use the Jayway JsonPath Evaluator Tool to test JSON expressions before you import any data.
Usage Examples
The usage examples are based on extracting fields from the following JSON document:
1
{
2
  "data": {
3
    "name": "Pete",
4
    "age": 24,
5
    "subjects": [
6
      {
7
        "name": "maths",
8
        "homework_grades": [80, 85, 90, 95, 100],
9
        "grade": "A",
10
        "score": 90
11
      },
12
      {
13
        "name": "english",
14
        "homework_grades": [60, 65, 70, 85, 90],
15
        "grade": "B",
16
        "score": 70
17
      }
18
    ]
19
  }
20
}
Copied!
Expression
Value
JSONPATHARRAYDEFAULTEMPTY(myJsonRecord, '$.subjects[*].name')
["maths", "english"]
JSONPATHARRAYDEFAULTEMPTY(myJsonRecord, '$.subjects[*].score')
[90, 70]
JSONPATHARRAYDEFAULTEMPTY(myJsonRecord, '$.subjects[*].homework_grades[1]')
[85, 65]
JSONPATHARRAYDEFAULTEMPTY(myJsonRecord, '$.subjects[*].homework_grades[7]')
[]
This function can be used in the table config to extract the name, score, and second value of homework_grades into their respective columns , as described below:
1
{
2
   "tableConfig":{
3
      "ingestionConfig":{
4
         "transformConfigs":[
5
            {
6
               "columnName":"names",
7
               "transformFunction":"JSONPATHARRAYDEFAULTEMPTY(data, '$.subjects[*].name')"
8
            },
9
            {
10
               "columnName":"ages",
11
               "transformFunction":"JSONPATHARRAYDEFAULTEMPTY(data, '$.subjects[*].score')"
12
            },
13
            {
14
               "columnName":"homeworkGrades",
15
               "transformFunction":"JSONPATHARRAYDEFAULTEMPTY(data, '$.subjects[*].homework_grades[1]')"
16
            }
17
         ]
18
      }
19
   }
20
}
Copied!

JSONPATHARRAY

JSONPATHDOUBLE

Last modified 11d ago

Copy link

Contents

Signature

Usage Examples