recordReaderSpec
config in the ingestion job spec.dataFormat
- Name of the data format to consume.className
- name of the class that implements the RecordReader
interface. This class is used for parsing the data.configClassName
- name of the class that implements the RecordReaderConfig
interface. This class is used the parse the values mentioned in configs
configs
- Key value pair for format specific configs. This field can be left out.fileFormat
- can be one of default, rfc4180, excel, tdf, mysqlheader
- header of the file. The columnNames should be seperated by the delimiter mentioned in the configdelimiter
- The character seperating the columnsmultiValueDelimiter
- The character seperating multiple values in a single column. This can be used to split a column into a list.multiValueDelimiter: ''
GenericRecord
. A java class or .avro
file is not required..thrift
file to parse the data. The .class file should be available in the Pinot's classpath. You can put the files in the lib/
folder of pinot distribution directory.INT96
and Decimal
type.INT96
and Decimal
type.INT96
type converts nanosecondsINT64
type of milliseconds.desc
) from the .proto
file using the command -