recordReaderSpecconfig in the ingestion job spec.
dataFormat- Name of the data format to consume.
className- name of the class that implements the
RecordReaderinterface. This class is used for parsing the data.
configClassName- name of the class that implements the
RecordReaderConfiginterface. This class is used the parse the values mentioned in
configs- Key value pair for format specific configs. This field can be left out.
fileFormat- can be one of default, rfc4180, excel, tdf, mysql
header- header of the file. The columnNames should be seperated by the delimiter mentioned in the config
delimiter- The character seperating the columns
multiValueDelimiter- The character seperating multiple values in a single column. This can be used to split a column into a list.
GenericRecord. A java class or
.avrofile is not required.
.thriftfile to parse the data. The .class file should be available in the Pinot's classpath. You can put the files in the
lib/folder of pinot distribution directory.
.desc) from the
.protofile using the command -