Acquire / file · All operations
Read another file format
Read any other file format (SAS, SPSS, Stata, PDF, YAML, logs).
Status
- In arcform
Not built yet
arcform does not do this yet. Its place on the roadmap
- Shape of the result
- a new table, from no input table
- Level
- needs a DuckDB extension
Variants
- Read a BI extract file
Read the data held in an extract file written by a business-intelligence tool.
- Read a configuration file
Read a YAML, TOML, properties or INI file into rows.
- Extract text from documents
Pull the text, tables or metadata out of PDF, Word and other documents.
- Read a geospatial file
Read features and their geometry from shapefiles, GeoJSON, geodatabases and tile sets.
- Read a text file line by line
Read a text file into a single string column with one row per line.
- Parse log files
Read web server, system and event logs into records, often with named patterns.
- Read images, audio or video
Load image, audio or video files as pixels, samples or frames.
- Read a machine-learning data file
Read training data and numeric arrays from formats such as ARFF, TFRecord, NumPy and HDF5.
- Read a table saved by a data tool
Read back a table or project stored in a data tool's own saved format.
- Read a statistics package file
Read a data file saved by a statistics package, such as SAS, SPSS, Stata or R, into a table.
- Read a whole file as one value
Read each file unparsed into a single text or binary value, one row per file.
Read another specialised format
Read one of the many formats that only one or two tools support, such as mailboxes, MARC, HL7 or Protocol Buffers.
What other tools call it
Meridian's classification; an independent blind rating agreed on 86.2% of 312 rows (exact class, version 2).
Alteryx Designer (5)
Allocate Inputread 2026-09-27Select geographies and variables from an installed Allocate demographic dataset
Blob Inputread 2026-09-27Read whole files such as images or media as binary objects, one file or a list of files
Image Inputread 2026-09-27Read image and PDF files into the workflow as binary objects
PDF to Textread 2026-09-27Extract text from PDF files, using OCR where pages are images
Profile Inputread 2026-09-27Read a behaviour Profile Set file as input
Apache Hop (7)
Apache Tikaread 2026-09-27Extract text content and metadata from documents of many formats with Apache Tika
De-Serialize From Fileread 2026-09-27Read rows and metadata from a binary Hop serialised file
Load file content in memoryread 2026-09-27Load the whole content of each file into a single field
Properties file Inputread 2026-09-27Read key and value pairs from Java properties or INI files
SAS inputread 2026-09-27Read SAS sas7bdat data files
Yaml Inputread 2026-09-27Read YAML from files or a field and emit rows
vCard Inputread 2026-09-27Read vCard files and emit contact fields as rows
Apache NiFi (9)
CEFReaderread 2026-09-27Read Common Event Format (CEF) events into records
GrokReaderread 2026-09-27Read unstructured text such as log files into records with Grok patterns
ParseEvtxread 2026-09-27Parse a Windows Event Log (evtx) file and write it out as XML
ProtobufReaderread 2026-09-27Read a Protocol Buffers message from binary format into records
StandardProtobufReaderread 2026-09-27Read Protocol Buffers messages into records, with several schema access strategies
Syslog5424Readerread 2026-09-27Read RFC 5424 syslog data into records
SyslogReaderread 2026-09-27Read RFC 5424 or RFC 3164 syslog messages into records
TailFileread 2026-09-27Tail a text file, or a list of them, ingesting new lines as they are written
YamlTreeReaderread 2026-09-27Read YAML into records by walking the document tree
Apache SeaTunnel (1)
Protobuf Formatread 2026-09-27Read and write Kafka messages in Protocol Buffers
AWS Glue (2)
Ion (read)read 2026-09-27Read Ion data from Amazon S3 and other supported connection types
grokLog (read)read 2026-09-27Read grokLog data from Amazon S3 and other supported connection types
Azure Data Factory (2)
Binary format (source)read 2026-09-27Read Binary files in copy activity
Common Data Model format (source)read 2026-09-27Read Common Data Model files in mapping data flow
DuckDB (2)
read_blobread 2026-09-27read_blob table function
read_textread 2026-09-27read_text table function
Duckle (6)
Esri File Geodatabase (.gdb)read 2026-09-25read a feature class from an Esri File Geodatabase with ST_Read
Geospatial (GeoParquet / GeoJSON / Shapefile / GeoPackage)read 2026-09-25read GeoParquet, GeoJSON, Shapefile, GeoPackage, KML, GPX or GML with ST_Read
PDF Pagesread 2026-09-25one row per PDF page with its text layer and document metadata
Qlik QVDread 2026-09-25read Qlik QVD files with a clean-room reader
TOMLread 2026-09-25read a TOML document as a single row
YAMLread 2026-09-25read a YAML document as rows, one per top-level array element
EasyMorph (5)
Import Qlik QVD fileread 2026-09-27Read data or metadata from a Qlik QVD file
Import SAS fileread 2026-09-27Read a SAS .sas7bdat file
Import SPSS fileread 2026-09-27Read an SPSS or PSPP .sav file
Import datasetread 2026-09-27Read a table from EasyMorph's native .dset file
Import plain textread 2026-09-27Read a text file unparsed into a single column
KNIME Analytics Platform (8)
ARFF Readerread 2026-09-27Read a Weka ARFF data file
KNIME Base Chemistry Types & Nodes (extension)read 2026-09-27Extension outside the base install: 15 current nodes: Fingerprint Bayesian Learner; Fingerprint Bayesian Predictor; Mol2 Reader, …
KNIME MDF Integration (extension)read 2026-09-27Extension outside the base install: 1 current node: MDF Reader
KNIME SAS7BDAT Reader (extension)read 2026-09-27Extension outside the base install: 1 current node: SAS7BDAT Reader
KNIME Webanalytics (extension)read 2026-09-27Extension outside the base install: 3 current nodes: Byte Converter; Country Extractor; Web Log Reader
Line Readerread 2026-09-27Read a file or URL line by line into a single string column
Read Imagesread 2026-09-27Read images from a column of URLs and append them as an image column
Table Readerread 2026-09-27Read a table stored in KNIME's native .table format
mlpack (18)
ARFFread 2026-09-27Load mixed categorical and numeric data from .arff; loading only
ArmaBinread 2026-09-27Load or save numeric data in Armadillo's packed arma_binary format
BMPread 2026-09-27Load or save image data as BMP
CoordASCIIread 2026-09-27Load or save a sparse matrix as a coordinate list in text
GIFread 2026-09-27Load image data from a GIF; loading only
HDF5read 2026-09-27Load or save numeric data as HDF5; needs Armadillo built with HDF5 support
JPGread 2026-09-27Load or save image data as JPEG
MP3read 2026-09-27Load audio samples from an mp3 file
PGMread 2026-09-27Load or save a matrix as a PGM image with values 0 to 255
PICread 2026-09-27Load image data from a PICtor file; loading only
PNGread 2026-09-27Load or save image data as PNG
PNMread 2026-09-27Load image data from a Portable Anymap file; loading only
PPMread 2026-09-27Load or save a matrix as a PPM image with values 0 to 255
PSDread 2026-09-27Load image data from a Photoshop file; loading only
RawBinaryread 2026-09-27Load or save packed binary numbers with no header or size information
TGAread 2026-09-27Load or save image data as TGA
WAVread 2026-09-27Load or save audio samples as a wave file
mlpack_image_converterread 2026-09-27Load a set of images into one dataset matrix, or unpack a matrix back into image files
OpenRefine (6)
Import Projectread 2026-09-27Load an exported project archive (.tar.gz) as a new project, with its full change history
MARCread 2026-09-27Read MARC bibliographic records
PC-Axis (PX)read 2026-09-27Read a PC-Axis statistical file
RDF data (JSON-LD, N3, N-Triples, Turtle, RDF/XML)read 2026-09-27Read RDF in any of five serialisations
Text filesread 2026-09-27Read plain text files
Wikitextread 2026-09-27Read wikitext
Pentaho Data Integration (10)
Copybook Inputread 2026-09-27Read binary data files laid out by a fixed-length COBOL copybook definition
De-serialize from fileread 2026-09-27Read rows from a serialised data cube file
ESRI Shapefile Readerread 2026-09-27Read shapes and attributes from an ESRI shapefile and its linked DBF file
HL7 Inputread 2026-09-27Read data from HL7 healthcare message streams
LDIF Inputread 2026-09-27Read entries from LDIF files
Load file content in memoryread 2026-09-27Load the content of a file into memory as a field
Property Inputread 2026-09-27Read key and value pairs from properties files
SAS Inputread 2026-09-27Read SAS sas7bdat files
XBase inputread 2026-09-27Read records from an XBase DBF file
Yaml Inputread 2026-09-27Read YAML from a file or field and emit rows
Polars (3)
DataFrame.deserializeread 2026-09-27Read a frame back from Polars' own serialised form
read_linesread 2026-09-27Read the lines of a text file into one string column
scan_linesread 2026-09-27Lazily read the lines of a text file into one string column
Power Query M (2)
Pdf.Tablesread 2026-09-27Extract the tables found in a PDF file
RData.FromBinaryread 2026-09-27Read the data frames of an RData file into a record of tables
RapidMiner Studio (19)
Process Images from Webcamread 2026-09-27Capture video frames from a webcam and run a subprocess on each frame
Read ARFFread 2026-09-27Read a Weka ARFF file into a table
Read BibTeXread 2026-09-27Read BibTeX bibliography entries into a table
Read Binaryread 2026-09-27Read fixed-length packed binary records into a table using a format string
Read C4.5read 2026-09-27Read data and column metadata from C4.5 .names and .data files
Read DASYLabread 2026-09-27Read a DASYLab measurement data file into a table
Read Documentread 2026-09-27Read a file as a text document, optionally discarding XML or HTML tags
Read Hyper Fileread 2026-09-27Read a table from a Tableau .hyper extract file
Read Imageread 2026-09-27Read an image from disk or a file object
Read Image from Webcamread 2026-09-27Capture a single image from a webcam
Read Office Fileread 2026-09-27Read a Word or PowerPoint file as a text document
Read SASread 2026-09-27Read a SAS data file into a table
Read SPSSread 2026-09-27Read an SPSS file into a table
Read Stataread 2026-09-27Read a Stata data file into a table
Read Videoread 2026-09-27Read the frames of a video file as a collection of images
Read dBaseread 2026-09-27Read a dBase file into a table
Retrieveread 2026-09-27Load a stored object (data table, model, result) from the repository into the process
Retrieve from Custom Extensionread 2026-09-27Load a stored object packaged inside a custom extension
Retrieve from Fileread 2026-09-27Deserialise a stored object (data, model, result) from a file object
Tableau Prep (1)
Tableau data extractsread 2026-09-27Read a Tableau extract (.hyper) file as input
Talend (7)
tApacheLogInputread 2026-09-27Read the access log file of an Apache HTTP server into rows
tExtractEDIFieldread 2026-09-27Read an EDIFACT message file, convert it to XML and extract fields with XPath queries
tFileInputARFFread 2026-09-27Read an ARFF file row by row into fields
tFileInputLDIFread 2026-09-27Read an LDIF file row by row into fields
tFileInputPropertiesread 2026-09-27Read a text file of key = value lines into rows
tFileInputRawread 2026-09-27Read the whole content of a file into a single output column
tQVDInputread 2026-09-27Read data from QVD files
VisiData (48)
babyl (loader)read 2026-09-23Load Babyl mailbox
claude (loader)read 2026-09-23Load Claude Code's .claude directory in the home folder: projects, sessions, messages
conll (loader)read 2026-09-23Load CoNLL annotation file
conllu (loader)read 2026-09-23Load CoNLL-U annotation file
dta (loader)read 2026-09-23Load Stata file via pandas
eml (loader)read 2026-09-23Load MIME email message; also filetype mhtml
f5log (loader)read 2026-09-23Load F5 log
fec (loader)read 2026-09-23Load Federal Election Commission filing
forg (loader)read 2026-09-23Load Emacs Org-mode file (forg variant)
frictionless (loader)read 2026-09-23Load Frictionless Data package
geojson (loader)read 2026-09-23Load GeoJSON
grep (loader)read 2026-09-23Load grep or ripgrep JSON Lines output
h5 (loader)read 2026-09-23Load HDF5; also filetype hdf5
jrnl (loader)read 2026-09-23Load jrnl CLI journal
maildir (loader)read 2026-09-23Load Maildir mailbox
mbox (loader)read 2026-09-23Load mbox mailbox; also filetype mailbox
mbtiles (loader)read 2026-09-23Load MapBox tileset
mh (loader)read 2026-09-23Load MH mailbox
mmdf (loader)read 2026-09-23Load MMDF mailbox
msgpack (loader)read 2026-09-23Load MessagePack; also filetype msgpackz
npy (loader)read 2026-09-23Load NumPy array
npz (loader)read 2026-09-23Load NumPy archive
open-cell-fileread 2026-09-23Open the file or URL whose path is in the current cell
open-fileread 2026-09-23Open a file or URL as a sheet; loader chosen by extension, URL scheme or filetype
open-row-fileread 2026-09-23Open the file in the current Directory Sheet row as a new sheet
open-row-filetyperead 2026-09-23Open file in current row with a prompted filetype
open-rowsread 2026-09-23Open each selected file (or selected HTML element) as its own sheet
org (loader)read 2026-09-23Load Emacs Org-mode file
orgdir (loader)read 2026-09-23Load directory of Org-mode files
pandas (loader)read 2026-09-23Load a format that pandas can read with read_<format>(); also filetype stata
pbf (loader)read 2026-09-23Load protocolbuffer vector tile
pcap (loader)read 2026-09-23Load network packet capture; also filetype cap, ntar, pcapng
pdf (loader)read 2026-09-23Load PDF
png (loader)read 2026-09-23Load PNG image as a sheet of pixels
puz (loader)read 2026-09-23Load crossword .puz file
pyprof (loader)read 2026-09-23Load Python profile data
rec (loader)read 2026-09-23Load recutils database file
sas7bdat (loader)read 2026-09-23Load SAS data file
shp (loader)read 2026-09-23Load ESRI shapefile; also filetype dbf
spss (loader)read 2026-09-23Load SPSS statistics file; also filetype sav
toml (loader)read 2026-09-23Load TOML
ttf (loader)read 2026-09-23Load TrueType or OpenType font; also filetype otf
txt (loader)read 2026-09-23Load plain text, one row per line
vcf (loader)read 2026-09-23Load vCard contacts
vds (loader)read 2026-09-23Load VisiData multi-sheet save file
xd (loader)read 2026-09-23Load crossword .xd file
xpt (loader)read 2026-09-23Load SAS transport file
yml (loader)read 2026-09-23Load YAML; also filetype yaml
Yggdrasil Decision Forests (6)
Google-internal formats (family)read 2026-09-274 formats marked Internal, absent from the public build: sstable+tfe, recordio+tfe, recordio+ygge, capacitor
partial_dataset_cache:read 2026-09-27Read a partly built column cache made for distributed training
tfrecord+tfe: (read and write)read 2026-09-27Deprecated gzip TFRecord reader and writer that needs TensorFlow C++ linked into the binary
tfrecord: (read and write)read 2026-09-27Read or write gzip-compressed TFRecord files of tf.Example rows, with no TensorFlow linked
tfrecordv2+tfe: (read and write)read 2026-09-27Read or write uncompressed TFRecord files of tf.Example rows; alias tfrecord-nocompression
ydf.util.read_tf_recordread 2026-09-27Read TFRecord files of tf.Example rows into a dictionary of NumPy arrays; documented as very slow
Background
In DuckDB, extensions can enhance its functionality by providing support for additional file formats, along with new types and domain-specific functionality.[1] A file format is the way that information is encoded for storage in a computer file, from its bit and byte layout to organisation such as tabular structure.[2] A file format may be standardised, as a proprietary or an open standard, or it can be an ad hoc convention.[2]
When to use it
Some file formats have a published specification, but such a document is not available for every format, sometimes because the format is considered a trade secret.[2] Sometimes a file format is defined de facto by the behaviour of the program that accesses the file.[2] Without a specification, a developer might reverse engineer a file format by inspecting files in it, or acquire the specification for a fee and under a non-disclosure agreement.[2] Because those approaches cost time and money, file formats with publicly available specifications tend to be supported by more programs.[2] Where a format has no published specification, treat any reader as one interpretation of the file, and check a few values against the program that wrote it. (Meridian's view) Keep the original file beside the table you read from it, so the reading can be repeated when a better reader appears. (Meridian's view)
The method
Both users and applications need to identify a file's format so that the file can be used appropriately, and the methods for identification vary by operating system.[2] One popular method, used by many operating systems, indicates the format of a file with a suffix of its file name, known as the extension.[2] Since there is no standardised list of filename extensions, more than one format can use the same extension.[2] Indicating a format by its extension means users and applications can be tricked into treating a file as a different format simply by renaming it.[2]
A file's format may also be indicated inside the file itself, often at its beginning, which is relatively easy for users and applications to read.[2] When a file starts with a relatively small datum that only indicates its format, that datum is often called a magic number.[2] When a reader refuses a file, look at the file's first bytes before trusting its name. (Meridian's view)
Sources
- [1]Extensions – DuckDBdocumentation
- [2]File format - Wikipediasecondary source
Used in
One Protocol uses this operation:
- SuperGPQA dataset, step
corpus