Airbyte Connector for JSON Files

Replicate your data in minutes, through our UI or programmatically with our API.

Replicate your JSON files in your data warehouse and lakes in minutes

JSON Files are often exchanged or published in various remote locations. This source aims to support an expanding range of storage providers (HTTPS, Google Cloud Storage, AWS S3, SFTP / SSH / SCP, WebHDFS, Local filesystem,…).

The Files source supports Full Refresh syncs. That is, every time a sync is run, Airbyte will copy all rows in the file and columns you set up for replication into the destination in a new table.

Check our detailed documentation on how to start syncing your JSON files.

Storage providers

Storage Providers / Supported

  • HTTPS / Yes
  • Google Cloud Storage / Yes
  • AWS S3 / Yes
  • SFTP, SSH, SCP / Yes
  • WebHDFS / Untested
  • Local filesystem / Untested
  • Azure Blob Storage / Untested (hidden)
  • HDFS / Untested (hidden)

Features of the connector

Feature
Supported
Full Refresh Sync
Yes
Incremental Sync
Coming soon
Replicate Incremental Deletes
Coming soon
Replicate Folders (multiple files)
Coming soon
Replicate Glob Patterns (multiple files)
Yes

Resulting schema

At this time, this source produces only a single stream for the target file as it replicates only one file at a time for the moment. We’ll be considering improving this behavior by globing folders or using patterns to capture more files in the next iterations as well as more file formats and storage providers.

Similar connectors

Stay in the know

Get the latest Airbyte news by email, with the latest community contributions, product updates and articles.