Fivetran Connector SDK allows Real-time, efficient data replication to your destination of choice.
Explore practical examples and ready-to-use connectors for building custom data connectors with the Fivetran Connector SDK. This repository contains 100+ community-contributed connectors and helpful resources to extend Fivetran's capabilities to fit your data integration needs.
This repository is a comprehensive catalog of connector examples demonstrating how to integrate various data sources with Fivetran using the Connector SDK. Whether you're looking to connect to a specific database, API, or data source, you'll find practical examples and patterns to get started quickly.
For SDK installation and setup, visit the main Fivetran Connector SDK repository.
Fivetran Connector SDK allows you to code a custom data connector using Python and deploy it as an extension of Fivetran. Fivetran automatically manages running Connector SDK connections on your scheduled frequency and manages the required compute resources, eliminating the need for a third-party provider.
Connector SDK provides native support for many Fivetran features and relies on existing Fivetran technology. It also eliminates timeout and data size limitations seen in AWS Lambda.
- Python version ≥3.10 and ≤3.14
- Operating system:
- Windows: 10 or later (64-bit only)
- macOS: 13 (Ventura) or later (Apple Silicon [arm64] or Intel [x86_64])
- Linux: Distributions such as Ubuntu 20.04 or later, Debian 10 or later, or Amazon Linux 2 or later (arm64 or x86_64)
- Install the Connector SDK: See Setup guide to get started.
- Choose a connector example: Browse the community connectors below to find an example similar to your use case.
- Customize and deploy: Modify the connector code to fit your requirements and deploy using the Fivetran CLI.
Run the .github/scripts/setup-hooks.sh script from the root of the repository to set up pre-commit hooks. This ensures that your code is formatted correctly and passes all tests before you commit them.
Note: To simplify the processes of building and maintaining connectors with Connector SDK, we've removed the need to use the Python generator pattern with Connector SDK operations,
yield, starting with Connector SDK version 2.0.0. This change is fully backward compatible, so your existing Connector SDK connections will continue to function without modification. For more information, refer to our Connector SDK release notes.
These are ready-to-use connectors, requiring minimal modifications to get started. Browse by category or search for your specific data source:
📋 Full List of Connectors (109 connectors)
- apache_druid/using_pydruid - This example demonstrates syncing from Apache Druid using the PyDruid library for native query capabilities, retry logic with exponential backoff, and optimized data retrieval for enhanced performance.
- apache_druid/using_sql - This example shows how to sync data from Apache Druid datasources using Druid's SQL API with time-based pagination and incremental sync to efficiently replicate event and analytics data.
- apache_hbase - Connect and sync data from Apache HBase using happybase and thrift libraries
- apache_hive/using_pyhive - Sync data from Apache Hive using PyHive
- apache_hive/using_sqlalchemy - Sync data from Apache Hive using SQLAlchemy with PyHive
- arango_db - Sync document and edge collections from ArangoDB multi-model database
- cassandra - Connect and sync data from Cassandra database
- clickhouse - Sync data from ClickHouse database
- couchbase_capella - Sync data from Couchbase Capella
- couchbase_magma - Sync data from self-managed Couchbase Server using Magma storage
- dgraph - Sync e-commerce product catalog from Dgraph graph databases
- documentdb - Connect to AWS DocumentDB and sync collections (Hybrid Deployment compatible)
- dolphin_db - Sync data from DolphinDB database
- dragonfly_db - Sync high-performance in-memory data from DragonflyDB
- ehi/simple_ehi - This example shows how to sync EHI tables such as Caboodle using Connector SDK. It connects to Microsoft SQL server to sync the data. You need to provide your server credentials for this example to work.
- ehi/high_volume_ehi - High-volume Microsoft SQL Server connector for syncing high volume EHI tables using keyset and offset pagination with parallel processing
- firebird_db - Sync data from Firebird DB
- greenplum_db - Sync data from Greenplum database
- ibm_db2 - This example shows how to connect and sync data from IBM Db2 using Connector SDK. It uses the
ibm_dblibrary to connect to the database and fetch data. - ibm_db2_log_based_replication - This example demonstrates log-based Change Data Capture (CDC) for IBM Db2 using the ASN SQL Replication framework. The
asncapdaemon reads the Db2 transaction log and writes every INSERT, UPDATE, and DELETE to a Change Data table; the connector reads exclusively from that table after the initial load, making this genuine log-based replication without polling the source. - ibm_informix_using_ibm_db - This example shows how to connect and sync data from IBM Informix using Connector SDK. This example uses the
ibm_dblibrary to connect to the Informix database and fetch data. - janus_graph - This example shows how to sync data from the Janus Graph database using the Connector SDK. You need to provide your Janus Graph credentials for this example to work.
- influx_db - Sync time-series data from InfluxDB
- neo4j - Extract data from Neo4j graph databases
- quest_db - Sync high-performance time series data from QuestDB
- raven_db - Sync document data from RavenDB NoSQL database
- redis - Sync gaming leaderboards and player statistics from Redis
- rethink_db - Sync data from RethinkDB real-time database
- sap_hana_sql - Connect to SAP HANA SQL Server using hdbcli
- sql_server - Connect to SQL Server using pyodbc
- teradata - Sync data from Teradata Vantage database
- tidb - Incremental replication from TiDB databases
- timescale_db - Sync time-series and vector data from TimescaleDB
- yugabyte_db - Sync data from YugabyteDB distributed SQL database
- aws_athena/using_boto3 - Sync data from AWS Athena using Boto3
- aws_athena/using_sqlalchemy - Sync data from AWS Athena using SQLAlchemy with PyAthena
- aws_dynamo_db_authentication - Connect and sync data from AWS DynamoDB
- aws_rds_oracle - Connect and sync data from AWS Oracle
- redshift/simple_redshift_connector - Sync records from Redshift
- redshift/large_data_volume - Sync large data volumes from Redshift
- redshift/using_unload - Sync data from Redshift using UNLOAD to S3
- apache_pulsar - Fetch data from Apache Pulsar topics with Reader API
- gcp_pub_sub - Sync data from Google Cloud Pub/Sub
- rabbitmq - Sync messages from RabbitMQ queues
- solace - Sync messages from Solace queue
- amazon_video_central - Sync report data from Amazon Video Central API
- awardco - Sync data from Awardco rewards platform
- betterstack - Sync uptime monitoring data from Better Stack
- checkly - Sync monitoring check data and analytics from Checkly
- clerk - Sync user data from Clerk authentication
- commonpaper - Sync agreement data from Common Paper
- courier - Sync notifications data from Courier multi-channel platform
- customer_thermometer - Sync customer feedback from Customer Thermometer
- data_camp - Sync course catalog from DataCamp LMS
- discord - Sync data from Discord
- docusign - Sync data from Docusign eSignature API
- elastic_email - Sync email marketing data from Elastic Email
- fleetio - Sync fleet management data from Fleetio
- fred - Sync economic data from Federal Reserve Economic Data (FRED)
- github - Sync repository data, commits, and pull requests from GitHub
- github_traffic - Sync GitHub repository traffic data
- gnews - Sync news articles from GNews API
- google_trends - Sync search interest data from Google Trends
- goshippo - Sync shipment data from Goshippo API
- grey_hr - Sync HR data from greytHR API
- gumroad - Sync sales, products, and subscribers from Gumroad
- harness_io - Connect and sync data from Harness.io
- healthchecks - Sync health check monitoring from Healthchecks.io
- hubspot - Sync event data from HubSpot
- iterate - Sync NPS survey data from Iterate REST API
- keycloak - Sync IAM data from Keycloak Admin API
- leavedates - Sync leave report data from LeaveDates API
- mailerlite - Sync email marketing data from MailerLite
- mastertax - Sync data from MasterTax API
- meilisearch - Sync index metadata and documents from MeiliSearch
- microsoft_excel - Sync data from Microsoft Excel files
- microsoft_intune - Retrieve managed devices from Microsoft Intune
- n8n - Sync workflow automation data from n8n
- netlify - Sync sites, deploys, and forms from Netlify API
- newsapi - Sync news articles from NewsAPI
- noaa - Sync weather observations from National Weather Service
- npi_registry - Sync healthcare provider data from NPPES NPI Registry
- oauth2_and_accelo_api_connector_multithreading_enabled - Sync data from Accelo API with OAuth 2.0 and multithreading
- odata_api - Sync data from OData APIs (versions 2 and 4)
- oktopost - Sync social media exports from Oktopost BI API
- oura_ring - This example shows how to sync health and wellness data from the Oura Ring API v2 using Connector SDK. It syncs daily activity, sleep, readiness, stress, and heart rate data with incremental syncing, cursor-based pagination, automatic flattening of nested contributor objects, and date-range chunking for high-volume heart rate data. You need to provide your Oura Personal Access Token for this example to work.
- owasp_api_vulns - Sync OWASP API vulnerability data from NVD 2.0
- partech - Sync POS data from Partech (formerly Punchh)
- pindrop - Sync nightly report data from Pindrop
- prefect - Sync workflow orchestration data from Prefect Cloud
- prometheus - Sync metrics and time series from Prometheus
- resend - Sync email data from Resend API
- rillet - This example shows how to use the Connector SDK to integrate with Rillet's API and sync accounting data. You need to provide the API key for this example to work.
- s3_csv_validation - Read and validate CSV files from Amazon S3
- sam_gov - Sync government contracting opportunities from SAM.gov
- sap_ariba - Sync procurement data from SAP Ariba
- sendcloud - Sync shipment data from Sendcloud API
- sensor_tower - Sync mobile app market intelligence from Sensor Tower
- sensource - Sync traffic and occupancy metrics from SenSource
- similarweb - Sync website performance metrics from SimilarWeb
- smartsheets - Sync sheets and reports from Smartsheets
- snipeitapp - Sync IT asset management data from Snipe-IT
- status_cake - Sync uptime monitoring from StatusCake
- suitedash - Sync CRM data from SuiteDash API
- supabase - Sync employee data from Supabase database
- talon_one - Sync events data from Talon.One
- temporal_cloud - This example shows how to sync workflow execution and schedule data from Temporal Cloud using Connector SDK. It retrieves workflow metadata, as well as schedule configurations. The connector uses async operations for efficient data retrieval and implements streaming to handle large datasets. You need to provide your Temporal Cloud host, namespace, and API key for this example to work.
- toast - Sync POS data from Toast
- tulip_interfaces - Sync data from Tulip Tables
- veeva_vault/basic_auth - Authenticate to Veeva Vault with basic auth
- veeva_vault/session_id_auth - Authenticate to Veeva Vault with session ID
- vercel - Sync deployment data from Vercel REST API
- weights_and_biases - This example shows how to sync machine learning experiment tracking data from Weights & Biases (W&B), including projects, runs (experiments), and artifacts (models and datasets), using the Fivetran Connector SDK The connector uses the W&B Python SDK to retrieve data and implements robust error handling. You need to provide your W&B API key and entity name for this example to work.
- zigpoll - Sync polling data from Zigpoll
- _template_connector - Reference template for building new connectors
- CONTRIBUTING.md - Guide for contributing to this repository
- PYTHON_CODING_STANDARDS.md - Python coding standards and best practices
- FIVETRAN_CODING_PRINCIPLES.md - Code review principles and PR guidelines
- Connector SDK Documentation - Official SDK documentation
- Connector SDK Best Practices - Best practices guide
We welcome contributions from the community! Whether you want to add a new connector, improve existing ones, or fix bugs, your contributions are appreciated.
Please read our CONTRIBUTING.md guide for detailed information on:
- How to fork and create a pull request
- Coding standards and guidelines
- Testing requirements
- Review process
Found an issue? Submit an issue and get connected to a Fivetran developer.
Learn how we support Fivetran Connector SDK.
We provide examples to help you effectively use Fivetran's Connector SDK. While we've tested the code provided in these examples, Fivetran cannot be held responsible for any unexpected or negative consequences that may arise from using these examples.
Note that API calls made by your Connector SDK connection may count towards your service's API call allocation. Exceeding this limit could trigger rate limits, potentially impacting other uses of the source API.
It's important to choose the right design pattern for your target API. Using an inappropriate pattern may lead to data integrity issues. We recommend that you review all our examples carefully to select the one that best suits your target API. Keep in mind that some APIs may not support patterns for which we currently have examples.
As with other new connectors, SDK connectors have a 14-day trial period during which your usage counts towards free MAR. After the 14-day trial period, your usage counts towards paid MAR. To avoid incurring charges, pause or delete any connections you created to run these examples before the trial ends.
The fivetran_csdk_connectors repository is actively maintained by Fivetran Developers. Reach out to our Support team for any inquiries.
This project is licensed under the MIT License - see the LICENSE file for details.