Connecting To Your Data
Core Skills#
- How to choose which DataConnector to use
- How to configure an InferredAssetDataConnector
- How to configure a ConfiguredAssetDataConnector
- How to configure a RuntimeDataConnector
- How to configure a DataConnector to introspect and partition a file system or blob store
- How to create a Batch of data from an in-memory Spark or Pandas dataframe
- How to get a Batch of data from a configured Datasource
In memory#
- How to connect to in-memory data in a Pandas dataframe
- How to connect to in-memory data in a Spark dataframe
Database#
- How to connect to a Athena database
- How to connect to a BigQuery database
- How to connect to a MySQL database
- How to connect to a PostgreSQL database
- How to connect to a Redshift database
- How to connect to a Snowflake database
- How to connect to a SQLite database
Filesystem#
- How to connect to data on a filesystem using Pandas
- How to connect to data on a filesystem using Spark
Cloud#
- How to connect to data on S3 using Pandas
- How to connect to data on S3 using Spark
- How to connect to data on GCS using Pandas
- How to connect to data on GCS using Spark
- How to connect to data on Azure Blob Storage using Pandas
- How to connect to data on Azure Blob Storage using Spark