Storage integrations are required to permit Snowflake to read data from and write to a cloud storage location. More information can be found at CREATE STORAGE INTEGRATION. A storage integration is a Snowflake object that stores a generated identity and access management (IAM) entity for your external cloud storage, along with an optional set of permitted or blocked storage locations (Amazon S3, Google Cloud Storage, or Microsoft Azure). Storage Integration: use a Snowflake storage integration.
Users can choose either:Ĭredentials: Uses Azure security credentials (configured in the Matillion ETL environment). Selecting will avail the user of properties to specify a custom staging area on Azure Blob Storage Internal stages can be setup this way to store staged data within Snowflake. Staging areas can be created through Snowflake using the CREATE STAGE command. To ensure these columns are set up beforehand, users can load their data with Matillion ETL's Azure Blob Load Generator. The table's data and structure are only accessed at runtime, meaning that additional columns must be added (and data types set) before the job is run.The Metadata Fields property will insert metadata columns at the end of the existing table and overwrite the same number of columns unless additional columns are added via the Create Table component.The Create Table component can be used to specify the metadata of the columns. All columns to be included in the load must be included in the Load Columns property, in the correct order and associated with the correct data type.If using an external stage, please be aware of the following information:
Important Information: External Stages and Metadata