# Query Iceberg Tables with Snowflake and Tableflow in Confluent Cloud
Tableflow enables seamless integration with Snowflake® by materializing
Apache Flink® topics into Apache Iceberg™ tables, which you can query directly in
Snowflake. By leveraging Snowflake’s externally managed Iceberg table
capabilities, Tableflow publishes metadata to its built-in Iceberg REST
Catalog or compatible external catalog, like AWS Glue, which ensures efficient,
query-ready access to streaming data.
You can use Snowflake with the Tableflow Catalog, or you can use Snowflake
with the AWS Glue Data Catalog.
Use Snowflake with Tableflow Catalog
: - [Step 1: Enable access to your S3 bucket](#cloud-tableflow-query-with-snowflake-enable-s3-access)
- [Step 2: Create a Snowflake external volume](#cloud-tableflow-query-with-snowflake-create-external-volume)
- [Step 3: Create the Snowflake catalog integration](#cloud-tableflow-query-with-snowflake-create-catalog-integration)
- [Step 4: Create the Iceberg table](#cloud-tableflow-query-with-snowflake-create-iceberg-table)
- [Step 5: Query the Iceberg table](#cloud-tableflow-query-with-snowflake-query-iceberg-table)
Use Snowflake with Snowflake Open Catalog
: - [Use Snowflake with Snowflake Open Catalog](#cloud-tableflow-query-with-snowflake-open-catalog)
Use Snowflake with AWS Glue Data Catalog integration
: - [Step 1: Configure AWS Glue Data Catalog integration in Tableflow](#cloud-tableflow-query-with-snowflake-configure-aws-glue)
- [Step 3: Configure access permissions for the AWS Glue Data Catalog](#cloud-tableflow-query-with-snowflake-configure-access-for-aws-glue)
- [Step 4: Create a Catalog integration in Snowflake](#cloud-tableflow-query-with-snowflake-create-catalog-integration-aws)
- [Step 5: Retrieve the AWS IAM user and external ID for your Snowflake account](#cloud-tableflow-query-with-snowflake-retrieve-iam-user)
- [Step 6: Grant the IAM user permissions to access the AWS Glue Data Catalog](#cloud-tableflow-query-with-snowflake-grant-iam-user-perms)
- [Step 4: Create the Iceberg table](#cloud-tableflow-query-with-snowflake-create-iceberg-table)
- [Step 5: Query the Iceberg table](#cloud-tableflow-query-with-snowflake-query-iceberg-table)
## Prerequisites
- Tableflow is enabled for the topic you plan to materialize into a table,
by completing steps 1-4 in the
[Tableflow Quick Start](../../get-started/quick-start-managed-storage.md#cloud-tableflow-quick-start-managed-storage).
- Docker is installed and running in your development environment.
## Use Snowflake with Tableflow Catalog
An Iceberg REST catalog integration enables Snowflake to access Iceberg
tables managed in a remote catalog that complies with the open-source Iceberg
REST OpenAPI specification. This means that you can access Confluent
Tableflow’s Iceberg tables by using the built-in Iceberg REST Catalog.
### Step 1: Enable access to your S3 bucket
1. Enable Snowflake access to your S3 bucket by following the
[Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-external-volume-s3),
and obtain the following properties for the storage bucket.
- STORAGE_BASE_URL
- STORAGE_AWS_ROLE_ARN
- STORAGE_AWS_EXTERNAL_ID
### Step 2: Create a Snowflake external volume
1. In Snowflake, run the following query to create a Snowflake external volume.
Use the values from the previous step in the storage locations properties.
```sql
CREATE OR REPLACE EXTERNAL VOLUME stock-trades-volume
STORAGE_LOCATIONS =
(
(
NAME = 'tableflow-quickstart-storage'
STORAGE_PROVIDER = 'S3'
STORAGE_BASE_URL = 's3://tableflow-quickstart-storage'
STORAGE_AWS_ROLE_ARN = ''
STORAGE_AWS_EXTERNAL_ID = ''
)
)
ALLOW_WRITES = FALSE;
```
2. In Snowflake, run the following command.
```sql
DESCRIBE EXTERNAL VOLUME stock-trades-volume
```
From the result, get the following properties and provide them to the
Confluent Tableflow team to update the trust policies of the S3 bucket.
- STORAGE_AWS_IAM_USER_ARN
- STORAGE_AWS_EXTERNAL_ID
### Step 3: Create the Snowflake catalog integration
1. Run the following query to create the Snowflake catalog integration. For the
`CATALOG_URI`, `OAUTH_CLIENT_ID`, and `OAUTH_CLIENT_SECRET` properties,
use the values you obtained previously.
```sql
CREATE OR REPLACE CATALOG INTEGRATION tableflow_rest_catalog_integration
CATALOG_SOURCE=ICEBERG_REST
TABLE_FORMAT=ICEBERG
CATALOG_NAMESPACE=''
REST_CONFIG = (
CATALOG_URI = ''
CATALOG_API_TYPE = PUBLIC
)
REST_AUTHENTICATION=(
TYPE=OAUTH
OAUTH_CLIENT_ID=''
OAUTH_CLIENT_SECRET=''
OAUTH_ALLOWED_SCOPES=('catalog')
)
ENABLED=true;
```
### Step 4: Create the Iceberg table
Create the Iceberg table using the external volume and Snowflake catalog
integration you created in the previous steps. Replace ``
with `tableflow-ea-stock-trades`.
```sql
CREATE OR REPLACE ICEBERG TABLE snowflake_stock_trades
EXTERNAL_VOLUME = 'stock-trades-volume'
CATALOG = 'tableflow_rest_catalog_integration'
CATALOG_TABLE_NAME = ''
```
### Step 5: Query the Iceberg table
Run the following statement to query the Iceberg table:
```sql
SELECT * from snowflake-stock-trades;
```
## Use Snowflake with Snowflake Open Catalog
You can use the Snowflake Open Catalog as the Iceberg catalog to query
Iceberg tables created by Tableflow.
1. Configure the Snowflake Open Catalog as an external catalog by using catalog
integration in Tableflow. This enables the metadata of Iceberg tables
materialized by Tableflow to be published to the Snowflake Open Catalog.
2. Create a Snowflake catalog integration with Snowflake Open Catalog to enable
seamless access.
1. Configure Tableflow catalog integration for Snowflake Open Catalog by
following the steps in
[Integrate Tableflow with Snowflake Open Catalog or Apache Polaris](../catalog-integration/integrate-with-snowflake-open-catalog-or-apache-polaris.md#cloud-tableflow-integrate-with-snowflake-open-catalog)
2. To query Tableflow Iceberg tables published to Snowflake Open Catalog,
you must create an external volume using the same storage bucket you used
to store Iceberg tables by following the steps in
[Configure an external volume for Amazon S3](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-external-volume-s3).
3. To use Snowflake to query your Iceberg tables, you must create a catalog
integration in Snowflake pointing to the Snowflake Open Catalog service by
running the following query.
```sql
CREATE OR REPLACE CATALOG INTEGRATION my_snowflake_open_catalog_int
CATALOG_SOURCE=POLARIS
TABLE_FORMAT=ICEBERG
CATALOG_NAMESPACE=''
REST_CONFIG = (
CATALOG_URI ='https://-.snowflakecomputing.com/polaris/api/catalog'
WAREHOUSE = 'my_tableflow_ext_catalog'
)
REST_AUTHENTICATION = (
TYPE=OAUTH
OAUTH_CLIENT_ID=''
OAUTH_CLIENT_SECRET=''
OAUTH_ALLOWED_SCOPES=('PRINCIPAL_ROLE:my_polaris_principal_role')
)
ENABLED=true;
```
4. Run the following query to create an externally managed Iceberg table.
```sql
CREATE ICEBERG TABLE open_catalog_orders_iceberg_table
CATALOG = 'my_snowflake_open_catalog_int'
EXTERNAL_VOLUME = 'my_tableflow_data_volume'
CATALOG_TABLE_NAME = 'orders_topic';
```
5. Run the following query to query your data.
```sql
SELECT * FROM open_catalog_orders_iceberg_table;
```
## Use Snowflake with AWS Glue Data Catalog integration
You can use the AWS Glue Data Catalog as the Iceberg catalog to query
Iceberg tables created by Tableflow. To do this, first configure the
AWS Glue Data Catalog as an external catalog. This enables the metadata
of Iceberg tables materialized by Tableflow to be published to AWS
Glue. Next, create a Snowflake catalog integration with AWS Glue to enable
seamless access.
### Step 1: Configure AWS Glue Data Catalog integration in Tableflow
To consume Tableflow tables in Snowflake with the AWS Glue Data Catalog,
configure
[AWS Glue Catalog Integration](../catalog-integration/integrate-with-aws-glue-catalog.md#cloud-tableflow-integrate-with-aws-glue-catalog).
### Step 2: Create a Snowflake external volume and Snowflake catalog integration
Follow these steps to create a Snowflake external volume and Snowflake catalog
integration.
- [Create a Snowflake external volume](#cloud-tableflow-query-with-snowflake-create-external-volume)
- [Create the Snowflake catalog integration](#cloud-tableflow-query-with-snowflake-create-catalog-integration)
### Step 3: Configure access permissions for the AWS Glue Data Catalog
Configure access permission in AWS to enable Snowflake and AWS Glue Data
Catalog connectivity by following the instructions in the
[Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-catalog-integration-rest#label-tables-iceberg-configure-catalog-integration-rest-glue).
### Step 4: Create a Catalog integration in Snowflake
In Snowflake, run the following SQL query to create a Snowflake catalog
integration for the AWS Glue Data Catalog.
```sql
CREATE CATALOG INTEGRATION myGlueCatalogIntegration
CATALOG_SOURCE = GLUE
CATALOG_NAMESPACE = ''
TABLE_FORMAT = ICEBERG
GLUE_AWS_ROLE_ARN = ''
GLUE_CATALOG_ID = ''
GLUE_REGION = ''
ENABLED = TRUE;
```
### Step 5: Retrieve the AWS IAM user and external ID for your Snowflake account
Obtain the AWS IAM user ARN and external ID for your Snowflake account by
following the instructions in the
[Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-catalog-integration-glue#step-3-retrieve-the-aws-iam-user-and-external-id-for-your-snowflake-account).
### Step 6: Grant the IAM user permissions to access the AWS Glue Data Catalog
Update the trust policy for the same IAM role that you specified with the ARN
when you created the catalog integration, by following the instructions in the
[Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg-configure-catalog-integration-glue#step-4-grant-the-iam-user-permissions-to-access-the-aws-glue-data-catalog).
### Step 7: Create an Iceberg table
Create the Iceberg table using the external volume and Snowflake catalog
integration that you created in Step 3. Replace ** with
*tableflow-stock-trades*.
```sql
CREATE OR REPLACE ICEBERG TABLE snowflake_stock_trades
EXTERNAL_VOLUME = 'stock-trades-volume'
CATALOG = 'myGlueCatalogIntegration'
CATALOG_TABLE_NAME = ''
```
### Step 8: Query the Iceberg table
Run the following statement to query the Iceberg table.
```sql
SELECT * from snowflake-stock-trades;
```
## Related content
- [Query with AWS](query-with-aws.md#cloud-tableflow-query-with-aws)
- [Query with DuckDB](query-with-duckdb.md#cloud-tableflow-query-with-duckdb)
- [Query with Flink](query-with-flink.md#cloud-tableflow-query-with-flink)
- [Query with Trino](query-with-trino.md#cloud-tableflow-query-with-trino)
- [Stream Processing with Confluent Cloud for Apache Flink](../../../../flink/overview.md#ccloud-flink)
#### NOTE
This website includes content developed at the [Apache Software Foundation](https://www.apache.org/)
under the terms of the [Apache License v2](https://www.apache.org/licenses/LICENSE-2.0.html).