Search External Tables with Confluent Cloud for Apache Flink¶
Confluent Cloud for Apache Flink® supports read-only external tables to enable different types of search with federated query execution on external databases.
Note
Searching external tables is an Open Preview feature in Confluent Cloud.
A Preview feature is a Confluent Cloud component that is being introduced to gain early feedback from developers. Preview features can be used for evaluation and non-production testing purposes or to provide feedback to Confluent. The warranty, SLA, and Support Services provisions of your agreement with Confluent do not apply to Preview features. Confluent may discontinue providing preview releases of the Preview features at any time in Confluent’s’ sole discretion.
- Key search with external databases: Perform lookups on exact key matches.
- Text search with external databases: Ideal for precise queries where exact word matches are desired. Less computationally intensive than vector search and can be used independently or in combination depending on the use case.
- Vector search with external databases: Use an input string to query vector space in an external vector database for semantic queries.
Important
External calls in stream processing enable powerful use cases like real-time enrichment and AI orchestration but may introduce risks: reprocessing can overwhelm external systems with replay traffic, network failures or high latency can cascade to entire pipelines, and historical replays may get current data instead of point-in-time state, breaking audit consistency. Success requires evaluating each use case’s criticality, volume patterns, and consistency requirements to choose the right implementation pattern.