Frequently Asked Questions about AI with Confluent Cloud for Apache Flink¶

This topic provides answers to frequently asked questions about using large language models (LLMs) and machine learning (ML) with Confluent Cloud for Apache Flink®.

What is AI with Confluent Cloud for Apache Flink?¶

AI with Confluent Cloud for Apache Flink enables you to integrate LLMs and ML models into your streaming data workflows seamlessly.

How do I get started using AI with Confluent Cloud for Apache Flink?¶

Get started by clicking SQL Workspaces in the Confluent Cloud Console. For more information, see Run an AI Model.

How do I register a remote AI model?¶

Use the CREATE MODEL statement to register an AI model that’s hosted outside Confluent Cloud. For more information, see Create a Remote AI Model.

How do I provide tools to an AI model?¶

Use the AI_TOOL_INVOKE function to provide Model Context Protocol (MCP) tools and user-defined functions (UDFs) to an AI model. For more information, see Invoke an AI Model.

How can I forecast and detect anomalies in my data?¶

Use the ML_FORECAST and ML_DETECT_ANOMALIES functions to forecast and detect anomalies in your data. For more information, see Built-in AI/ML Functions.

How can I evaluate the performance of an AI model?¶

Use the ML_EVALUATE function to evaluate the performance of an AI model.

How can I use an AI model to generate text?¶

Use the AI_PREDICT function with an AI model to generate text.

How can I use an AI model to classify data?¶

Use the ML_PREDICT function with an AI model to classify data.

How can I create vector embeddings for retrieval-augmented generation (RAG)?¶

Use the AI_EMBEDDING function to create vector embeddings for RAG. For more information, see Vector search with Pinecone.

How can I do vector searches over external tables?¶

Use the VECTOR_SEARCH_AGG function to do vector searches over external tables.

How can I do key and text searches over external tables?¶

Use the KEY_SEARCH_AGG and TEXT_SEARCH_AGG functions to do key and text searches over external tables.

How can I use an AI model to generate text completions?¶

Use the AI_COMPLETE function with an AI model to generate text completions.