CCDAK practice question 21 of 25
To import data from external databases, I should use
Full set: 150 questionsKafka Connect is the designated framework within the Confluent Platform and Apache Kafka for streaming data between Kafka and other systems. To import data from an external system, such as a database, into Kafka topics, a Kafka Connect Source connector is used. Source connectors are purpose-built to understand how to poll or listen for changes in an external data source (like a database table) and write that data into Kafka in a scalable and reliable manner. This is the standard and recommended approach for this use case.
A. Confluent REST Proxy: This provides an HTTP(S) interface to a Kafka cluster. It is not the primary tool for continuous, scalable data ingestion from databases.
B. Kafka Connect Sink: A sink connector does the opposite; it exports data from Kafka topics to an external system or database.
C. Kafka Streams: This is a client library for building stream processing applications that read from and write to Kafka topics, not for importing data from external systems.
1. Confluent Documentation, "Kafka Connect Concepts - Source Connectors": "A source connector ingests entire databases and streams table updates to Kafka topics. It can also collect metrics from all of your application servers into Kafka topics, making the data available for stream processing with low latency." This directly states that source connectors are used to ingest data from databases.
Source: Confluent Documentation, docs.confluent.io/platform/current/connect/concepts.html#source-connectors
2. Confluent Documentation, "Kafka Connect Overview": "Kafka Connect is a tool for scalably and reliably streaming data between Apache Kafka® and other systems. It makes it simple to quickly define connectors that move large collections of data into and out of Kafka." This establishes Kafka Connect as the correct framework for the task.
Source: Confluent Documentation, docs.confluent.io/platform/current/connect/index.html#what-is-kafka-connect
3. Confluent Documentation, "Kafka Connect Concepts - Sink Connectors": "A sink connector delivers data from Kafka topics into secondary indexes like Elasticsearch, or batch systems such as Hadoop for offline analysis." This clarifies the role of a sink connector as an export mechanism, contrasting it with a source connector.
Source: Confluent Documentation, docs.confluent.io/platform/current/connect/concepts.html#sink-connectors
Keep practicing
Take the free CCDAK practice test
Ten exam-style questions with answers and explanations, plus the exam facts and study guides.
More questions
Other CCDAK practice questions
- Question 1In Avro, removing or adding a field that has a default is a __ schema evolution
- Question 2A topic has three replicas and you set min.insync.replicas to 2. If two out of three repl…
- Question 3To get acknowledgement of writes to only the leader partition, we need to use the config.…
- Question 4A customer has many consumer applications that process messages from a Kafka topic. Each …
- Question 5What information isn't stored inside of Zookeeper? (select two)
- Question 6If you enable an SSL endpoint in Kafka, what feature of Kafka will be lost?
