Databricks-Certified-Data-Engineer-Associate Exam Dumps - Databricks Certified Data Engineer Associate Exam

File notification mode is the recommended option for scalable file discovery. On the stream’s first execution, Auto Loader performs a complete directory listing to discover existing files and establish a valid read position in its checkpoint and file-events cache. It can therefore ingest the 50,000 historical files without requiring a separate directory-listing stream. Subsequent executions discover newly arriving files through cloud-storage events instead of repeatedly scanning the entire directory, improving discovery performance and reducing cloud API and compute costs. Auto Loader maintains its checkpoint state and exactly-once processing guarantees when using either detection mode. Although switching modes across restarts is supported, it is unnecessary for this requirement. Options B, C, and D incorrectly imply that notification mode cannot efficiently initialize from existing files. Therefore, option A is correct.

================

The --target prod option explicitly selects the prod target from the bundle configuration. Databricks then resolves ${var.dataset_catalog} using the target-level value catalog_prod, which takes precedence over the top-level default of catalog_dev. This allows the same dashboard resource definition to be promoted across environments without editing the resource itself. The --var option can override an individual variable, but it does not automatically select the production target. The --profile option selects an authentication profile from .databrickscfg; it does not select a bundle target or automatically apply the target’s variables. bundle execute is not the deployment command. Consequently, option D correctly combines production-target selection with the environment-specific variable override already defined in the YAML configuration.

================

The reason why all of the data files and metadata files were deleted from the file system after dropping the table is that the table was managed. A managed table is a table that is created and managed by Spark SQL. It stores both the data and the metadata in the default location specified by the spark.sql.warehouse.dir configuration property. When a managed table is dropped, both the data and the metadata are deleted from the file system.

Option B is not correct, as the size of the table’s data does not affect the behavior of dropping the table. Whether the table’s data is smaller or larger than 10 GB, the data files and metadata files will be deleted if the table is managed, and will be preserved if the table is external.

Option C is not correct, for the same reason as option B.

Option D is not correct, as an external table is a table that is created and managed by the user. It stores the data in a user-specified location, and only stores the metadata in the Spark SQL catalog. When an external table is dropped, only the metadata is deleted from the catalog, but the data files are preserved in the file system.

Option E is not correct, as a table must have a location to store the data. If the location is not specified by the user, it will use the default location for managed tables. Therefore, a table without a location is a managed table, and dropping it will delete both the data and the metadata.

Managing Tables

[Databricks Data Engineer Professional Exam Guide]

Databricks separates workspace-management services from data processing. Notebook source files stored as workspace objects are managed in the Databricks control plane and are encrypted at rest. When the scheduled job starts, Databricks orchestrates the run from the control plane, but the notebook commands execute on compute resources in the compute plane. The compute plane is where Spark transformations, Python code, and other data-processing operations run. Unity Catalog governs data and AI assets but is not the execution environment or the general storage location for workspace notebook source. Delta Lake is a table-storage layer and does not execute notebook code. Option D is also incorrect because Databricks does not describe workspace notebook source as unencrypted. Therefore, option C accurately represents the separation between notebook storage and workload execution.

Option A is correct because Lakeflow Connect provides a built-in, fully managed Salesforce connector. It ingests Salesforce data into Databricks, supports incremental processing, and publishes governed destination tables in Unity Catalog. Managed SaaS connectors handle source-specific authentication, incremental reads, schema evolution, and automated retries, reducing the custom engineering required for API pagination, state tracking, and failure recovery. Calling the Salesforce REST API from a notebook would require the team to develop and maintain those capabilities itself. Auto Loader is designed to discover and incrementally process files arriving in cloud object storage; it does not connect directly to Salesforce. Using an exported Amazon S3 path would also require a separate export system outside the requested managed Databricks ingestion experience. Therefore, option A is the low-code capability that directly satisfies the Salesforce ingestion requirement.

================

The only option that is stored in the Databricks customer’s cloud account is data. Data is stored in the customer’s cloud storage service, such as AWS S3 or Azure Data Lake Storage. The customer has full control and ownership of their data and can access it directly from their cloud account.

Option A is not correct, as the Databricks web application is hosted and managed by Databricks on their own cloud infrastructure. The customer does not need to install or maintain the web application, but only needs to access it through a web browser.

Option B is not correct, as the cluster management metadata is stored and managed by Databricks on their own cloud infrastructure. The cluster management metadata includes information such as cluster configuration, status, logs, and metrics. The customer can view and manage their clusters through the Databricks web application, but does not have direct access to the cluster management metadata.

Option C is not correct, as the repos are stored and managed by Databricks on their own cloud infrastructure. Repos are version-controlled repositories that store code and data files for Databricks projects. The customer can create and manage their repos through the Databricks web application, but does not have direct access to the repos.

Option E is not correct, as the notebooks are stored and managed by Databricks on their own cloud infrastructure. Notebooks are interactive documents that contain code, text, and visualizations for Databricks workflows. The customer can create and manage their notebooks through the Databricks web application, but does not have direct access to the notebooks.

Databricks Architecture

Databricks Data Sources

Databricks Repos

[Databricks Notebooks]

[Databricks Data Engineer Professional Exam Guide]

A webhook alert destination is a way to send notifications to external applications or services via HTTP requests. A data engineer can use a webhook alert destination to notify their entire team via a messaging webhook, such as Slack or Microsoft Teams, whenever the number of NULL values in the input data reaches 100. To set up a webhook alert destination, the data engineer needs to do the following steps:

In the Databricks SQL workspace, navigate to the Settings gear icon and select SQL Admin Console.

Click Alert Destinations and click Add New Alert Destination.

Select Webhook and enter the webhook URL and the optional custom template for the notification message.

Click Create to save the webhook alert destination.

In the Databricks SQL editor, create or open the query that returns the number of input records containing unexpected NULL values.

Click the Create Alert icon above the editor window and configure the alert criteria, such as the value column, the condition, and the threshold.

In the Notification section, select the webhook alert destination that was created earlier and click Create Alert. References: What are Databricks SQL alerts?, Monitor alerts, Monitoring Your Business with Alerts, Using Automation Runbook Webhooks To Alert on Databricks Status Updates.