Pass the Huawei HCIA-Big Data H13-711_V3.0 Questions and answers with ExamsMirror

After the Loader submits the job to YARN for execution, if the Loade phase is abnormal at this time, the job fails to execute.

The Loader submits the job to the small YARN for execution. If a Mapper task fails to execute, it can automatically retry

After the Loadet job fails to execute, garbage data will be generated, which needs to be cleared manually by the user

After the Loader submits a job to YARN for execution, other jobs cannot be submitted until the job is executed.

File

Kafka

Memory

HDFS

Switch the active and standby Loader nodes

Start the loader instance

Configure loader parameters

View loader service status

All 4 blocks will be written to RAM_DISK

If it is a copy other than the first copy that fails to write, try to write to the storage type specified by "Alternative storage policy for copy"

The first block copy will be written to RAM_DISK, the rest of the replicas are written to DISK

If the first block copy is written to RAM_If DISK fails, try to write to the storage type specified by "Alternative Storage Policy"

Hive finally stores data in HDFS

Hive is a data warehouse tool for the Hadoop platform

HQL can execute tasks through MapReduce

Hive has a strong dependence on HBase

A DataSet is a strongly typed collection of domain-specific objects

DataSet can perform most operations without deserialization

DataSet needs to be deserialized to perform operations such as sort, filter, shuffle, etC.

DataSet - highly similar to RDD. Better performance than RDD

warehouse

Metastore

State store

Storage

Job Scheduler

HA Manager

Job Manager

Resource Manager

Offline computing

real-time interactive computing

Iterative calculation

Streaming Computing

Supervisor is responsible for resource allocation and task scheduling

Supervisort is responsible for accepting tasks assigned by Nimbus, starting and stopping Worker processes that belong to its own management

Supervisor is a process that runs specific processing logic

Supervisor is a component that receives data in Topology and then performs processing

container

jar

application-attempt

Aapplication

Create a normal table by default

The essence of the external table is to associate the file path that already exists on HDFS with the table

When deleting a normal table, both metadata and data are deleted at the same time

When deleting an external table, only the external table data is deleted without the metadata

dfs-cat

dfs -mkdir

dfs -get

dfs-put

Install Manager->Execute preinstall->LLD tool for configuration->Install cluster->Check after installation->Configure after installation

LLD tool to configure -> execute preinstall-> install Managers-> install cluster-> post-installation check-> post-installation configuration

Install Manager->LLD tool for configuration->execute preinstall->install cluster->post-installation check->post-installation configuration

LLD tool to configure -> execute preinstalls-> install cluster-> install Manager-> post-installation check-> post-installation configuration

Hive metadata storage is independent of data storage, thereby decoupling metadata and data. High flexibility, while traditional data warehouse data application is single, low flexibility

Hive is based on HDFS storage. Theoretically, the storage capacity can be expanded infinitely. The storage capacity of traditional data warehouses will have an upper limit

Since Hive data is stored in HDFS, it can ensure high fault tolerance and high reliability of data

Since Hive is based on a big data platform, query efficiency is faster than traditional data warehouses