Apache Tajo – Architecture


Apache Tajo – Architecture


”;


The following illustration depicts the architecture of Apache Tajo.

Architecture

The following table describes each of the components in detail.

S.No. Component & Description
1

Client

Client submits the SQL statements to the Tajo Master to get the result.

2

Master

Master is the main daemon. It is responsible for query planning and is the coordinator for workers.

3

Catalog server

Maintains the table and index descriptions. It is embedded in the Master daemon. The catalog server uses Apache Derby as the storage layer and connects via JDBC client.

4

Worker

Master node assigns task to worker nodes. TajoWorker processes data. As the number of TajoWorkers increases, the processing capacity also increases linearly.

5

Query Master

Tajo master assigns query to the Query Master. The Query Master is responsible for controlling a distributed execution plan. It launches the TaskRunner and schedules tasks to TaskRunner. The main role of the Query Master is to monitor the running tasks and report them to the Master node.

6

Node Managers

Manages the resource of the worker node. It decides on allocating requests to the node.

7

TaskRunner

Acts as a local query execution engine. It is used to run and monitor query process. The TaskRunner processes one task at a time.

It has the following three main attributes −

  • Logical plan − An execution block which created the task.
  • A fragment − an input path, an offset range, and schema.
  • Fetches URIs
8

Query Executor

It is used to execute a query.

9

Storage service

Connects the underlying data storage to Tajo.

Workflow

Tajo uses Hadoop Distributed File System (HDFS) as the storage layer and has its own query execution engine instead of the MapReduce framework. A Tajo cluster consists of one master node and a number of workers across cluster nodes.

The master is mainly responsible for query planning and the coordinator for workers. The master divides a query into small tasks and assigns to workers. Each worker has a local query engine that executes a directed acyclic graph of physical operators.

In addition, Tajo can control distributed data flow more flexible than that of MapReduce and supports indexing techniques.

The web-based interface of Tajo has the following capabilities −

  • Option to find how the submitted queries are planned
  • Option to find how the queries are distributed across nodes
  • Option to check the status of the cluster and nodes

Advertisements

”;

Leave a Reply

Your email address will not be published. Required fields are marked *