How do you run a transformation in Pentaho?

How do you run a transformation in Pentaho?

The default Pentaho local configuration runs the transformation using the Pentaho engine on your local machine....Complete one of the following tasks to run your transformation:

1. Click the Run icon on the toolbar.
2. Select Run from the Action menu.
3. Press F9.

What is transformation in Pentaho?

A transformation is a network of logical tasks called steps. Transformations are essentially data flows. ... There are over 140 steps available in Pentaho Data Integration and they are grouped according to function; for example, input, output, scripting, and so on.

What is job and transformation in Pentaho?

A job has one start place, and executes one step at a time, with one flow through the steps. A transformation has many possible start places and all steps execute in parallel. If a step has a step before it, it will take the data in there, and use it.

How do I create a repository in Pentaho?

To create a repository, follow these steps:

1. Open the MySQL command-line client.
2. In the command window, type the following command: ...
3. Open Spoon.
4. Unless a repository dialog appears, open the repository dialog from the Tools | Repository | Connect... ...
5. Click on the plus icon to create a new repository.

How do I get a job in PDI?

Build a Job

1. In the Spoon menubar, go to File > New > Job. ...
2. Click the Design tab. ...
3. Expand the General node and select the Start job entry.
4. Drag the Start job entry to the workspace (canvas) on the right. ...
5. Expand the General node, select and drag a Transformation job entry on to the workspace.

How do you test for transformation in ETL?

The key to perform a successful ETL testing for data transformations is to pick the correct and sufficient sample data from the source system to apply the transformation rules. The first step is to create a list of scenarios of input data and the expected results and validate these with the business customer.

What is PDI transformation?

PDI uses a workflow metaphor as building blocks for transforming your data and other tasks. Workflows are built using steps or entries as you create transformations and jobs. Each step or entry is joined by a hop which passes the flow of data from one item to the next.

How do I read a text file in Pentaho?

Click Browse to navigate to your source file or directory. Click Add to include the source in the Selected files table. If the source location is defined in a field, see Accept File Names from a Previous Step to specify your file name. Specify a regular expression to match filenames within a specified directory.

How do I use Pentaho Repository?

The Pentaho Repository

1. Click Get Started.
2. Enter or update the Display Name property.
3. Modify the URL associated with your repository, if necessary.
4. Click Finish to test the connection of your repository. ...
5. If the test is successful, you can either Connect Now, Manage Connections, or Finish to close the dialog box.

How to run a Pentaho transformation through a command line?

• First and foremost we need to create the script that would run the specified transformation through a command line. For that Pentaho provides us with a Pan application which is a program that can execute transformations designed in the spoon when stored as a KTR file or in a repository.

How to create a new job in Pentaho?

• You create a new Job in one of three ways: By clicking on the New Job button on the main tool bar Any one of these actions opens a new Job tab for you to begin designing your job. Notes allow you to add descriptive text notes to the Job or Transformation canvas: To add a note to the graphical view, right-click on the canvas and select Add note.

How to create batch file to run scheduled Pentaho?

• Here we have defined the path where the Pan batch file is located and then we have written the script which calls that particular transformation getting into the repository and to that particular directory where our transformation is stored. Try to run the same and you should very well be able to run the given transformation.

How do I add a step to a input file in Pentaho?

• Double-click the text input file icon and give a name to the step. Click the Browse… button and search the file group1.txt. Select the file. The textbox File or directory will be temporarily populated with the full path of the file—for example, C:\\pdi_files\\input\\group1.txt. Click the Add button.