Pentaho BI Technical Latest Interview Questions And Answers
Define Pentaho Bi Project?
The Pentaho BI Project is an current effort by the Open Source communal to provide groups with best-in-class solutions for their initiative Business Intelligence (BI) needs.
What Major Applications Comprises Of Pentaho Bi Project?
The Pentaho BI Project encompasses the following major application areas:
Business Intelligence Platform
Data Mining
Reporting
Dashboards
Business Intelligence Platform
Which Platform Benefits From The Pentaho Bi Project?
Java developers who generally use project components to rapidly assemble custom BI solutions
ISVs who can improve the value and ability of their solutions by embedding BI functionality
End-Users who can quickly deploy packaged BI solutions which are either modest or greater to traditional commercial offerings at a dramatically lower cost.
Explain Pentaho?
It addresses the blockades that block the organization’s ability to get value from all our data. Pentaho is discovered to ensure that each member of our team from developers to business users can easily convert data into value.
How Do You Duplicate A Field In A Row In A Transformation?
Several solutions exist:
Use a “Select Values” step renaming a field while selecting also the original one. The result will be that the original field will be duplicated to another name.
It will look as follows:
This will duplicate fieldA to fieldB and fieldC.
Use a calculator step and use e.g. The NLV(A,B) operation as follows:
This will have the same effect as the first solution: 3 fields in the output which are copies of each other: fieldA, fieldB, and fieldC.
Use a JavaScript step to copy the field:
This will have the same effect as the previous solutions: 3 fields in the output which are copies of each other: fieldA, fieldB, and fieldC.
Why Can’t I Duplicate Fieldnames In A Single Row?
You can’t. PDI will complain in most of the cases if you have duplicate fieldnames. Before PDI v2.5.0 you were able to force duplicate fields, but also only the first value of the duplicate fields could ever be used.
I’ve Got A Transformation That Doesn’t Run Fast Enough, But It Is Hard To Tell In What Order To Optimize The Steps. What Should I Do?
Transformations stream data through their steps:
That means that the slowest step is going to determine the speed of a transformation.
So you optimize the slowest steps first. How can you tell which step is the slowest: look at the size of the input buffer in the log view.
In the latest 3.1.0-M1 nightly build you will also find a graphical overview of this: HTTP://WWW.IBRIDGE.BE/?P=92
(the “graph” button at the bottom of the log view will show the details).
A slow step will have consistently large input buffer sizes. A fast step will consistently have low input buffer sizes.
We Will Be Using Pdi Integrated In A Web Application Deployed On An Application Server. We’ve Created A Jndi Datasource In Our Application Server. Of Course Spoon Doesn’t Run In The Context Of The Application Server, So How Can We Use The Jndi Data Source In Pdi?
If you look in the PDI main directory you will see a sub-directory “simple-jndi”, which contains a file called “jdbc.properties”. You should change this file so that the JNDI information matches the one you use in your application server.
After that you set in the connection tab of Spoon the “Method of access” to JNDI, the “Connection type” to the type of database you’re using. And “Connection name” to the name of the JDNI datasource (as used in “jdbc.properties”).
Mention Major Features Of Pentaho?
Direct Analytics on MongoDB: It authorizes business analysts and IT to access, analyze, and visualize MongoDB data.
Science Pack: Pentaho’s Data Science Pack operationalizes analytical modeling and machine learning while allowing data scientists and developers to unburden the labor of data preparation to Pentaho Data Integration.
Full YARN Support for Hadoop: Pentaho’s YARN mixing enables organizations to exploit the full computing power of Hadoop while leveraging existing skillsets and technology investments.
Finite ordered list of elements is called as tuple.
What Kind Of Data, Cube Contain?
The Cube will contain the following data:
3 Fact fields: Sales, Costs and Discounts
Time Dimension: with the following hierarchy: Year, Quarter and Month
2 Customer Dimensions: one with location (Region, Country) and the other with Customer Group and Customer Name
Product Dimension: containing a Product Name
Differentiate Between Transformations And Jobs?
Transformations is moving and transforming rows from source to target.
Jobs are more about high level flow control.
How To Do A Database Join With Pdi?
If we want to join 2 tables from the same database, we can use a “Table Input” step and do the join in SQL itself.
If we want to join 2 tables that are not in the same database. We can use the the “Database Join”.
How To Sequentialize Transformations?
it is not possible as in PDI transformations all of the steps run in parallel. So we can’t sequentialize them.
How We Can Use Database Connections From Repository?
We can Create a new conversion or close and re-open the ones we have loaded in Spoon.
How Do You Insert Booleans Into A Mysql Database, Pdi Encodes A Boolean As ‘y’ Or ‘n’ And This Can’t Be Insert Into A Bit(1) Column In Mysql.?
BIT is not a standard SQL data type. It’s not even standard on MySQL as the meaning (core definition) changed from MySQL version 4 to 5.
Also a BIT uses 2 bytes on MySQL. That’s why in PDI we made the safe choice and went for a char(1) to store a boolean. There is a simple workaround available: change the data type with a Select Values step to “Integer” in the metadata tab. This converts it to 1 for “true” and 0 for “false”, just like MySQL expects.
By Default All Steps In A Transformation Run In Parallel, How Can We Make It So That 1 Row Gets Processed Completely Until The End Before The Next Row Is Processed?.
This is not possible as in PDI transformations all the steps run in parallel. So we can’t sequentialize them. This would require architectural changes to PDI and sequential processing also result in very slow processing.
Yes, Pentaho is a trademark.
What Do You Understand By Pentaho Metadata?
Pentaho Metadata is a piece of the Pentaho BI Platform designed to make it easier for users to access information in business terms.
How Does Pentaho Metadata Work?
With the help of Pentaho’s open source metadata capabilities, administrators can outline a layer of abstraction that presents database information to business users in familiar business terms.
What Is The Pentaho Reporting Evaluation?
Pentaho Reporting Evaluation is a particular package of a subset of the Pentaho Reporting capabilities, designed for typical first-phase evaluation activities such as accessing sample data, creating and editing reports, and viewing and interacting with reports.
Explain Mdx?
Multidimensional Expressions (MDX) is a query language for OLAP databases, much like SQL is a query language for relational databases. It is also a calculation language, with syntax similar to spreadsheet formulas.
Why Can’t We Duplicate Fieldnames In A Single Row?
we can’t. if we have duplicate fieldnames. Before PDI v2.5.0 we were able to force duplicate fields, but also only the first value of the duplicate fields could ever be used.
What Are The Benefits Of Pentaho?
1. Open Source
2. Have community that support the users
3. Running well under multi platform (Windows, Linux, Macintosh, Solaris, Unix, etc)
4. Have complete package from reporting, ETL for warehousing data management,
5. OLAP server data mining also dashboard.
Differentiate Between Arguments And Variables?
Arguments are command line arguments that we would normally specify during batch processing .
Variables are environment or PDI variables that we would normally set in a previous transformation in a job.
What Are The Applications Of Pentaho?
1. Suite Pentaho
BI Platform (JBoss Portal)
Pentaho Dashboard
JFreeReport
Mondrian
Kettle
Weka
2. All build under Java platform
What Are The Steps To Decrypt A Folder Or File?
Right-click on the folder or file we want to decrypt, and then click on Properties option.
Click the General tab, and then click Advanced.
Clear the Encrypt contents to secure data check box, click OK, and then click OK again.
Explain Encrypting File System?
It is the technology which enables files to be transparently encrypted to secure personal data from attackers with physical access to the computer.
What Do You Mean By Repository?
Repository is a storage location where we can store the data safely without any harmness.
Explain Why We Need Etl Tool?
ETL Tool is used to get data from many source system like RDBMS, SAP, etc. and convert them based on the user requirement. It is required when data float across many systems.
What Is Etl Process? Write The Steps Also?
ETL is extraction , transforming , loading process the steps are :
1 – define the source
2 – define the target
3 – create the mapping
4 – create the session
5 – create the work flow
What Is Metadata?
The metadata stored in the repository by associating information with individual objects in the repository.
What Are Snapshots?
Snapshots are read-only copies of a master table located on a remote node which can be periodically refreshed to reflect changes made to the master table.
What Is Data Staging?
Data staging is actually a group of procedures used to prepare source system data for loading a data warehouse.
Data Staging Is Actually A Group Of Procedures Used To Prepare Source System Data For Loading A Data Warehouse.?
Full Load means completely erasing the insides of one or more tables and filling with fresh data.
Incremental Load means applying ongoing changes to one or more tables based on a predefined schedule.
Define Mapping?
Dataflow from source to target is called as mapping.
Explain Session?
It is a set of instruction which tell when and how to move data from respective source to target.
What Is Workflow?
It is a set of instruction which tell the infomatica server how to execute the task.
Define Mapplet?
It creates and configure the set of transformation.
What Do You Understand By The Term Pentaho Dashboard?
Pentaho Dashboards give business users the critical information they need to understand and improve organizational performance.
What Is The Use Of Pentaho Reporting?
Pentaho Reporting allows organizations to easily access, format and deliver information to employees, customers and partners.
Define Pentaho Schema Workbench?
Pentaho Schema Workbench offers a graphical edge for designing OLAP cubes for Pentaho Analysis.
Define Pentho Data Mining?
Pentaho Data Mining used the Waikato Environment for Information Analysis to search data for patterns. It have functions for data processing, regression analysis, classification methods, etc.
Brief About Pentaho Report Designer?
It is a visual, banded report writer. It has various features lilke using subreports, charts and graphs etc.
What Do You Un Derstand By The Term Etl?
It is an entri level tool for data manipulation.
What Do You Understand By Hierarchical Navigation?
A hierarchical navigation menu allows the user to come directly to a section of the site several levels below the top.
A data warehouse is said to be a three-tier system where a middle system provides usable data in a secure way to end users. Both side of this middle system are the end users and the back-end data stores.
What Is Ods?
ODS is Operational Data Store which comes in between of data warehouse and staging area.
Differentiate Between Etl Tool And Olap Tool?
ETL Tool is used for extracting data from the legecy system and load it into specified database with some processing of cleansing data.
OLAP Tool is used for reporting process . Here data is available in multidimensional model hence we can write simple query to extract data from database.
Wha Is Xml?
XML is an extensiable markup language which defines a set of rule for encoding documents in both formats which is human readable and machine readable.
What Are Various Tools In Etl?
Abinitio,DataStage, Informatica, Cognos Decision Stream, etc
Define Mdx?
MDX is multi- dimensional expression which is a main query language implemented by the Mondrains.
Define Multi-dimensional Cube?
It is a cube to view data where we can slice and dice the data. It have time dimension, locations and figures.
Define Pentaho Bi Project?
The Pentaho BI Project is an current effort by the Open Source communal to provide groups with best-in-class solutions for their initiative Business Intelligence (BI) needs.
What Major Applications Comprises Of Pentaho Bi Project?
The Pentaho BI Project encompasses the following major application areas:
Business Intelligence Platform
Data Mining
Reporting
Dashboards
Business Intelligence Platform
Which Platform Benefits From The Pentaho Bi Project?
Java developers who generally use project components to rapidly assemble custom BI solutions
ISVs who can improve the value and ability of their solutions by embedding BI functionality
End-Users who can quickly deploy packaged BI solutions which are either modest or greater to traditional commercial offerings at a dramatically lower cost.
It addresses the blockades that block the organization’s ability to get value from all our data. Pentaho is discovered to ensure that each member of our team from developers to business users can easily convert data into value.
How Do You Duplicate A Field In A Row In A Transformation?
Several solutions exist:
Use a “Select Values” step renaming a field while selecting also the original one. The result will be that the original field will be duplicated to another name.
It will look as follows:
This will duplicate fieldA to fieldB and fieldC.
Use a calculator step and use e.g. The NLV(A,B) operation as follows:
This will have the same effect as the first solution: 3 fields in the output which are copies of each other: fieldA, fieldB, and fieldC.
Use a JavaScript step to copy the field:
This will have the same effect as the previous solutions: 3 fields in the output which are copies of each other: fieldA, fieldB, and fieldC.
Why Can’t I Duplicate Fieldnames In A Single Row?
You can’t. PDI will complain in most of the cases if you have duplicate fieldnames. Before PDI v2.5.0 you were able to force duplicate fields, but also only the first value of the duplicate fields could ever be used.
I’ve Got A Transformation That Doesn’t Run Fast Enough, But It Is Hard To Tell In What Order To Optimize The Steps. What Should I Do?
Transformations stream data through their steps:
That means that the slowest step is going to determine the speed of a transformation.
So you optimize the slowest steps first. How can you tell which step is the slowest: look at the size of the input buffer in the log view.
In the latest 3.1.0-M1 nightly build you will also find a graphical overview of this: HTTP://WWW.IBRIDGE.BE/?P=92
(the “graph” button at the bottom of the log view will show the details).
A slow step will have consistently large input buffer sizes. A fast step will consistently have low input buffer sizes.
We Will Be Using Pdi Integrated In A Web Application Deployed On An Application Server. We’ve Created A Jndi Datasource In Our Application Server. Of Course Spoon Doesn’t Run In The Context Of The Application Server, So How Can We Use The Jndi Data Source In Pdi?
If you look in the PDI main directory you will see a sub-directory “simple-jndi”, which contains a file called “jdbc.properties”. You should change this file so that the JNDI information matches the one you use in your application server.
After that you set in the connection tab of Spoon the “Method of access” to JNDI, the “Connection type” to the type of database you’re using. And “Connection name” to the name of the JDNI datasource (as used in “jdbc.properties”).
Mention Major Features Of Pentaho?
Direct Analytics on MongoDB: It authorizes business analysts and IT to access, analyze, and visualize MongoDB data.
Science Pack: Pentaho’s Data Science Pack operationalizes analytical modeling and machine learning while allowing data scientists and developers to unburden the labor of data preparation to Pentaho Data Integration.
Full YARN Support for Hadoop: Pentaho’s YARN mixing enables organizations to exploit the full computing power of Hadoop while leveraging existing skillsets and technology investments.
Define Tuple?
Finite ordered list of elements is called as tuple.
What Kind Of Data, Cube Contain?
The Cube will contain the following data:
3 Fact fields: Sales, Costs and Discounts
Time Dimension: with the following hierarchy: Year, Quarter and Month
2 Customer Dimensions: one with location (Region, Country) and the other with Customer Group and Customer Name
Product Dimension: containing a Product Name
Differentiate Between Transformations And Jobs?
Transformations is moving and transforming rows from source to target.
Jobs are more about high level flow control.
How To Do A Database Join With Pdi?
If we want to join 2 tables from the same database, we can use a “Table Input” step and do the join in SQL itself.
If we want to join 2 tables that are not in the same database. We can use the the “Database Join”.
How To Sequentialize Transformations?
it is not possible as in PDI transformations all of the steps run in parallel. So we can’t sequentialize them.
How We Can Use Database Connections From Repository?
We can Create a new conversion or close and re-open the ones we have loaded in Spoon.
How Do You Insert Booleans Into A Mysql Database, Pdi Encodes A Boolean As ‘y’ Or ‘n’ And This Can’t Be Insert Into A Bit(1) Column In Mysql.?
BIT is not a standard SQL data type. It’s not even standard on MySQL as the meaning (core definition) changed from MySQL version 4 to 5.
Also a BIT uses 2 bytes on MySQL. That’s why in PDI we made the safe choice and went for a char(1) to store a boolean. There is a simple workaround available: change the data type with a Select Values step to “Integer” in the metadata tab. This converts it to 1 for “true” and 0 for “false”, just like MySQL expects.
By Default All Steps In A Transformation Run In Parallel, How Can We Make It So That 1 Row Gets Processed Completely Until The End Before The Next Row Is Processed?.
This is not possible as in PDI transformations all the steps run in parallel. So we can’t sequentialize them. This would require architectural changes to PDI and sequential processing also result in very slow processing.
Is Pentaho A Trademark?
Yes, Pentaho is a trademark.
What Do You Understand By Pentaho Metadata?
Pentaho Metadata is a piece of the Pentaho BI Platform designed to make it easier for users to access information in business terms.
How Does Pentaho Metadata Work?
With the help of Pentaho’s open source metadata capabilities, administrators can outline a layer of abstraction that presents database information to business users in familiar business terms.
What Is The Pentaho Reporting Evaluation?
Pentaho Reporting Evaluation is a particular package of a subset of the Pentaho Reporting capabilities, designed for typical first-phase evaluation activities such as accessing sample data, creating and editing reports, and viewing and interacting with reports.
Explain Mdx?
Multidimensional Expressions (MDX) is a query language for OLAP databases, much like SQL is a query language for relational databases. It is also a calculation language, with syntax similar to spreadsheet formulas.
Why Can’t We Duplicate Fieldnames In A Single Row?
we can’t. if we have duplicate fieldnames. Before PDI v2.5.0 we were able to force duplicate fields, but also only the first value of the duplicate fields could ever be used.
What Are The Benefits Of Pentaho?
1. Open Source
2. Have community that support the users
3. Running well under multi platform (Windows, Linux, Macintosh, Solaris, Unix, etc)
4. Have complete package from reporting, ETL for warehousing data management,
5. OLAP server data mining also dashboard.
Differentiate Between Arguments And Variables?
Arguments are command line arguments that we would normally specify during batch processing .
Variables are environment or PDI variables that we would normally set in a previous transformation in a job.
What Are The Applications Of Pentaho?
1. Suite Pentaho
BI Platform (JBoss Portal)
Pentaho Dashboard
JFreeReport
Mondrian
Kettle
Weka
2. All build under Java platform
What Are The Steps To Decrypt A Folder Or File?
Right-click on the folder or file we want to decrypt, and then click on Properties option.
Click the General tab, and then click Advanced.
Clear the Encrypt contents to secure data check box, click OK, and then click OK again.
Explain Encrypting File System?
It is the technology which enables files to be transparently encrypted to secure personal data from attackers with physical access to the computer.
What Do You Mean By Repository?
Repository is a storage location where we can store the data safely without any harmness.
Explain Why We Need Etl Tool?
ETL Tool is used to get data from many source system like RDBMS, SAP, etc. and convert them based on the user requirement. It is required when data float across many systems.
What Is Etl Process? Write The Steps Also?
ETL is extraction , transforming , loading process the steps are :
1 – define the source
2 – define the target
3 – create the mapping
4 – create the session
5 – create the work flow
What Is Metadata?
The metadata stored in the repository by associating information with individual objects in the repository.
What Are Snapshots?
Snapshots are read-only copies of a master table located on a remote node which can be periodically refreshed to reflect changes made to the master table.
What Is Data Staging?
Data staging is actually a group of procedures used to prepare source system data for loading a data warehouse.
Data Staging Is Actually A Group Of Procedures Used To Prepare Source System Data For Loading A Data Warehouse.?
Full Load means completely erasing the insides of one or more tables and filling with fresh data.
Incremental Load means applying ongoing changes to one or more tables based on a predefined schedule.
Define Mapping?
Dataflow from source to target is called as mapping.
Explain Session?
It is a set of instruction which tell when and how to move data from respective source to target.
What Is Workflow?
It is a set of instruction which tell the infomatica server how to execute the task.
Define Mapplet?
It creates and configure the set of transformation.
What Do You Understand By The Term Pentaho Dashboard?
Pentaho Dashboards give business users the critical information they need to understand and improve organizational performance.
What Is The Use Of Pentaho Reporting?
Pentaho Reporting allows organizations to easily access, format and deliver information to employees, customers and partners.
Define Pentaho Schema Workbench?
Pentaho Schema Workbench offers a graphical edge for designing OLAP cubes for Pentaho Analysis.
Define Pentho Data Mining?
Pentaho Data Mining used the Waikato Environment for Information Analysis to search data for patterns. It have functions for data processing, regression analysis, classification methods, etc.
Brief About Pentaho Report Designer?
It is a visual, banded report writer. It has various features lilke using subreports, charts and graphs etc.
What Do You Un Derstand By The Term Etl?
It is an entri level tool for data manipulation.
What Do You Understand By Hierarchical Navigation?
A hierarchical navigation menu allows the user to come directly to a section of the site several levels below the top.
What Do You Understand By Three Tier Data Warehouse?
A data warehouse is said to be a three-tier system where a middle system provides usable data in a secure way to end users. Both side of this middle system are the end users and the back-end data stores.
What Is Ods?
ODS is Operational Data Store which comes in between of data warehouse and staging area.
Differentiate Between Etl Tool And Olap Tool?
ETL Tool is used for extracting data from the legecy system and load it into specified database with some processing of cleansing data.
OLAP Tool is used for reporting process . Here data is available in multidimensional model hence we can write simple query to extract data from database.
Wha Is Xml?
XML is an extensiable markup language which defines a set of rule for encoding documents in both formats which is human readable and machine readable.
What Are Various Tools In Etl?
Abinitio,DataStage, Informatica, Cognos Decision Stream, etc
Define Mdx?
MDX is multi- dimensional expression which is a main query language implemented by the Mondrains.
Define Multi-dimensional Cube?
It is a cube to view data where we can slice and dice the data. It have time dimension, locations and figures.