Plotly – Introduction ”; Previous Next Plotly is a Montreal based technical computing company involved in development of data analytics and visualisation tools such as Dash and Chart Studio. It has also developed open source graphing Application Programming Interface (API) libraries for Python, R, MATLAB, Javascript and other computer programming languages. Some of the important features of Plotly are as follows − It produces interactive graphs. The graphs are stored in JavaScript Object Notation (JSON) data format so that they can be read using scripts of other programming languages such as R, Julia, MATLAB etc. Graphs can be exported in various raster as well as vector image formats Print Page Previous Next Advertisements ”;
Category: Big Data & Analytics
Plotly – Environment Setup
Plotly – Environment Setup ”; Previous Next This chapter focusses on how to do the environmental set up in Python with the help of Plotly. Installation of Python package It is always recommended to use Python’s virtual environment feature for installation of a new package. Following command creates a virtual environment in the specified folder. python -m myenv To activate the so created virtual environment run activate script in bin sub folder as shown below. source bin/activate Now we can install plotly’s Python package as given below using pip utility. pip install plotly You may also want to install Jupyter notebook app which is a web based interface to Ipython interpreter. pip install jupyter notebook Firstly, you need to create an account on website which is available at https://plot.ly. You can sign up by using the link mentioned herewith https://plot.ly/api_signup and then log in successfully. Next, obtain the API key from settings page of your dashboard. Use your username and API key to set up credentials on Python interpreter session. import plotly plotly.tools.set_credentials_file(username=”test”, api_key=”********************”) A special file named credentials is created in .plotly subfolder under your home directory. It looks similar to the following − { “username”: “test”, “api_key”: “********************”, “proxy_username”: “”, “proxy_password”: “”, “stream_ids”: [] } In order to generate plots, we need to import the following module from plotly package − import plotly.plotly as py import plotly.graph_objs as go plotly.plotly module contains the functions that will help us communicate with the Plotly servers. Functions in plotly.graph_objs module generates graph objects Print Page Previous Next Advertisements ”;
Power BI – Useful Resources
Power BI – Useful Resources ”; Previous Next The following resources contain additional information on Power BI. Please use them to get more in-depth knowledge on this topic. Useful Video Courses Power BI Online Training Course Best Seller 41 Lectures 4 hours Tutorialspoint More Detail Mastering DAX And Data Models In Power BI Desktop 54 Lectures 5.5 hours Abhay Gadiya More Detail Microsoft Power BI Course by Tutorialspoint Best Seller 123 Lectures 7.5 hours Tutorialspoint More Detail Business Intelligence Course With Microsoft Power BI Best Seller 137 Lectures 8.5 hours Pavan Lalwani More Detail Data Science Bootcamp with Power BI and Python Best Seller 52 Lectures 3.5 hours Harshit Srivastava More Detail Print Page Previous Next Advertisements ”;
Power BI – Home
Power BI Tutorial PDF Version Quick Guide Resources Job Search Discussion Power BI is a Data Visualization and Business Intelligence tool that converts data from different data sources to interactive dashboards and BI reports. Power BI suite provides multiple software, connector, and services – Power BI desktop, Power BI service based on Saas, and mobile Power BI apps available for different platforms. These set of services are used by business users to consume data and build BI reports. This tutorial covers all the important concepts in Power BI and provides a foundational understanding on how to use Power BI. Audience This tutorial has been prepared for beginners to help them understand the basic concepts of Power BI. This tutorial will give you enough understanding on Power BI, from where you can take yourself to a higher level of expertise. Prerequisites Before proceeding with this tutorial, you should be familiar with Microsoft Excel, data modeling, and have some knowledge of DAX language. What is Power BI? Power BI is a Data Visualization and Business Intelligence tool that converts data from different data sources to interactive dashboards and BI reports for business-driven decisions. The Power BI suite provides multiple software, connectors, and services. Power BI apps are available for different platforms. This set of services is used by business users to consume data and build BI reports. What is Business Intelligence? Business Intelligence assists companies in processing and filtering massive amounts of stored data and transforming it into actionable insights. Mining, Data Warehouse, and Data Analytics are the correlated names of Business Intelligence. Exploratory data analysis, dashboards, and predictive modeling are the core methods of business intelligence. Why do we need a Business Intelligence Tool? In today”s digital era, unstructured data is dispersed all around the world. Companies face difficulty in handling and monitoring huge amounts of data, which in turn negatively affects their business strategies and operation management. This is why the companies require powerful BI tools for quick decision-making to increase their sales production, increase the availability of structured data, generate immense reports, handle customers, track employee performance, and enhance operational efficiency. Popular business intelligence tools such as Power BI and Tableau are being used by financial companies and big firms like Deloitte, PwC, and EY to compile data from various sources and present it in an attractive format that can be used for making crucial business decisions and identifying market trends and patterns. What are the Major Components of Power BI? Following are the major components of Power BI − Power Query It is the process of cleansing and transforming data and permits users to access datasets connecting from multiple sources. It is included on the Power BI desktop. Business users may view the data from distinct databases like MySQL, SQL servers, DB2, and many more. Power View It is a data visualization tool that assists users in developing stunning charts, and colorful maps, that turn data into a story. Power Map It is a 3D map visualization tool to identify geospatial data on Map visuals. It seamlessly helps organizations to examine the maximum sales production geographically, visualizing the demographic populations of specific regions. Power Pivot It is a Data Modelling technique that is used to create relationships between datasets. It performs complex computations by utilizing DAX functions. Power Q & A When dealing with giant datasets, it becomes crucial to get to know the in-depth details of the data. Luckily, it is done through natural language where users may ask questions and obtain the answer through Power Q & A. Why Power BI as a Career? Aspirants who are willing to make their career as a Power BI developer, researcher, business analyst, or data analyst should learn the Power BI tool and get certified by attempting the PL 300 exam. They should start from scratch and learn all the core components of Power BI. Anyone who is well versed in Excel can easily learn Power BI. The growing demand for Power BI professionals who can develop interactive dashboards and reports has been increasing continuously. Power BI is widely used in all domains, like healthcare, finance, manufacturing, retail, and more. This allows enthusiastic Power BI learners to grab opportunities in these domains. Print Page Previous Next Advertisements ”;
Power BI – Quick Guide
Power BI – Quick Guide ”; Previous Next Power BI – Introduction Power BI is a Data Visualization and Business Intelligence tool that converts data from different data sources to interactive dashboards and BI reports. Power BI suite provides multiple software, connector, and services – Power BI desktop, Power BI service based on Saas, and mobile Power BI apps available for different platforms. These set of services are used by business users to consume data and build BI reports. Power BI desktop app is used to create reports, while Power BI Services (Software as a Service – SaaS) is used to publish the reports, and Power BI mobile app is used to view the reports and dashboards. Power BI Desktop is available in both 32-bit and 64-bit versions. To download the latest version, you can use the following link − https://powerbi.microsoft.com/en-us/downloads/ Power BI – Installation Steps To check the system requirements, installation files detail, users have to navigate to “Advanced download options”. Following are the system requirements to download Power BI tool − Supported Operating Systems Windows 10, Windows 7, Windows 8, Windows 8.1, Windows Server 2008 R2, Windows Server 2012, Windows Server 2012 R2 Microsoft Power BI Desktop requires Internet Explorer 9 or higher Microsoft Power BI Desktop is available for 32-bit (x86) and 64-bit (x64) platforms Users can select a language in which they want to install Power BI and following files are available for download. This is the link to directly download Power BI files − https://www.microsoft.com/en-us/download/details.aspx?id=45331 PBIDesktop_x64.msi shows a 64-bit OS file. Select the file you want to install as per OS type and click Next. Save the installation file on the local drive. When you run the installation file, following screen is displayed. Accept the license agreement and follow the instructions on the screen to finish the installation. When Power BI is installed, it launches a welcome screen. This screen is used to launch different options related to get data, enrich the existing data models, create reports as well as publish and share reports. Power BI – Architecture Power BI includes the following components − Power BI Desktop − This is used to create reports and data visualizations on the dataset. Power BI Gateway − You can use Power BI on-premises gateway to keep your data fresh by connecting to your on-premises data sources without the need to move the data. It allows you to query large datasets and benefit from the existing investments. Power BI Mobile Apps − Using Power BI mobile apps, you can stay connected to their data from anywhere. Power BI apps are available for Windows, iOS, and Android platform. Power BI Service − This is a cloud service and is used to publish Power BI reports and data visualizations. Power BI – Supported Data Sources Power BI supports large range of data sources. You can click Get data and it shows you all the available data connections. It allows you to connect to different flat files, SQL database, and Azure cloud or even web platforms such as Facebook, Google Analytics, and Salesforce objects. It also includes ODBC connection to connect to other ODBC data sources, which are not listed. Following are the available data sources in Power BI − Flat Files SQL Database OData Feed Blank Query Azure Cloud platform Online Services Blank Query Other data sources such as Hadoop, Exchange, or Active Directory To get data in Power BI desktop, you need to click the Get data option in the main screen. It shows you the most common data sources first. Then, click the More option to see a full list of available data sources. When you click “More..” tab as shown in the above screenshot, you can see a new navigation window, where on the left side it shows a category of all available data sources. You also have an option to perform a search at the top. Following are the various data sources listed − All Under this category, you can see all the available data sources under Power BI desktop. File When you click File, it shows you all flat file types supported in Power BI desktop. To connect to any file type, select the file type from the list and click Connect. You have to provide the location of the file. Database When you click the Database option, it shows a list of all the database connections that you can connect to. To connect to any database, select a Database type from the list as shown in the above screenshot. Click Connect. You have to pass Server name/ User name and password to connect. You can also connect via a direct SQL query using Advance options. You can also select Connectivity mode- Import or DirectQuery. Note − You can’t combine import and DirectQuery mode in a single report. Import vs DirectQuery DirectQuery option limits the option of data manipulation and the data stays in SQL database. DirectQuery is live and there is no need to schedule refresh as in the Import method. Import method allows to perform data transformation and manipulation. When you publish the data to PBI service, limit is 1GB. It consumes and pushes data into Power BI Azure backend and data can be refreshed up to 8 times a day and a schedule can be set up for data refresh. Advantages of Using DirectQuery Using DirectQuery, you can build data visualizations on large datasets, which is not feasible to import in Power BI desktop. DirectQuery doesn’t apply any 1GB data set limit. With the use of DirectQuery, the report always shows current data. Limitations of Using DirectQuery There is a limitation of 1 million row for returning data while using DirectQuery. You can perform aggregation of more number of rows, however, the result rows should be less than 1 million to return the dataset. In DirectQuery, all tables should come from a single database. When a complex query is used in the Query editor, it throws an error.
Power BI – Introduction
Power BI – Introduction ”; Previous Next Power BI is a Data Visualization and Business Intelligence tool that converts data from different data sources to interactive dashboards and BI reports. Power BI suite provides multiple software, connector, and services – Power BI desktop, Power BI service based on Saas, and mobile Power BI apps available for different platforms. These set of services are used by business users to consume data and build BI reports. Power BI desktop app is used to create reports, while Power BI Services (Software as a Service – SaaS) is used to publish the reports, and Power BI mobile app is used to view the reports and dashboards. Power BI Desktop is available in both 32-bit and 64-bit versions. To download the latest version, you can use the following link − https://powerbi.microsoft.com/en-us/downloads/ Print Page Previous Next Advertisements ”;
QlikView – Home
QlikView Tutorial PDF Version Quick Guide Resources Job Search Discussion QlikView is a leading Business Discovery Platform. It is very powerful in visually analyzing the relationships between data. It does in-memory data processing and stores the data in the report itself that it creates. It can read data from numerous sources including files and relational databases. It is used by businesses to get deeper insight by doing advanced analytics on the data they have. It even does data integration by combining data from various sources into one QlikView analysis document. QlikView is a leading Business Intelligence and Analytics Platform in Gartner Magic Quadrant. Audience This tutorial is designed for all those readers who want to create, read, write, and modify Business Intelligence Reports using QlikView. In addition, it will also be quite useful for those readers who would like to become a Data Analyst or Data Scientist. Prerequisites Before proceeding with this tutorial, you should have a basic understanding of Computer Programming terminologies. A basic understanding of any of the programming languages will help you in understanding the QlikView programming concepts. Familiarity with SQL will help you learn it very fast. Print Page Previous Next Advertisements ”;
QlikView – IntervalMatch
QlikView – IntervalMatch ”; Previous Next QlikView IntervalMatch is a powerful function used to match distinct numeric values to numeric intervals. It is useful in analyzing how the events actually happened versus the planned events. The example of a scenario where it is used is in the assembly lines of the production houses where the belts are planned to run at certain times and for certain duration. However, the actual run can happen at different points in time because of breakdown etc. Example Consider an assembly line where there are three belts named A, B and C. They are planned to start & stop at specific times of a day. In a given day, we study the actual start and end time and analyze what all happened in that day. For this, we consider two sets of observations as shown below. # Data Set for AssembilyLine. StartTime,EndTime, BeltNo 00:05,4:20, A 1:50,2:45,B 3:15,10:30,C # Data set for the events happened. ActualTime,Product 1:10,Start Belt A 2:24,Stop Belt A 3:25,Restart Belt A 4:35,Stop Belt A 2:20,Start Belt B 3:11, Stop Belt B 3:15,Start Belt C 11:20, Stop Belt C Creating the Script We open the script editor in a new QlikView document using Control+E. The following code creates the required tables as inline data. After creating this script, press control+R to reload the data into the QlikView document. Creating Sheet Object Let us create a Table Box sheet object to show the data generated by the IntervalMatch function. Go to the menu item Layout → New Sheet Object → Table Box. The following window appears in which we mention the Title of the table and select the required fields to be displayed. Showing the Table Box On clicking OK in the above window, a table appears showing the field ActualTime matched to the intervals StartTime and EndTime. Print Page Previous Next Advertisements ”;
Power BI – Data Modeling
Power BI – Data Modeling ”; Previous Next In this chapter, you will learn about data modeling in Power BI. Using Data Modeling and Navigation Data Modeling is one of the features used to connect multiple data sources in BI tool using a relationship. A relationship defines how data sources are connected with each other and you can create interesting data visualizations on multiple data sources. With the modeling feature, you can build custom calculations on the existing tables and these columns can be directly presented into Power BI visualizations. This allows businesses to define new metrics and to perform custom calculations for those metrics. In the above image, you can see a common data model, which shows a relationship between two tables. Both tables are joined using a column name “Id”. Similarly, in Power BI, you set the relationship between two objects. To set the relationship, you have to drag a line between the common columns. You can also view the “Relationship” in a data model in Power BI. To create data model in Power BI, you need to add all data sources in Power BI new report option. To add a data source, go to the Get data option. Then, select the data source you want to connect and click the Connect button. Once you add a data source, it is presented on the right side bar. In the following image, we have used 2 xls file to import data – Customer and Product. In Power BI on the left side of the screen, you have the following three tabs − Report Data Relationships When you navigate to the Report tab, you can see a dashboard and a chart selected for data visualization. You can select different chart types as per your need. In our example, we have selected a Table type from available Visualizations. When you go to the Data tab, you can see all the data as per the defined Relationship from the data sources. In the Relationship tab, you can see the relationship between data sources. When you add multiple data sources to Power BI visualization, the tool automatically tries to detect the relationship between the columns. When you navigate to the Relationship tab, you can view the relationship. You can also create a Relationship between the columns using Create Relationships option. You can also add and remove relationships in data visualization. To remove a relationship, you have to right-click and select the “Delete” option. To create a new “Relationship”, you just need to drag and drop the fields that you want to link between the data sources. You can also use the Relationship view to hide a particular column in the report. To hide a column, right-click on the column name and select the “Hide in report view” option. Creating Calculated Columns You can create calculated columns in Power BI by combining two or more elements of the existing data. You can also apply calculation on an existing column to define a new metric or combine two columns to create one new column. You can even create a calculated column to establish a relationship between the tables and it can also be used to setup a relationship between two tables. To create a new calculated column, navigate to Data View tab on the left side of the screen and then click Modeling. When you navigate to the Modeling tab, you can see a New Column option at the top of the screen. This also opens the formula bar, where you can enter DAX formula to perform calculation. DAX- Data Analysis Expression is a powerful language also used in Excel to perform calculations. You can also rename the column by changing the Column text in the formula bar. In the following example, let us create a new column: Product Code (Product_C), which is derived from the last three characters of Prod_Id column. Then, write the following formula − Product_C = RIGHT( Sheet1[Prod_Id],3) A long list of formulas is also provided that you can use for creating calculated columns. You have to enter the first character of formula to be used in calculations as shown in the following screenshot. Creating Calculated Tables You can also create a new calculated table in data modeling in Power BI. To create a new table, navigate to the Data View tab on the left side of the screen, and then go to the Modeling option at the top of the screen. DAX expression is used to create the new table. You have to enter the name of a new table on the left side of the equal sign and DAX formula to perform the calculation to form that table on the right. When the calculation is complete, the new table appears in the Fields pane in your model. In the following example, let us define a new table – Table_CustC that returns a one column table containing unique values in a column in another table. A new table is added under the “Fields” section in Power BI screen as shown in the following screenshot. Once the calculated column and calculated tables are created as per your requirement, you can use the fields in the Report tab in Power BI. To add these objects, you have to select a checkbox and a relationship is automatically detected if possible. If not, then you can drag the columns that you want to connect. To view the report, you navigate to the Report tab and you can see both “Calculated columns” and fields from the new “Calculated table” in the report view. Managing Time-Based Data Power BI allows to drill through time-based data by default. When you add a date field in your analysis and enable drill on your data visualization, it takes you to the next level of time-based data. Let us consider we have added Time-based table in Power BI visualization. We have added Revenue and Year column in our report. We can enable the drill feature in
QlikView – Web file
QlikView – Web File ”; Previous Next QlikView can process files from the web, which are in the HTML format. It can extract data from HTML tables. The URL of the web file to be processed is given as an input and QlikView fetches both, the structure and content of the file. Then it analyzes the structure of the page extracting the relevant data from the HTML tables present in the page. We choose the Web files option from the Data from files section under the Data tab of script Editor. Give the URL as Input On selecting the Web files option, we get a new window to give the URL as input. In this example, we are choosing the List of sovereign states and dependent territories in Asia as the input page from Wikipedia. Mention the URL and click Next. Select the Table from the Web File On opening the selected Web file, the window shown below comes up. Here we can see the various tables present in the webpage labeled as @1, @1, @3 and so on. Choose the first table and click Next twice. Select the Columns of the Table From the above table, we can choose only the columns we need by removing the unwanted columns using the cross sign. Load Script The loading of the file into QlikView is done through the load script, which can be seen in the screen shot given below. Hence, when we use any delimited file, we can tweak the below given script as per the file format. Now the script wizard prompts to save the file in the form of *.qvw file extension. It asks to select a location where you need to save the file. Click “Next step” to proceed. Now it is time to see the data that is loaded from the web file. We use a Table Box sheet object to display this data. Create Table Box The Table Box is a sheet object to display the available data as a table. It is invoked from the menu Layout → New Sheet Object → Table Box. On clicking Next, we get the option to choose the fields from the Table Box. You can use the Promote or Demote buttons to rearrange the fields. Table Box Data On completing the above step, the Table Box Sheet Object appears, which shows the data that is read from the Web file. Mark the Non-English characters !! Print Page Previous Next Advertisements ”;