Setting up the system in BODS

Below are the basic steps you need to follow when setting up a Data Services system-

1) Create a database in SQL (or any supporting back end DB)
2) Create a Repository (Local, Central or Profiler)
3) Assign the Repository (Management Console)
4) Define a Job server ( Server Manager)
5) Start with the Designer ( Data services Designer)

 

I) First step is you need to create a database in SQL so that it will contain all the information of the intermediate layers like temp tables (simple temp tables for one to one mapping or those temp tables which handle the transformed data)
You can create a separate user id and password for the DB which you can use when you login to the Data Services Designer.
Following screenshots illustrate the steps on how you create your database-

Login to SQL management studio
Navigation :- Start – Program Files -Microsoft SQL Server 2005 -SQL Server Management studio Express
Give in the Credentials
Authentication :- SQL Server Authentication
Login :- your user name
enter password and click on connect.
Now you will be in SQL Server Management Studio.

wp_bods4.png

Now select the Data base folder on the left hand side and Right click -> New Database

Give the Database name “how2BODS” and click on OK

wp_bods5

If you want to change the login ID and password of the DB, open the Security Folder under the Database folder. Select the Security Folder – right click – new-login – you will get the below window-

wp_bods6.png

wp_bods7

Give the Login name for ex:- bods_user1

Select the SQL Server Authentication radio button.

Give the new password “ us1_123”

Confirm the password “us1_123”

Uncheck the Enforce password policy (the remaining two also will be unchecked)

Select the default database to “how2bods” using the Dropdown button available.

Next if you look at the left hand side of the same window you will find-

wp_bods8.png

Now select the server roles and  check system admin on the right hand side.

wp_bods9

Next click on the User mapping

Check the database you created in the right side top portion of the window and check public and db_owner on the bottom part of the Window.

Now click on ok and the User name with password will be created for the Database you created.

wp_bods10

II) Create a repository on the Data Services side-

We have 3 types of repositories in data services

  • Local Repository
  • Central Repository
  • Profiler Repository

Local repository is used for a single user instance. This repository is created locally in your system and the user who login to this system can access the local repository. (It is local to the system)

(Local repository holds all the Jobs, workflows, data flows, data stores and functions of the local user)

Central Repository  is used for the Multiple user instance. This repository is created centrally and it can be used or accessed by multiple users and user groups that are created for this project. Using the Central repo you can share your jobs and Dataservices components across the multiple users.

This acts as a central storage place so that all the users can upload and download (share) the Data services artifacts.

Profiler Repository   is used to do the data profiler activities like data cleansing and consolidation. Data Quality aspects are carried out using the Profiler repository. This holds the reports that were generated when you do a data quality to check to ensure the health of the data.

Navigation:-

Start – Program Files – SAP BusinessObjects XI 3.2 – SAP BusinessObjects Data Services – Data Services Repository Manager

You  will get the below screen-

wp_bods11.png

Using the drop down menu select the repository type as “ Local”

Database Type :- Microsoft SQL Server

Database Server name : Give the SQL server name here.

Database name : how2bods

User name: bods_user1

Password: us1_123

Now click on Create button and your local repository will be created.

wp_bods12.png

III) Assign the Repository to Data services using Management Console

You need to assign the created repository to the data services.

Now login to the Data Services Management console using the following Navigation in your desktop-

All programs-SAP BusinessObjects XI 3.2 – SAP BusinessObjects Data Services – Data Services Management Console

Management Console is a web based tool.

This is like an Administration tool that is used to create and maintain the repositories, add the repositories, Create the User Groups and Users and also used to schedule and execute the jobs.

Since it is a web based tool, it can be accessed from any location and the administrator / user can access it from any remote location and perform the tasks.

Login using the User id and password as  “admin”. This will be created when you install BODS.

In the screen that appears, click on the Administrator and then click on the Repositories and click on ADD on the right side to add the local repository that you created-

wp_bods13.png

management console

add repository

Give the below credentials-

Repository Name :  Local Repo

Database type : Microsoft SQL Server

Machine Name: SQL server Name

Database Name :  how2bods

User name : bods_user1

Password: us1_123

Now click on test button and see if the above credentials entered were correct and click on Apply.

Now you assigned the local repository to the data services.

IV) Define the Job server

Defining a job server is a one time job and you can define multiple job servers per repository as required. Job server is used to execute the jobs that you build using the Data Services.

To create the or define the job server go to-

All programs-SAP BusinessObjects XI 4.2 – SAP BusinessObjects Data Services – Data Services Server Manager

You will get the below screen-

wp_bods14.png

Click on “Configuration Editor”

wp_bods15.png

You will find the list of the job serves (and their port numbers) available. If you want to add a new job server click on add.

You will get the below screen-

new job server

Give the job server name :- Job_server_how2bods

Job server port :- 3507 ( this port number should be unique per job server so please cross check with the port numbers that available and use a new port number)

Click on Add on the right side and now the Repository  Information pane will be active.

Give the Data base Type : Microsoft SQl Server

Server name : SQL Server name

Database name: how2bods

User name : bods_user1

Password : us1_123

Click on Apply, click on ok, again click on ok and once you come to the main job server page, click on restart button at the last.

This will restart the services so that the newly created job server will be set as the default server. This is how you will create the job server.

V) Starting with the Data Services Designer-

Dataservices designer is used to connect to the source and target system, extract the data, build the job to apply the business rules on the field level data that is extracted and send the data to the target system. It is one place where you can perform from simple one to one mapping query transform to complex query transforms like Global address cleansing, able compression and so on.

 

designer credentials

Give the credentials

Database type : Microsoft Sql server

Database server name : SQL server name

Database name : how2bods

User name : bods_user1

Password : us1_123

Make sure that the windows authentication is unchecked.

Click on OK and now you will login to the designer.

Designer is broadly divided into three regions-

designer regions

Project Area (contains all the projects that you build and displayed in a hierarchical folder way like project, script, conditions, work flows, data flows)

Local Object library (contains tabs like Project, Job, Work Flow, dataflow, Transformations, datastores, formats and functions )

Designer Canvas / Window is used to design or build the job.

First we need to connect or establish a connection between our designer and data base (source, target or staging) this can be done using the datastores.

Datastore is present as a tab under the local object library and this is used to establish a connection between the data services and any other (source or target) Systems.

Go to Data store and right click in local object library and click on new-

bods1.png

bods2.PNG

Give in the credentials

Data store Name : data_staging

Datastore Type : Database

Database Type: Microsoft SQL server

Database version: SQL server 2005

Database server name: SQL server name

Database name : how2bods

User name: bods_user1

Password: us1_123

Click on apply and click on OK

Now your data store will be created under the data store tab in the Local Object library. This establishes a connection between the local database and the Data Services.

Extracting a Flat file data and loading the data to the database (SQL)

In this scenario we are creating  job which will load the data from a flat file to SQL DB.

Create a flat file and fill it with data.

Customer ID Customer Name Address Phone Region Country
C103 Bill Denver 122340329 US Canada
C104 Mike Washington 122340387 US United States
C105 Phil Brookefield 984923601 Europe France

Save the spread sheet on your desktop.

Now your data source (Flat file ) is ready and you need to call that sheet to the data services. Since it’s a flat file you can directly call that to the data services using File format tab under local object library instead of building a Datastore for connection.

Go to File Format. Select Excel Work book. Right click -new

bods3.PNG

First select the Directory. Click on the Down arrow and navigate to your desktop. Next using down arrow navigate and select the file that is saved on your desk top. Copy the same name and past that in the format name. Select worksheet and select the sheet 1 in which you have the data.

Check First Row values as column -> click on import schema button.

bods4.PNG

Now you can see the structure created on the top of the same screen. Make sure that all the data type are Varchar 255 and click on OK.

Check that file should come under the Excel workbooks under the local object library.

bods5.PNG

Start creating a project and start building a job so that you can extract the data from the Spread sheet to data services and store that in the SQL server DB.

Moving the data from Excel to SQL

Just above the project Area  you will find a new button. Click on that to create a new project. Give the project name and click on Ok. Now you can see the project folder created under the Project area. Select the project- Right click – New Batch job.

bods6.PNG

Give Job name. Observe that the canvas window will appear or it will be activated. In the canvas, click on the Work Flow on the right side pane and click on the canvas region to get a work flow and name the work flow as WF_how2bods.

Double Click on the work flow and similarly get a dataflow into it. If you now observe under the project area you will find the job displayed as a tree structure.

See the below screen shots for the steps to do-

bods7.PNG

bods8.PNG

Double click on Work Flow and Click on Dataflow on the right side pane and click back on canvas-

wf1.png

Double click on the Dataflow. This is the place where your actual process starts.

Drag the created flat file from the Excel workbooks to the designer window or canvas.

Click on the query transform from the right side pane and click it next to the spreadsheet dragged. Connect the spread sheet to query transform.

wf2.png

Double click on the query and drag all the fields from schema In to Schema Out.

wf3.png

Click on back at the top of the window.

Now create a template table and point it to the data store you created to connect to SQL Server as below.

Click on the template table on the right side pane and click it back on the canvas.

wf4.png

wf5.png

Make sure that you select the data store you created using the down arrow. Click on OK. Now your temp table will be created. Connect the query transformation to the temp table and click on save.

wf6.png

Once you click on save, the magnifying glass symbol will be shown at the right bottom of the temp tale and it says that the table is saved with the structure or schema.

wf7.png

Now your job is ready and you can run the job, select the job you created “Job_how2bods”. Right click and click on execute.

Make sure that the file is not open while the job is executing, else job will fail.