Query Transform in Data Services 3.2

Hi,
I am using Query transform to extract data from DB2 database and just realized that the whole source table is accessed and then the query transform's where condition is applied, meaning the whole table is loaded in the memory befored it filters the data.
Is there anything I can do to access only the required data from the source? My filter conditions are dynamic based on system date, so creating a database view is not a valid option.
Thanks & regards,
Bhavesh

I don't see the option to "right-click to stop a job" in the Data Servcies 3.2 Management Console >Status >Repository >Job :Monitor.
I do see we can Select the job, then click Abort at bottom of screen.
Are you sure it's a right-click?
On the Monitor Tab, I don't have a right click to stop the job either.
Also in the Management Console I don't see where I can right-click and select Properties to add a description for a specific trace log
Am I in the wrong spot?
Thanks
Jay

Similar Messages

Transforms in Data Services.

Hello ,
I just start learning data services and i am getting confused with the transforms used in it.So, please help me to understand the concepts of transforms in data services and their uses also.
Thanks.

Hi,
if you are new to DS you maybe want to start with the Tutorial
http://help.sap.com/businessobject/product_guides/boexir32/en/xi32_ds_tutorial_en.pdf
There you find also some guidance to the Transforms.
Regards
-Seb.

BAM Data Control - Group query with Active Data Service

Trying to get a group query from a BAM data control to work with Active Data Service in an ADF application (JDeveloper 11.1.1.4.0).
With a flat query, as the data changes, I can see DataChangeEvents fired, resulting in a data push to the client -
<BAMDataChangeEventFilter> <log>
#### DataChangeEvent #### on [DataControl name=CEP_Person_DOB_Flat, binding=data.view_mainPageDef.FlatDOB1.view_pageDefs_FlatDOBViewPageDef_WEB_INF_FlatDOB_xml_FlatDOB.QueryIterator]
Filter/Collection Id : 1966
Collection Level : 0
Event Id : 5
==== DataChangeEntry (#1)
ChangeType : INSERT_AFTER
KeyPath : [2157, 0]
InsertKeyPath : [null, 0]
AttributeNames : [id, _PersonKey, _County, _Surname, _AGE, _DOB, _Country, _FirstName]
AttributeValues : [2157, 10008/129, Vagzukarbsm, Gnnfzxxyqfgpsijcr, 110, Thu Dec 26 00:00:00 GMT 1901, Ekcqvrkoksr, Vwhm]
When I try a group query on the same data, currently just trying to group by _DOB for every 10 years to count the number of people, I get no data change events fired, so don't get any data pushed to the client, though the data has been changed if I refresh the page.
Any ideas ?

can you include bam and jdev versions and also include exception from logs?

Query regarding BO Data services installation

I am in process of installing BO data services on Unix(AIX) system. I need to install DATA SERVICES XI 3.2 SP3. For this I have downloaded the installables and patches from marketplace. We have following queries:
1. On installation of the data services can we directly apply SP3 patch1 or we need to install SP1, SP2 and SP3 first.
2. How to check the version of SP installed. I have applied SP3 patch1 but I am not able to check the same.
3. During installation, I have skipped the step of creating the repository as I need to do it later using repoman, can this be a reason of that I am not able to upgrade SP for this?
Any pointers on this would be helpful.

check the JobServer log in the %LINK_DIR%\log\<JobServerName>\server_eventlog_<date>.log file
look for the following entry
Sending notification to <inet:ip-address:port number> here ip-address is the ip-address of the Designer machine, try to ping from the job server machine on that ip or try to do a telnet
telnet <ip-address> <port number>
what is the status of JobServer on Designer?
where is you DI webServer installed? on the same machine as Designer ? or on the JobServer machine

New tutorials posted for Text Data Processing on Data Services 4.0

Check out the 3 new Text Data Processing tutorials available at http://wiki.sdn.sap.com/wiki/display/BOBJ/TextDataProcessing within the Product Tutorials section.
-- Introduction to Entity Extraction Transform: this 15-minute demo provides an overview of the Text Data Processing Entity Extraction transform for Data Services 4.0. The Entity Extraction transform enables you to process unstructured text, such as web pages, news articles, maintenance logs, text from a spreadsheet, or even from a database column, to extract key pieces of information that you can use in query and reporting.
-- Using Text Data Processing Blueprints: this 6-minute demo explains how to get up and running with TDP quickly using a series of jobs contained in a blueprint. A blueprint is a sample end-to-end solution available on SAP Community Network.
-- Creating an Extraction Dictionary: this 13-minute demo explains how to create an Extraction Dictionary, which can be used to customize a TDP Entity Extraction transform to improve results.

Thanks for sharing your use case. I have a few questions if you don't mind:
1) What file formats are typically found within these compressed containers? For example, html, xml, txt, pdf, MS Office, etc.
2) Do these compressed containers ever have other embedded compressed containers within them? For example, a zip file containing other zip files within it.
3) If the intention is to process document files, do any of the document files have other document formats embedded/nested within them? For example, a MS Word document with a spreadsheet embedded within it.

Error while calling ABAP program from Data Services

Hi All,
We have a ABAP program which accepts two parameters 1] a date 2] a string of comma separated ARTICLE numbers .
We have used a ABAB transform in ABAP dataflow which refers this ABAP program.
If I pass a string of 6 articles as second parameter the job executes successfully
But if i pass 9 articles as follows
$GV_ITEM_VALUES='3564785,1234789,1234509,1987654,1234567,2345678,3456789,4567890,5456759';
i get the following error
ABAP program syntax error: <Literals that take up more than one line are not permitted>.
The error occurs immediately after ABAP dataflow starts, ie even before the ABAP job gets submitted to ECC
I am using BODS 4.2 . The datatype of $GV_ITEM_VALUES is varchar(1000).
The ABAP program that gets generated by the DS job has the following datatype for this parameter
PARAMETER $PARAM2(1000) TYPE C
Is there a different way to pass string characters to ABAP transform in data services?
I have attached the screen shot of trace log and error
Regards,
Sharayu

Hi Sharayu,
The error your getting is because the literals exceeds more than 72 characters.
It seems that the length of the string is exceeding more than 72 character.
Can you check the following in ECC GUI
Go to Transaction SE38=>Utilities=>Settings=>ABAP Editor=>Editor=> Downwards -Comp.Line Length(72).
The checkbox which defines length 72 must be clicked so the error is coming. Can you uncheck the checkbox and then try passing the parameter $GV_ITEM_VALUES using the BODS job
Regards
Arun Sasi

Can't call WCF Data Service from within a WCF Service

I am trying to query my WCF Data Service from within a WCF Service and I receive a error 404. However, when I query the data service from my application, it works just fine. The WCF Service will work just fine if I comment out the Data Service
query request.
How do I get a WCF Service and a WCF Data Service to play nice?

Hi,
For this situation, first you could try to create the wcf data service and run it then consume the data service within your application by adding service reference.
Here is an example for creating and consuming WCF Data service in console application, and for consuming the service in wcf service, you could just follow the same steps as the console application does.
http://www.c-sharpcorner.com/uploadfile/dhananjaycoder/introduction-to-wcf-data-service-and-odata/
Regards

BO Data Services - Reading from excel file and writing to SQL Server Table

Hi,
I would like to read data from an excel file and write it to a SQL Server Data base table without making any transformations using Data Services. I have created an excel file format as source and created target table in SQL Server. The data flow will just have source and target. I am not sure how to map the columns between source and target. Appreciate your quick help in providing a detailed steps of mapping.
Regards,
Ramesh

Ramesh,
were you able to get this to work? if not, let me know and I can help you out with it.
Lynne

Question - new to BO Data Services Designer - how to automatically transform varchar column data to upper(varchar) across all columns in a table?

Hello -
New user to BO Data Services Designer. Company is using Data Services Version 12.2.
I have many tables that all need the same transformation- converting varchars fields to upper(varchar) fields
Example:
I have a table called Items. It has 40 columns, 25 of which are of type varchar.
What I have been doing is ....
I make the Item table as the source table then create a Query transform that is then attached to a new target table called - ITEMS_Production.
I can manually drag and drop columns from the source table to the query and then in the mapping area I can manually type in upper(table_name.column_name) or select the upper function and then select the table.column name from the function drop down list.
Obviously, I want to do this quicker as I have to do this for lots and lots of tables.
How can set up Data Services so that I can drag and drop an upper transform quickly and easily or automate this process.
I also know Python-Java so am happy to script something if need be.
the logic would be something like -
if there is a column with a type varchar, add the upper() transformation to column. Go to next column.
Excited to be using this new tool-
Thanks in advance.
Ray

Use the DS Workbench.

% Wildcard selection - extract data via Query as a Web Service

Hello all,
I am using Query as a Web Service to extract data through to my Xcelsius document. I have a series of charts that display summed data according to user selections within some combo boxes.
Is there any way to send through a wildcard selection, i.e. pass a " like '%' " query string somehow through to the database?
With the query that I have created:
I have a measure value returned
I have 4 filter objects
I have selected the "Prompt" option for each
Within the Data Manager, the prompt fields are assigned to cells which reference the combo box selections
When I build the query, the selections available are many (equal to, not equal to, greater than, greater than or equal to, etc), but there is no 'like' comparison.
Alternatively, is there a way that I can pass the selected parameter values, including " like '%' " if no value is selected within a dropdown, to the original measure calculations within the universe?
I hope this makes sense, let me know if I need to clarify anything. Any help would be very much appreciated.
Cheers,
Marco

Very easy solution - select 'matches pattern' within the filter objects selection when building the query.
Don't know why I didn't try this earlier.

How to use OData Date filter query to filter data from OData NetWeaver Gateway Service?

Hello,
I am trying to use the OData Filter query. to filter data records from the OData Service, using Date range for filters.
Please check the below URL for the SAP's sample OData Service, with filter option.
Service Query URL :
https://sapes1.sapdevcenter.com/sap/opu/odata/sap/ZGWSAMPLE_SRV/SalesOrderCollection?$filter=CreatedAt eq DateTime
It gives out following error :->
<message xml:lang="en">'$filter ' is not a valid system query option</message>
Please let me know, if there is any mistake in the Query or is there anything that needs to be done on the
Backend Service.
Thanks & Regards,
Suraj Kumar

Hi Jitendra,
Once again, thank you for your help.
I am able to filter the records using a date range.
I am sharing the information, just in case anyone out there might need it.
The OData Filter Query for Date Range (i.e. with Two date values) will return the results only if the OData Back-end Service is modified to accommodate such filter requests.
This has to be done in ABAP.
Please refer the following links which talks more about the Back-end ABAP Service being modified to ensure that the service returns records of data, as per the date range filter query
http://scn.sap.com/thread/3170195
http://scn.sap.com/blogs/lindsay.stanger/2012/12/29/gateway-odata-calls-convert-ivfilterstring-to-itfilterselectoptions
http://scn.sap.com/thread/3173146
Hope these links are helpful for those looking for OData Date Range filter query.
Do let me know.
Regards,
Suraj Kumar.

Query as a Web Service can't see .unx universes to use as data source?

Hi,
I created a Universe using Information Designer. The Universe is published on the server as *.unx.
With Query as a Web Service Designer, I connect to the server to create a query. However, in "Choose a universe as a data source for the query", I do not see the *.unx Universes, I only see *.unv Universes.
Both software are the latest version (XI 4.0).
Anyone know what is the issue here?
Thanks,

Hi there,
So in QaaWS tool, therefore, only UNV files are seen?
Regarding going through WebI Rich client > Web Services, how do I generate a URL?
In WebI Rich client this is already sourcing the Web Service (provided i already have a URL)...
I am confused with this.
Can someone please reply?
Regards,
Iris

Data Services Designer Query tranform dynamic where clause or another way

I have an XML source that has 5 fields. These fields are used to query 4 different SQL table data sources and do an AND inthe where clause of a query transform. Works well if all 5 fields in the xml have data. If one (or more) are blank, then it runs the where checking for blank matches and gives no results. What I want to do is if a field is blank, do not use it in the where clause. Could this be an outer join setup? Issue is that if there is a PhoneNumber input, then to be considered a result, there must be a PhoneNumber match on potential result records...

I have an XML source that has 5 fields. These fields are used to query 4 different SQL table data sources and do an AND inthe where clause of a query transform. Works well if all 5 fields in the xml have data. If one (or more) are blank, then it runs the where checking for blank matches and gives no results. What I want to do is if a field is blank, do not use it in the where clause. Could this be an outer join setup? Issue is that if there is a PhoneNumber input, then to be considered a result, there must be a PhoneNumber match on potential result records...

Data Integrator "where" in query transform vs SAP table column date

I have the following problem:
I am using a query transform to grab data from a SAP table and have a "where" that looks like this that works:
ZMM_STOMOS_HIST.ZPOST_DATE = to_date(to_char(sysdate(), 'YYYYMMDD'), 'YYYYMMDD')
BUT it runs for a very long time and I have just realised that when I look at the sql statement via display optimized sql that the "where" statement does not show - which makes sense because it seems to return the entire table rows to DI before it starts to filter them on the "where".
this is even though the pure SAP date is stored as YYYYMMDD type date and in DI we say take it to our BO table as type date u2013 the sql server database made it datetime. And when I validate the sql transform I get this warning.
[Query:Query_1]
BODI-1110411: Conversion warning <Warning: Expression <to_date(to_char(sysdate(), 'YYYYMMDD'), 'YYYYMMDD')> of type <DATETIME> will be converted to type <DATE>.> for expression <ZMM_STOMOS_HIST.ZPOST_DATE = to_date(to_char( sysdate( ),'YYYYMMDD'),'YYYYMMDD')
>.
I can get other "where" conditions to show in the optimized sql on the same table - no problem.
e.g.
SELECT ZSERIAL , ZUMOVETYP , ZUORIGIN , ZUDESTN , ZUTRDATT , ZUTRTIMM , ZUVENDER , ZUBOXSA1 , ZUBOXSA2
FROM ZMM_STOMOS_HIST
WHERE ZUMOVETYP = 'RBX'
How do I get this particular where clause to appear in the optimized sql statement ? I suspect it has something to do with the formatting and have tried many formats but no go.

Thank you so much .... I had to use a variable / paramter of type varchar(8) and the value as YYYYMMDD
e.g. my script
$today = to_char(sysdate(),'YYYYMMDD');
print('date is : [$today]');
This has resulted in a huge resource and most of all time saving.
I still dont understand why DI cant just figure this out in a normal where like it does with other datatypes but right now it works so I am happy.

XML transformation with BusinessObjects Data Services

Hi,
We have a legacy web service based on JAX-RPC and the data retrieved from this service does not conform to the schema generated, so there's a need to retrieve the data generically(a complete XML body is returned in a varchar field) and then parse the data inside and assign to individual fields. For a limited period of time until this service is phased out, we need to use this service to retrieve data for some ETL processes. Does BusinessObejcts Data Services offer me a way to implement a custom transformation (for example, a custom Java parser code)? If it does, please advise how to find the relevant how-to guides, or any other means to get the data.
Kind regards,
S. Gökhan Topç

Hi,
DS offers the possibility to run a program at the end of an ETL job. So you could write your java code and let DS run it.
Maybe thats sufficient.
But i would recommend you check the "Enterprise Information Management" Forum, there are the DS Gurus located.
Regards
-Seb.

Query Transform in Data Services 3.2

Similar Messages

Maybe you are looking for