Text Data Processing 4.1 Training in February & April for APJ & EMEA

We would like to announce upcoming training opportunities in Malaysia and Germany for partners and select customers on Text Data Processing within the upcoming Data Services 4.1. Get early hands-on access to software and participate in the review of the product roadmap.
Why Partner Test?
- Receive an introduction to the product and how text analytics capabilities are being delivered through Data Services
- Only source for partners and select customers to get deep product knowledge directly from development at this early stage
- Better understand migration scenarios for BusinessObjects Text Analysis XI customers
Test Scope
- Entity Extraction from unstructured data in one or more of the 31 supported languages
- Data Quality transforms for post-processing such as Match and Address Cleanse
- Sentiment analysis in either English, German, French or Spanish
Time Frame & Location
- Kuala Lumpur, Malaysia: February 13-16 >>> FULL <<<
- Walldorf, Germany: April 16-17 and 18-20 >>> FULL <<<
Tester Profile
- Data Services knowledge helpful
- Previous experience with text analytics or text mining
- Existing use cases for text analysis and sample data to test
Tester Demand
- 2-4 days depending on session
- No registration fee but attendees must provide their own travel and lodging
For further Text Data Processing info: http://wiki.sdn.sap.com/wiki/display/BOBJ/TextDataProcessing
If you are interested in attending or have questions please contact Anthony Waite @ SAP.
Edited by: Anthony Waite on Feb 7, 2012 4:58 PM

Did you tried this document:
How to find the Missing Records for the Target Table during Post Load validation at Business Objects Data Services - Bus…

Similar Messages

New tutorials posted for Text Data Processing on Data Services 4.0

Check out the 3 new Text Data Processing tutorials available at http://wiki.sdn.sap.com/wiki/display/BOBJ/TextDataProcessing within the Product Tutorials section.
-- Introduction to Entity Extraction Transform: this 15-minute demo provides an overview of the Text Data Processing Entity Extraction transform for Data Services 4.0. The Entity Extraction transform enables you to process unstructured text, such as web pages, news articles, maintenance logs, text from a spreadsheet, or even from a database column, to extract key pieces of information that you can use in query and reporting.
-- Using Text Data Processing Blueprints: this 6-minute demo explains how to get up and running with TDP quickly using a series of jobs contained in a blueprint. A blueprint is a sample end-to-end solution available on SAP Community Network.
-- Creating an Extraction Dictionary: this 13-minute demo explains how to create an Extraction Dictionary, which can be used to customize a TDP Entity Extraction transform to improve results.

Thanks for sharing your use case. I have a few questions if you don't mind:
1) What file formats are typically found within these compressed containers? For example, html, xml, txt, pdf, MS Office, etc.
2) Do these compressed containers ever have other embedded compressed containers within them? For example, a zip file containing other zip files within it.
3) If the intention is to process document files, do any of the document files have other document formats embedded/nested within them? For example, a MS Word document with a spreadsheet embedded within it.

.cfg file in text data processing

While doing sentimental analysis of social media data (Twitter) I have created .cfg file to define auth code,search term and all other details.
I want to restrict the data coming from Twitter on the basis of date (Data should pull only from particular date). What parameter I need to give in .cfg file for the same.
Thanks,
Sagar

Did you tried this document:
How to find the Missing Records for the Target Table during Post Load validation at Business Objects Data Services - Bus…

Unable to create .fsm file in Text Data Processing from .rul file

I am trying to compile english-tf-voc-sentiment.rul file to generate english-tf-voc-sentiment.fsm file using below command from cmd.
tf-cgc -i C:\Users\336655\Desktop\Modified\english-tf-voc-sentiment.rul -o C:\Users\336655\Desktop\Modified\english-tf-voc-sentiment.fsm
But getting below error.
Error: Could not open file ./english-tf-voc-thesaurus.rul
Error: Could not build FSM file.
where as english-tf-voc-thesaurus.rul is file which is called by english-tf-voc-sentiment.rul file
Any idea how to resolve this issue?

You can use following code to capture the error.
TRY.
      OPEN DATASET filename FOR OUTPUT IN BINARY MODE MESSAGE V_MSG.
      CATCH CX_ROOT
      INTO EXCEPTION.
      CALL METHOD O_EXCEPTION ->IF_MESSAGE~GET_TEXT
        RECEIVING
        RESULT = V_MSG.
      MESSAGE v_msg
      TYPE 'E'.
ENDTRY.
You can capture error in v_msg.
Following are the exceptions for the same:
Exceptions
Catchable Exceptions
CX_SY_FILE_OPEN
Cause: The file is already open.
Runtime Error: DATASET_REOPEN
CX_SY_CODEPAGE_CONVERTER_INIT
Cause: The desired conversion is not supported. (Due to specification of invalid code page or of language not supported in the conversion, with SET LOCALE LANGUAGE.)
Runtime Error: CONVT_CODEPAGE_INIT
CX_SY_CONVERSION_CODEPAGE
Cause: Internal error in the conversion.
Runtime Error: CONVT_CODEPAGE
CX_SY_FILE_AUTHORITY
Cause: No authorization for access to file
Runtime Error: OPEN_DATASET_NO_AUTHORITY
Cause: Authorization for access to this file is missing in OPEN DATASET with addition FILTER.
Runtime Error: OPEN_PIPE_NO_AUTHORITY
CX_SY_PIPES_NOT_SUPPORTED
Cause: The operating system does not support pipes.
Runtime Error: DATASET_NO_PIPE
CX_SY_TOO_MANY_FILES
Cause: Maximum number of open files exceeded.
Runtime Error: DATASET_TOO_MANY_FILES   Non-Catchable Exceptions
Cause: An attempt was made to open a pipe that is already open.
Runtime Error: DATASET_PIPE_POSITION
Hope that will help you.
Please reward if useful.

PLEASE HELP!!! Problem with Java and SQLServer Text data type

Hi there,
I have a java app. that reads from an MS SQLServer database. Originally, all long text fields were declared as NVARCHAR(200). The program worked fine.
Someone then advised that I change all long text fields to the TEXT data type. The program now crashes out with the following Exception:
"java.sql.SQLException: [JRun][SQLServer JDBC Driver]This ResultSet can not re-read row data for column 25."
Basically, I have a method that retrieves a resulset and iterates through it. The resultset is passed to another method during each iteration. In the example below, the 'specialNote' field used to be NVARCHAR(200). The code worked fine. Then when it was changed to TEXT, the program no longer works with the above Exception thrown.
Anyone know any special way SQLServer TEXT data types need to be handled?
Thanks for any advice!
The code looks something like this in functionality:
<CODE>
public void method1 (Connection conn)
Resultset rs = conn.createStatement().executeQuery("SELECT * FROM ProductBB");
while (rs.next())
method2(rs);
public void method2 (ResultSet rs)
String str = rs.getString("specialNote");
</CODE>

Hi JWoods,
Thanks for the suggestion. I originally had the code do what you suggested, ie, get the resultset then retrieve the data all within the same method. The data is then used to set properties in an object.
When I had to create another method that also retrieved a resultset but using a different primary key, then also use the returned data to set the properties in the same type of object, I didn't want to repeat the setter code. That's why I decided to pass the resultsets to the same method that did the property setting.
Unfortunately, it stopped working with the data type change.
Any other thoughts?

Calling a Stored Procedure using SSRS Custom Data Processing Extension

I need SSRS Custom Data Processing Extension to call a stored procedure for my ssrs report. I refered many links regarding this, but i cannot find it. Instead of that there are examples for Data processing extensions that uses XML files and also multiple
data sources.
I want Data Processing Extension to call a stored procedure.
Please Help. Thanks in advance

Sorry why do you need a Data Processing Extension for that? Cant you directly call the procedure
from SSRS dataset? Whats the RDBMS which holds this procedure?
Please Mark This As Answer if it solved your issue
Please Vote This As Helpful if it helps to solve your issue
Visakh
My Wiki User Page
My MSDN Page
My Personal Blog
My Facebook Page

How to use DS's text processing to parsel the text data stored in DB table?

I want to use DS's text processing to parse the text data stored in a database table, but all the demo I see is parsing text from a flat file. I tried with the blueprint sample and edit the input from a flat file to database table, but can not map the column with the base entityExtraction. anyone can give me a guide or example? thanks so much!
regards,
Bin

Still looking for some ansewers. Can any one help me?

Custom Data Processing Extension and Parameters

Hello,
I have successfully implemented a custom data processing extension. Now I'm trying to add parameters, but the documentation is very weak on this topic. Also all examples of custam data processing extensions I have found so far are working without parameter support. Using a search engine I have found a custom data processing extension's sequence diagram during report execution. The related article also gives some hints about the IDbCommandAnalysis interface.
The GetParameters implementation creates a parameter collection based on the current command text and returns this collection. So far no problem.
My question is how to implement the IDbCommand's CreateParameter method and Parameters property? In CreateParameter I just return a new instance of my IDataParameter implementation, and the Parameters property returns a new parameter collection based on the current command text.
Is this ok so? At least this is the first implementation which seems to work in the data designer. If I share an instance variable for GetParameters and Parameters I will either get all parameters twice or BIDS will crash when pressing the execute button in the dataset designer - depending on my actual implementation.
What I'm still missing is how to get the parameters added automaticall to the dataset's properties parameter register?
thanx in advance and kind regards, Gerald

I think that finally (after some days of trying) I could make it work. The dataset and report parameters are reflecting the command text's parameters now (BTW: to answer my last question - the dataset's properties are updated after pressing the refresh button only). The road to success was not to use the same member variable for the collections returned by IDbCommandAnalysis:GetParameters() and IDbCommand:Parameter and not to fill the latter one with the command text's parameters (see partial source code below).
public sealed class MyCommand : IDbCommand, IDbCommandAnalysis
    private string m_commandText;
    private MyParameterCollection m_parameters = new MyParameterCollection();
    public string CommandText
        get { return this.m_commandText; }
        set { SetCommandText(value); }
    public IDataParameterCollection Parameters
        get { return m_parameters; }
    public IDataParameter CreateParameter()
        return new MyParameter();
    public IDataParameterCollection GetParameters()
        return GetParameterCollection();
    private void SetCommandText(string commandText)
        m_commandText = commandText;
    private MyParameterCollection GetParameterCollection()
        // ... create parameter collection based on m_commandText
Still there are some open questions:
How can I update the report parameter's properties? Now the parameter's data type is always string, but I'd like to assign the right data type. I'd also like to tag the parameters as hidden and supply a non-queried default value. Is this possible? How?
Although I my implementation of IDbCommandAnalysis:GetParameters() returns a collection containing the parameter names and values the "prompt query parameters" dialog (after pressing the query designer's execute button in the toolbar) shows a "<blank>" value for the parameters. What could be the problem?
Thanx in advance and regards,
Gerald

The following error text was processed in the system IDS : Access via 'NULL' object reference not possible.

Hi all ,
Im getting the below error , actually recently i created my own custom table zstudent, later i wrote select query to fetch data from the same and dump at internal table and then bind this to the table node.
But im getting below error, even i removed the select query still same error is occuring.
Error when processing your request
What has happened?
The URL http://********00.*****b.com:8000/sap/bc/webdynpro/sap/zdemo_student/ was not called due to an error.
Note
The following error text was processed in the system IDS : Access via 'NULL' object reference not possible.
The error occurred on the application server axsids00_IDS_00 and in the work process 0 .
The termination type was: RABAX_STATE
The ABAP call stack was:
Method: WDDOINIT of program /1BCWDY/YUSM2Q74A826Y0JY1I4V==CP
Method: IF_WDR_COMPONENT_DELEGATE~WD_DO_INIT of program /1BCWDY/YUSM2Q74A826Y0JY1I4V==CP
Method: DO_INIT of program CL_WDR_DELEGATING_COMPONENT===CP
Method: INIT_CONTROLLER of program CL_WDR_CONTROLLER=============CP
Method: INIT_CONTROLLER of program CL_WDR_COMPONENT==============CP
Method: INIT of program CL_WDR_CONTROLLER=============CP
Method: INIT of program CL_WDR_CLIENT_COMPONENT=======CP
Method: INIT of program CL_WDR_CLIENT_APPLICATION=====CP
Method: IF_WDR_RUNTIME~CREATE of program CL_WDR_MAIN_TASK==============CP
Method: HANDLE_REQUEST of program CL_WDR_CLIENT_ABSTRACT_HTTP===CP

Thanks Rama,
Acutally i accidentally commented the lo_nd_student = wd_context ....etc
this line was commented .
i have one small requirement to fetch data from local customised table and fill the same to internal table and bind that to table node.
my table node is student having attributes as name , city and number , all are of type strings.
now i created one custom table zstudent having ID - char of length 10,
name of type string
city of type string
num of type string
i have inserted records
but when i use select query to fill data from this zstudent to my internal table of type lt_student type wd_this->elements_student ,
im getting same above error.

'Error in Loading Master -Text data'

hi Experts,
i am Novice in BW Tech. Today i have tries to Load Master data Attr and Text from Flat file(CSV ) format .
AttrData Load was Successful but I My Text is failed to Load.
My Text Data file has Three fields
(1) Langu for this filed i have Loaded data 'E'
(2) Materailnumber it is my key field it size is char
15 and values in the file 'MAT01' ' MAT02 ' and so on
(3) Third is the Description and its size 20 char
I can see following error
First field 'langu' is successful in loading.
System response
A caller 01, 02 or equal to or greater than 20 contains an error meesage.
Advance thanks
Cheers,
Anil

Hi Nagesh ,
These are the Messages
Error message when processing in the Business Warehouse
Diagnosis
An error occurred in the SAP BW when processing the data. The error is documented in an error message.
System response
A caller 01, 02 or equal to or greater than 20 contains an error meesage.
Further analysis:
The error message(s) was (were) sent by:
Update
Procedure
Check the error message (pushbutton below the text).
Select the message in the message dialog box, and look at the long text for further information.
Follow the instructions in the message.
In Preview only Language Fields 'E" filled
Remaining two fields are Empty.
I remained you Transfer rules are Ok
Thanks

Custom Data Processing Extension, use in SSRS Report Properties - References

I've built a Custom Data Processing Extension (CDPE) and registered it
successfully (ie. it shows up in the new datasources dialog/drop-down and saves just fine, for VS2010-2014). It is intended to be a custom (XML-based) DataSource. However, based on the "nature of the beast", I also need to have a Custom Query
Designer (CQD) for development testing of the CDPE.
Here are the errors I get for the CQD:
Pulling a report up in "Report Preview", which is wired to the CDPE->CQD, I get:
"An error occurred during local report processing. The definition of the report '/TestDS' is invalid. Error while loading code module: 'Microsoft.ReportingServices.Interfaces, Version=11.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91'. Details:
Could not load file or assembly 'Microsoft.ReportingServices.Interfaces, Version=11.0.0.0, Culture=neutral, PublicKeyToken 89845dcd8080cc91' or one of it's dependencies. The located assembly's manifest definition does not match the assembly reference. (Exception
from HREULT: 0x80131040)"
My CDPE directly includes Microsoft.ReportingServices.Interfaces.dll AND matches everything as far as version and key. It also includes Microsoft.ReportingServices.QueryDesigners.dll required for the CQD.
I've written other WORKING CDPEs but not one with a CQD (Query Designer Custom replacement in Visual Studio). All the references from what I can tell are OK. I think CQDs are screwed up for XML datasources. The interfaces are not right.
(will explain further on)
From the "Data Sources", Dataset Properties, I click on the "Query Designer", I get:
"An error occurred while loading the query designer 'DATASET' (which is the name of the CDPE). Query Designer: Object reference not set to an instance of an object."
I "think" XML type CDPEs are trying to execute a web services call, versus working properly/CORRECTLY with a
text-based query for XML. The reason I say this is that I've created both WinForm and WebForm test harnesses. They both come up with this error: "...Failed to prepare web request for the specified URL. (rsXmlDataProviderError), Invalid
URI: The URI is empty." (which is nonsense, there is no request, the query is simply text/file-based stuff, and I read locally ALL of the XML data expected for testing without issue -> I'm ONLY making the CDPE XML-based because I have custom
WCF calls which already work). (If you really want to understand overall architecture, please see my post: http://social.msdn.microsoft.com/Forums/en-US/d15d9206-95d7-473a-a7f9-a38b4279de8c/ssrs-extension-which-to-use?forum=sqlreportingservices&prof=required
Other than "100 mile" overviews from Microsoft, this has got to be some of the worst documented stuff I've ever seen (
http://msdn.microsoft.com/en-us/library/microsoft.reportingservices.interfaces.iquerydesigner.aspx ). Remote Debugging it doesn't work 95% of the time.
My environment is VS2013 Ultimate with BI and SQL Server 2012 SP1.
Thanks Rob
Rob K

Update:
I can now see the Custom Query Designer and get anticipated results (after some fooling around with different combinations).
Here's how things were broken by the MS SQL Server 2012 product/release team:
1. they upgraded to .Net v4.x here (to support SharePoint, AX, MS Data Tools, etc.)
C:\Program Files (x86)\Microsoft SQL Server\110\Tools\Binn\ManagementStudio\Microsoft.ReportingServices.QueryDesigners.dll
C:\Program Files (x86)\Microsoft SQL Server\110\Tools\Binn\ManagementStudio\Microsoft.ReportingServices.Interfaces.dll
2. they left c:\Program Files\Microsoft SQL Server\MSRS.11.MSSQLSERVER\Reporting Services\ReportServer\bin\Microsoft.ReportingServices.Interfaces.dll at .Net
v2.x
3. they don't support Custom Extensions (which use a Query Designer) with anything higher than .Net v3.5
In my case, I had to segregate:
a. Report Definition Custom Extension to v4.5
b. Custom Data Processing Extension to v3.5
c. Custom Query Designer to v4.x
d. my WCF/SSO to v4.5.1.
#2 and #3 above, in my humble opinion are simply dead wrong as far as what you ever want to do in the release cycle (I can see there being an early/first release exception(s), but 2 years out and a successor product (2014) should have meant that this
was rectified more than a year ago.)
Whomever failed to get this communicated in the 2012 documentation created even more havoc than an average developer can decipher:
http://msdn.microsoft.com/en-us/library/microsoft.reportingservices.interfaces.iquerydesigner(v=sql.110).aspx
(I'm still working on how to get the remote debugger working consistently.)
Rob

Use of MIN with text data

I am not familiar with using MIN with text data as in the sample below and could use some help in deciphering what it is doing. This SELECT statement is taken from a larger CREATE OR REPLACE VIEW statement. The first line of the WHERE clause is making the connection to look at the correct user's information. The section after the first AND is what I am trying to interpret correctly. I have moved into a new position and wasn't around when this view was created. The statement is designed to assign the correct DOMAIN_ID to each user based on values in the elms.elms_dom_lkup table ed. This table consists of 4 columns: DOMAIN_ID, PROC_LVL, LOCATION, AND POSITION. The DOMAIN_ID is the only field that is not nullable. The primary key for the table is a combination of the 4 columns. The section after the first AND matches the PROC_LVL from the ed (lookup table) to the PROCESS_LEVEL in the cd (reference table) and confirms the process level is associated with the users primary position. It then looks for one of three conditions:
1. process levels match and LOCATION and POSITION are NULL
2. process levels match and LOCATION matches user's location in a reference table
3. PROC_LVL is NULL and POSITION matches user's position in a reference table
(SELECT MIN (domain_id)
FROM elms.elms_dom_lkup ed, mici.const_dept cd
WHERE c.constituent_id = cd.constituent_id
AND ( (ed.proc_lvl = cd.process_level AND cd.pos_level = 1
AND ( (ed.location IS NULL AND ed.position IS NULL)
OR (LOWER (ed.location) = LOWER (loc.campus))))
OR (LOWER (ed.position) = LOWER (c.job_desc)
AND ed.proc_lvl IS NULL))), /*Domain ID*/
My question revolves around the priority on those matches. The ed table is not organized in any manor. The records are in the order they were entered. Does the MIN in the SELECT statement cause the DOMAIN_ID

Hi,
Welcome to the forum!
If v is a string column (such as a VARCHAR2), then MIN (v) is the first string in collating order (that is, alphabetic order, but with numbers and punctuation symols given particular values in the ordering).
It lookw like the code fragment you posted is a Scalar Sub-Query , that is, a sub-query used where an expression is exprected. For example, in a query like this:
SELECT *
FROM    scott.emp
WHERE   sal     > 1200
;You can replace the literal 1200 with any kind of numeric expression, even
SELECT *
FROM    scott.emp
WHERE   sal     > (     --Begin scalar sub-query
                SELECT AVG (sal)
                FROM    scott.emp
            )     -- End scalar sub-query
;You have to be careful that a sclar sub-query produces exactly one column, and either 0 or 1 rows. You'll get a run-time error if the sub-query ever produces 2 or more rows.
People sometimes use MIN in situations like yours when the sub-query might otherwise return 2 or more rows, and either:
(a) all the non-NULL rows will contain the same domain_id, or
(b) it doesn't matter which domain_id is used, just so long as it is one that actually exists in the result set.
842436 wrote:
My question revolves around the priority on those matches. The ed table is not organized in any manor. The records are in the order they were entered. Does the MIN in the SELECT statement cause the DOMAIN_IDSorry, I don't understand exactly what you're asking.
Rows in a relational table are never in any intrensic order.
It looks like the question got cut off. Does the MIN in the SELECT statement cause the DOMAIN_ID to do what?
Edited by: Frank Kulash on Mar 7, 2011 3:01 PM
I see you corrected your first post.
842436 wrote:
... My question is does the MIN in the SELECT statement cause the DOMAIN_ID from the first record that meets any of the 3 conditions to be returned?Yes, it makes the sub-0query return the first domain_id ( in alphabetic order ) that meets all the conditions. If there are 1,000 rows that meet all the conditions, the query will ind all 1,000 of them, keeping track iof which one is first in alphabetic order. Remember that
'127.255.255.0' is less than
'25.0.0.0' in alphabetic order, because '1' is less that '2'.

System Master Data Process Chain

Hello Guys,
I am working on Admin cockpit. So far it s going well. However, I am struglling with scheduling System Master Data Process chain. When I look at its logs, I see that Operation Type (WHM)- Texts becomes red and Attribute Change Run (final step) has not finished yet(almost three hours) Please help.
Thank you,
OLGA

refer this..similar issue is discussed Alpha Conversion
Non Alpha Compliant Value..hw can this be resolved on BI 7.0 SP 13

Please confirm is the maximum Text Data Type Size within MDS 4000 characters

Hi,
Please confirm is the maximum Text Data Type Size within MDS 4000 characters?
If you could give me a link referencing my answer to the above question that would be even better.
Kind Regards,
Kieran.
Kieran Patrick Wood http://www.innovativebusinessintelligence.com http://uk.linkedin.com/in/kieranpatrickwood http://kieranwood.wordpress.com/

However I am extending a system which stores dynamic SQL within an MDM column to facilitate a generic extract and load process. I am sure you are already aware in this type of scenario the business rules behind a piece of dynamic SQL defining a generic
extract process could easily exceed 4000 characters.
Kieran Patrick Wood http://www.innovativebusinessintelligence.com http://uk.linkedin.com/in/kieranpatrickwood http://kieranwood.wordpress.com/

Sending user text data

Hi everyone. I am not certain if I am in the correct section.
I have a website designed in Flash. The site has a contact
section with 3 fields (name, e-mail and message). Having completed
these fields one would click "submit" to send the entered data to a
text file which resides on a Linux (Apache) based server.
My question is... What action statement do I need to
configure?
Any help \ suggestions will be appreciated.
Regards
Fred

You'll need to send the data, from Flash, to a server-side
script for
processing. That can be done in PHP, ASP or others. Have a
look at the
LoadVars class in the help - the sendAndLoad method has a
nice example you
should be able to use to get started. For tutorials, search
for 'forms in
flash', this gets asked about a lot, so there's a good deal
of info.
Dave -
Head Developer
http://www.blurredistinction.com
Adobe Community Expert
http://www.adobe.com/communities/experts/

Text Data Processing 4.1 Training in February & April for APJ & EMEA

Similar Messages

Maybe you are looking for