Payload Content Based Search in PI

Hello Experts,
We are trying to implement Payload contenet based search functionality in our PI enviroemnt.
One of the approch I can across is to have the message index using TREX index engine. This would allow us to do the message content based search from RWB itself.
Can somebody give me a idea of how much does it take to have lience and configuration set up of TREX engine? Also, any link to a "How to guide" or any blog will be greatly appreciated.
The other approch I could find out on SDN was to have a ABAP report to achieve the same.But, it is only recomended for a system where messages flowing through the system are very low.
I would really appreciate If anybody can help me with more information or available documentation.
- Rajan

Hi Rajan,
Please have a look at following blog:
/people/alessandro.guarneri/blog/2006/02/14/super-message-monitor-for-sap-xi
Kind Regards,

Similar Messages

Sorting incoming files based on payload content

Hi,
I have a file>XI-> FILE scenario...I need to sort the incoming file based on payload content...But my understanding is in XI each line item would be processed one at a time...Is it possible to sort the entire file before beginning to process???
-Ken

Hi Ken,
you can try to create generic content sorting with java mapping:
/people/ravikumar.allampallam/blog/2005/06/24/convert-any-flat-file-to-any-idoc-java-mapping
Regards,
michal

ABAP stack configuration for content based message search in PI 7.

Hi experts,
I am trying to eanble Content based message search in PI7.11 SP10.
My requirement is to Filter message in PI moni based on a particular DeviceID field in the paylaod.I have set filters in SXMS_LMS_CONF.
But upon testing the extractor, the messages are extarcted based on the interface mentioned in the filter criteria, and not the particluar field of the message.
I have referred a few bolgs on this topic , but could not find a relevant solution to my issue. Am i missing any configurations in this? Or is his not possible without TREX.
Could anyone suggest a solution for this.
Thanks.

Filter
Extractor:
XPath: nm:XXXXXCreateRequest/MeterReadingDocument/UtiltiesMeasurementTask/UtiltiesDevice/UtilitiesDeviceID

Performance impact of Content based message search in IE

Hello Experts,
I am working on implementing Content based message search in IE in PI 7.0 and PI 7.1 landscape.
All the configurations are done and its working fine in Development scenario.
I need help in identifying , how this actually works on technical level as in how the messages are getting searched based on the filter criteria, if there is any table getting created in background and values are getting stored etc.
And also how could this impact the overall performance after implementing it in Production system.
Thanks in advance!
Warm Regards,
Lisin

Hi Lisin
Not sure about 7.0/1 but for 7.4 these are the tables.(most probably tables should be same)
When you configure a filter for UDMS search on ABAP stack(Tcod: sxms_lms_conf)
Entries will be created in the following backed ABAP tables. (you can go to se16 and check the entries).
SXMS_LMS_EXTR
SXMS_EXT_FIL
SXMS_NSPREFIX
Data will be stored in this table
SXMSPDATA
When you configure a UDMS filter in RWB(java stack), entries will be created in the following backend tables
XI_AF_LMS_EXTRACTR
XI_AF_LMS_FILTER
Data will be stored in the table (only the message id, direction, key field,value and position)
XI_AF_LMS_DATA
We have UDMS configured in our production system, and i never saw any performance issue.
Regards
Osman

Bypass content-based format detection so I can use a custom iFilter in Sharepoint 2013 Search

Can I get SharePoint 2013 Search to bypass the content-based format detection and use the file extension to determine the format (and therefore the format handler so that I can use a customer iFilter)?
We have a proprietary file format which uses xml, and we use a specific filename extension to indicate the type of file. We have a custom iFilter to parse the file, because we only want some of the content to be indexed. The iFilter works with
Windows Search. I’m now trying to use our custom iFilter to search the same files with SharePoint 2013. SharePoint 2013 Search appears to determine a file’s format from its content and not from its file extension (I have confirmed this by changing
the extensions of .docx and .txt files). SharePoint 2013 search appears to use the built-in XML format handler to index our proprietary files. Can I get SharePoint 2013 Search to bypass the content-based format detection and use the file extension
to determine the format (and therefore the format handler)? I think SharePoint 2010 may allow this, but I can’t find out if/how it is done in SharePoint 2013.
I understand that built-in format handlers can’t be replaced by custom iFilters, but I don’t want to replace the XML format handler for .xml files.

Hi jeh271,
quite interesting, because as i know iPersistStream should be installed when you need to use ifilter when using windows search.
just curious, if you also restart the spsearchhostcontroller?
as i know the search should have the content-based format,we cant bypass it, if we bypass it, then it may broke.
i saw some thread about this before:
http://social.technet.microsoft.com/Forums/sharepoint/en-US/944e6878-a7f0-4c0e-98b7-a7fb9faeef1b/bcs-connector-and-mimetypefield
ifilter example:
http://msdn.microsoft.com/en-us/library/hh694268(v=office.14).aspx
last time i did this, seems similar issue:
• The custom iFilter is working in SP 2010 but when we followed the same process of registering the iFilter in SP 2013, it was not working.
• So, we knew that we were some missing some extra step in registering the filter in SP 2013.
• Finally, we involved the Product group and we found out that we need to run an extra PowerShell commandlet apart from following the steps to register it in SP 2010 (given in this link:- http://msdn.microsoft.com/en-us/library/hh694268(v=office.14).aspx )
• We ran the commandlet described here in this article http://technet.microsoft.com/en-us/library/jj219556.aspx.
• The New-SPEnterpriseSearchFileFormat cmdlet adds a new file format and a corresponding file name extension to the search parsing system. This binds the file format to a filter-based format handler in the search parsing system. Thus, the search parsing system can only parse the new file format if the user has installed a corresponding filter-based format handler, an IFilter, for the new file format. If the installed IFilter registers more than one file name extension, the user must use the New-SPEnterpriseSearchFileFormat cmdlet to add a new file format to the parsing system for each of these file name extensions. The user must also ensure that the file name extension of the new file format is a member of the file-type inclusion list. The file-type inclusion list specifies which files that are crawled, based on their file name extensions. The system will only consider the new file format after a restart of the content processing components
• The example for our scenario would be something like this:-
New-SPEnterpriseSearchFileFormat -SearchApplication $ssa -FormatId dwg -FormatName DWGFiles -MimeType application/dwg
• Then, we restarted the SharePoint Search Host controller service on the machine where you have installed the iFilter and this resolved our issue and we were able to successfully search with .dwg files using the custom iFilter.
i am not quite sure if search treating your file as an XML file, if it is true, perhaps you can check this xmlmapper:http://msdn.microsoft.com/en-us/library/ff795813(v=office.14).aspx
Regards,
Aries
Microsoft Online Community Support
Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread.

Sender SMTP Adapter / Content Based Routing / Mapping of an attachement

Hi all,
I'm still working on my SMTP --> PI --> Proxy scenario (asynchronous). I've tried several different properties of my sender communication channel (type = mail), but I didn't find the correct configuration. Hopefully it exists.
I'm working with PI 7.0 SP10.
I get an inbound message via Mail using sender SOAP Adapter. The message payload itself is an attachement. Now I'd like to do the following:
a) Content Based Routing in Receiver Determination based on the message subject
b) Mapping of the Attachement XML message to my inbound proxy interface
Now, trying to do so, I didn't get it work. When I use XIPAYLOAD with keep attachements, I get two attachements in my inbound message (one in XI mail package format having the subject within, one with the IDoc structure I'd like to map). How can I assign the second attachement to be used for my message mapping?
When I use XIALL instead of XIPAYLOAD, I think the mapping will work but my subject for content based routing will be lost, right? That one I didn't get running because of another failure, so I don't know the exact behaviour of the adapter for that configuration.
Anybody out there who know the correct configuration for the sender mail adapter for my small scenario above?
BR
Holger

Hi Stefan,
sorry for misunderstanding, for sure I'm using the mail adapter, not the SOAP Adapter. I'm actually on the same direction. I'm using XIPAYLOAD as message protocoll (having the attachement as the content for the mapping --> correct). Furthermore I've also found the predefined context objects for the content based routing receiver determination.
What I missed was setting the following properties in the communication channel:
To store adapter attributes in the message header of the XI message, set the Set Adapter-Specific Message Attributes indicator.
The following attributes are added to the XI message header if the sender makes them available, and if the Variable Transport Binding indicator is set.
Now it's working
BR
Holger

Content based routing in PI 7.1?

Hi Guys,
For the normal content based routing in PI 7.1 in the receiver determination step once i select the conditin and in the condition editor to choose the filed, i dont see any interface under the xpath.
I dont have any search help option in the xpath column
any help or suggestions would be appreciated
Thanks,
Raj

Hi Raj,
Try the steps which I am giving below, although it's a workaround and don't know the exact reason why it is failing.
1. Open your Outbound Message Interface (which you are using in your Receiver Determination) in IR, edit it and change the Interface pattern (which is there just below the category "Outbound") to "Stateless (XI30 - Compatible)" , save it activate it.
2. Follow the same step for your Inbound Message Interface. Change the Interface Pattern from "Sateless" to "Stateless (XI30 - Compatible)" .
3. Go to ID. Remove your Outbound and Inbound Message Interface from their respective Business Service/Comp and add it again.
4. Create your your receiver determination again using the Outbound and Inbound MI you have changed.
5. Open condition editor of your receiver determination.You should be able to see your Message Interface and can choose the XPath.
Follow the above steps carefully. It took me an hour to find this workaround. Let me know if it works.
Thanks
Amit

Content Based Routing in ESB

Hi All ,
I needed some help on the content based routing feature in ESB .
I have an ESB Process in which Data is extracted from a Database(using Select operation) and I have a column X based on whose content I want to invoke the next set of target services . I had assumed having 3 different routing rules with the Filter expression based on the content of X will do the work .This works only when I have one record for a batch of records it doesnot work .
Wanted to know how does it evaluate for a scenario where we have multiple records in a payload with the value of the column on which we are doing content based routing varrying across the payload ?
Thanks in advance.

Hi,
As James stated esb is processing the incomming recordset as one message so it applies your xpath expression to that message as a whole. Anyway, in your case, if you want to process records from a database table one record at the time i would go for the db polling mechanism and change my database model to include a logical delete column (eg a column processed which contains a Y or a N). You can not split a multiple record message in esb itself into separate messages for each record.
Kind Regards,
Andre

Content based retrieval

Hello Forum,
I'm wondering if it is possible to search for similar images in the database. Google gives some links to Oracle interMedia User's Guide and Reference Release 9.0.1 where chapter 2 is labeled "Content-Based Retrieval Concepts". So now I'm looking for this feature in the documentation for Oracle Multimedia Release 11.2 but I'm wasn't able to find anything.
Is the search for similar images not possible anymore in 11g?
What I'm planning to do is the following:
I want to store scanned images (advertisements) into the database and link them to the advertiser. If I get a new image, I want to search the database to see if it's already tagged so that I can get to the corresponding advertiser.
Since scanned images are never completely equal, I have to find similar images and show the most similar one.
Can someone gibe me a hint where I can find the documentation for the methods necessary for that?
Thanks in advance,
dhalek

Hello Brian,
I found the documentation but Oracle doesn't give any useful examples.
I'm guessing that I have to use SI_FeatureList to get the wanted results. Are there some examples available? I'm interested in information on how to index feature lists in order to get the ten best matching images for a given image. I hope there is a way to avoid calculating the score for every image in the database.
Regards,
dhalek

Content based retrival in intermedia

If I have human bodies stored in intermedia. Like for each person one image of his body. Can I go and run a query show me all those bodies that have a particular kind of dot in the body[the real images are more complicated than this we are storing hearts, lungs etc]. I want to do kind of do ultra search like show me all resume with "oracle" keyword - the way we do in oracletext.
What I know, it can be done if I include it as an additional column in the table storing the image column. But here we do not know what a user will search so really i should be able to search on the content of the image.
Also, can I store word or pdf files in Intermedia and do search on their contents or do I need Oracletext for this functionality. I want to save these files in database and allow query on its content.
Please answer these questions as my project is highly classified and we should be able to do all of the above else we need to change our approach to see what we can and what we can not.
Thanks.

The content based image query capabilitys work on
. Color
. Texture
. Shape
So, you can search on images that have similar colors, or similar textures (like a plaid versus a paisly), or similar shapes (circle, square etc.) or a combination of the above. It cannot do things like return me the pictures of cars, or return me the pictures with 10 dots on a body. So far, this has been used for fabric, wall paper etc... finding and searching (find me a fabric with a similar pattern and different colors, or similar colors and different patterns).
I don't know what kind of "dot" you are looking for, but if you have pictures of the dots and want to compare the shape of the dots, we might be able to do that, but I am not sure if the results will be what you need or not.
If you have a picture of the body, and expect interMedia to focus on the dots, I really don't think there is any way that would work. But if you have pictures of just the dots, and you are comparing the shapes of dots, it might work.
The only way you will know for sure is to try it out. Without knowing exactly what you are doing, I am a little septical it will be what you need. I am thinking forensic
As for the search capabilities, you do need Oracle Text to be able to do the text based ("contains") queries.

Content DB Search fails to find file

Search does not return the file when searching unless the search starts on the specific folder the file is in. When a search is performed at a container and or library level, the file is not found unless you perform the search at the /domain/container/library/folder level. Any thoughts of what to check for ?

I got the same problem here, and I found the solution from MetaLink.
This may related to the corruption of the folder index, try to drop and create the folder index. Then the search will be worked again.
1. Shut down the Content Services domain
2. Set the java environment variables:
set JAVA_HOME=%ORACLE_HOME%/jdk/bin
set CLASSPATH=%ORACLE_HOME%/jdbc/lib/classes12.zip;%ORACLE_HOME%/content/lib/content.jar;%ORACLE_HOME%/content/lib/backport-util-concurrent.jar;%ORACLE_HOME%/jlib/ldap.jar;%ORACLE_HOME%/jlib/ldapjclnt10.jar;%ORACLE_HOME%/lib/xmlparserv2.jar
3. Run the DropFolderIndex tool in the Content Services %ORACLE_HOME%:
java oracle.ifs.admin.tools.folderindex.DropFolderIndex
4. The tool will prompt for the domain and schema password;
The format of a Content Services domain is:
ifs://<databasehost>:<listenerport>:<globalDatabaseName>:<schema>
5. The output should read:
Starting service
Session established
Folder index does exist; dropping now...
Dropping Folder index
Folder index successfully dropped
6. Now re-create the folder index by running the CreateFolderIndex tool:
java oracle.ifs.admin.tools.folderindex.CreateFolderIndex
7. The tool will prompt for the domain and schema password;
The format of a Content Services domain is:
ifs://<databasehost>:<listenerport>:<globalDatabaseName>:<schema>
e.g.
ifs://benc211.be.oracle.com:1521:csinfra.be.oracle.com:CONTENT
8. The output should read:
Starting service
Session established
Creating Folder index...
Creating Folder index tables
Creating Folder index initial self-reference rows
Promoting Folder Root Folder to level 2
Promoting Folder be to level 1
Promoting Folder bepartner to level 1
Promoting Folder system-data to level 1
Rebuilding Folder index
Running search for FolderPathRelationship objects...
Processing search results ...
Selected and applied 2745 folder relationships
Completing the Index Creation
Changing update mode to Synchronous
Folder index successfully created
NOTE: recreating the FolderIndex takes significant time & CPU. Please reserve at least 2 hours
downtime.
9. Restart the Oracle Content Services domain and verify using folder-based searches that you
can now retrieve all files when doing folder-based searches.

Windows 7 PDF & Word content server search

Our organization is in the process of upgrading to Windows 7 from XP (don't laugh). One thing I've noted is that it would appear that Windows no longer does content search without indexing. And from reading this page: http://www.documentsnap.com/how-to-fix-pdf-search-in-windows-7-64-bit/ it would appear I have to edit the indexing control panel to control the search by content functionality. Specifically we have mapped network drives that no longer appear to let me search by content like they did under XP. And I don't have administrative privileges. Is there a way for a non-admin to setup network drive search by content? Or will someone with admin rights have to edit the control panel settings to search those drives and add them to the index?

It would appear that Microsoft has stopped non-index based searching of PDF files that had been available in XP, and left it up to Adobe to keep it up in Windows 7. Acrobat Pro 9 through XI all support find by content searching through control-shift-F. Word files can be searched by content without indexing through the Organize menu of the Folder browser through its Folder and search options.

The 'Content, index, search' section of my help is not working in Mozilla

Dear All,
The 'Content, index, search' section of my help is not working in Mozilla.
I am using robo8 and mozilla 8. Any idea? please help...
Regards,
Jobin.

Dear William,
It is a webhelp
It is working in all other browsers except Mozilla.
It is a merged help...
waiting for your reply..:)
Regards,
Jobin.

Content Based Correlation in Oracle 11g

Dear Veterans!!!
I am working on the following use-case.
An order processor accepts order(Mode-Buy/Sell, Price, Quantity) on webservice from various customers, and presents them to DecisionService, after adding the order Id to it. The decision service would check if the price*quantity > 1000, if so the response is sent as (Order ID, OrderStatus="Fail") else, sends (Order ID, OrderStatus="Success").
What I want to do?
Now I need to create Order Processor using single JMS Adapter with Interaction type "Asynchronous Request/Reply" using content based.
What I have been able to do?
I have been able to do content-based Correlation between Decision Service BPEL and Order Processor BPEL, where Order Processor has two JMS Adapters, One Producer which enqueues the order for Decision Service, setting the orderId as correlation. The another JMS Adapter is set as Consumer and recieve activity is registered with it and picks up the response after correlating the message.
Also I have been able to do the "native correlation" scenario, using Decision Service as mediation module.
What is the problem?
1. I need to have the decision service as BPEL, and be able to do the native correlation, which I wonder how to do, because the Jdeveloper 11g has removed support for Adapter Header variables.
2. I need to use decision service as BPEL and be able to do the content-based correlation, using a single Asyncronous Request/Reply JMS Adapter instead of two (Producer and consumer).
Any Pointers shall be useful.
Many Thanks,
Regards,
SwapSawe.
I am aware of how to set the correlation
http://swapnil-soa.blogspot.com/2008/01/correlation-this-post-would-effort-to.html
And how to do it in Oracle 11g
http://biemond.blogspot.com/2009/10/jms-request-reply-interaction-pattern.html
Edited by: SwapSawe on Nov 30, 2009 11:01 PM

Dear Friends,
If I was not able to make my point clear, I would explain it again. I am posting message from one BPEL process to an Asynchronous Request/Reply JMS Adapter.
A consumer JMS Adapter, would read the message from Q and would initiate another BPEL process, which would perform some business logic to generate a response and post it to reply queue via JMS Producer.
Now the reply posted, is picked up by the Async Request/Reply, but the receive activity is unable to correlate the message.
I was able to do this scenario using native correlation, i.e. JMS Message Id mapped to JMS Correlation Id, through mediation module. But I am looking forward to do this using content based correlation.
Regards,
SwapSawe

How to make a form-based search API using HTTPClient

Hi,
I am getting trouble to make an API that is related to making a site search by using a form-based search API by help of HTTPClient

Hi,
Something seems to get added to the form action because of "http". Hence I am removing it.
You need to write a procedure with the values in the as parameters. Say for example you want to insert a record into dept
table then
Dynamic page code
<html>
<body>
<form action="portalschema.insert_dept">
<input type="text" name="p_deptno">
<input type="text" name="p_dname">
<input type="submit" name="p_action" value="save">
</form>
</body>
</html>
Procedure code.
create or replace procedure insert_dept
(p_deptno in number,
p_dname in varchar2,
p_action in varchar2)
is begin
if p_action = 'save' then
insert into scott.dept(deptno,dname) values(p_deptno,p_dname);
commit;
end if;
end;
grant execute on insert_dept to public;
Hope this helps.
Thanks,
Sharmila

Payload Content Based Search in PI

Similar Messages

Maybe you are looking for