Debatch unique records only, BizTalk 2010

Hi all,
I have a flat file coming onto BizTalk that contains multiple duplicate rows. I want to debatch to XML, however only keep the unique records. Is there a way of doing this without using a custom pipeline component?
Thanks in advance.
GilesB

Use a map and with custom XSLT in your map you can filter the records eliminating the duplicate records (Muenchian), then in orchestration by calling the Receive pipeline you can debatch the message. Check the following references for eliminating the duplicate
records in maps:
http://social.msdn.microsoft.com/Forums/en-US/760d5bd6-aa97-4fff-a4c8-706f86bda7b5/eliminate-duplicate-records-in-map-instance?forum=biztalkgeneral
http://alamnaushad.wordpress.com/2012/02/24/filter-unique-records-using-biztalk-xsl/
And following is the reference for debatching the message in orchestration by calling the Receive pipeline
http://geekswithblogs.net/sthomas/archive/2005/06/16/44023.aspx
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful by clicking the upward arrow mark next to my reply.

Similar Messages

SAP query unique records only

Folks,
I have created a query which gives me a list with all open deliveries based on a certain route and postal code. We have multiple deliveries for the same ship-to so the list may show duplicate postal codes. I would like to have a list with only unique postal codes. How can this be achieved in SAP query?
Thanks,
MdZ

hi,
you can include the logic for unique postal code in Sq02 transaction.
goto sq02 transaction ,give your infoset name ,change,click on extras button in app tool bar .
there you have a button called code where you can incorporate your logic.

How to show all records (instead of unique records) in OBIEE Answers

I am a newbie of OBIEE and have below question.
The fact table has 3 fields:
ID (Primary Key)
Status (either 'open' or 'close')
Amount
There are 100 records in the fact table. When I drag the column Status into the Answers, the result returned is 2 records, 'open' and 'close'. Thus, seems Answers always returns unique records only.
Can I achieve disabling such Answers feature such that all records will be shown? For above example, can the result returned all 100 records of either 'open' or 'close' ??
Thank you very much.

Hi,
OBIEE is an analytical tool, it is there to help people see the value of numeric facts against one or more textual attributes. With that in mind OBIEE will always aggregate to the highest possible level when returning the results to you. In your case the highest level is status. If you include another column wich breaks the data down further then you will see it aggregated at that level. If you want to see individual records then you need to add a column which is unique for each record, usually you can use the column holding the identifier of the row from the source system, generally this is called Integration Id.
Edit: After reading your post again, just add the ID column in your request and voila.
Regards,
Matt
Edited by: mod100 on 13-Oct-2009 23:39

Query Unique Records WITH ROWID

Hi All,
I have 2 columns which returns records like this Say Column A and Column B.
A B
1 1
1 1
2 2
2 2
3, 3
I need only distinct records from these columns. So i executed DISTINCT Clause in my query and it returned unique records. Issue is I need to execute a query like this i.e compulsorily use ROWID in my select list.
i.e SELECT DISTINCT ROWID A, B from TEST;
But this query we will give duplicated records only when we give rowid, how to achieve a output like this using rowid in the column select list of my query.
A B
1 1
2 2
3, 3
Please Help.
Thanks in advance.

If you want just one rowid for each (a, b) couple:
SQL> select a, b, min(rowid)
2 from y
3 group by a, b;
         A          B MIN(ROWID)
         1          1 AAAfoUAAEAAA7T0AAA
         2          2 AAAfoUAAEAAA7T0AAC
         3          3 AAAfoUAAEAAA7T0AAEIf you want all rowid's for each couple:
SQL>select a, b, rtrim(extract(xmlagg(xmlelement("a",rowid||',')),'//text()'),',') rowids
2 from y
3* group by a, b
         A          B ROWIDS
         1          1 AAAfoUAAEAAA7T0AAA,AAAfoUAAEAAA7T0AAB
         2          2 AAAfoUAAEAAA7T0AAC,AAAfoUAAEAAA7T0AAD
         3          3 AAAfoUAAEAAA7T0AAEThanks Buga for posting sample data ;)
Max
[My Italian Oracle blog| http://oracleitalia.wordpress.com/2010/02/07/aggiornare-una-tabella-con-listruzione-merge/]

Can we develop a solution in Visual Studio 2012 and still deploy it on BizTalk 2010?

Can we develop a solution in Visual Studio 2012 and still deploy it on BizTalk 2010? or Is it that solutions developed in VS 2012 have to be deployed only to BizTalk 2013?
Thanks

BizTalk 2010 projects are not compatible with Visual Studio 2012. To use Visual Studio 2012 with BizTalk 2010 projects, you must install
BizTalk 2013 on the computer that has Visual Studio 2012. The first time you open a BizTalk 2010 project, it is automatically upgraded to the BizTalk 2013/Visual Studio 2012 project system
Refer
this.
Please mark it as Answer if this answers your question
Thanks.
Mo
The contents I write here is my personal views, not the view of my employer and anyone else.

BizTalk 2010 Load Balancing Not So Balanced

Ok here's our scenario.
1. One Orchestration running under HostInstanceProcess on 3 servers in the same Groupe using 3 different domain accounts
2. That Orchestration has a reference to Utilities dll, which in turns calls a stored procedure using ADO.net code
3. We run that orchestration, it gets around 2000 de-batched messages and for those 2000 messages it calls that ADO.net code
4. Back in that database we run sp_who to check how many connections are made from each machine, and we find that over 60% connections are always made from one particular BizTalk machine and it's not one off, I've seen it atleast 7 to 8 times, that machine
always has most number of connections, for example if there are 120 connections in total, 80 connections are from Server 1 while rest from others.
5. We put a Max Pool connections in the connection string to 250 (default is 100) but that doesn't make any difference.
6. This interface is facing a lot of connection time outs from the database, hence this investigation is done
7. The same interface works perfectly fine on BizTalk 2006 R2, it's connecting to the same database (so can't be a database issue), it has 2 servers, which make almost same number of connections to the DB when I check with sp_who, so load balancing seems
to working as expected in BizTalk 2006 R2.
So my question, I know BizTalk is supposed to do load balancing in a round robin fashion which should equally distribute the load but in my example in BizTalk 2010, it's not doing that clearly, it's overloading one server with almost 70% of the requests,
what could be the reason for this? Host instances are set-up similarly in all servers. Any help greatly appreciated.
Regards
Syed

BizTalk load balancing works in Round Robin fashion only for the new messages, while in case of instance subscription message will be routed to server holding dehydrated orchestration instance.
So the server having dehydrated instances will receive the correlated response along with the new incoming message.
So you can see one server slightly overloaded.
Thanks,
Prashant
Please mark this post accordingly if it answers your query or is helpful.

Alternative to find unique records with 60 character in selection string.

Hi,
We have to find out the values from the Infoobject. When we try to display data from an master object, the maximum length of selection it accepts 45 characters only but we need to input data around 60 characters in selection.
Thing we tried:
1. Selecting complete data without any condition but it did not work due to large volume of data.
2. We tried to extract data from RSA3 but it did not work due to large volume of data.
Please suggest me alternative to find unique records with 60 character in selection string.
Regards,
Himanshu Panchal.

This sounds a bit strange. Are you perhaps mistakenly storing text data incorrectly as the primary key of the master data? I can't think of any actual data that is that length to ensure usinqueness - even GUIDs are maximum 32 characters - but GUIDs don't count as actual "readable" data although you do need to be able to select it from time to time. Perhaps you have a super secure password hash or something like it ?
Also are you expecting to have a unique single record returned by your selection? To do this would in general REQUIRE that ALL the data is read because master data is not stored in the DB sorted by the data itself, but stored instead sorted by the it's SID.
When you say you are selecting data from master data, which master data tables are you using? I have been able to select data from very large MD table (15 million unique records) using SE16 with no problems. Just enter the table name, and before you execute just count the number of records - it helps to know what you want to end up with.
Have you tried using wild cards (the *) to preselect a smaller number of records : * a bit of your 60 character string *
If you are trying to select from a non-key field you will encounter performance issues, but you can still use the wildcards, and get a result.
Don't use RSA3 it was designed to make selections and group them into datapackets. It's not the same as selecting directly on the table in SE11 or SE16

Unique records

I've created a dynamic table that retrieves multiple records
for an individual. I've included a submit button in each line
created with the unique record ID as hidden data to be sent for
selecting a update page, but the data I get is all of the unique
records ID's, like 45,46,48,49,50 where I only wanted #46. The
example in the workbook shows an href call to select a particular
record. Is it possible to use either a submit key or a radio button
to select a certain record to update? I have additional data I need
to pass along to the next page so an href pointer won't really
work. What am I doing wrong?

If you don't want to use an HREF pointer, then you will need
to use some JavaScript to let you know which record the user has
selected. Instead of using a type="submit", use a type="button" and
then include the following onClick statement in the tag:
onClick="document.form1.selectID=#rs_AP_Cert_Quest.Key#;
document.form1.submit();"
Then include a hidden form element named selectID at the
bottom of the page.
I probably would use a function instead of coding it directly
in case I needed to add some more functionality and it would get to
messy to do all of the JS inline. But the above code will get you
running.

Problems with Upload record to Infotype 2010 together with Cost Assignment (PREF)

Hi
I create program using your guide
http://scn.sap.com/people/aditya.palekar/blog/2010/01/19/uploading-a-pa-infotype-record-with-cost-assignment
but I have two problems:
If I call method "CALL METHOD ref2->modify_data" is obligatory parameter SECONDARY_RECORD, but I update only infotype 2010 as PRIMARY_RECORD and PREF (I don't have secondary record).
When for secondary_record use same record as primary_record, give me an error. When for secondary_record use null record give me a error.
I try used "ref2->MODIFY_PRIMARY_RECORD" and "ref2->MODIFY_PREF" together, but using method "CALL METHOD g_masterdata_bl->INSERT" updated only last record (in this case is PREF because is call as last method"ref2->MODIFY_PREF")
What InfoType is Secondary_Record for InfoType 2010?
I have problem with NO COMMIT data. Method "CALL METHOD g_masterdata_bl->flush" have a parameter no_commit with two possible options. When I use no_commit = 'X', this commit data even if this do don't commit.
Why still commit data? When this method no_commit data?
Thank you

Hi
I create program using your guide
http://scn.sap.com/people/aditya.palekar/blog/2010/01/19/uploading-a-pa-infotype-record-with-cost-assignment
but I have two problems:
If I call method "CALL METHOD ref2->modify_data" is obligatory parameter SECONDARY_RECORD, but I update only infotype 2010 as PRIMARY_RECORD and PREF (I don't have secondary record).
When for secondary_record use same record as primary_record, give me an error. When for secondary_record use null record give me a error.
I try used "ref2->MODIFY_PRIMARY_RECORD" and "ref2->MODIFY_PREF" together, but using method "CALL METHOD g_masterdata_bl->INSERT" updated only last record (in this case is PREF because is call as last method"ref2->MODIFY_PREF")
What InfoType is Secondary_Record for InfoType 2010?
I have problem with NO COMMIT data. Method "CALL METHOD g_masterdata_bl->flush" have a parameter no_commit with two possible options. When I use no_commit = 'X', this commit data even if this do don't commit.
Why still commit data? When this method no_commit data?
Thank you

Extracting unique records from two different tables record

Hello,
In the following code of two different tables www.testing.com exists in both tables. I want to compare two different columns of the two different tables to get unique records.
SQL> select unique(videoLinks) from saVideos where sa_id=21;
VIDEOLINKS
www.testing.com
SQL> ed
Wrote file afiedt.buf
1* select unique(picLinks) from saImages where sa_id=21
SQL> /
PICLINKS
test
test14
www.hello.com
www.testing.comThanks & best regards

Unfortunatly you didn't mention the expected output. I guess it would be the one line
"www.testing.com"
in that case simply join the two tables.
select *
from saVideos v
join saImages i on i.sa_id = v.sa_id and i.picLinks = v.videoLinks
where v.sa_id=21;If needed then you could change the select list to retrieve only distinct values.
select unique v.sa_id, v.videolinks
from saVideos v
join saImages i on i.sa_id = v.sa_id and i.picLinks = v.videoLinks
where v.sa_id=21;I usually avoid distinct/unique whereever possible. This requires the database to do a sort and makes the query slow.
Edited by: Sven W. on Feb 10, 2011 1:55 PM

Picking unique records from huge set of records

Hi db experts,
Could anyone help me in having a query which is based on partitioned table with 400,00,000 records each day . It has member number unique and I want to pick unique ones say for dates between 20-jan-2007 and 20-apr-2007.
How can I proceed to write query. Am expecting query which will only pull unique records in less possible time.
Thanks in advance
Ravikanth

The table has 400 lakh records each day my mistake - I misread the original post.
Is this a one-off exercise or an ongoing requirement? What are you going to do with the data once you've got it - do you need more columns than the numbers? Do you have a feel for how many unique numbers there are per day and over the entire quarter?
The easiest way to do this would probably be to create an extract table (maybe a temporary one) and vary the query I posted to insert the unique numbers into this table for each day i.e. run it multiple times against a smaller data set. Then you can select the unique numbers from the extract table to get the finished set.
Of course, whether this is a viable solution depends on the answers to the questions I posed above. The more information you give us the easier it is for us to advise you.
Cheers, APC

How to get a count of unique records

How do you get a count of unique records? Looking only for one number, not a list..so if the data is:
ID
===
1234
1234
1234
1236
1236
1237
Then, the count total will be one field called 'ID' with the value '3' in it..
All I know how to do is get a count that will count all records, or do it in two queries. Looking to do this in one query statment..
Thanks..

Just a small clarification...
Concatenation could potentially give wrong result, depending on the data.
For example...
sudhakar@ORCL>ed
Wrote file afiedt.buf
1 with t1 as
2 (select 'AA' c1, '101' c2 from dual union
3 select 'AA1' c1, '01' c2 from dual union
4 select 'AA101' c1, null c2 from dual union
5 select 'BB2' c1, '345' c2 from dual union
6 select 'AA101' c1, null c2 from dual union
7 select 'BB2' c1, '345' c2 from dual union
8 select 'BB234' c1, '5' c2 from dual
9 )
10* select count(distinct c1 || c2) from t1
sudhakar@ORCL>/
2IMHO, the required answer will be...
sudhakar@ORCL>ed
Wrote file afiedt.buf
1 with t1 as
2 (select 'AA' c1, '101' c2 from dual union
3 select 'AA1' c1, '01' c2 from dual union
4 select 'AA101' c1, null c2 from dual union
5 select 'BB2' c1, '345' c2 from dual union
6 select 'AA101' c1, null c2 from dual union
7 select 'BB2' c1, '345' c2 from dual union
8 select 'BB234' c1, '5' c2 from dual
9 )
10* select count(distinct c1 ||'.'|| c2) from t1
sudhakar@ORCL>/
5
sudhakar@ORCL>vr,
Sudhakar B.

No able to select BAM Portal in BizTalk 2010 Installation Wizard

I am trying to set BAM for BizTalk 2010.
I got it to the point where I have created activities, views and deployed them to SQL. Both BAM databases are there: BAM archive and Primary Import table. But I want to view data through BAM website, upon research I realised BAM website can be created after
installing BAM portal but I am not able to select the check box in installation wizard.
Please note IIS is already started and configured as per following link:
https://social.msdn.microsoft.com/Forums/en-US/c99e608b-2c29-4ef1-889c-432c7117f247/bam-portal?forum=biztalkgeneral
Also gone through:
https://social.msdn.microsoft.com/Forums/en-US/85c3b584-9bc8-41c9-8c10-e2a8349ddc3f/bam-portal-missing-from-biztalk-configuration-tool?forum=biztalkgeneral
Appreciate your help!
Thanks,
Prabhdeep

Hi,
BAM Portal runs only runs on a 32-bit mode. If you are installing IIS on a 64-bit machine then you must ensure that ASP.NET 2.0 is enabled
on 32-bit mode.
Ensure you have all the pre-requisites in place as per this blog. BizTalk
2010 Installation and Configuration – Enable Internet Information Services (Part 1)
Rachit

[svn:fx-trunk] 14166: Record-only merge of revision 14165 from 4.0. 0 to trunk.

Revision: 14166
Revision: 14166
Author:   [email protected]
Date:     2010-02-13 09:17:45 -0800 (Sat, 13 Feb 2010)
Log Message:
Record-only merge of revision 14165 from 4.0.0 to trunk.
Update flex-fontkit.jar with P4 build 270762
QE notes: N/A
Doc notes: N/A
Bugs: SDK-25392
Reviewer: N/A
Tests run: checkintests
Is noteworthy for integration: No
Ticket Links:
    http://bugs.adobe.com/jira/browse/SDK-25392
Property Changed:
    flex/sdk/trunk/
    flex/sdk/trunk/frameworks/

Camuzo, please go to the forum and just un-subscribe yourself.
each of your emails is getting sent to everyone who does want to use this forum
just sending messages is not going to do anything.
GO to this url:
http://forums.adobe.com/community/opensource/flexsdk
and simply tell your account not to be emailed.
But, please kindly stop just sending us all your messages.

Biztalk 2010 Json and REST

I have requirement to send JSON/REST message out of biztalk. My current version is Biztalk 2010 (not 2010R2).
Can somebody tell me how I can do that, specially converting xml message to JSON and then sending it as REST message.

Thanks, it is helpful.
You mean using JSON.net packege I can convert my xml message to JSON and also can send it out?
It means it will be good if I write c# class and call it in my pipeline component, as most probably my scenario will be message only.
Suggest me is this approach is good or you see some issue there.
If you want to persist messages, you should publish it with receive port and send it with send port. Send port probably will be Null port which just dump messages. Your JSON... logic can be in receive or send pipe, it is up to your requirements.
If you don't need persistence, you can use just receive pipe and do not persist messages at all. Why use receive port and pipe (and BizTalk) at all? BizTalk is a great hosting platform and it gives loose coupling with receive transport, listening endpoints
etc.
Leonid Ganeline [BizTalk MVP]

Debatch unique records only, BizTalk 2010

Similar Messages

Maybe you are looking for