Merge records

Question

I have a need to merge records received from two different services in BPEL. Here's the requirement - A BPEL process invokes two different services. One of the services places a fixed-length flat file in the file system. The other service responds with a set of XML records. The XML records need to transformed and merged with those in the flat file and eliminate duplicate records (in terms of an ID field) while doing so. What could be an efficient way to do this? The XML file is at least 80MB in size. Will XSLT be memory intensive?

Answer 1

Not ideal use case for SOA Suite but achieveable.
If they are licensed for SOA Suite they can use OSB, this may be a better tool for this use case.
your xquery can look something like this:
                        let $Runners := $runners
                        let $Odds := $odds
                        return
                            <Runners>
                                    for $Runner in $Runners/ns1:Runner
                                      for $Odd in $Odds/ns0:RunnerOdds/ns0:RunnerOdd
                                       where $Odd/ns0:Runner_Num = $Runner/ns1:Runner_Num
                                    return
                                        <Runner>
                                            <WIN_Odd>{ data($Odd/ns0:WIN_Odd) }</WIN_Odd>
                                            <Runner_Num>{ data($Runner/ns1:Runner_Num) }</Runner_Num>
                                            <PLC_Odd>{ data($Odd/ns0:PLC_Odd) }</PLC_Odd>
                                            <Runner_Name>{ data($Runner/ns1:Runner_Name) }</Runner_Name>
                                            <Jockey_Name>{ data($Runner/ns1:Jockey_Name) }</Jockey_Name>
                                            <Runner_Status>{ data($Runner/ns1:Runner_Status) }</Runner_Status>
                                        </Runner>
                            </Runners>
                    } what this code does is merges 2 payloads, 1 payload has the name of horses, the other payload has the odds of the horse. You can merge using the where clause and linking via the key of Runner_num
cheers
James